Crunch Debug Logging -
anyone has used crunch pipelines knows nothing performed until pipeline.run() or pipeline.done() method called. traditionally in languages, can put log statements print out intermediate variable values, crunch not possible because of pipeline behavior. there way/workaround this?
thanks.
you can add debug , log statements inside dofn, mapfn, filterfn functions logged during execution of pipeline.
Comments
Post a Comment