Explanation:Inner classes contain references to their parent outer classes, so unless MyPipeline implements the Serializable interface, the NotSerializableException will be thrown when Crunch tries to serialize the inner DoFn. 5. Point out the wrong statement :
A. DoFns also have a number of helper methods for working with Hadoop Counters, all named increment
B. The Crunch APIs contain a number of useful subclasses of DoFn that handle common data processing scenarios and are easier to write and test
C. FilterFn class defines a single abstract method
D. None of the mentioned
Answer:A
Explanation:Inner classes contain references to their parent outer classes, so unless MyPipeline implements the Serializable interface, the NotSerializableException will be thrown when Crunch tries to serialize the inner DoFn. 5. Point out the wrong statement :
A. DoFns also have a number of helper methods for working with Hadoop Counters, all named increment B. The Crunch APIs contain a number of useful subclasses of DoFn that handle common data processing scenarios and are easier to write and test C. FilterFn class defines a single abstract method D. None of the mentioned
Explanation:Counters are an incredibly useful way of keeping track of the state of long-running data pipelines and detecting any exceptional conditions that occur during processing 6. DoFns provide direct access to the __________ object that is used within a given Map or Reduce task via the getContext method.