How to handle error path with easy-batch

[CXwudi]

Problem: easy-batch doesn't support Listener class on a single intermidate processor, how to handle error path.
Also for writers, since it already group them in Batch, we can't do much for it

Possible solutions:

• just write error path logic inside the normal path business code
  • use an ErrHandler class
  • should we use Listener and reply on throwing exps to guide to err path? or should we just use conditions to guide to err path? An: long functions will split, and it will cause return value headache 😫
  • don't write delegate RecordProcessor class with exp handling. It probably won't work for all scenarios
• let writer class implemented in RecordProcessor class, and use Listener to handle exceptions.
  • This is not a good usage of easy-batch, although it can solve problems easily because with batch writing, we can support writing to DB or cache if we want

^{Created from JetBrains using CodeStream}

[CXwudi]

Answer:

• create an ErrRecorder class to handle writing errors to the /err path
  • ErrRecorder class can not be a subclass of Listener because we want to write any thing possible to error json file
• use Listener to handle exp in intermediate processing
  • which basically direct the writing process to ErrRecorder
• let writer class includes the bean of ErrRecorder, this requires us to handle exp code flow by ourself
  • we can't use WriterListener because it takes the whole Batch<> as an argument
• no listener for reader class, just go hard failure