Custom Writers (CSV, JSON, SQL, XML, etc)

[mauricio1990silva]

DataGen should be able at least to export the final output as CSV, JSON, SQL, XML, etc, chosen by the user

[bryantrobbins]

@mauricio1990silva how is this going? Please feel free to send a PR.

[mibrahim]

As a thought, I propose looking at webhdfs and writing an output stream wrapper to it.

[mibrahim]

@mauricio1990silva, @bryantrobbins and Andriy is looking at this.

[bryantrobbins]

Discussed this today, and decided to add an interface like this to dg-commons:

interface DataWriter< T >:
void pre()
void writeOutput(T)
void post()

For example, the current DefaultWriter:

DefaultWriter implements DataWriter<Map<String, String>>:

void writeOutput(Map< String, String > data):
data.getKey()
data.getValue()
;;

[bryantrobbins]

Andriy and @mauricio1990silva were looking into this. Are we still on track with getting this into dg-commons by the end of the year?

[mibrahim]

@mauricio1990silva is it reasonable to assume that this will not happen before the end of the month ? I just want to plan for what features are going in Dec 15th

[mauricio1990silva]

I have done the code, I just need to correct a feww things, but sure this
can be fully done by Dec 15th
On Nov 20, 2015 9:17 AM, "Mohamed Ibrahim" notifications@github.com wrote:

@mauricio1990silva https://github.com/mauricio1990silva is it
reasonable to assume that this will not happen before the end of the month
? I just want to plan for what features are going in Dec 15th

—
Reply to this email directly or view it on GitHub
#213 (comment)
.

[mibrahim]

@mauricio1990silva any updates on that ?

[mibrahim]

@mauricio1990silva can you please send a PR if we're changing code ?