Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Look into making FluoConfiguration Serializable #813

Closed
keith-turner opened this issue Dec 16, 2016 · 1 comment
Closed

Look into making FluoConfiguration Serializable #813

keith-turner opened this issue Dec 16, 2016 · 1 comment
Milestone

Comments

@keith-turner
Copy link
Contributor

Was looking into writing a Spark code using Fluo. I was expecting FluoConfiguration to be serializable and it was not.

@keith-turner
Copy link
Contributor Author

In the next release of Fluo, FluoConfiguration will be serializable. There are many ways to work around this issue before the next release. Below is an example of one way.

void doFluoStuff(FluoConfiguration fconf, JavaRDD<?> someRdd){
  //this map is serializable
  Map<String, String> confMap = fconf.toMap();

  someRdd.foreachPartition(iter->{
    FluoConfiguration fconf = new FluoConfiguration(confMap);
    try(FluoClient client = FluoFactory.newClient(fconf)){
      //do fluo stuff
    }
  }
}

@asfgit asfgit closed this as completed in bf13386 Dec 20, 2016
@mikewalch mikewalch added this to the 1.1.0 milestone May 19, 2017
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants