problem with joins using data from a pail

[robinkraft]

Using the local pail dataset we've concocted, we're having trouble joining static datasets a la static-src.

Extracting values from the thrift objects in the pail works fine, but the join fails completely.

Sample data and code here: https://gist.github.com/3035928

[eightysteele]

Just started working on a new Pail structure in a different project and remembered this issue. Only a hunch, but curious if this issue might be related to something in our ThirftPailStructure class.

[jeroenvandijk]

@robinkraft You asked me a while ago if I had problems joining Pails. This thread came up on the Cascalog mailinglist: https://groups.google.com/d/msg/cascalog-user/HSkph8Vac_U/VPzOK7_WpAIJ and continued on the Cascading mailinglist https://groups.google.com/d/msg/cascading-user/1vNtHhPI39E/PLa4MuC_stcJ

If you think this is the same issue, maybe you can try out the proposed patch here: https://github.com/nathanmarz/dfs-datastores-cascading/pull/5/commits

HTH,
Jeroen

[robinkraft]

Thanks for the heads up! It sounds like this could be the same issue. @eightysteele you said you'd dealt with the pail join problem in another project. Do the threads + patch below jibe with your fix?

On Jan 11, 2013, at 1:17 AM, Jeroen van Dijk notifications@github.com wrote:

@robinkraft You asked me a while ago if I had problems joining Pails. This thread came up on the Cascalog mailinglist: https://groups.google.com/d/msg/cascalog-user/HSkph8Vac_U/VPzOK7_WpAIJ and continued on the Cascading mailinglist https://groups.google.com/d/msg/cascading-user/1vNtHhPI39E/PLa4MuC_stcJ

If you think this is the same issue, maybe you can try out the proposed patch here: https://github.com/nathanmarz/dfs-datastores-cascading/pull/5/commits

HTH,
Jeroen

—
Reply to this email directly or view it on GitHub.

[sritchie]

That sounds like exactly what was up.

Sam Ritchie
703.662.1337
@sritchie

On Sunday, January 13, 2013 at 2:34 PM, Robin Kraft wrote:

Thanks for the heads up! It sounds like this could be the same issue. @eightysteele you said you'd dealt with the pail join problem in another project. Do the threads + patch below jibe with your fix?

On Jan 11, 2013, at 1:17 AM, Jeroen van Dijk notifications@github.com wrote:

@robinkraft You asked me a while ago if I had problems joining Pails. This thread came up on the Cascalog mailinglist: https://groups.google.com/d/msg/cascalog-user/HSkph8Vac_U/VPzOK7_WpAIJ and continued on the Cascading mailinglist https://groups.google.com/d/msg/cascading-user/1vNtHhPI39E/PLa4MuC_stcJ

If you think this is the same issue, maybe you can try out the proposed patch here: https://github.com/nathanmarz/dfs-datastores-cascading/pull/5/commits

HTH,
Jeroen

—
Reply to this email directly or view it on GitHub.

—
Reply to this email directly or view it on GitHub (#60 (comment)).

[sritchie]

@eightysteele did you ever look into this?

[eightysteele]

@sritchie https://twitter.com/eightysteele/status/219962902088646656