New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Using Miller in a join prepipe #347
Comments
Thanks!!! :)
No, I think not -- I never thought of this combination of |
Well, the temp file is OK, still I could not guess why I cannot use mlr itself as a prepipe, is it because of the "<" redirect restriction?, just curiosity if you know off hand. |
I have a similar use case and am currently working around the temporary file using process substitution: mlr --csv join -f <(mlr --csv cat left.csv) -j id right.csv |
@mfernandez-turnto @sonicdoe it looks like process substituation is the right thing to do -- ? I'm closing this out but please let me know if I'm mistaken and we can re-open -- thank you! |
I agree, especially because process substitution keeps all of Miller’s flexibility. Should we document this in Questions about joins, though? |
Process substitution with mlr is not working for me on Windows with Cygwin.
The same mlr commands work as expected for me if I switch to a Linux machine. Since process substitution works with everything except mlr, is there something different about the windows build? |
@railgauge I'll check it out. Windows is definitely different in many ways -- see also https://miller.readthedocs.io/en/latest/miller-on-windows/ -- but Cygwin smooths out many of those differences. Can we first check, what's your |
Thanks! I only compiled from source because I had a separate issue: when when I tried using miller from
The Windows path includes This seems to be something about paths since the error states it is looking for a Windows path rather than a cygwin path. If I use the choco or pre-compiled binaries in powershell they work with regular file input (also In zsh I just tried |
I guess is more of a question than an issue, but I don't know of other places to ask. BTW Miller is the most wonderful thing that I've encountered in a a long while, I use it every day.
Here is the thing, lets say I have two files I want to join by a colun name identifier, lets call them file1 and file2.
works great if none of the files contains a list values in identifier which would require nest, if just one (for simplicity lets say file1) has nested values in identifier, it is quite easy to fix this without creating additional files:
but when both files have commas I have to resort to producing an intermediate file. I thought:
could do what I wanted, but it did not work.
Is there a standard way of doing that?
The text was updated successfully, but these errors were encountered: