-
Notifications
You must be signed in to change notification settings - Fork 200
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Zero-config CSV queries #135
Comments
Hey, I think some thought must be put into if this wouldn't cause any trouble with ambivalent meanings further down the road. However, what we want to support for sure is allowing to input csv / json data via standard input for queries like:
Maybe a table valued function would be a good idea? That would be very easy to add after the recent parser customizations.
Not sure though if it's a good idea to provide so many ways to solve a single problem (open a csv file) |
This would be fantastic! One problem would be, how to tell what format stdin is providing? I can imagine people piping in json at least as often CSV. Another option would be to pipe in a config from stdin, something like this may not be too bad:
This would be a very general, but doesn't seem very standard. I'll take a look at how Hive, Presto try to deal with this, maybe there's some good ideas there. |
I think that discerning between csv and json wouldn't be too hard :) and I don't think there are much more formats people would like to pipe in through stdin (Excel?) |
I very much like this idea. Having the ability to arbitrarily query and join a few files without needing a config file would be very convenient.
I think this is a decent idea, but I don't see why the shorthand select * from `./test.xlsx`.Sheet1 for Excel (using the MySQL quoting there). If you do go the function route, I would imagine the |
I'm actually working on a rewrite of OctoSQL on the redesign branch and this syntax is supported there. Examples:
I'll probably release an initial version in the following months. |
That's very exciting, thanks for sharing! |
Just curious, it seems like you released this new zero-config, but I don't see Excel support (even though I see previous commits for it). Was this lost in the shuffle? |
@tooolbox Sorry, lost track of this issue. Yeah, zero-config is now here and excel support is gone for now cause I haven't yet had the time to port it. That said, I'm planning to bring it back soon. Should be very little work to port it over as a plugin. Closing this as zero-config csv queries are here, but I'll open another issue for tracking Excel support. |
I'm not sure how feasible this may be, but the old logparser program from Microsoft supported queries like
And it would read from test.csv, without needing any config files.
The text was updated successfully, but these errors were encountered: