Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

JSON Data Source #3805

Merged
merged 2 commits into from
Jul 11, 2019
Merged

JSON Data Source #3805

merged 2 commits into from
Jul 11, 2019

Conversation

arikfr
Copy link
Member

@arikfr arikfr commented May 15, 2019

What type of PR is this? (check all applicable)

  • New Query Runner (Data Source)

Description

JSON data source, which allows loading data from (almost) any JSON URL (Documentation).

TODO:

- [ ] Rename it to HTTP (?).
- [ ] Migration to update the type of existing URL data sources to use this one.
- [ ] Migration to update existing queries to support the new format.
- [ ] Remove URL data source.

I figured there is no point in waiting to deprecate the URL data source and delaying the release of this one. We will do it in a separate task.

Related Tickets & Documents

https://discuss.redash.io/t/missing-json-data-source/3448/22

@arikfr arikfr added the Backend label May 15, 2019
@AlanHodgkinson1
Copy link

Hello.

When is this likely to be available in the preview docker containers?

Thanks.

@morsedl
Copy link

morsedl commented May 18, 2019

Fantastic, and thanks for your efforts on this! We're just now switching over to a more heavily REST-oriented approach, so this will be most helpful. Please keep us apprised, and if I can help with some testing or the like, I'd be happy to do so (at least as best I can; we're swamped laying down an entirely new software infrastructure).

@rwatts3
Copy link

rwatts3 commented May 30, 2019

I understand you all are busy building, would it be possible to provide instructions for how to build this PR into a docker image so that it can be tested?

I attempted to deploy a version of redash from the docs with docker, however I ran into a few issues getting things to run nicely. I.E webpack, etc.

@rwatts3
Copy link

rwatts3 commented Jun 18, 2019

Just stopping by to see if there is an update on the docker preview build.
I see the new previews are starting to tag 8.0 beta, however, I'm still noticing there is no JSON data source.

@flolivaud
Copy link

Hi everyone,

Tried to build docker image locally, but i can't view/use the current json datasources.
Tried to test it locally without docker too, still the same problem.

Is there something i miss about it, or maybe it's not functionnal now ?

Thanks.

if 'url' not in query:
raise QueryParseError("Query must include 'url' option.")

if is_private_address(query['url']):

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Why should we avoid querying private url/ip ?

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Because in some environments being able to query private addresses might allow you to poke around things you shouldn't (like AWS metadata of the instance hosting Redash). We can make this optional if needed.

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think it's a good idea to have an option to disable it

@arikfr arikfr changed the title WIP: JSON Data Source JSON Data Source Jul 11, 2019
@arikfr arikfr marked this pull request as ready for review July 11, 2019 10:54
@arikfr arikfr merged commit 15a8eec into master Jul 11, 2019
@arikfr arikfr deleted the json-ds branch July 11, 2019 11:23
The-Alchemist pushed a commit to The-Alchemist/redash that referenced this pull request Jul 15, 2019
* WIP: JSON Data Source

* Add JSON data source to default list
harveyrendell pushed a commit to pushpay/redash that referenced this pull request Nov 14, 2019
* WIP: JSON Data Source

* Add JSON data source to default list
@susodapop susodapop mentioned this pull request Jul 26, 2021
1 task
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants