Skip to content

EXPERIMENTAL: Api, ZIP dags#1340

Closed
bolkedebruin wants to merge 9 commits intoapache:masterfrom
bolkedebruin:api
Closed

EXPERIMENTAL: Api, ZIP dags#1340
bolkedebruin wants to merge 9 commits intoapache:masterfrom
bolkedebruin:api

Conversation

@bolkedebruin
Copy link
Contributor

This is an experimental branch. Just to test out a couple of ideas.

  • API: for submitting dag files, loading them from the api for distribution, obtaining connection info for a dag
  • Fix for the webserver not reloading the dag folder
  • Allow ZIP dag files (can also be used for future dependency management by adding a zip to sys.modules) (superseded by Add support for zipped dags #1352)
  • some fixes in refreshing files,
  • Let the scheduler download dag files if missing or new
  • Some kerberos stuff

@landscape-bot
Copy link

Code Health
Repository health decreased by 1% when pulling 99b846f on bolkedebruin:api into 559a98f on airbnb:master.

import json
import requests

base_url = "http://localhost:8080/api/v1/"
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Shouldn't the port come from conf?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@r39132 sure, this really is experimental, ie. trying out new stuff quick 'n dirty. Nothing you want to merge, but maybe make spinoffs in separate PRs (as with the ZIP functionality)

@ldct
Copy link
Contributor

ldct commented Oct 30, 2016

@bolkedebruin should we close this? it seems to me that most points have made it to other PRs

@asfgit asfgit closed this in b5ca095 Nov 16, 2016
alekstorm pushed a commit to alekstorm/incubator-airflow that referenced this pull request Jun 1, 2017
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants