-
Notifications
You must be signed in to change notification settings - Fork 86
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Restructure workflows steps #343
Merged
PawelPeczek-Roboflow
merged 150 commits into
main
from
feature/restructure_workflows_steps
May 7, 2024
Merged
Changes from 102 commits
Commits
Show all changes
150 commits
Select commit
Hold shift + click to select a range
665bd17
Add foundations for change in steps definitions
PawelPeczek-Roboflow ce8fd3a
Merge branch 'main' into feature/restructure_workflows_steps
PawelPeczek-Roboflow f499215
Refactor Roboflow classifier step
PawelPeczek-Roboflow 458918a
Add multi-label classification
PawelPeczek-Roboflow ffb483d
Transform roboflow models blocks to new schema of blocks
PawelPeczek-Roboflow 5721259
Add foundations modules for blocks
PawelPeczek-Roboflow b465e4d
Port majority of blocks
PawelPeczek-Roboflow f1e661a
Port additional blocks
PawelPeczek-Roboflow 696a634
Port LMM steps
PawelPeczek-Roboflow 6e455f3
Provide a logic to implement initialisation of steps
PawelPeczek-Roboflow 28dead6
WIP - part of work reuqired to construct and validate execution graph
PawelPeczek-Roboflow fdae1a3
Finalise first draft of new compiler
PawelPeczek-Roboflow 1d4c0ae
Start building executor
PawelPeczek-Roboflow 1a2b04f
Add module to keep step outputs cached
PawelPeczek-Roboflow 81a8bbd
Complete first draft of new execution engine
PawelPeczek-Roboflow eda2a61
First rooughly working executor
PawelPeczek-Roboflow 6c00172
Fix issue with windows listing files twice
PawelPeczek-Roboflow b7404e4
Add error handling for parsing and graph construction
PawelPeczek-Roboflow d145883
Add better error handling for new workflows execution engine
PawelPeczek-Roboflow f34291b
Provide demo for workflow execution engine in InferencePipeline
PawelPeczek-Roboflow c9db7dd
Kick of the docs
PawelPeczek-Roboflow 92b9f68
Add docs
PawelPeczek-Roboflow 340fdb0
Fix tests
PawelPeczek-Roboflow 467f80a
Make linter happy
PawelPeczek-Roboflow e1f0420
Fix imports
PawelPeczek-Roboflow e8e235b
Fix imports
PawelPeczek-Roboflow 564320b
Fix makefile
PawelPeczek-Roboflow f13e4e6
Make changes to properly distinguish between batch and non-batch
PawelPeczek-Roboflow c9de256
Fix not imported symbol
PawelPeczek-Roboflow b879b76
Fix not imported symbol
PawelPeczek-Roboflow b02ec72
Add batch of boolean
PawelPeczek-Roboflow da1e5c9
Add batch/singular modes for inputs and outputs
PawelPeczek-Roboflow fb3be52
initial docs
SkalskiP 73ba5f2
inputs documented
SkalskiP 6e1c5d2
Fix issue with pulling multiple selectors from list
PawelPeczek-Roboflow 78f52cd
with love for James :*
SkalskiP 25d4108
Fix inference pipeline for workflows and add kind
PawelPeczek-Roboflow 9443936
Fix naming convention
PawelPeczek-Roboflow 3cb25a0
long and short descriptions added
SkalskiP 905b4d4
Merge fresh origin branch
PawelPeczek-Roboflow 278b0a5
Make linters happy
PawelPeczek-Roboflow 4e01bc8
Add generated docs to gitignore
PawelPeczek-Roboflow 775f6bf
Get rid of uncercognised types
PawelPeczek-Roboflow 8abd0ba
licenses added
SkalskiP f37ee23
available connections added
SkalskiP f31c095
Merge
PawelPeczek-Roboflow 2c5f5e6
Fix table
PawelPeczek-Roboflow 92cf515
format available blocks with links
SkalskiP 6b3bd69
Fix bug with list of ref
PawelPeczek-Roboflow f3747be
refs styles
SkalskiP e8486b6
bindings docs refactor
SkalskiP 181ed18
small fixes
SkalskiP 884fd6c
Run black against docs building script
PawelPeczek-Roboflow 96aa6ca
Fix couple of issues
PawelPeczek-Roboflow c9470b2
Merge pull request #360 from roboflow/feature/restructure_workflows_s…
PawelPeczek-Roboflow aee7f47
Work in progress - build introspection components
PawelPeczek-Roboflow 3a7c2f2
Add changes to make it possible to generate docs about klinds
PawelPeczek-Roboflow 9413479
Add JSON example to blocks definitions
PawelPeczek-Roboflow 5863f5e
Add JSON example to blocks definitions
PawelPeczek-Roboflow 408bb7b
Fix errors spotted while testing
PawelPeczek-Roboflow 65e2889
Make linters happy
PawelPeczek-Roboflow 6582ef8
Create tmp docs building
PawelPeczek-Roboflow 8025578
Create tmp docs building
PawelPeczek-Roboflow 2838e48
Create tmp docs building
PawelPeczek-Roboflow aa26c57
Create tmp docs building
PawelPeczek-Roboflow f691c31
Create tmp docs building
PawelPeczek-Roboflow b5d23f9
Create tmp docs building
PawelPeczek-Roboflow f118aa5
Create tmp docs building
PawelPeczek-Roboflow fa7ca0c
Create tmp docs building
PawelPeczek-Roboflow 051cc5f
Add enterprise workflows
PawelPeczek-Roboflow 113c79f
Add enterprise workflows
PawelPeczek-Roboflow 32e4aaf
Add gh token
PawelPeczek-Roboflow 588f3d2
Add gh token
PawelPeczek-Roboflow ba7ba39
Get rid of old workflows
PawelPeczek-Roboflow d2caf3b
Restructure docs
PawelPeczek-Roboflow 68cacf4
Merge with main
PawelPeczek-Roboflow e192777
Make linters happy
PawelPeczek-Roboflow 5127ff0
Fix AL data collector
PawelPeczek-Roboflow 2bf8b84
Make linters happy
PawelPeczek-Roboflow 620e9bb
Fix circular dependency issue
PawelPeczek-Roboflow 63a642d
Fix imports
PawelPeczek-Roboflow c44365d
Make linters happy
PawelPeczek-Roboflow bee8304
Get rid of not needed errors definitions
PawelPeczek-Roboflow e1f429a
Add unit tests for workflows/introspection/schema_parser
PawelPeczek-Roboflow 2763b22
Add unit tests for connections discovery
PawelPeczek-Roboflow bc4f542
Add tests to loading
PawelPeczek-Roboflow ae968ba
Add unit tests for workflows core steps manifests parsing
PawelPeczek-Roboflow 914fc1b
Add unit tests for workflows core steps manifests parsing
PawelPeczek-Roboflow 1c65319
Add tests for graph constructor
PawelPeczek-Roboflow 0de7a9a
Add tests for kinds check
PawelPeczek-Roboflow db7ef8c
Add tests for steps initialisation
PawelPeczek-Roboflow 6455780
Make linters happy
PawelPeczek-Roboflow 6886a60
Add test to cover inputs substitutions
PawelPeczek-Roboflow 7551017
Add first batch of tests for execution engine:
PawelPeczek-Roboflow 814bcaf
Add tests for outputs constructor
PawelPeczek-Roboflow 194e548
Add remaining unit tests for execution engine
PawelPeczek-Roboflow ff48a1d
Add changes to SDK errors handler
PawelPeczek-Roboflow b434cac
Merge branch 'main' into feature/restructure_workflows_steps
PawelPeczek-Roboflow 5f48a12
Fix problem with getting config from roboflow API
PawelPeczek-Roboflow b9274c8
Fix bug from previous commit
PawelPeczek-Roboflow acec962
Fix bug with wildcards outputs
PawelPeczek-Roboflow 919bf38
Bump version
PawelPeczek-Roboflow a133333
Add definition of CI for unit tests of workflows
PawelPeczek-Roboflow ff0f39a
Resolve conflicts with main
PawelPeczek-Roboflow 6db9355
Comment out old tests of workflows
PawelPeczek-Roboflow 41caf5d
Fix imports
PawelPeczek-Roboflow cab8924
Make linters happy
PawelPeczek-Roboflow 81173c2
Fix tests and definitions of requirements to accomodate for pydantic …
PawelPeczek-Roboflow 8283fdf
Remove explicit _parent_coordinates output
PawelPeczek-Roboflow fb50218
Add first integration tests for workflows
PawelPeczek-Roboflow e8e3a23
Point to CPU torch wheels in integration tests install
PawelPeczek-Roboflow bb5765f
Add integration tests for static crop-based workflows
PawelPeczek-Roboflow d6621c1
Add integration test for multi stage workflow: detection plus ocr
PawelPeczek-Roboflow 44ce24f
Add requirements to install DocTR model in workflows integration tests
PawelPeczek-Roboflow cf90648
Denote in kinds connections if property accepts list of references
PawelPeczek-Roboflow d9ad139
Try to fix stability reg. test of detection + crop
PawelPeczek-Roboflow 6181c58
Add integration tests for detection+classification and flow_controll+…
PawelPeczek-Roboflow 93826d5
Fix plugin loading such that it can be mocked for older versions of Py
PawelPeczek-Roboflow b2c4fef
Apply first CR comments
PawelPeczek-Roboflow 542b1c1
Apply change issubclass->isinstance
PawelPeczek-Roboflow 215d902
Apply next portion of CR comments
PawelPeczek-Roboflow e240f4a
Apply next portion of CR comments
PawelPeczek-Roboflow 5af4d26
Make linters happy
PawelPeczek-Roboflow 438d042
Apply next portion of CR comments
PawelPeczek-Roboflow beb5adc
Apply next portion of CR comments
PawelPeczek-Roboflow 0e80da5
Apply next portion of CR comments
PawelPeczek-Roboflow 535335f
Change operators
PawelPeczek-Roboflow 2193d1c
Make changes into naming conventions in entities impacting manifests …
PawelPeczek-Roboflow 2112296
Revert unwanted changes
PawelPeczek-Roboflow 8f7530b
Uncomment commented blocks
PawelPeczek-Roboflow 932a79c
Fix naming conventions in internal functions
PawelPeczek-Roboflow 951ab4c
Resolve rest of requests for changing names
PawelPeczek-Roboflow 7607fad
Make linters happy
PawelPeczek-Roboflow 205c57c
Remove tmp focs building
PawelPeczek-Roboflow 1da06ad
Bump version
PawelPeczek-Roboflow bf7c604
Migrate tests for models
PawelPeczek-Roboflow f673989
Add assets
PawelPeczek-Roboflow bfea803
Port remaining tests
PawelPeczek-Roboflow 17db17b
Add extension to export primitive types connections
PawelPeczek-Roboflow 46ce988
Rename literals for selected elements markers in kinds
PawelPeczek-Roboflow 44ad1a9
Move methods to detect outputs to manifest entities
PawelPeczek-Roboflow 1eb2554
Add integration tests for server
PawelPeczek-Roboflow e49e1c0
Merge branch 'main' into feature/restructure_workflows_steps
PawelPeczek-Roboflow 81fd980
Add integration tests for server
PawelPeczek-Roboflow b513306
Fix issue with ABC
PawelPeczek-Roboflow 95c71af
Add workflow dispatch trigger
PawelPeczek-Roboflow e6d4c68
Add changes to docs
PawelPeczek-Roboflow 8a92155
Add fixes for problems detected while testing
PawelPeczek-Roboflow 942ae86
Bump version
PawelPeczek-Roboflow 280547e
Update comment about detection offset
PawelPeczek-Roboflow File filter
Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,46 @@ | ||
name: TMP WORKFLOW DOCS BUILD | ||
|
||
on: | ||
pull_request: | ||
branches: [main] | ||
|
||
jobs: | ||
deploy: | ||
runs-on: ubuntu-latest | ||
permissions: | ||
contents: write | ||
steps: | ||
- uses: actions/checkout@v4 | ||
with: | ||
ref: ${{ github.head_ref }} | ||
path: inference_repo | ||
- uses: actions/checkout@v4 | ||
with: | ||
repository: roboflow/workflows-enterprise-blocks | ||
ref: main | ||
path: roboflow_enterprise_blocks | ||
token: ${{ secrets.GH_TOKEN_FOR_WORKFLOWS_ENTERPRISE }} | ||
- uses: actions/setup-python@v5 | ||
with: | ||
python-version: "3.10" | ||
check-latest: true | ||
- run: pip install mkdocs-material | ||
- run: pip install "mkdocstrings[python]" | ||
- run: pip install "mkdocs-material[imaging]" | ||
- run: pip install "mkdocs-swagger-ui-tag" | ||
- run: pip install "mkdocs-gen-files" | ||
- run: pip install "mkdocs-literate-nav" | ||
- run: pip install "mkdocs-jupyter" | ||
- run: pip install -r requirements/requirements.docs.txt | ||
working-directory: ./inference_repo | ||
- run: | | ||
python -m pip install --upgrade pip | ||
pip install --upgrade setuptools | ||
pip install -r requirements/_requirements.txt -r requirements/requirements.cpu.txt -r requirements/requirements.sdk.http.txt -r requirements/requirements.test.unit.txt -r requirements/requirements.http.txt | ||
working-directory: ./inference_repo | ||
- run: pip install . | ||
working-directory: ./roboflow_enterprise_blocks | ||
- run: WORKFLOWS_PLUGINS="workflows_enterprise_blocks" python -m development.docs.build_block_docs | ||
working-directory: ./inference_repo | ||
- run: mkdocs gh-deploy --force | ||
working-directory: ./inference_repo |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Oops, something went wrong.
Oops, something went wrong.
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Will this get migrated to be no temporary after deploy?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
yes, at the end - so far I would like to have verification that I am not breaking anything