Skip to content

Conversation

@gszpak
Copy link
Contributor

@gszpak gszpak commented Jul 10, 2020

Changes:

  • Added BulkImportRequest entity
  • Implemented method to create BulkImportRequest from python dictionaries
  • Implemented method to upload local ndjson file with predictions to Labelbox' object storage

@gszpak gszpak requested a review from rllin July 10, 2020 18:45
@gszpak gszpak force-pushed the gs/bulk-import-request branch from 95ccebc to 489857e Compare July 23, 2020 18:23
@gszpak gszpak force-pushed the gs/bulk-import-request branch from 51c9f88 to f9d2db6 Compare August 3, 2020 19:15
setup.py Outdated
url="https://labelbox.com",
packages=setuptools.find_packages(),
install_requires=["requests>=2.22.0"],
install_requires=["backoff>=1.10.0", "ndjson>=0.3.1", "requests>=2.22.0"],
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

in general let's freeze with '=='

'>=' can leave use susceptible to breaking changes

we can bump manually and test if there are security concerns

Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

(this happened with marshmallow-dataclass recently)

Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

addressed this myself :)

@rllin rllin merged commit b012e39 into develop Aug 4, 2020
@rllin rllin deleted the gs/bulk-import-request branch August 4, 2020 22:32
rllin pushed a commit that referenced this pull request Aug 5, 2020
* Fix api_reference_generator deletion.

* [fix] Project setup order of operations (#24)

* Improve Exception handling.

* Fix LabelboxError.__str__

* Add 30 min flag to export_labels. (#22)

Co-authored-by: Alexandra Cota <alexandracota@Alexandras-MBP.localdomain>

* Add CONTRIB.md (#26)

* [BACKEND-766] upload with content type guess (#28)

* wip

* clean up

* change log and bump version

* [BACKEND-825] github actions integration tests (#31)

* Create python-package.yml

* fix syntax errors

* remove unused function

* env key

* test against prod

* let tox manage pyenv for now

* tox gh actions

* install python

* environ chooser

* fix

* move environ to conftest

* environ

* remove import

* fix

* fix

* prod

* fix

* no comments

* fix

* fix

* fix

* fix

* address comments

* Update test_label.py

* [BACKEND-826] yapf enforcer + yapf entire repo (#33)

* Create python-package.yml

* fix syntax errors

* remove unused function

* env key

* test against prod

* let tox manage pyenv for now

* tox gh actions

* install python

* environ chooser

* fix

* move environ to conftest

* environ

* remove import

* fix

* fix

* prod

* fix

* no comments

* fix

* fix

* fix

* fix

* yapf in action

* yapf

* yapf

* [BACKEND-828] github actions publish package upon release creation (#34)

* Create python-package.yml

* fix syntax errors

* remove unused function

* env key

* test against prod

* let tox manage pyenv for now

* tox gh actions

* install python

* environ chooser

* fix

* move environ to conftest

* environ

* remove import

* fix

* fix

* prod

* fix

* no comments

* fix

* fix

* fix

* fix

* yapf in action

* yapf

* address comments

* publish workflow

* dev

* 2.4.2dev

* 2.4.2rc1

* install rc2

* works, reset

* [BACKEND-829] fix content length (#30)

* package data for upload properly to fix content length being incorrect for file uploads

* basename -> filename

* yapf

* fix mypy

* yapf

* test coverage for video uploads

* test video

* clear parens

* bump version to 2.4.2 (#35)

* bump version

* update change log

* posargs

* sleep longer

* Added BulkImportRequest integration (#27)

* Added method to create BulkImportRequest from dictionaries

* Added method to upload local ndjson with predictions to Labelbox' GCS

* Bugfix: field_type

* Moved part of try block to else block

* Removed UploadedFileType enum

* Fix

* Creating BulkImportRequest from url

* Creating BulkImportRequest objects from objects and local file

* Added ndjson validation + sending contentLength

* Making relationships work for BulkImportRequest

* Added tests for BulkImportRequests

* Added test for BulkImportRequest.refresh()

* Added docstrings

* Updated changelog and setup.py

* Vhanged test URL

* Using existing URL in tests

* Implemented BulkImportRequest.wait_till_done method

* Actually sleeping

* Bumped version to 2.4.3

* Yapfing the whole project

* Made mypy happy

* Made mypy happy one more time

* freeze dependencies

Co-authored-by: rllin <randall@labelbox.com>

Co-authored-by: Florijan Stamenkovic <florijan.stamenkovic@gmail.com>
Co-authored-by: TohnJhomas <49878111+TohnJhomas@users.noreply.github.com>
Co-authored-by: Alex Cota <cota.alexandra14@gmail.com>
Co-authored-by: Alexandra Cota <alexandracota@Alexandras-MBP.localdomain>
Co-authored-by: Florijan Stamenković <florijan@toptal.com>
Co-authored-by: Grzegorz Szpak <greg@labelbox.com>
msokoloff1 pushed a commit that referenced this pull request Sep 22, 2021
* Added method to create BulkImportRequest from dictionaries

* Added method to upload local ndjson with predictions to Labelbox' GCS

* Bugfix: field_type

* Moved part of try block to else block

* Removed UploadedFileType enum

* Fix

* Creating BulkImportRequest from url

* Creating BulkImportRequest objects from objects and local file

* Added ndjson validation + sending contentLength

* Making relationships work for BulkImportRequest

* Added tests for BulkImportRequests

* Added test for BulkImportRequest.refresh()

* Added docstrings

* Updated changelog and setup.py

* Vhanged test URL

* Using existing URL in tests

* Implemented BulkImportRequest.wait_till_done method

* Actually sleeping

* Bumped version to 2.4.3

* Yapfing the whole project

* Made mypy happy

* Made mypy happy one more time

* freeze dependencies

Co-authored-by: rllin <randall@labelbox.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants