Skip to content

Conversation

@balysv
Copy link
Contributor

@balysv balysv commented Jan 25, 2023

The current logic does not take into account files that may have .json in the middle of the file name. The change ensure that the split happens only for the last .json occurrence

The current logic does not take into account files that may have
'.json' in the middle of the file name. The change ensure that
the split happens only for the last '.json' occurence
@linear
Copy link

linear bot commented Jan 25, 2023

SWAT-716 BUG: Model training crashes for ReelData

Customer details:

Issue description:

  • Summary (Dataset/file example + Business Context + Loom/Screenshots - make sure to capture Console/Network):

    Our customer was trying to train a classification model and the training session crashed for them.

    • Models:

      image.png

      We have the permission to re-train the model on both classes:

      image.png

  • Timeline/Environment (date/time when spotted; production/staging; browser and OS version; python and darwin-py version): production

  • Steps to Reproduce:

    Re-train the Classification model on salmon-facial-clarity dataset

  • Expected Behaviour:

    Model doesn't crash and trains successfully.

  • Additional Notes (if applicable): N/A

Copy link
Contributor

@owencjones owencjones left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nice catch

@balysv balysv marked this pull request as ready for review January 25, 2023 14:22
@balysv balysv merged commit 3fa8e42 into master Jan 30, 2023
balysv added a commit that referenced this pull request Feb 24, 2023
…mports

* master:
  including release in dataset (#534)
  [IO-749][external] Added python support install on 3.7 (#540)
  Io 585 incorrect type annotation (#537)
  [IO-543][internal] Move Imports To Multiprocessing (#521)
  Version bump to 0.8.12
  HOTFIX: Version for unincluded file (#533)
  [IO-683][internal] Fix version parsing (#532)
  [SWAT-753][external]: Fix a 'darwin convert' to mask formats path issue (#531)
  Added nifti to supported formats. (#530)
  [IO-665][internal] Type fixes (#529)
  Allow passing a Client to get_dataset() to avoid authentication errors if environment variable isn't set or there is no config. (#522)
  Version bump to 0.8.11
  Version bump (#528)
  [SWAT-734][Internal] Fixing conversion to darwin_json_1.0 (#523)
  Version_bump_v0.8.9 (#527)
  Updating docs for release process (#525)
  [io-524][internal] Fix for windows builds
  [SWAT-716][internal]: Fix .json extension parsing for dataset splitting (#520)
  [IO-557][internal] Move to use Poetry for packaging and publishing (#512)
balysv added a commit that referenced this pull request Feb 24, 2023
…mports

* master:
  including release in dataset (#534)
  [IO-749][external] Added python support install on 3.7 (#540)
  Io 585 incorrect type annotation (#537)
  [IO-543][internal] Move Imports To Multiprocessing (#521)
  Version bump to 0.8.12
  HOTFIX: Version for unincluded file (#533)
  [IO-683][internal] Fix version parsing (#532)
  [SWAT-753][external]: Fix a 'darwin convert' to mask formats path issue (#531)
  Added nifti to supported formats. (#530)
  [IO-665][internal] Type fixes (#529)
  Allow passing a Client to get_dataset() to avoid authentication errors if environment variable isn't set or there is no config. (#522)
  Version bump to 0.8.11
  Version bump (#528)
  [SWAT-734][Internal] Fixing conversion to darwin_json_1.0 (#523)
  Version_bump_v0.8.9 (#527)
  Updating docs for release process (#525)
  [io-524][internal] Fix for windows builds
  [SWAT-716][internal]: Fix .json extension parsing for dataset splitting (#520)
  [IO-557][internal] Move to use Poetry for packaging and publishing (#512)
@Nathanjp91 Nathanjp91 deleted the swat-716-bug-model-training-crashes-for-reeldata branch November 8, 2023 10:44
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants