Skip to content

Weekly Digest (2 August, 2020 - 9 August, 2020) #4365

New issue
New issue
Closed
Closed
Weekly Digest (2 August, 2020 - 9 August, 2020)#4365
@weekly-digest

Description

@weekly-digest
weekly-digest
bot
opened on Aug 9, 2020

Here's the Weekly Digest for iterative/dvc:

ISSUES

Last week 49 issues were created.
Of these, 18 issues have been closed and 31 issues are still open.

OPEN ISSUES

💚 #4364 term: review "URL" term usage in remote cmds, and get/import-url, by jorgeorpinel
💚 #4363 dependency: fine grained (user cmd filter), by casperdcl
💚 #4362 remote modify: better handle unrecognized parameters [qa], by jorgeorpinel
💚 #4361 check-ignore: exit --stdin silently on empty string [qa], by jorgeorpinel
💚 #4360 can't move dvc.yaml?, by majidaldo
💚 #4359 Support additional configuration parameters for S3 transfer, by sserdyukov
💚 #4358 check-ignore: update help output, by jorgeorpinel
💚 #4357 pylint: crashing on commit, by jorgeorpinel
💚 #4356 DVC metrics show doesn't find metrics files, by e3bo
💚 #4354 Error message when no match found., by karajan1001
💚 #4353 push: do not push .dir file for directory with missing files, by pmrowla
💚 #4352 add: can't track --external output with rel path [qa], by jorgeorpinel
💚 #4351 check-ignore: confusing help message when no matches are found [qa], by jorgeorpinel
💚 #4350 get: get -o behavior should be consistent with import -o, by pmrowla
💚 #4348 Parquet file owned by other user gets deleted upon dvc add, by aernesto
💚 #4347 Smoke testing, by skshetry
💚 #4346 experiments show: allow filtering/sorting specific metrics/params, by pmrowla
💚 #4344 Empty subdirectories left in place while checking out previous version of the datasets, by atifraza
💚 #4343 dvc push: when not all files are in local cache, still pushes the hash.dir file, breaking remote repository., by bobertlo
💚 #4339 exception text: clarify error message, by bobertlo
💚 #4336 DBFS (Databricks) Support, by Guichaguri
💚 #4335 Callback stage not exectued if params defined in dvc.yaml, by jhoecker
💚 #4334 Config to enable/disable updater , by PuneethaPai
💚 #4333 Result inconsistency for __call__, is_ignored_file and is_ignored_dir, by karajan1001
💚 #4332 dvc add --external fails on hdfs directory, by rkmwiaim
💚 #4330 dvc add - flag to stage .dvc files to git, by bobertlo
💚 #4327 detect duplication in gitignore, by efiop
💚 #4326 ERROR: unexpected error - database disk image is malformed, by bjonnh
💚 #4325 Create a troubleshooting entry for the lock error message, by shcheklein
💚 #4324 dvcignore: api to unhide subrepos directory, by skshetry
💚 #4316 Did you forget to fetch? is generally not the solution to my problem, by braaannigan

CLOSED ISSUES

❤️ #4355 version: missing fields in the output, by shcheklein
❤️ #4349 add/etc: better handle file tracking crashes [qa], by jorgeorpinel
❤️ #4345 experiments: add --no-pager option for dvc exp show, by pmrowla
❤️ #4342 dvc diff support for -R, --recursive, by garylschultz
❤️ #4341 config: use wtree for non-repo configs, by efiop
❤️ #4340 import: fix importing into subdirectory bug, by pmrowla
❤️ #4338 [WIP] upgrade azure version, by efiop
❤️ #4337 completion: bump shtab, by casperdcl
❤️ #4331 experiments: support dvc repro --exp command line params, by pmrowla
❤️ #4329 tests: fix regex, by skshetry
❤️ #4328 updater: Remove unnecessary ( in logging, by skshetry
❤️ #4323 Two new modes --all and --stdin for check-ignore, by karajan1001
❤️ #4322 Two new mode -all and --stdin for dvc check-ignore, by karajan1001
❤️ #4321 Interactive mode and all patterns mode for dvc check-ignore command, by karajan1001
❤️ #4320 experiments: more intelligent checkout behavior, by pmrowla
❤️ #4319 experiments: separate install requirements, by pmrowla
❤️ #4318 TOML no included as a dependency in the conda build for dvc, by yfarjoun
❤️ #4317 repro: update status message for dvc-added files, by sarthakforwet

LIKED ISSUE

👍 #4316 Did you forget to fetch? is generally not the solution to my problem, by braaannigan
It received 👍 x4, 😄 x0, 🎉 x0 and ❤️ x0.

NOISY ISSUE

🔈 #4343 dvc push: when not all files are in local cache, still pushes the hash.dir file, breaking remote repository., by bobertlo
It received 21 comments.

PULL REQUESTS

Last week, 21 pull requests were created, updated or merged.

UPDATED PULL REQUEST

Last week, 10 pull requests were updated.
💛 #4364 term: review "URL" term usage in remote cmds, and get/import-url, by jorgeorpinel
💛 #4363 dependency: fine grained (user cmd filter), by casperdcl
💛 #4358 check-ignore: update help output, by jorgeorpinel
💛 #4354 Error message when no match found., by karajan1001
💛 #4353 push: do not push .dir file for directory with missing files, by pmrowla
💛 #4339 exception text: clarify error message, by bobertlo
💛 #4334 Config to enable/disable updater , by PuneethaPai
💛 #4324 dvcignore: api to unhide subrepos directory, by skshetry
💛 #4295 force YAML 1.1 syntax when dumping yaml files with ruamel, by dtrifiro
💛 #4229 Special dir warning #3436, by aerubanov

MERGED PULL REQUEST

Last week, 11 pull requests were merged.
💜 #4345 experiments: add --no-pager option for dvc exp show, by pmrowla
💜 #4341 config: use wtree for non-repo configs, by efiop
💜 #4340 import: fix importing into subdirectory bug, by pmrowla
💜 #4337 completion: bump shtab, by casperdcl
💜 #4331 experiments: support dvc repro --exp command line params, by pmrowla
💜 #4329 tests: fix regex, by skshetry
💜 #4328 updater: Remove unnecessary ( in logging, by skshetry
💜 #4323 Two new modes --all and --stdin for check-ignore, by karajan1001
💜 #4320 experiments: more intelligent checkout behavior, by pmrowla
💜 #4317 repro: update status message for dvc-added files, by sarthakforwet
💜 #4282 dvc check-ignore command, by karajan1001

COMMITS

Last week there were 12 commits.
🛠️ dvc: bump to 1.4.0 by efiop
🛠️ [Two new modes --all and --stdin for check-ignore (#4323) * Two new mode -all and --stdin for check-ignore

Fix #4321

Introduce new arguments --all for dvc check-ignore
Add tests for dvc check-ignore --all

  • --stdin and targets only one
  1. --stdin and targets can and only can have one
  2. more tests
  • New tests for stdin mode and solve a problem
  1. Add a new tests with mock stdin for interactive mode
  2. Solve the problem of assert "" in caplog.text in tests always True.
  • Remove path_input interface
  1. remove path_input and make _ask to a public method instead

  • Update dvc/command/check_ignore.py

  • Update dvc/command/check_ignore.py

  • Update dvc/command/check_ignore.py

  • Update dvc/command/check_ignore.py

  • Update dvc/command/check_ignore.py

  • Update dvc/command/check_ignore.py

  • Update dvc/command/check_ignore.py

  • Update dvc/command/check_ignore.py

  • fix styling

Co-authored-by: karajan1001 jah@mail.ustc.edu.cn
Co-authored-by: Ruslan Kuprieiev kupruser@gmail.com
Co-authored-by: Ruslan Kuprieiev ruslan@iterative.ai](e2a5741) by karajan1001
🛠️ [experiments: support dvc repro --exp command line params (#4331) * experiments: support passing params values instead of reading from user's workspace

Co-authored-by: Ruslan Kuprieiev kupruser@gmail.com](4759517) by sarthakforwet
🛠️ [config: use wtree for non-repo configs (#4341) For example, when dvc importing something, dvc won't see stuff
declared in system and global configs, because GitTree doesn't see stuff
that is outside of the git repo.

Discord context:
https://discordapp.com/channels/485586884165107732/563406153334128681/740543492417126521](https://github.com/iterative/dvc/commit/7afff1ef29dd213c7bb71ef2e6cadfc454fe72f6) by efiop
🛠️ [import: fix importing into subdirectory bug (#4340) * tests: test importing into subdirectory

I adjusted it to expect minor and patch version to be of multiple digits.](35dd1fd) by skshetry
🛠️ Update updater.py (#4328) by skshetry
🛠️ [experiments: more intelligent checkout behavior (#4320) * restore Experiments.chdir

  • used in experiments.show

  • experiments: make checkout work without git reset --hard

  • experiments: remove --force parameter

  • experiments: reject checkout if current workspace commit doesnt match
    expected baseline](73750df) by pmrowla
    🛠️ [dvc check-ignore command (dvc check-ignore command #4282) * Update some tests first

fix #3736

  • first edition

  • solve failure in Windows

  • For Windows ci

  • Some help ducuments issue.

  • Update dvc/ignore.py

abspath

Co-authored-by: Ruslan Kuprieiev kupruser@gmail.com

  • Refactor with OutOfWorkSpaceError

  • Solve a bug

  • Update dvc/command/check_ignore.py

Co-authored-by: Jorge Orpinel jorgeorpinel@users.noreply.github.com

  • Update dvc/command/check_ignore.py

Co-authored-by: Jorge Orpinel jorgeorpinel@users.noreply.github.com

  • Update dvc/command/check_ignore.py

  • Revert "Refactor with OutOfWorkSpaceError"

This reverts commit 27eec49.

  • Two change request
  1. Argument targets's description.
  2. Error handling of _get_normalize_path
  • Update dvc/main.py

Co-authored-by: Ruslan Kuprieiev kupruser@gmail.com

  • check_ignore now only accept one path a time
  1. Add a new test for the out side repo cases
  2. check ignore now only check one file not file lists

Co-authored-by: Ruslan Kuprieiev kupruser@gmail.com
Co-authored-by: karajan1001 jah@mail.ustc.edu.cn
Co-authored-by: Jorge Orpinel jorgeorpinel@users.noreply.github.com](11d906e) by karajan1001

CONTRIBUTORS

Last week there were 6 contributors.
👤 efiop
👤 karajan1001
👤 pmrowla
👤 sarthakforwet
👤 casperdcl
👤 skshetry

STARGAZERS

Last week there were 43 stagazers.
⭐ chentsulin
⭐ jamfly
⭐ josix
⭐ aballiet
⭐ GalAster
⭐ zeaphoo
⭐ geyy472
⭐ ashleyha
⭐ lucischen
⭐ mrxuyong
⭐ jo0ger
⭐ Vodolazskyi
⭐ louiscpalma
⭐ aartaria
⭐ Criterionist
⭐ ManantenaKiady
⭐ Jefersonalves
⭐ pcrespov
⭐ zlf0625
⭐ SpikingNeuron
⭐ lilixiang
⭐ Ning-Ding
⭐ Zagoshipda
⭐ Lance0312
⭐ AVDAX
⭐ SigureMo
⭐ AyoGitNg
⭐ edobry
⭐ Vodrech
⭐ humanfactors
⭐ danilfromekb
⭐ ObservedObserver
⭐ raddessi
⭐ pmart123
⭐ ShawnHouCHN
⭐ scientistkev
⭐ therealparmesh
⭐ ursueugen
⭐ soar-zhengjian
⭐ gdahia
⭐ ggarnier
⭐ bhoov
⭐ bcessa
You all are the stars! 🌟

RELEASES

Last week there was 1 release.
🚀 1.4.0 1.4.0

That's all for last week, please 👀 Watch and ⭐ Star the repository iterative/dvc to receive next weekly updates. 😃

You can also view all Weekly Digests by clicking here.

Your Weekly Digest bot. 📆

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions