Skip to content
This repository has been archived by the owner on Dec 16, 2022. It is now read-only.

Multitask example #4898

Merged
merged 83 commits into from
Jan 19, 2021
Merged

Multitask example #4898

merged 83 commits into from
Jan 19, 2021

Commits on Nov 26, 2020

  1. Make the VQA reader work for the other datasets

    @dirkgr
    dirkgr committed Nov 26, 2020
    Configuration menu
    Copy the full SHA
    cc083d0 View commit details
    Browse the repository at this point in the history

  2. Also find pngs

    @dirkgr
    dirkgr committed Nov 26, 2020
    Configuration menu
    Copy the full SHA
    5333901 View commit details
    Browse the repository at this point in the history

  3. Really support pngs

    @dirkgr
    dirkgr committed Nov 26, 2020
    Configuration menu
    Copy the full SHA
    8808b7d View commit details
    Browse the repository at this point in the history

  4. Remove debug code

    @dirkgr
    dirkgr committed Nov 26, 2020
    Configuration menu
    Copy the full SHA
    37cc69c View commit details
    Browse the repository at this point in the history

  5. More logging

    @dirkgr
    dirkgr committed Nov 26, 2020
    Configuration menu
    Copy the full SHA
    4668bb1 View commit details
    Browse the repository at this point in the history

  6. Unexpected formatting

    @dirkgr
    dirkgr committed Nov 26, 2020
    Configuration menu
    Copy the full SHA
    1844709 View commit details
    Browse the repository at this point in the history

  7. Respect the device

    @dirkgr
    dirkgr committed Nov 26, 2020
    Configuration menu
    Copy the full SHA
    4d1cd4e View commit details
    Browse the repository at this point in the history

  8. This is how your replace things in named tuples.

    @dirkgr
    dirkgr committed Nov 26, 2020
    Configuration menu
    Copy the full SHA
    2351649 View commit details
    Browse the repository at this point in the history

  9. Remove unused import

    @dirkgr
    dirkgr committed Nov 26, 2020
    Configuration menu
    Copy the full SHA
    9c6e505 View commit details
    Browse the repository at this point in the history

  10. This is how you override a method properly.

    @dirkgr
    dirkgr committed Nov 26, 2020
    Configuration menu
    Copy the full SHA
    3fe3bd3 View commit details
    Browse the repository at this point in the history

  11. This is how you set parameters in detectron.

    @dirkgr
    dirkgr committed Nov 26, 2020
    Configuration menu
    Copy the full SHA
    1ef85c5 View commit details
    Browse the repository at this point in the history

  12. Also set the device for the region detector

    @dirkgr
    dirkgr committed Nov 26, 2020
    Configuration menu
    Copy the full SHA
    1f1abe4 View commit details
    Browse the repository at this point in the history

Commits on Nov 30, 2020

  1. Training configs for all three datasets contained in VQA

    @dirkgr
    dirkgr committed Nov 30, 2020
    Configuration menu
    Copy the full SHA
    53ba25c View commit details
    Browse the repository at this point in the history

  2. Bigger batches

    @dirkgr
    dirkgr committed Nov 30, 2020
    Configuration menu
    Copy the full SHA
    947735e View commit details
    Browse the repository at this point in the history

  3. Bigger batches for image processing

    @dirkgr
    dirkgr committed Nov 30, 2020
    Configuration menu
    Copy the full SHA
    c561870 View commit details
    Browse the repository at this point in the history

Commits on Dec 1, 2020

  1. Fix vilbert-from-huggingface config

    @dirkgr
    dirkgr committed Dec 1, 2020
    Configuration menu
    Copy the full SHA
    9cd8cb1 View commit details
    Browse the repository at this point in the history

  2. Make the config switch modes for constructing vocab

    @dirkgr
    dirkgr committed Dec 1, 2020
    Configuration menu
    Copy the full SHA
    8432834 View commit details
    Browse the repository at this point in the history

  3. Merge remote-tracking branch 'origin/vision' into OtherVQAData2

    @dirkgr
    dirkgr committed Dec 1, 2020
    Configuration menu
    Copy the full SHA
    4db41b0 View commit details
    Browse the repository at this point in the history

Commits on Dec 2, 2020

  1. More vocab, more docs, better way of deriving vocab

    @dirkgr
    dirkgr committed Dec 2, 2020
    Configuration menu
    Copy the full SHA
    9cea943 View commit details
    Browse the repository at this point in the history

  2. Modernize the from_huggingface config

    @dirkgr
    dirkgr committed Dec 2, 2020
    Configuration menu
    Copy the full SHA
    1eeeed5 View commit details
    Browse the repository at this point in the history

  3. More updates to the from_huggingface config

    @dirkgr
    dirkgr committed Dec 2, 2020
    Configuration menu
    Copy the full SHA
    11fd67c View commit details
    Browse the repository at this point in the history

  4. Better hyperparameters stolen from another project

    @dirkgr
    dirkgr committed Dec 2, 2020
    Configuration menu
    Copy the full SHA
    7aa7e0e View commit details
    Browse the repository at this point in the history

  5. Fix for inverted parameter

    @dirkgr
    dirkgr committed Dec 2, 2020
    Configuration menu
    Copy the full SHA
    08a498c View commit details
    Browse the repository at this point in the history

  6. Formatting

    @dirkgr
    dirkgr committed Dec 2, 2020
    Configuration menu
    Copy the full SHA
    a12769c View commit details
    Browse the repository at this point in the history

  7. Throw a meaningful error message when we don't have images

    @dirkgr
    dirkgr committed Dec 2, 2020
    Configuration menu
    Copy the full SHA
    16f1d12 View commit details
    Browse the repository at this point in the history

  8. Add a warning that includes instructions for how to fix things

    @dirkgr
    dirkgr committed Dec 2, 2020
    Configuration menu
    Copy the full SHA
    b363af5 View commit details
    Browse the repository at this point in the history

  9. Merge branch 'vision' into OtherVQAData2

    @dirkgr
    dirkgr committed Dec 2, 2020
    Configuration menu
    Copy the full SHA
    bcdc63c View commit details
    Browse the repository at this point in the history

  10. Remove unused script

    @dirkgr
    dirkgr committed Dec 2, 2020
    Configuration menu
    Copy the full SHA
    639d043 View commit details
    Browse the repository at this point in the history

  11. Merge branch 'OtherVQAData2' of https://github.com/allenai/allennlp i… 

    …nto OtherVQAData2
    @dirkgr
    dirkgr committed Dec 2, 2020
    Configuration menu
    Copy the full SHA
    a55f141 View commit details
    Browse the repository at this point in the history

  12. Merge issue

    @dirkgr
    dirkgr committed Dec 2, 2020
    Configuration menu
    Copy the full SHA
    184c45f View commit details
    Browse the repository at this point in the history

Commits on Dec 3, 2020

  1. Adds named splits to the SNLI-VE reader

    @dirkgr
    dirkgr committed Dec 3, 2020
    Configuration menu
    Copy the full SHA
    a1367cf View commit details
    Browse the repository at this point in the history

Commits on Dec 4, 2020

  1. Make the multitask data loader discoverable

    @dirkgr
    dirkgr committed Dec 4, 2020
    Configuration menu
    Copy the full SHA
    16dc3c4 View commit details
    Browse the repository at this point in the history

  2. Formatting

    @dirkgr
    dirkgr committed Dec 4, 2020
    Configuration menu
    Copy the full SHA
    e37dd4a View commit details
    Browse the repository at this point in the history

  3. More flexible inputs to the dataset readers

    @dirkgr
    dirkgr committed Dec 4, 2020
    Configuration menu
    Copy the full SHA
    ac1a2d9 View commit details
    Browse the repository at this point in the history

  4. Prototype config for the multitask training job

    @dirkgr
    dirkgr committed Dec 4, 2020
    Configuration menu
    Copy the full SHA
    0a9ac4e View commit details
    Browse the repository at this point in the history

Commits on Dec 16, 2020

  1. Merge remote-tracking branch 'origin/vision' into MultitaskExample 

    # Conflicts:
#	allennlp/data/dataset_readers/gqa.py
    @dirkgr
    dirkgr committed Dec 16, 2020
    Configuration menu
    Copy the full SHA
    866d43d View commit details
    Browse the repository at this point in the history

Commits on Jan 4, 2021

  1. Merge remote-tracking branch 'origin/vision' into MultitaskExample

    @dirkgr
    dirkgr committed Jan 4, 2021
    Configuration menu
    Copy the full SHA
    6aa7e0e View commit details
    Browse the repository at this point in the history

Commits on Jan 6, 2021

  1. json_lines_from_file() already calls cached_path()

    @dirkgr
    dirkgr committed Jan 6, 2021
    Configuration menu
    Copy the full SHA
    ff35247 View commit details
    Browse the repository at this point in the history

  2. Visual entailment should track accuracy

    @dirkgr
    dirkgr committed Jan 6, 2021
    Configuration menu
    Copy the full SHA
    626c509 View commit details
    Browse the repository at this point in the history

  3. Switching to torch

    @dirkgr
    dirkgr committed Jan 6, 2021
    Configuration menu
    Copy the full SHA
    67f85d5 View commit details
    Browse the repository at this point in the history

  4. Fixing VE image paths

    @dirkgr
    dirkgr committed Jan 6, 2021
    Configuration menu
    Copy the full SHA
    140bbd3 View commit details
    Browse the repository at this point in the history

  5. Formatting

    @dirkgr
    dirkgr committed Jan 6, 2021
    Configuration menu
    Copy the full SHA
    8b7668e View commit details
    Browse the repository at this point in the history

  6. Experimentally use threaded_generator to read instances from readers … 

    …simultaneously
    @dirkgr
    dirkgr committed Jan 6, 2021
    Configuration menu
    Copy the full SHA
    a633e67 View commit details
    Browse the repository at this point in the history

  7. Vilbert backbone

    @dirkgr
    dirkgr committed Jan 6, 2021
    Configuration menu
    Copy the full SHA
    67b942b View commit details
    Browse the repository at this point in the history

  8. Fixed paths

    @dirkgr
    dirkgr committed Jan 6, 2021
    Configuration menu
    Copy the full SHA
    54c8a46 View commit details
    Browse the repository at this point in the history

  9. Formatting

    @dirkgr
    dirkgr committed Jan 6, 2021
    Configuration menu
    Copy the full SHA
    ddb0501 View commit details
    Browse the repository at this point in the history

Commits on Jan 8, 2021

  1. Merge remote-tracking branch 'origin/main' into MultitaskExample

    @dirkgr
    dirkgr committed Jan 8, 2021
    Configuration menu
    Copy the full SHA
    5e30634 View commit details
    Browse the repository at this point in the history

  2. Adds heads

    @dirkgr
    dirkgr committed Jan 8, 2021
    Configuration menu
    Copy the full SHA
    42d0a65 View commit details
    Browse the repository at this point in the history

  3. Revert "Experimentally use threaded_generator to read instances from … 

    …readers simultaneously"

This reverts commit a633e67.
    @dirkgr
    dirkgr committed Jan 8, 2021
    Configuration menu
    Copy the full SHA
    73111ad View commit details
    Browse the repository at this point in the history

Commits on Jan 12, 2021

  1. Multitask trains now!

    @dirkgr
    dirkgr committed Jan 12, 2021
    Configuration menu
    Copy the full SHA
    74c8637 View commit details
    Browse the repository at this point in the history

  2. Remove useless parameter from GQA reader

    @dirkgr
    dirkgr committed Jan 12, 2021
    Configuration menu
    Copy the full SHA
    6a79238 View commit details
    Browse the repository at this point in the history

  3. Updated multitask config

    @dirkgr
    dirkgr committed Jan 12, 2021
    Configuration menu
    Copy the full SHA
    85c2329 View commit details
    Browse the repository at this point in the history

Commits on Jan 13, 2021

  1. Schedulers produce batches, not instances

    @dirkgr
    dirkgr committed Jan 13, 2021
    Configuration menu
    Copy the full SHA
    493712f View commit details
    Browse the repository at this point in the history

  2. Track multiple metrics

    @dirkgr
    dirkgr committed Jan 13, 2021
    Configuration menu
    Copy the full SHA
    6dac87d View commit details
    Browse the repository at this point in the history

  3. Make mypy happy

    @dirkgr
    dirkgr committed Jan 13, 2021
    Configuration menu
    Copy the full SHA
    0858d8d View commit details
    Browse the repository at this point in the history

  4. Formatting

    @dirkgr
    dirkgr committed Jan 13, 2021
    Configuration menu
    Copy the full SHA
    1c064b7 View commit details
    Browse the repository at this point in the history

  5. Keep better track of which heads have been called

    @dirkgr
    dirkgr committed Jan 13, 2021
    Configuration menu
    Copy the full SHA
    ce20246 View commit details
    Browse the repository at this point in the history

  6. Merge remote-tracking branch 'origin/vision' into MultitaskExample 

    # Conflicts:
#	allennlp/data/data_loaders/__init__.py
#	allennlp/data/data_loaders/multitask_data_loader.py
    @dirkgr
    dirkgr committed Jan 13, 2021
    Configuration menu
    Copy the full SHA
    58b6745 View commit details
    Browse the repository at this point in the history

  7. Fix the merge

    @dirkgr
    dirkgr committed Jan 13, 2021
    Configuration menu
    Copy the full SHA
    0a4db8f View commit details
    Browse the repository at this point in the history

  8. We have more than strings for input

    @dirkgr
    dirkgr committed Jan 13, 2021
    Configuration menu
    Copy the full SHA
    9ae0555 View commit details
    Browse the repository at this point in the history

  9. Remove unused imports

    @dirkgr
    dirkgr committed Jan 13, 2021
    Configuration menu
    Copy the full SHA
    7d420bb View commit details
    Browse the repository at this point in the history

  10. -1 is CPU

    @dirkgr
    dirkgr committed Jan 13, 2021
    Configuration menu
    Copy the full SHA
    79baa38 View commit details
    Browse the repository at this point in the history

Commits on Jan 14, 2021

  1. Go back to tracking instances per epoch so that the samplers can work

    @dirkgr
    dirkgr committed Jan 14, 2021
    Configuration menu
    Copy the full SHA
    4b52a56 View commit details
    Browse the repository at this point in the history

  2. Better error message

    @dirkgr
    dirkgr committed Jan 14, 2021
    Configuration menu
    Copy the full SHA
    a9ddd17 View commit details
    Browse the repository at this point in the history

  3. A useful sampler to have

    @dirkgr
    dirkgr committed Jan 14, 2021
    Configuration menu
    Copy the full SHA
    50baedc View commit details
    Browse the repository at this point in the history

  4. We haven't indexed until we've indexed

    @dirkgr
    dirkgr committed Jan 14, 2021
    Configuration menu
    Copy the full SHA
    da29019 View commit details
    Browse the repository at this point in the history

  5. Makes tests pass

    @dirkgr
    dirkgr committed Jan 14, 2021
    Configuration menu
    Copy the full SHA
    25dad23 View commit details
    Browse the repository at this point in the history

  6. Formatting

    @dirkgr
    dirkgr committed Jan 14, 2021
    Configuration menu
    Copy the full SHA
    1258dd0 View commit details
    Browse the repository at this point in the history

  7. Fine-tuning the metric tracker

    @dirkgr
    dirkgr committed Jan 14, 2021
    Configuration menu
    Copy the full SHA
    0da384f View commit details
    Browse the repository at this point in the history

  8. Update model configs for my changes

    @dirkgr
    dirkgr committed Jan 14, 2021
    Configuration menu
    Copy the full SHA
    6e7030b View commit details
    Browse the repository at this point in the history

  9. Fixing model configs for Akshita's changes

    @dirkgr
    dirkgr committed Jan 14, 2021
    Configuration menu
    Copy the full SHA
    0d011a3 View commit details
    Browse the repository at this point in the history

  10. Implement VisionTextModel in terms of VilbertBackbone

    @dirkgr
    dirkgr committed Jan 14, 2021
    Configuration menu
    Copy the full SHA
    7165edf View commit details
    Browse the repository at this point in the history

  11. Formatting

    @dirkgr
    dirkgr committed Jan 14, 2021
    Configuration menu
    Copy the full SHA
    8ccb259 View commit details
    Browse the repository at this point in the history

  12. Merge remote-tracking branch 'origin/vision' into MultitaskExample

    @dirkgr
    dirkgr committed Jan 14, 2021
    Configuration menu
    Copy the full SHA
    8a5d8cf View commit details
    Browse the repository at this point in the history

  13. Fix stale comment

    @dirkgr
    dirkgr committed Jan 14, 2021
    Configuration menu
    Copy the full SHA
    b926016 View commit details
    Browse the repository at this point in the history

  14. Use the server paths by default, not Dirk's desktop

    @dirkgr
    dirkgr committed Jan 14, 2021
    Configuration menu
    Copy the full SHA
    18a6772 View commit details
    Browse the repository at this point in the history

  15. Fix tests

    @dirkgr
    dirkgr committed Jan 14, 2021
    Configuration menu
    Copy the full SHA
    931af0d View commit details
    Browse the repository at this point in the history

  16. Merge branch 'MultitaskExample' of https://github.com/allenai/allennlp … 

    …into MultitaskExample
    @dirkgr
    dirkgr committed Jan 14, 2021
    Configuration menu
    Copy the full SHA
    9c0e950 View commit details
    Browse the repository at this point in the history

  17. Formatting again

    @dirkgr
    dirkgr committed Jan 14, 2021
    Configuration menu
    Copy the full SHA
    f11a0f4 View commit details
    Browse the repository at this point in the history

Commits on Jan 16, 2021

  1. Merge branch 'vision' into MultitaskExample

    @dirkgr
    dirkgr committed Jan 16, 2021
    Configuration menu
    Copy the full SHA
    440c7aa View commit details
    Browse the repository at this point in the history

Commits on Jan 19, 2021

  1. Merge branch 'vision' into MultitaskExample

    @epwalsh
    epwalsh committed Jan 19, 2021
    Configuration menu
    Copy the full SHA
    e771934 View commit details
    Browse the repository at this point in the history

  2. Removed data loader parameters that don't exist anymore

    @dirkgr
    dirkgr committed Jan 19, 2021
    Configuration menu
    Copy the full SHA
    bd1a2f1 View commit details
    Browse the repository at this point in the history

  3. Clarified comment

    @dirkgr
    dirkgr committed Jan 19, 2021
    Configuration menu
    Copy the full SHA
    7c145b8 View commit details
    Browse the repository at this point in the history