Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[P1] Streamlining trainable intervention artifacts saving and sharing #30

Closed
frankaging opened this issue Dec 21, 2023 · 0 comments
Closed
Assignees

Comments

@frankaging
Copy link
Collaborator

frankaging commented Dec 21, 2023

Description:
After training, the intervention's artifacts are saved in memory without a good way of saving to disk with other metadata or sharing on huggingface marketplace. This will be a change to provide a smooth way of saving/sharing interventions trained by users.

The key thing will be serializing metadata into a shareable format (i.e., serializing and deserializing need both be tested). It will still require sharing parties to know the counterfactual dataset generation, but it is less of a problem of this library and more about sharing the dataset itself. And dataset sharing could be a separate process not included in this library.

This change should also consider sharing interventions that contain a vector store (some truthful direction for sharing, etc..).

Testing Done:

  • Local Test Log:
.Removing testing dir ./test_output_dir_prefix-d9080f
Removing testing dir ./test_output_dir_prefix-dff621
Removing testing dir ./test_output_dir_prefix-9227e2
Removing testing dir ./test_output_dir_prefix-6cb8c4
Removing testing dir ./test_output_dir_prefix-67cd73

----------------------------------------------------------------------
Ran 25 tests in 4.280s

OK
  • New Tutorial Added tutorials/basic_tutorials/Load_Save_and_Share_Interventions.ipynb.
@frankaging frankaging self-assigned this Jan 9, 2024
frankaging added a commit that referenced this issue Jan 10, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant