[CT-2042] Enable seeds to be handled from stored manifest data #6875
Labels
backport 1.0.latest
Tag for PR to be backported to the 1.0.latest branch
backport 1.1.latest
backport 1.2.latest
This PR will be backported to the 1.2.latest branch
backport 1.3.latest
backport 1.4.latest
backport 1.5.latest
backport 1.6.latest
file_system
How dbt-core interoperates with file systems to read/write data
Impact: Orch
python_api
Issues related to dbtRunner Python entry point
seeds
Issues related to dbt's seed functionality
Right now we don't store the content of a seed file, we just store a checksum of the content or just the path if the size of the seed exceeds 1 megabyte. The seed is retrieved later using the absolute path of the file. This is not functional for a world in which files can come from a file diff and we have portable manifests.
We need to decide how to do this for file diffs and portable manifests. How important is the existence of large seeds to our users? It is documented as an anti-pattern, but I'm sure some people are doing it. Do we want to load the content below a certain size? Do some kind of special handling?
The text was updated successfully, but these errors were encountered: