You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
The fasta action currently relies on reading from a duckdb table, which itself actually only reads from a .parquet on disk and joins that file with the set of sequence ids that are to be returned. This is the only place duckdb is used after preprocessing.
We can make this both more efficient and remove that dependence by reading from the files directly, maybe using a different file format, that is already ordered by id, which would remove the need for a join.
The text was updated successfully, but these errors were encountered:
The fasta action currently relies on reading from a duckdb table, which itself actually only reads from a
.parquet
on disk and joins that file with the set of sequence ids that are to be returned. This is the only place duckdb is used after preprocessing.We can make this both more efficient and remove that dependence by reading from the files directly, maybe using a different file format, that is already ordered by id, which would remove the need for a join.
The text was updated successfully, but these errors were encountered: