Skip to content

Ability to ingest records from other sources - #972

Merged
bennybp merged 22 commits into
mainfrom
external_ingest
Aug 26, 2025
Merged

Ability to ingest records from other sources#972
bennybp merged 22 commits into
mainfrom
external_ingest

Conversation

@bennybp

@bennybp bennybp commented Aug 25, 2025

Copy link
Copy Markdown
Contributor

Description

This adds the basics of external record ingestion. That is, users will now have the ability to import records from other sources into the QCFractal server.

Basically, you can now send/upload a QCPortal record or QCSchema result. It will create a record on the server that behaves identically to other records.

This will allow for running computations in customized ways and uploading the results, and also for transferring between QCFractal instances.

Some limitations:

  • QCSchema results can be imported, but they must be full "successful" computations
  • QCPortal records that have a state of error, cancelled, invalid, deleted cannot be reset
  • QCPortal records that are waiting will not be run on the new server
  • The new records must be attached to a project (not loose on the server)

Right now, only individual records can be imported - datasets are coming soon.

This PR also adds some useful functions, such as comparing records

Few more things to do:

  • Better error handling in the server-side ingestion functions (returning InsertMetadata, etc)
  • Add tests for importing into projects

Status

  • Code base linted
  • Ready to go

@bennybp
bennybp merged commit 0141ee9 into main Aug 26, 2025
19 checks passed
@bennybp
bennybp deleted the external_ingest branch August 26, 2025 15:06
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant