Skip to content

BEL validation/pipeline performance #89

@wshayes

Description

@wshayes

We can do a batch request to arangodb for multiple terms/orthologies to speed things up.

We can also do the same for Elasticsearch queries: https://www.elastic.co/guide/en/elasticsearch/reference/current/search-multi-search.html

Look into using asyncio for processing many nanopubs/assertions at a time. Use asyncio semaphore to not overload the system by limiting the number of nanopubs/assertions to run at the same time.

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions