Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Benchmarking PC/FCI algorithms #123

Open
adam2392 opened this issue Mar 16, 2023 · 1 comment
Open

Benchmarking PC/FCI algorithms #123

adam2392 opened this issue Mar 16, 2023 · 1 comment

Comments

@adam2392
Copy link
Collaborator

Helpful in general because we want code that is easily re-runnable that generates a summary benchmark.

We would like to do the following, where we generate a bunch of graphs and datasets from those graphs and varying i) the number of nodes and ii) the edge probability and then testing our implantation for:

  • speed
  • correctness

We can vary the edge probability model to be Erdos-Renyi, Weighted-Edge-Degree, and any of the common networkx models.

Ideally, this suite of benchmark scripts is easy to plug in an alternative algorithm e.g. causal-learn, so we can explicitly run the same benchmarks side-by-side.

cc: @jaron-lee

@adam2392
Copy link
Collaborator Author

We probably need a good simulation suite to make this "complete", but we can start off simple.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant