issues Search Results · repo:stan-dev/performance-tests-cmdstan language:Python
Filter by
14 results
(55 ms)14 results
instan-dev/performance-tests-cmdstan (press backspace or delete to remove)script runPerformanceTests.py uses file suffix .tmp to specify csv outputs. should be .tmp.csv in order to accomodate
CmdStan s filename munging.
cf:
https://github.com/stan-dev/performance-tests-cmdstan/blob/e6b31c65e9f9946d83bd1455c1bd1504c779c00e/runPerformanceTests.py#L207 ...
mitzimorris
- Opened on Jan 2, 2024
- #61
Creating this mainly so @serban-nicusor-toptal and I don t forget to look into this once we have the other pipelines
green again
WardBrian
- 5
- Opened on Nov 9, 2023
- #59
master pipeline is failing in the Numerical Accuracy and Performance Tests on Known-Good Models step and looks like
Shotgun Performance Regression Tests is failing also. See:
https://github.com/stan-dev/performance-tests-cmdstan/issues/49 ...
serban-nicusor-toptal
- 4
- Opened on May 9, 2023
- #50
I thought updating the golds in #48 would be enough, but it is still failing. If I recall correctly from the original
source of the failures (the Eigen 3.4 PR) it was actually due to a Eigen change which ...
WardBrian
- Opened on May 1, 2023
- #49
rok-cesnovar
- Opened on May 2, 2022
- #39
We should add a more diverse set of models to this, especially ones that use a lot of functions to test inlining, and
preferably a few we hand write specifically targeting parts of the optimizer.
enhancement
WardBrian
- 1
- Opened on Apr 28, 2022
- #38
There are Stan models that could be used for compilation regression testing (checking that everything compiles) only.
For now just tracking down models that could be used for that. There are some models ...
rok-cesnovar
- 2
- Opened on Mar 1, 2021
- #30
The definition of stdev in runPerformanceTests.py is a bit odd.
def stdev(coll, mean):
if len(coll ) 2:
return 0
return (sum((x - mean)**2 for x in coll) / (len(coll) - 1)**0.5)
Looks ...
gbdrt
- Opened on Feb 5, 2021
- #29
For runs 1 it would be nice to have the standard deviation of the runs as well. Some of these benchmarks are very fast
and can be a bit noisy. Having the standard deviation reported would give a better ...
SteveBronder
- Opened on Jan 22, 2020
- #26
Not a huge priority but it would simplify testing with Windows. I can add this if you give me writing permissions to the
repo.
In order to make it work on windows we need:
- dynamic folder separators ...
rok-cesnovar
- 2
- Opened on May 18, 2019
- #20

Learn how you can use GitHub Issues to plan and track your work.
Save views for sprints, backlogs, teams, or releases. Rank, sort, and filter issues to suit the occasion. The possibilities are endless.Learn more about GitHub IssuesProTip!
Press the /
key to activate the search input again and adjust your query.
Learn how you can use GitHub Issues to plan and track your work.
Save views for sprints, backlogs, teams, or releases. Rank, sort, and filter issues to suit the occasion. The possibilities are endless.Learn more about GitHub IssuesProTip!
Restrict your search to the title by using the in:title qualifier.