Skip to content

issues Search Results · repo:stan-dev/performance-tests-cmdstan language:Python

Filter by

14 results
 (55 ms)

14 results

instan-dev/performance-tests-cmdstan (press backspace or delete to remove)

script runPerformanceTests.py uses file suffix .tmp to specify csv outputs. should be .tmp.csv in order to accomodate CmdStan s filename munging. cf: https://github.com/stan-dev/performance-tests-cmdstan/blob/e6b31c65e9f9946d83bd1455c1bd1504c779c00e/runPerformanceTests.py#L207 ...
  • mitzimorris
  • Opened 
    on Jan 2, 2024
  • #61

Creating this mainly so @serban-nicusor-toptal and I don t forget to look into this once we have the other pipelines green again
  • WardBrian
  • 5
  • Opened 
    on Nov 9, 2023
  • #59

master pipeline is failing in the Numerical Accuracy and Performance Tests on Known-Good Models step and looks like Shotgun Performance Regression Tests is failing also. See: https://github.com/stan-dev/performance-tests-cmdstan/issues/49 ...
  • serban-nicusor-toptal
  • 4
  • Opened 
    on May 9, 2023
  • #50

I thought updating the golds in #48 would be enough, but it is still failing. If I recall correctly from the original source of the failures (the Eigen 3.4 PR) it was actually due to a Eigen change which ...
  • WardBrian
  • Opened 
    on May 1, 2023
  • #49

We should add a more diverse set of models to this, especially ones that use a lot of functions to test inlining, and preferably a few we hand write specifically targeting parts of the optimizer.
enhancement
  • WardBrian
  • 1
  • Opened 
    on Apr 28, 2022
  • #38

There are Stan models that could be used for compilation regression testing (checking that everything compiles) only. For now just tracking down models that could be used for that. There are some models ...
  • rok-cesnovar
  • 2
  • Opened 
    on Mar 1, 2021
  • #30

The definition of stdev in runPerformanceTests.py is a bit odd. def stdev(coll, mean): if len(coll ) 2: return 0 return (sum((x - mean)**2 for x in coll) / (len(coll) - 1)**0.5) Looks ...
  • gbdrt
  • Opened 
    on Feb 5, 2021
  • #29

For runs 1 it would be nice to have the standard deviation of the runs as well. Some of these benchmarks are very fast and can be a bit noisy. Having the standard deviation reported would give a better ...
  • SteveBronder
  • Opened 
    on Jan 22, 2020
  • #26

Not a huge priority but it would simplify testing with Windows. I can add this if you give me writing permissions to the repo. In order to make it work on windows we need: - dynamic folder separators ...
  • rok-cesnovar
  • 2
  • Opened 
    on May 18, 2019
  • #20
Issue origami icon

Learn how you can use GitHub Issues to plan and track your work.

Save views for sprints, backlogs, teams, or releases. Rank, sort, and filter issues to suit the occasion. The possibilities are endless.Learn more about GitHub Issues
ProTip! 
Press the
/
key to activate the search input again and adjust your query.
Issue origami icon

Learn how you can use GitHub Issues to plan and track your work.

Save views for sprints, backlogs, teams, or releases. Rank, sort, and filter issues to suit the occasion. The possibilities are endless.Learn more about GitHub Issues
ProTip! 
Restrict your search to the title by using the in:title qualifier.
Issue search results · GitHub