v0.4.0

What's Changed

• Reduce unit test warnings by @douglasjacobsen in #139
• Remove support for the deprecated mpi and batch attributes by @douglasjacobsen in #146
• Merge release branch v0.3.0 into develop by @douglasjacobsen in #142
• Merge Release v0.3.0 into Develop by @douglasjacobsen in #148
• Cleanup add_expand_vars by @dodecatheon in #131
• Add default workspaces directory to .gitignore by @douglasjacobsen in #150
• Software definitions command by @douglasjacobsen in #137
• Remove support for deprecated v1 spack configuration by @douglasjacobsen in #144
• Update ramble config edit to create missing directories by @douglasjacobsen in #152
• Remove staticmethod decorator that causes old python vers to fail by @rfbgo in #153
• Allow sphinx to generate doc for namespace subpackages by @rfbgo in #155
• Fix regex warnings from application definitions by @douglasjacobsen in #157
• add spell checking by @vsoch in #160
• Fix incorrect placement of error=0 in style CI test by @douglasjacobsen in #136
• Fix an issue where flake8 errors on moved files by @douglasjacobsen in #145
• Add a test of the application short_print method. by @douglasjacobsen in #135
• Convert workspace level internals to config section by @douglasjacobsen in #158
• Update defaults for application langauge features by @douglasjacobsen in #140
• add space between mpi command and template command by @vsoch in #161
• Fix typos in develop missed from spelling check by @douglasjacobsen in #162
• Add modifier functionality, tests, commands, and documentation by @douglasjacobsen in #132
• Fix workloads with multiple inputs by @douglasjacobsen in #154
• Remove support for deprecated env-vars by @douglasjacobsen in #151
• Cleanup ramble workspace info and create a standard color utility by @douglasjacobsen in #156
• Add attribute front-end commands by @douglasjacobsen in #149
• Fix an invalid reference to section_title by @douglasjacobsen in #168
• Allow variable passthrough by @douglasjacobsen in #165
• Allow workloads to be templatized by @douglasjacobsen in #166
• Update FOMs to expand fom_name (LHS) using groups (RHS) by @rfbgo in #169
• Resolve package definition conflicts by @douglasjacobsen in #167
• Allow input files path to be expanded by @rfbgo in #170
• Add HPCC application, which includes DGEMM and other useful benchmarks by @rfbgo in #171
• Allow ramble to attempt to detect node type by @rfbgo in #173
• Add documentation for configuration files by @douglasjacobsen in #172
• Update Application Documention by @rfbgo in #177
• Remove references to spack environment in config merging by @douglasjacobsen in #176
• Update gcp metadata curl to be silent by @rfbgo in #179
• Fix issue preventing spack specs from passing through expander by @douglasjacobsen in #180
• Add sha256 sums for input_file directives by @dodecatheon in #181
• Allows software definitions to inhert lower level variables by @douglasjacobsen in #178
• Warn when a package and its compiler are added to an environment by @douglasjacobsen in #183
• Allow variables to be specified in spack config section by @douglasjacobsen in #185
• Fix an issue when merging variables in software environments by @douglasjacobsen in #186
• Add config edit and util.editor unit tests by @douglasjacobsen in #175
• Add support for application based success functions and FOM comparisons by @douglasjacobsen in #174
• Add support for variables to be defined as ranges by @douglasjacobsen in #188
• Add documentation for success criteria by @douglasjacobsen in #187
• Add fv3m ufs weather model by @dodecatheon in #184
• Update modifier langauge to use the language helpers by @douglasjacobsen in #191
• Add missing namd_flags workload variable by @douglasjacobsen in #192
• Add success criteria to modifier definitions by @douglasjacobsen in #193
• Fix fetch fallback when mirrors are GCS buckets by @douglasjacobsen in #190
• Add workspace / experiment hash functionality by @douglasjacobsen in #182
• Convert spack version to use git and import by @douglasjacobsen in #197
• Add WATER_EXX workload to Quantum-Espresso by @douglasjacobsen in #198
• Add caching to get_inputs by @douglasjacobsen in #189
• Fix software conflicts by @douglasjacobsen in #200
• Update APS modifier to append instead of prepend by @douglasjacobsen in #201
• Update ramble examples by @douglasjacobsen in #199
• Fix typo from PR #165 by @dodecatheon in #204
• Add bigquery upload chunking by @rfbgo in #205
• Add documentation about generated software environments by @douglasjacobsen in #203
• Raise an error when variable names contain decimals by @douglasjacobsen in #207
• Fix minixyce and add performance centric FOMs by @rfbgo in #206
• Add missing language helpers to modifier language by @douglasjacobsen in #208
• Add application instances as an input to executable modifiers by @douglasjacobsen in #202
• Add a basic getting started tutorial by @douglasjacobsen in #209
• Update docs format to be more consistent by @rfbgo in #213
• Intel MKL-optimized HPL by @dodecatheon in #195
• Update LAMMPS application definition by @douglasjacobsen in #212
• Extra gromacs inputs by @dodecatheon in #214
• Update and fix OpenFoam application definition by @douglasjacobsen in #215
• Add success criteria to WRF application definitions by @douglasjacobsen in #211
• Wire up workspace hash to push to db by @rfbgo in #218
• Documentation for ramble mirror by @dodecatheon in #216
• Fix spack using auxiliary software when installing compilers by @douglasjacobsen in #219
• Remove some spack env logic from vendored spack by @douglasjacobsen in #217
• Extract shared directives into a shared base class by @douglasjacobsen in #210
• Add documentation for workspace_dirs configuration by @dodecatheon in #220
• Fix CI Syntax errors and increase minimum coverage requirement by @douglasjacobsen in #224
• Add expand_var_name function to expander by @douglasjacobsen in #225
• Ensure consistent application definitions by @dodecatheon in #222
• Improve logic preventing repeated tasks by @douglasjacobsen in #223
• Add missing _COMREPLY suffix to auto-complete generation by @douglasjacobsen in #226
• Update README.md by @dapomeroy in #228
• Add support for explicit zips by @douglasjacobsen in #221
• Add support for package manager configs, and remove spack module generation by @douglasjacobsen in #230
• Allow Ramble to track the origin of a FOM by @rfbgo in #229
• Add support to import & upload experiment results by @dapomeroy in #227
• Add an application developer guide by @douglasjacobsen in #232
• Allow Ramble to upload origin/origin_type by @rfbgo in #234
• Add HMMER application to Ramble by @dodecatheon in #231
• Add support for experiment exclusions by @douglasjacobsen in #233
• Fix typo in lib/ramble/ramble/language/application_language.py by @dodecatheon in #238
• expand wrf dryrun check contexts of simlink is updated by @rfbgo in #237
• Reduce prints to screen by @dapomeroy in #235
• Update error message for vector length mismatch by @douglasjacobsen in #239
• Ignore an irrelevant warning when using an undefined subdir by @douglasjacobsen in #241
• Make it so licenses are sourced from a shared file by @rfbgo in #242
• Update spack installation path documentation by @douglasjacobsen in #246
• Add support for phase selections by @douglasjacobsen in #244
• Clean up context attribute definitions by @dapomeroy in #243
• Eliminate duplicate prints from 'workspace info' by @dapomeroy in #248
• Fix a caching issue that avoided installing all environments by @douglasjacobsen in #249
• Replace spack_env with env_path by @douglasjacobsen in #250
• Add documentation around configuration scope merging by @douglasjacobsen in #247
• Add support for prefix on spack commands by @douglasjacobsen in #245
• Fix matrix handling by @douglasjacobsen in #251
• Allow compilers to be found before trying to install by @douglasjacobsen in #252
• udpate self.exe to self.spack by @rfbgo in #253
• Fix a typo in the name of concretizer by @douglasjacobsen in #254
• Add a prepare_analysis phase / hook to modifiers and applications by @douglasjacobsen in #256
• Update vendored cray platform definition by @douglasjacobsen in #255
• Fix a variable name issue in the modifier language by @douglasjacobsen in #259
• Fix WRF FOM time calculation by @rfbgo in #260
• Redirect prints from Spack to log file by @dapomeroy in #257
• Add command-line control over workspace actions by @douglasjacobsen in #258
• Re-order logger creation to avoid recusrive limit by @douglasjacobsen in #261
• Add load/unload of APS to the APS modifier by @douglasjacobsen in #263
• Add explicit support for deprecated ast.Str by @douglasjacobsen in #262
• Add FOM definition for top MPI functions for intel-aps by @douglasjacobsen in #264
• Fix typo in pipeline.py by @dodecatheon in #265
• Update the openfoam definition to fix the motorbike workload by @douglasjacobsen in #266
• Fix output spacing during setup error check by @rfbgo in #267
• Allow fom_name and fom_context in success criteria to be variables by @douglasjacobsen in #268
• Add directives for defining phases and their order by @douglasjacobsen in #269
• Make license env vars safer by @rfbgo in #272
• Add default mode capability to modifiers by @dapomeroy in #273
• Add 'Running an Experiment' tutorial to docs by @dapomeroy in #270
• Add a typos config file to override incorrect typos by @douglasjacobsen in #275
• Add HNS-REAXFF workload to LAMMPS by @douglasjacobsen in #276
• Add debug info to docs, and docs link to readme by @douglasjacobsen in #277
• Prevent success if no application FOMs are detected by @douglasjacobsen in #278
• Add a spack-stack application definition by @douglasjacobsen in #279
• Implement a custom format parser by @douglasjacobsen in #271
• clean magic string out of pipeline enum by @rfbgo in #280
• Update schema validation error message by @dapomeroy in #282
• simlink log files to allow for known latest path by @rfbgo in #281
• Clean out unneeded caching in spack runner by @rfbgo in #285
• Remap hypen based args to underscore named functions by @rfbgo in #286
• Add simple prototype of functionality to push to spack caches by @rfbgo in #274
• Fix issue where ramble clean -a could leave us in a bad state by @rfbgo in #287
• Fix an invalid lookup where spack variables are None by @douglasjacobsen in #288
• Update help message for 'ramble results' by @dapomeroy in #289
• Increase probability ramble will continue in broken workspace by @rfbgo in #290
• Update chained experiment documentation by @dapomeroy in #291
• Update the gromacs tutorial content by @douglasjacobsen in #292
• Allow all language features to be class methods by @douglasjacobsen in #284
• Cleanup application developers guide by @douglasjacobsen in #293
• Add documentation around ramble info by @douglasjacobsen in #294
• Add config option to disable passthrough by @dapomeroy in #295
• Allow modifiers to specify required variables by @rfbgo in #297
• Allow the setup pipeline to skip/fail workspace inventory generation by @rfbgo in #298
• Allow spack compiler find to have flags by @douglasjacobsen in #303
• Add a custom logger to ramble by @douglasjacobsen in #296
• Define variables from modifiers before rendering templates by @douglasjacobsen in #304
• Add a more robust success criteria for the spack-stack application by @douglasjacobsen in #305
• Enhance error messages for spack commands by @douglasjacobsen in #306
• Fix nested compiler install by @douglasjacobsen in #302
• update hashes on hmmer to match current release by @rfbgo in #299
• Add missing import in spack-stack app definition by @douglasjacobsen in #312
• Add a hello world tutorial by @douglasjacobsen in #313
• Disable color characters in log files by @douglasjacobsen in #311
• Make analyze always print result file to screen by @rfbgo in #315
• Fixup IMB to be more configurable by @rfbgo in #316
• Add a tutorial about modifying existing experiments by @douglasjacobsen in #314
• Add psm3 modifier by @rfbgo in #319
• Add two new tutorials by @douglasjacobsen in #318
• Make intel-mpi-benchmarks prefer inbuilt IMP-MPI1 over intel-oneapi-mpis by @rfbgo in #320
• Define zips as a config section by @douglasjacobsen in #323
• Stop using "shm:tcp" as it is no longer supported by @rohitramu in #322
• Add a tutorial for creating experiments from scratch by @douglasjacobsen in #321
• Tutorials for zips, matrices, variable expansion and indirection, and software stack parameterization by @douglasjacobsen in #324
• Convert GCP modifier to executable_modifier format and collect all ids by @rfbgo in #325
• Add three tutorials and cleanup tutorial content by @douglasjacobsen in #326
• Change lulesh to use gcc over icc to be more consistent by @rfbgo in #329
• Update intel-hpl to consume the compiler it defines by @rfbgo in #328
• Remove pmi as an openmpi dep as it is not needed (and sometimes invalid) by @rfbgo in #331
• Allow workspace archive to track spack.lock files as well by @douglasjacobsen in #330
• Fix error introduced where workspace_name is not passed to context by @rfbgo in #333
• Allow custom executables to be injected relative to other executables by @douglasjacobsen in #327
• Add hash and inventory files to archives by @douglasjacobsen in #337
• Bump QE gcc 12->13 to avoid compile error by @rfbgo in #334
• Allow empty spack environments when constructing hash by @douglasjacobsen in #336
• Add experiment_index as a defined variable by @douglasjacobsen in #338
• Revise tutorial content after working through all of them by @douglasjacobsen in #335
• Fix typos by @szepeviktor in #340
• Fix typos in var/ by @szepeviktor in #344
• Prevent expander from searching across new lines by @douglasjacobsen in #341
• Fix expander removing leading zeros by @douglasjacobsen in #345
• Update redirection in WRF applications by @douglasjacobsen in #346
• Redirect GROMACS stderr to experiment log file by @douglasjacobsen in #342
• Add backported AST logic to prevent stripping zeros by @douglasjacobsen in #348
• Application Definition Fixes by @rfbgo in #347
• Add a modifier to print when experiments begin by @douglasjacobsen in #350
• Ensure default compiler is consistent in tutorials by @douglasjacobsen in #351
• Revert expander fixes by @douglasjacobsen in #352
• Detect when 0 rows of data would be uploaded by @rfbgo in #353
• Fix typo in zip example from tutorial 7 by @rfbgo in #354
• Fix issue when compiler is already installed by @rfbgo in #357
• Fixed regex escapes to quiet unittest warnings by @rfbgo in #358
• Convert ramble root to existing variable by @douglasjacobsen in #355
• Add description to all subparser helps by @dodecatheon in #359
• Detect undefined packages and print a useful error message by @douglasjacobsen in #362
• gromacs: add adh_dodec, change nsteps to variable by @danielahlin in #356
• Promote on to a proper pipeline by @douglasjacobsen in #363
• Expand args when calling executors by @douglasjacobsen in #365
• Add archival to log files within workspaces by @douglasjacobsen in #366
• Print figures of merit for with ramble info by @douglasjacobsen in #368
• add nvbandwidth application definition by @rfbgo in #369
• Add elk application definition by @rfbgo in #370
• Allow the user to specify archive prefix by @rfbgo in #371
• Remove $ symbol from gromacs executable def by @douglasjacobsen in #372
• Add reference to python's zip docs by @douglasjacobsen in #367
• Add expandable attribute to variable definitions by @douglasjacobsen in #373
• Ramble creates execute_experiment.tpl when a config and template are provided by @rfbgo in #376
• Allow for empty spack env by @rfbgo in #349
• Fix exclusion examples not rendering properly by @douglasjacobsen in #374
• Add ramble-python command by @douglasjacobsen in #364
• Allow fom and success criteria regular expressions to have variables by @douglasjacobsen in #377
• Prevent undefined functions from erroring string expansion by @douglasjacobsen in #378
• add divergent requirements to better support py36 by @rfbgo in #379
• Extend accepted functions in expander AST by @douglasjacobsen in #380
• Add a sleep application definition by @douglasjacobsen in #384
• Remove run_experiments from workspace.py by @douglasjacobsen in #383
• Add support for chained experiment variable inheritance by @douglasjacobsen in #385
• Add notes about expected errors by @douglasjacobsen in #382
• Add support for including and excluding secrets (licenses) from workspace archives by @douglasjacobsen in #389
• Add documentation on disable_passthrough by @dapomeroy in #381
• Change spack hash semantics to hash yaml contents by @douglasjacobsen in #388
• Allow Ramble Upload to track the calling user by @rfbgo in #386
• Define simplified namespace variables, and a simplify_str expansion function by @douglasjacobsen in #390
• Allow workspace create to create links to external directories by @douglasjacobsen in #393
• encourage compatible urllib3 version for python3.6 by @rfbgo in #394
• Fix typo urlib --> urllib by @douglasjacobsen in #395
• Allow executable scoped variable definitions by @douglasjacobsen in #392
• Update error message when non-existent input files are referenced by @douglasjacobsen in #396
• Add support for workload and experiment tagging by @douglasjacobsen in #387
• Add hashes for objects to workspace inventories by @douglasjacobsen in #397
• Promote some variables to top level keys by @douglasjacobsen in #398
• Add package_manager_requirements directive by @douglasjacobsen in #399
• update uploader to reflect RAMBLE_VARIABLES change by @rfbgo in #400
• Remove unneeded print of data when uploading by @douglasjacobsen in #401
• Add timing statistics for pipeline phases by @douglasjacobsen in #402
• Add repeated experiments with summary statistics by @dapomeroy in #375
• Add modifier_variable directive by @douglasjacobsen in #404
• Allow expansion characters to be escaped by @douglasjacobsen in #405
• Suppress printing non-actionable experiments in pipeline output by @douglasjacobsen in #406
• Allow applications to specify env vars by @rfbgo in #403
• Add modifiers for installing spack and ramble by @douglasjacobsen in #408
• Fix typos in install-spack modifier by @douglasjacobsen in #409
• Add support for formatted executable variables by @douglasjacobsen in #407
• Allow environments to have empty entries in packages by @douglasjacobsen in #411
• Add execution-date modifier by @rfbgo in #410
• Allow ramble to read from the config to specify shell inside scripts by @rfbgo in #412
• Ensure null context is first in results by @dapomeroy in #414
• Update Variables schema to an object not an array by @rfbgo in #413
• Allow flags on spack env create by @douglasjacobsen in #417
• Update license headers to 2024 year by @douglasjacobsen in #418
• Update to version v0.4.0 by @douglasjacobsen in #420
• Merge develop into main for v0.4.0 release by @douglasjacobsen in #421

New Contributors

• @vsoch made their first contribution in #160
• @dapomeroy made their first contribution in #228
• @rohitramu made their first contribution in #322
• @szepeviktor made their first contribution in #340
• @danielahlin made their first contribution in #356

Full Changelog: v0.3.0...v0.4.0