Permalink
Browse files

The release index now links to OPy test output.

Also:
- scripts/release.sh: remove _tmp/wild/www, not _tmp/wild.
- Fix a crash in 'scripts/count.sh opy-python-symbols' due to undefined
  variable.
  • Loading branch information...
Andy Chu
Andy Chu committed Jul 14, 2018
1 parent d9afd05 commit d83205013e910518c9396288472f1ac21cc46419
Showing with 46 additions and 16 deletions.
  1. +22 −1 doc/release-index.md
  2. +2 −1 opy/byterun/ovm.py
  3. +3 −3 scripts/count.sh
  4. +19 −11 scripts/release.sh
View
@@ -40,7 +40,7 @@ Oil Version 0.5.0
[cloc]: https://github.com/AlDanial/cloc
### Tests Results
### Oil Tests
- [Spec Tests](test/spec.wwz/). Test OSH behavior against that of existing
shells.
@@ -52,6 +52,26 @@ Oil Version 0.5.0
- [osh2oil Tests](test/osh2oil.wwz/log.txt). Test the conversion of OSH to
Oil.
#### OPy Tests
The OPy compiler is used to compile Oil, but it isn't technically part of the
release. Here is some rough evidence that it works.
- [build-oil-repo](test/opy.wwz/build-oil-repo.txt)
- [test-gold](test/opy.wwz/test-gold.txt)
- [test-oil-unit-byterun](test/opy.wwz/test-oil-unit-byterun.txt)
- [test-spec-all](test/opy.wwz/test-spec-all.txt)
Tree-shaking:
- [Symbols in Oil](test/opy.wwz/oil-symbols.txt)
- [Symbols in OPy](test/opy.wwz/opy-symbols.txt)
### Manual Tests
- [ ] Test build and install on OS X
- [ ] Test build and install on Alpine Linux
### Benchmarks
- [OSH Parser Performance](benchmarks.wwz/osh-parser/). How fast does OSH
@@ -64,6 +84,7 @@ Oil Version 0.5.0
- [OVM Build](benchmarks.wwz/ovm-build/). How long does it take for end users
to build Oil? How big is the resulting binary?
<!-- TODO:
/src/ annotated/cross-referenced source code
coverage/ code coverage in Python and C
View
@@ -443,7 +443,8 @@ def run_frame(self, frame):
do_wrap = False
if do_wrap:
# Hm there needs to be a better way of doing this?
callargs = inspect.getcallargs(func, *posargs, **namedargs)
#callargs = inspect.getcallargs(func, *posargs, **namedargs)
callargs = None
frame = self.make_frame(func.func_code, callargs)
retval = self.run_frame(frame)
else:
View
@@ -206,7 +206,7 @@ _python-symbols() {
local out_dir=$3
mkdir -p $out_dir
local out=${out_dir}/${name}.txt
local out=${out_dir}/${name}-symbols.txt
CALLGRAPH=1 $main | tee $out
@@ -216,12 +216,12 @@ _python-symbols() {
}
oil-python-symbols() {
local out_dir=${1:-_tmp/metrics/symbols}
local out_dir=${1:-_tmp/opy-test}
_python-symbols bin/oil.py oil $out_dir
}
opy-python-symbols() {
local out_dir=${1:-_tmp/metrics/symbols}
local out_dir=${1:-_tmp/opy-test}
_python-symbols bin/opy_.py opy $out_dir
}
View
@@ -20,6 +20,7 @@
# Commit files to oilshell/benchmark-data repo and sync.
# benchmarks/report.sh all
# $0 metrics
# $0 test-opy (2 minutes)
# $0 build-tree
# $0 compress
# $0 git-changelog-$VERSION
@@ -93,9 +94,10 @@ log() {
_clean-tmp-dirs() {
rm -r -f \
_tmp/{spec,wild,unit,gold,osh2oil} \
_tmp/{osh-parser,osh-runtime,vm-baseline,ovm-build,oheap} \
_tmp/{spec,unit,gold,osh2oil,wild/www} \
_tmp/metrics \
_tmp/opy-test \
_tmp/{osh-parser,osh-runtime,vm-baseline,ovm-build,oheap} \
_tmp/oil-tar-test
}
@@ -159,9 +161,13 @@ _test-release-build() {
# verification. For example we found out something about the golden checksums
# for the OPy regtest!
test-opy() {
local out=$PWD/_tmp/opy-release
local out=$PWD/_tmp/test-opy
mkdir -p $out
scripts/count.sh oil-python-symbols $out
scripts/count.sh opy-python-symbols $out
pushd opy
local step=''
@@ -171,14 +177,14 @@ test-opy() {
time ./build.sh oil-repo > $out/$step.txt 2>&1
echo $?
step='test-oil-unit-byterun'
step='test-gold'
echo "--- $step ---"
time ./test.sh oil-unit-byterun > $out/$step.txt 2>&1
time ./test.sh gold > $out/$step.txt 2>&1
echo $?
step='test-gold'
step='test-oil-unit-byterun'
echo "--- $step ---"
time ./test.sh gold > $out/$step.txt 2>&1
time ./test.sh oil-unit-byterun > $out/$step.txt 2>&1
echo $?
# Hm does this need its own table output?
@@ -524,11 +530,16 @@ compress() {
log "--- test/wild"
local out="$root/test/wild.wwz"
pushd _tmp/wild/www
time zip -r -q $out . # recursive, quiet
popd
log "--- test/opy"
local out="$root/test/opy.wwz"
pushd _tmp/test-opy
time zip -r -q $out . # recursive, quiet
popd
log "--- metrics"
local out="$root/metrics.wwz"
pushd _tmp/metrics
@@ -589,9 +600,6 @@ metrics() {
line-counts $out/line-counts
scripts/count.sh oil-python-symbols $out/symbols
scripts/count.sh opy-python-symbols $out/symbols
tree $out
}

0 comments on commit d832050

Please sign in to comment.