Skip to content

Commit

Permalink
FIx not enough steps being run (#515)
Browse files Browse the repository at this point in the history
* Run all builtin tests as integration tests

* Fix bitwise infer value bug

* Allow checking for failures

* Update blake test

* Fix checkUsedCells bug

* Update blake test
  • Loading branch information
har777 committed Jul 10, 2024
1 parent dc4ae3b commit c740c91
Show file tree
Hide file tree
Showing 3 changed files with 112 additions and 50 deletions.
94 changes: 47 additions & 47 deletions integration_tests/BenchMarks.txt
Original file line number Diff line number Diff line change
@@ -1,97 +1,97 @@
===========================================================================================================================
| File | PythonVM (ms) | GoVM (ms) |
===========================================================================================================================
| uint256_unsigned_div_rem.small.cairo | 872 | 106 |
| cmp.small.cairo | 902 | 106 |
---------------------------------------------------------------------------------------------------------------------------
| unsafe_keccak_finalize.small.cairo | 659 | 103 |
| dict_squash.small.cairo | 783 | 107 |
---------------------------------------------------------------------------------------------------------------------------
| keccak_test.starknet_with_keccak.cairo| 1304 | 107 |
| ec.small.cairo | 4479 | 158 |
---------------------------------------------------------------------------------------------------------------------------
| assert_not_zero.cairo | 678 | 109 |
| import_secp256R1P.small.cairo | 610 | 103 |
---------------------------------------------------------------------------------------------------------------------------
| dict_squash.small.cairo | 1965 | 273 |
| is_positive.small.cairo | 733 | 114 |
---------------------------------------------------------------------------------------------------------------------------
| split64.small.cairo | 944 | 107 |
| signed_div_rem.small.cairo | 701 | 105 |
---------------------------------------------------------------------------------------------------------------------------
| split_felt.small.cairo | 890 | 104 |
| uint256_add.small.cairo | 720 | 105 |
---------------------------------------------------------------------------------------------------------------------------
| cmp.small.cairo | 1150 | 111 |
| blake.starknet_with_keccak.cairo | 46788 | 482 |
---------------------------------------------------------------------------------------------------------------------------
| memcpy.cairo | 615 | 105 |
| pedersen_test.small.cairo | 625 | 103 |
---------------------------------------------------------------------------------------------------------------------------
| factorial.cairo | 1041 | 105 |
| pow.small.cairo | 712 | 105 |
---------------------------------------------------------------------------------------------------------------------------
| search_sorted_lower.small.cairo | 760 | 109 |
| verify_ecdsa_signature.small.cairo | 754 | 103 |
---------------------------------------------------------------------------------------------------------------------------
| uint256_signedNN.small.cairo | 863 | 108 |
| memset.cairo | 682 | 104 |
---------------------------------------------------------------------------------------------------------------------------
| fib.cairo | 666 | 103 |
| split64.small.cairo | 812 | 105 |
---------------------------------------------------------------------------------------------------------------------------
| assert_250_bits.small.cairo | 915 | 129 |
| uint256_sqrt.small.cairo | 923 | 108 |
---------------------------------------------------------------------------------------------------------------------------
| ec.small.cairo | 5145 | 159 |
| assert_250_bits.small.cairo | 969 | 103 |
---------------------------------------------------------------------------------------------------------------------------
| get_point_from_x.small.cairo | 869 | 109 |
| is_quad_residue.small.cairo | 793 | 123 |
---------------------------------------------------------------------------------------------------------------------------
| pow.small.cairo | 787 | 106 |
| reduce_v1.small.cairo | 824 | 106 |
---------------------------------------------------------------------------------------------------------------------------
| assert_not_equal.cairo | 783 | 105 |
| set_add.small.cairo | 662 | 104 |
---------------------------------------------------------------------------------------------------------------------------
| hintrefs.cairo | 671 | 105 |
| split_felt.small.cairo | 812 | 106 |
---------------------------------------------------------------------------------------------------------------------------
| import_secp256R1P.small.cairo | 697 | 106 |
| uint256_mul_div_mod.small.cairo | 916 | 108 |
---------------------------------------------------------------------------------------------------------------------------
| sqrt.small.cairo | 806 | 108 |
| poseidon_test.starknet_with_keccak.cairo| 1315 | 107 |
---------------------------------------------------------------------------------------------------------------------------
| verify_ecdsa_signature.small.cairo | 937 | 108 |
| div_mod_n.small.cairo | 942 | 111 |
---------------------------------------------------------------------------------------------------------------------------
| verify_zero.small.cairo | 801 | 105 |
| assert_not_zero.cairo | 666 | 105 |
---------------------------------------------------------------------------------------------------------------------------
| ecdsa_test.starknet_with_keccak.cairo | 1399 | 107 |
| memcpy.cairo | 631 | 103 |
---------------------------------------------------------------------------------------------------------------------------
| pedersen_test.small.cairo | 636 | 103 |
| search_sorted_lower.small.cairo | 759 | 107 |
---------------------------------------------------------------------------------------------------------------------------
| blake.starknet_with_keccak.cairo | 3863 | 136 |
| uint256_unsigned_div_rem.small.cairo | 873 | 108 |
---------------------------------------------------------------------------------------------------------------------------
| reduce_v1.small.cairo | 823 | 105 |
| unsigned_div_rem.small.cairo | 798 | 106 |
---------------------------------------------------------------------------------------------------------------------------
| uint256_add.small.cairo | 708 | 103 |
| verify_zero.small.cairo | 716 | 105 |
---------------------------------------------------------------------------------------------------------------------------
| uint256_sqrt.small.cairo | 929 | 108 |
| fib.cairo | 651 | 103 |
---------------------------------------------------------------------------------------------------------------------------
| poseidon_test.starknet_with_keccak.cairo| 1260 | 146 |
| assert_not_equal.cairo | 638 | 102 |
---------------------------------------------------------------------------------------------------------------------------
| dict.cairo | 1876 | 109 |
| keccak_test.starknet_with_keccak.cairo| 1293 | 107 |
---------------------------------------------------------------------------------------------------------------------------
| is_positive.small.cairo | 754 | 107 |
| is_zero.small.cairo | 830 | 104 |
---------------------------------------------------------------------------------------------------------------------------
| split_int.small.cairo | 803 | 105 |
| hintrefs.cairo | 714 | 104 |
---------------------------------------------------------------------------------------------------------------------------
| uint256_mul_div_mod.small.cairo | 914 | 106 |
| unsafe_keccak.small.cairo | 707 | 105 |
---------------------------------------------------------------------------------------------------------------------------
| set_add.small.cairo | 690 | 107 |
| factorial.cairo | 1013 | 109 |
---------------------------------------------------------------------------------------------------------------------------
| unsafe_keccak.small.cairo | 698 | 104 |
| simple.cairo | 637 | 103 |
---------------------------------------------------------------------------------------------------------------------------
| unsigned_div_rem.small.cairo | 819 | 105 |
| ecdsa_test.starknet_with_keccak.cairo | 1385 | 108 |
---------------------------------------------------------------------------------------------------------------------------
| usort.small.cairo | 885 | 112 |
| get_point_from_x.small.cairo | 870 | 106 |
---------------------------------------------------------------------------------------------------------------------------
| div_mod_n.small.cairo | 1921 | 150 |
| dict.cairo | 653 | 105 |
---------------------------------------------------------------------------------------------------------------------------
| find_element.small.cairo | 889 | 106 |
| find_element.small.cairo | 774 | 105 |
---------------------------------------------------------------------------------------------------------------------------
| is_quad_residue.small.cairo | 862 | 124 |
| split_int.small.cairo | 713 | 105 |
---------------------------------------------------------------------------------------------------------------------------
| memset.cairo | 853 | 179 |
| sqrt.small.cairo | 823 | 105 |
---------------------------------------------------------------------------------------------------------------------------
| bitwise_builtin_test.starknet_with_keccak.cairo| 1293 | 108 |
| uint256_signedNN.small.cairo | 683 | 105 |
---------------------------------------------------------------------------------------------------------------------------
| alloc.cairo | 871 | 229 |
| unsafe_keccak_finalize.small.cairo | 675 | 103 |
---------------------------------------------------------------------------------------------------------------------------
| is_zero.small.cairo | 870 | 107 |
| usort.small.cairo | 740 | 106 |
---------------------------------------------------------------------------------------------------------------------------
| signed_div_rem.small.cairo | 804 | 111 |
| alloc.cairo | 715 | 596 |
---------------------------------------------------------------------------------------------------------------------------
| simple.cairo | 606 | 103 |
| bitwise_builtin_test.starknet_with_keccak.cairo| 1304 | 107 |
===========================================================================================================================
Loading

0 comments on commit c740c91

Please sign in to comment.