Skip to content

Fix and update benchmark notebooks to getml 1.5.0 #28

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 3 commits into from
Sep 13, 2024
Merged

Fix and update benchmark notebooks to getml 1.5.0 #28

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
3 commits
Select commit Hold shift + click to select a range
56feaf0
Fix deprecation warnings and update benchmark notebooks to getml 1.5.0
cyclux Sep 6, 2024
8f586f3
Updated fastprop benchmark notebooks to getml 1.5.0
cyclux Sep 12, 2024
699b3b4
Updated dependencies tsfresh + featuretools
cyclux Sep 13, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
8,401 changes: 4,377 additions & 4,024 deletions fastprop_benchmark/air_pollution_prop.ipynb
View file
Open in desktop

Large diffs are not rendered by default.

6 changes: 3 additions & 3 deletions fastprop_benchmark/comparisons/air_pollution.csv
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
,runtime,num_features,features_per_second,normalized_runtime,normalized_runtime_per_feature,mae,rmse,rsquared
getML: FastProp,0 days 00:00:08.637513,289,33.45824411134903,1.0,1.0,44.2526350869082,63.41911260454679,0.5461637964380341
featuretools,0 days 00:34:01.839960,114,0.055831995273039954,236.3921142578888,599.2664949143469,43.91507134716814,62.56717509580391,0.5593690691075496
tsfresh,0 days 00:01:30.572946,72,0.7949390997155709,10.485998226572857,42.089065845824415,47.11059400765295,66.59998183642728,0.5015240507138585
getML: FastProp,0 days 00:00:13.433118,289,21.514167079021536,1.0,1.0,44.25020198393413,63.41678046742225,0.5461908346025002
featuretools,0 days 00:35:42.350566,114,0.05321257909185177,159.4827474901955,404.30603902669907,43.91507134716814,62.56717509580391,0.5593690691075496
tsfresh,0 days 00:01:21.479423,72,0.8836584165371371,6.065562961629608,24.34670080247843,47.11059400765295,66.59998183642728,0.5015240507138585
6 changes: 3 additions & 3 deletions fastprop_benchmark/comparisons/dodgers.csv
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
,runtime,num_features,features_per_second,normalized_runtime,normalized_runtime_per_feature,rsquared,rmse,mae
getML: FastProp,0 days 00:00:09.406415,526,55.9190292456523,1.0,1.0,0.674739861410577,7.824273388224941,5.615137721839041
featuretools,0 days 00:09:19.754041,59,0.10540343322170759,59.50769139996481,530.523793546944,0.6497682308113026,8.500887091670293,6.08627656339764
tsfresh,0 days 00:00:46.115063,12,0.2602186565327113,4.902512062246881,214.8924677067606,0.5778110797835911,8.913407825293008,6.788610043264059
getML: FastProp,0 days 00:00:12.106112,526,43.449923962633065,1.0,1.0,0.674740264167421,7.824265418275141,5.615102199203448
featuretools,0 days 00:08:51.202688,59,0.11106871988302243,43.87888431892915,391.1985661525092,0.6497682308113026,8.500887091670293,6.08627656339764
tsfresh,0 days 00:00:31.919755,12,0.37594267626072375,2.636664438591019,115.5759287421247,0.5778110797835911,8.913407825293008,6.788610043264059
4 changes: 2 additions & 2 deletions fastprop_benchmark/comparisons/interstate94.csv
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,3 +1,3 @@
,runtime,num_features,features_per_second,normalized_runtime,normalized_runtime_per_feature,rsquared,rmse,mae
getML: FastProp,0 days 00:00:03.963151,461,116.31964638827498,1.0,1.0,0.9826778318692238,261.9388731680907,180.4867341518402
featuretools,0 days 00:04:46.446138,59,0.205972417409695,72.2773717176055,564.7340932883563,0.9745821357660296,317.51997565190663,210.1987933667501
getML: FastProp,0 days 00:00:04.806504,461,95.9140610013428,1.0,1.0,0.9826778318692238,261.9388731680907,180.4867341518402
featuretools,0 days 00:04:27.009351,59,0.22096605475273678,55.551675604555825,434.06694801457894,0.9745821357660296,317.51997565190663,210.1987933667501
6 changes: 3 additions & 3 deletions fastprop_benchmark/comparisons/occupancy.csv
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
,runtime,num_features,features_per_second,normalized_runtime,normalized_runtime_per_feature,accuracy,auc,cross_entropy
getML: FastProp,0 days 00:00:01.918944,289,150.6024096385542,1.0,1.0,0.9888233849177106,0.9981658593326046,0.044271389667191616
featuretools,0 days 00:08:02.660716,103,0.21340043781233822,251.52412785365283,705.7268072289156,0.9885777450257922,0.9972594581153477,0.0500798548174994
tsfresh,0 days 00:00:20.578092,60,2.915723915933848,10.723654259842913,51.651807228915665,0.9877180054040776,0.9978609436533588,0.049358601666829864
getML: FastProp,0 days 00:00:01.825967,289,158.27793605571384,1.0,1.0,0.9888233849177106,0.9981659495576908,0.044212831751311917
featuretools,0 days 00:07:20.110459,103,0.234032161167652,241.0287036950832,676.3084836973726,0.988454925079833,0.9972073080154513,0.04923589235646241
tsfresh,0 days 00:00:14.295312,60,4.197183689744182,7.828899426988549,37.7105096549541,0.9877180054040776,0.9978609436533588,0.04935860166671465
6 changes: 3 additions & 3 deletions fastprop_benchmark/comparisons/robot.csv
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
,runtime,num_features,features_per_second,normalized_runtime,normalized_runtime_per_feature,rsquared,rmse,mae
getML: FastProp,0 days 00:00:00.278417,134,481.23195380173246,1.0,1.0,0.9950588372738192,0.7236222637718679,0.5515208330459932
featuretools,0 days 00:16:25.821720,158,0.1602723861256683,3540.8100798442624,3002.588065447546,0.9947913268168053,0.7480833930239688,0.5718029095391902
tsfresh,0 days 00:00:34.619104,120,3.466288610122256,124.34263712345151,138.8320500481232,0.9938361598092297,0.7906022324089085,0.5986000367767544
getML: FastProp,0 days 00:00:00.398347,134,336.3605785401951,1.0,1.0,0.9950578985273825,0.7237156701589754,0.5516075682525006
featuretools,0 days 00:14:21.611109,158,0.18337738975122106,2162.9662304473236,1834.2532795156408,0.9947842730879888,0.7594597450557347,0.5828310842859015
tsfresh,0 days 00:00:26.638362,120,4.504788590271459,66.87225459210187,74.66733938782374,0.9938361598092297,0.7906022324089085,0.5986000367767544
Loading