-
Notifications
You must be signed in to change notification settings - Fork 362
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Update to SQLExecutor and Visualization Code Exporting #388
Commits on Nov 29, 2020
-
Lux DataFrame current_vis should be an empty list after recs are expired. Executor name for small_df and very_small_df checks should be "PandasExecutor"
Configuration menu - View commit details
-
Copy full SHA for b3e1e88 - Browse repository at this point
Copy the full SHA b3e1e88View commit details -
Executor check here should look for name "PandasExecutor"
Configuration menu - View commit details
-
Copy full SHA for d774a41 - Browse repository at this point
Copy the full SHA d774a41View commit details -
Configuration menu - View commit details
-
Copy full SHA for 9747848 - Browse repository at this point
Copy the full SHA 9747848View commit details -
Configuration menu - View commit details
-
Copy full SHA for fbafb96 - Browse repository at this point
Copy the full SHA fbafb96View commit details -
Configuration menu - View commit details
-
Copy full SHA for ecfb434 - Browse repository at this point
Copy the full SHA ecfb434View commit details
Commits on Nov 30, 2020
-
Configuration menu - View commit details
-
Copy full SHA for 47ece2b - Browse repository at this point
Copy the full SHA 47ece2bView commit details -
Update current_vis() to reference lux.config.executor
Configuration menu - View commit details
-
Copy full SHA for 3e68db3 - Browse repository at this point
Copy the full SHA 3e68db3View commit details
Commits on Dec 2, 2020
-
Configuration menu - View commit details
-
Copy full SHA for 3a5473e - Browse repository at this point
Copy the full SHA 3a5473eView commit details -
Configuration menu - View commit details
-
Copy full SHA for 68d1600 - Browse repository at this point
Copy the full SHA 68d1600View commit details
Commits on Dec 3, 2020
-
Cleaned up executor imports, Fixed issue in AltairRenderer
Issue where Altair Renderer was not using lux.config.executor
Configuration menu - View commit details
-
Copy full SHA for b6a5e99 - Browse repository at this point
Copy the full SHA b6a5e99View commit details -
Configuration menu - View commit details
-
Copy full SHA for 9a1748c - Browse repository at this point
Copy the full SHA 9a1748cView commit details
Commits on Dec 9, 2020
-
Merged changes from Master branch, Moved Executor Parameters to Config (
#163) * Merging Recent SQL Executor changes * Fix to Validator Uses unique value metadata to verify if a value is valid * Fix Bug with Widget Rendering frame.py was trying to import luxWidget instead of luxwidget * Added Number of Observations to MetaData, Fixed Interestingness issue with SQL Executor Some interestingness functions required the number of observations in the data and visualization, so I added these values to the metadata to make the scoring work when using the SQL executor Added tests for SQL executor * Re-added Licensing Headers * Adding Recent frame.py changes * Adjusted SQL Executor Tests Removed lines that changed Year column type to datetime * Update Frame with new Action Registering * Resolving Conflicts in frame.py * Commenting out local SQL Executor tests SQL Executor tests interfering with travis build, commenting out for now * Update correlation.py * Update frame.py * bugfix: "number of remaining bars" text overcounts for colored bar charts * update number of bars calculation to account for when len(data) double counts * Fixing Code Format * Cleaning up Pandas Executor imports * Fix Validation Bug Issue where validator was relying on metadata which was not yet generated, moved metadata calculation before validation step in frame.py * Changed metadata variable name Renamed num_obs to length, removed ordinal variable from Executor mapping function * Adding support for setting intent on front end (#112) * added functionality to delete Vis * fixed deletion logic * add observer to automatically update deletions * able to refresh widget on setting intent * support for setting intent from frontend * quick fix to output * changed variable intentindex name * Make default_display a global setting (#121) * remove and register action functions * update changes inframe.py * update changes inframe.py * add documentation and changes * indentation and comments * new line * globally defined default display works with warning * no examples * add back space * new line * uncomment docstring Co-authored-by: Caitlyn Chen <caitlynachen@berkeley.edu> * Added script to generate Postgresql database Updated travis.yml file to create postgresql database in test instance. Added script to populate test database with data. * Update upload_car_data.py Updated database credentials * Updated script name in travis.yml * Removed unnecessary import from travis.yml * Added psycopg2 to requirements.txt * Creating Postgres test database in travis * Fixed directory issue * Updated SQL Executor Tests Added tests for basic SQL Executor functionality. * Update requirements.txt (#128) * basic scatterplot experiments * experiment results with manually binned heatmaps * experiment result * incorporated heatmap code into executor and renderer * additional experiments to evaluate scatter v.s. heatmap performance * experiment based on real estate and airbnb data * modified general sampling criteria, suppress SettingWithCopyWarning stemming from groupby .agg (#93) * decrease sampling parameter * change sampling strategy (above threshold keep 3/4 of data) * remove experiment dir * modified performance param * enforce lux-widget minimum version * update requirement.txt * separate dev and install requirements * replaced _exportedVisIdxs --> _selectedVisIdxs * bugfix: plot config error when current_vis is None * Added sql_executor example notebook, minor bug fix Added an example notebook to showcase how to use the sql-engine. Fixed variable reference in interestingness.py that was causing issues. * Add LuxSeries Implementation (#122) * add preliminary groupby fixes * preliminary LuxSeries implementation * add tests for new Series implementation * clean up the added code * minor code changes * fix issues with Vis with index * small fixes * remove comments * bugfix column group display empty Vis involving groupby index * bugfix Cylinders not showing up as bar charts Co-authored-by: Doris Lee <dorisjunglinlee@gmail.com> * add black to travis (#127) * add black to travis * reformat all code and adjust test * remove .idea * fix contributing doc * small change in contributing * update * reformat, update command to fix version * remove dev dependencies * fix doc failing from black format * Cleaned SQL Executor Example Notebook restarted kernel and cleared output * Update custom action reference to executor Now uses executor tied to the dataframe for execution * Updated Interestingness Tests (#133) * add black * update cars dataset and tests * Delete old dataset * Updated Interestingness Tests Updated tests to use the newly updated cars dataset * switch to local cars reference Co-authored-by: Kunal Agarwal <kagarwal2@berkeley.edu> Co-authored-by: Kunal Agarwal <32151899+westernguy2@users.noreply.github.com> Co-authored-by: 19thyneb <thyne.boonmark@gmail.com> Co-authored-by: Doris Lee <dorisjunglinlee@gmail.com> * fix broken link in docs * Updated Tests, Added benchmarking for SQL Executor Updated Compiler and Interestingness tests to work for SQL executor. Updated SQL Executor to have some benchmarking code for tracking query performance. * Merge with upstream branch, added preliminary benchmarking code * Better warning message for Vis and VisList (#135) * added functionality to delete Vis * fixed deletion logic * add observer to automatically update deletions * able to refresh widget on setting intent * support for setting intent from frontend * quick fix to output * changed variable intentindex name * added better error msg for > 1 intent for vis * reverting some changes * adding warning message for Vis intents being > 1 * passes tests and intent < 3 * minor change to error message, added test * run black * accounted for more edge cases and hid traceback * fixed typo * added tests * format w/ black * ran black again * Update Vis.py minor readability changes Co-authored-by: Doris Lee <dorisjunglinlee@gmail.com> * Pandas rewrite Performance optimizations (#136) * basic scatterplot experiments * experiment results with manually binned heatmaps * experiment result * incorporated heatmap code into executor and renderer * additional experiments to evaluate scatter v.s. heatmap performance * experiment based on real estate and airbnb data * modified general sampling criteria, suppress SettingWithCopyWarning stemming from groupby .agg (#93) * decrease sampling parameter * change sampling strategy (above threshold keep 3/4 of data) * remove experiment dir * modified performance param * enforce lux-widget minimum version * update requirement.txt * testing out modin (Recursion error) * create modin executor, all else in sync with master changes * rewrote .loc with column reference, speed up by 100x * replace agg("count") with .count() --> ~0.1ms speedup * run black * Added 2D Binning functionality to SQL Executor added 2D binning to replace scatterplots when using SQL executor. * Update README.md update slack link * Updated temporal detection and tests (#139) * Updated temporal detection and tests * Reformatted code with black * Update PandasExecutor.py * added stock date test Co-authored-by: Doris Lee <dorisjunglinlee@gmail.com> * Fix Inline comments breaking to new lines (#137) * add black to travis * reformat all code and adjust test * remove .idea * fix contributing doc * small change in contributing * update * reformat, update command to fix version * remove dev dependencies * first pass -- inline comments * _config/config.py * delete test notebook * action * line length 105 * executor * interestingness * processor * vislib * tests, travis, CONTRIBUTING * .format () changed * replace tabs with escape chars * update using black * more rewrites and merges into single line Co-authored-by: Doris Lee <dorisjunglinlee@gmail.com> * Improve warning message when values specified as attributes (#143) * Improve warning message when values specified as attributes (#142) * added test, ran black * bugfix test * Better warning message for Vis and VisList (#146) * added functionality to delete Vis * fixed deletion logic * add observer to automatically update deletions * able to refresh widget on setting intent * support for setting intent from frontend * quick fix to output * changed variable intentindex name * added better error msg for > 1 intent for vis * reverting some changes * adding warning message for Vis intents being > 1 * passes tests and intent < 3 * minor change to error message, added test * run black * accounted for more edge cases and hid traceback * fixed typo * added tests * format w/ black * ran black again * Update Vis.py minor readability changes * added check and tests for Vis list and | syntax * ran black Co-authored-by: Doris Lee <dorisjunglinlee@gmail.com> * Updated docs for JupyterLab (#148) * added functionality to delete Vis * fixed deletion logic * add observer to automatically update deletions * able to refresh widget on setting intent * support for setting intent from frontend * quick fix to output * changed variable intentindex name * added better error msg for > 1 intent for vis * reverting some changes * updated install and faq * added install_lab.sh script * Global shared variable in test (#144) (#149) * using global shared variable in test (#144) * modified fixture scope as session, resolved dependency test cases * run black Co-authored-by: Doris Lee <dorisjunglinlee@gmail.com> * Updated 2D Binning Functionality Interestingness function now compatible with 2D binning with SQL Executor. Fixed issue where some datapoints in heatmap data were of string type instead of integer. * documentation for custom actions (#134) * documentation for custom actions * fix config tests * fix documentaion links * Add default display Config Class documentation * delete hpi * doc resolved changes Co-authored-by: Caitlyn Chen <caitlynachen@berkeley.edu> Co-authored-by: Doris Lee <dorisjunglinlee@gmail.com> * Patch failing test (#134) * Patch failing test (#134) * Patch failing test (#134) * Added Heatmap generation to SQL Executor, Bug fix in PandasExecutor Added 2D Binning function to collect data for heatmaps in the SQL Executor and updated compiler test to reflect heatmap changes in SQL Executor Fixed issue within PandasExecutor where 2D binning function would not color heatmap using temporal variables * Updated Code Formatting with Black * Update Requirements to include psycopg2 * Update upload_car_data.py Updated to use newest car.csv file * Update Compiler tests to use correct test DB * Removed Benchmarking Code * Fixing Black Formatting * Add Toggle button for LuxSeries (#153) * add black * add groupby to history * add LuxSeries visualization implementation * remove groupby extending * run black * merge master into branch * run black * Reformat Warnings Labels (#151) * add format for warnings * fix small details * globally defined lux * fix formatting * Delete similarity.py * Rename similarity_old.py to similarity.py * fix commit * update master with changes to warning labels * fix formatting Co-authored-by: Caitlyn Chen <caitlynachen@berkeley.edu> * Make plot_config a global variable (#152) * plot_config made global config * docs and tests updates; black formatting * Delete Untitled.ipynb * cleanup * remove data encapsulation * black formatting * Update style.rst Co-authored-by: Doris Lee <dorisjunglinlee@gmail.com> * Patch documentation (#134) * code cleanup * making LuxDataFrame pickle-able * various simplification and rewrite to Compiler and Vis * changing `render_VSpec` to `to_code` * bugfix in filter (list comprehension lazily evaluated) * Moved Executor Parameters to Global Config * Black formatting * Fix issue with read_json and add tests for different file types (#156) * fix read_json bug and add tests * convert tests to reference lux-datasets * run black * remove comments * Update __init__.py * Update test_pandas_coverage.py new_df --> df * fix tests to work with lux-datasets * fix init * remove lxml dependency * remove html test Co-authored-by: Doris Lee <dorisjunglinlee@gmail.com> * Improved warning message stack trace for unexpected error (#145) * Moved table_name parameter to frame.py. Removed executor_type parameter executor_type parameter no longer necessary to maintain * Fixed reference to table_name parameter table_name is now a parameter within frame.py * bug fix patching #146 (#159) * remove sys.tracebacklimit to avoid `ERROR:root:Internal Python error in the inspect module` * changed SyntaxError to TypeError to reserved SyntaxError for Pandas native syntax problems * Ensure that recommendation and current_vis properties are accessible before df first printed (#159) * bugfix erased `name` dtype in LuxSeries (#140) * Adjusted Functions to Set SQL Connection Moved set_SQL_connection function to config. Added set_SQL_table function within frame.py to let users specify which database table will be associated with their dataframe * Update Makefile and pyproject.toml (#160) * add black to travis * reformat all code and adjust test * remove .idea * fix contributing doc * small change in contributing * update * reformat, update command to fix version * remove dev dependencies * first pass -- inline comments * _config/config.py * delete test notebook * action * line length 105 * executor * interestingness * processor * vislib * tests, travis, CONTRIBUTING * .format () changed * replace tabs with escape chars * update using black * more rewrites and merges into single line * update pyproject.toml and makefile * updating contributing doc * Update CONTRIBUTING.md Co-authored-by: Doris Lee <dorisjunglinlee@gmail.com> * Update README.md * Update SQLExecutor name parameter * Merging master branch with sql engine. Moving executor parameters to config * Parameter Bug Fix Lux DataFrame current_vis should be an empty list after recs are expired. Executor name for small_df and very_small_df checks should be "PandasExecutor" * Reference Fix in Warning Executor check here should look for name "PandasExecutor" * Black Formatting * Black formatting * Cleaned up executor imports, Fixed issue in AltairRenderer Issue where Altair Renderer was not using lux.config.executor * Black formatting Co-authored-by: 19thyneb <thyne.boonmark@gmail.com> Co-authored-by: Doris Lee <dorisjunglinlee@gmail.com> Co-authored-by: cjachekang <47467363+cjachekang@users.noreply.github.com> Co-authored-by: Caitlyn Chen <caitlynachen@gmail.com> Co-authored-by: Caitlyn Chen <caitlynachen@berkeley.edu> Co-authored-by: Kunal Agarwal <32151899+westernguy2@users.noreply.github.com> Co-authored-by: jinimukh <46768380+jinimukh@users.noreply.github.com> Co-authored-by: Kunal Agarwal <kagarwal2@berkeley.edu> Co-authored-by: Jared Zhao <jaredzhao@berkeley.edu> Co-authored-by: Piyush Gupta <piyushg9794@gmail.com>
Configuration menu - View commit details
-
Copy full SHA for 77a390d - Browse repository at this point
Copy the full SHA 77a390dView commit details
Commits on Dec 20, 2020
-
Configuration menu - View commit details
-
Copy full SHA for cb22f5c - Browse repository at this point
Copy the full SHA cb22f5cView commit details -
Fixed Index Issue in Pandas Executor
Issue caused when user sets an index. The Pandas Executor was not correctly renaming this new index column to Record in execute_aggregate()
Configuration menu - View commit details
-
Copy full SHA for 5223a11 - Browse repository at this point
Copy the full SHA 5223a11View commit details
Commits on Dec 21, 2020
-
Configuration menu - View commit details
-
Copy full SHA for ad89594 - Browse repository at this point
Copy the full SHA ad89594View commit details -
Configuration menu - View commit details
-
Copy full SHA for 4718c05 - Browse repository at this point
Copy the full SHA 4718c05View commit details
Commits on Dec 22, 2020
-
Configuration menu - View commit details
-
Copy full SHA for 2a7d4b2 - Browse repository at this point
Copy the full SHA 2a7d4b2View commit details -
Update Pandas Executor to handle NA values
Readded missing dropna parameter within execute_aggregate() groupby function call
Configuration menu - View commit details
-
Copy full SHA for 269c062 - Browse repository at this point
Copy the full SHA 269c062View commit details
Commits on Dec 27, 2020
-
Configuration menu - View commit details
-
Copy full SHA for 79b381a - Browse repository at this point
Copy the full SHA 79b381aView commit details -
Update to Config, and Compiler/Interestingness Tests
Removed duplicate set_SQL_connection function from config. Updated tests to reflect these changes. Merged in recent changes in master branch.
Configuration menu - View commit details
-
Copy full SHA for fd93cd4 - Browse repository at this point
Copy the full SHA fd93cd4View commit details -
Configuration menu - View commit details
-
Copy full SHA for 7324e29 - Browse repository at this point
Copy the full SHA 7324e29View commit details -
Configuration menu - View commit details
-
Copy full SHA for 674d828 - Browse repository at this point
Copy the full SHA 674d828View commit details -
Updated to include numpy version requirement
Configuration menu - View commit details
-
Copy full SHA for 2931442 - Browse repository at this point
Copy the full SHA 2931442View commit details
Commits on Dec 28, 2020
-
* Merging Recent SQL Executor changes * Fix to Validator Uses unique value metadata to verify if a value is valid * Fix Bug with Widget Rendering frame.py was trying to import luxWidget instead of luxwidget * Added Number of Observations to MetaData, Fixed Interestingness issue with SQL Executor Some interestingness functions required the number of observations in the data and visualization, so I added these values to the metadata to make the scoring work when using the SQL executor Added tests for SQL executor * Re-added Licensing Headers * Adding Recent frame.py changes * Adjusted SQL Executor Tests Removed lines that changed Year column type to datetime * Update Frame with new Action Registering * Resolving Conflicts in frame.py * Commenting out local SQL Executor tests SQL Executor tests interfering with travis build, commenting out for now * Update correlation.py * Update frame.py * bugfix: "number of remaining bars" text overcounts for colored bar charts * update number of bars calculation to account for when len(data) double counts * Fixing Code Format * Cleaning up Pandas Executor imports * Fix Validation Bug Issue where validator was relying on metadata which was not yet generated, moved metadata calculation before validation step in frame.py * Changed metadata variable name Renamed num_obs to length, removed ordinal variable from Executor mapping function * Adding support for setting intent on front end (#112) * added functionality to delete Vis * fixed deletion logic * add observer to automatically update deletions * able to refresh widget on setting intent * support for setting intent from frontend * quick fix to output * changed variable intentindex name * Make default_display a global setting (#121) * remove and register action functions * update changes inframe.py * update changes inframe.py * add documentation and changes * indentation and comments * new line * globally defined default display works with warning * no examples * add back space * new line * uncomment docstring Co-authored-by: Caitlyn Chen <caitlynachen@berkeley.edu> * Added script to generate Postgresql database Updated travis.yml file to create postgresql database in test instance. Added script to populate test database with data. * Update upload_car_data.py Updated database credentials * Updated script name in travis.yml * Removed unnecessary import from travis.yml * Added psycopg2 to requirements.txt * Creating Postgres test database in travis * Fixed directory issue * Updated SQL Executor Tests Added tests for basic SQL Executor functionality. * Update requirements.txt (#128) * basic scatterplot experiments * experiment results with manually binned heatmaps * experiment result * incorporated heatmap code into executor and renderer * additional experiments to evaluate scatter v.s. heatmap performance * experiment based on real estate and airbnb data * modified general sampling criteria, suppress SettingWithCopyWarning stemming from groupby .agg (#93) * decrease sampling parameter * change sampling strategy (above threshold keep 3/4 of data) * remove experiment dir * modified performance param * enforce lux-widget minimum version * update requirement.txt * separate dev and install requirements * replaced _exportedVisIdxs --> _selectedVisIdxs * bugfix: plot config error when current_vis is None * Added sql_executor example notebook, minor bug fix Added an example notebook to showcase how to use the sql-engine. Fixed variable reference in interestingness.py that was causing issues. * Add LuxSeries Implementation (#122) * add preliminary groupby fixes * preliminary LuxSeries implementation * add tests for new Series implementation * clean up the added code * minor code changes * fix issues with Vis with index * small fixes * remove comments * bugfix column group display empty Vis involving groupby index * bugfix Cylinders not showing up as bar charts Co-authored-by: Doris Lee <dorisjunglinlee@gmail.com> * add black to travis (#127) * add black to travis * reformat all code and adjust test * remove .idea * fix contributing doc * small change in contributing * update * reformat, update command to fix version * remove dev dependencies * fix doc failing from black format * Cleaned SQL Executor Example Notebook restarted kernel and cleared output * Update custom action reference to executor Now uses executor tied to the dataframe for execution * Updated Interestingness Tests (#133) * add black * update cars dataset and tests * Delete old dataset * Updated Interestingness Tests Updated tests to use the newly updated cars dataset * switch to local cars reference Co-authored-by: Kunal Agarwal <kagarwal2@berkeley.edu> Co-authored-by: Kunal Agarwal <32151899+westernguy2@users.noreply.github.com> Co-authored-by: 19thyneb <thyne.boonmark@gmail.com> Co-authored-by: Doris Lee <dorisjunglinlee@gmail.com> * fix broken link in docs * Updated Tests, Added benchmarking for SQL Executor Updated Compiler and Interestingness tests to work for SQL executor. Updated SQL Executor to have some benchmarking code for tracking query performance. * Merge with upstream branch, added preliminary benchmarking code * Better warning message for Vis and VisList (#135) * added functionality to delete Vis * fixed deletion logic * add observer to automatically update deletions * able to refresh widget on setting intent * support for setting intent from frontend * quick fix to output * changed variable intentindex name * added better error msg for > 1 intent for vis * reverting some changes * adding warning message for Vis intents being > 1 * passes tests and intent < 3 * minor change to error message, added test * run black * accounted for more edge cases and hid traceback * fixed typo * added tests * format w/ black * ran black again * Update Vis.py minor readability changes Co-authored-by: Doris Lee <dorisjunglinlee@gmail.com> * Pandas rewrite Performance optimizations (#136) * basic scatterplot experiments * experiment results with manually binned heatmaps * experiment result * incorporated heatmap code into executor and renderer * additional experiments to evaluate scatter v.s. heatmap performance * experiment based on real estate and airbnb data * modified general sampling criteria, suppress SettingWithCopyWarning stemming from groupby .agg (#93) * decrease sampling parameter * change sampling strategy (above threshold keep 3/4 of data) * remove experiment dir * modified performance param * enforce lux-widget minimum version * update requirement.txt * testing out modin (Recursion error) * create modin executor, all else in sync with master changes * rewrote .loc with column reference, speed up by 100x * replace agg("count") with .count() --> ~0.1ms speedup * run black * Added 2D Binning functionality to SQL Executor added 2D binning to replace scatterplots when using SQL executor. * Update README.md update slack link * Updated temporal detection and tests (#139) * Updated temporal detection and tests * Reformatted code with black * Update PandasExecutor.py * added stock date test Co-authored-by: Doris Lee <dorisjunglinlee@gmail.com> * Fix Inline comments breaking to new lines (#137) * add black to travis * reformat all code and adjust test * remove .idea * fix contributing doc * small change in contributing * update * reformat, update command to fix version * remove dev dependencies * first pass -- inline comments * _config/config.py * delete test notebook * action * line length 105 * executor * interestingness * processor * vislib * tests, travis, CONTRIBUTING * .format () changed * replace tabs with escape chars * update using black * more rewrites and merges into single line Co-authored-by: Doris Lee <dorisjunglinlee@gmail.com> * Improve warning message when values specified as attributes (#143) * Improve warning message when values specified as attributes (#142) * added test, ran black * bugfix test * Better warning message for Vis and VisList (#146) * added functionality to delete Vis * fixed deletion logic * add observer to automatically update deletions * able to refresh widget on setting intent * support for setting intent from frontend * quick fix to output * changed variable intentindex name * added better error msg for > 1 intent for vis * reverting some changes * adding warning message for Vis intents being > 1 * passes tests and intent < 3 * minor change to error message, added test * run black * accounted for more edge cases and hid traceback * fixed typo * added tests * format w/ black * ran black again * Update Vis.py minor readability changes * added check and tests for Vis list and | syntax * ran black Co-authored-by: Doris Lee <dorisjunglinlee@gmail.com> * Updated docs for JupyterLab (#148) * added functionality to delete Vis * fixed deletion logic * add observer to automatically update deletions * able to refresh widget on setting intent * support for setting intent from frontend * quick fix to output * changed variable intentindex name * added better error msg for > 1 intent for vis * reverting some changes * updated install and faq * added install_lab.sh script * Global shared variable in test (#144) (#149) * using global shared variable in test (#144) * modified fixture scope as session, resolved dependency test cases * run black Co-authored-by: Doris Lee <dorisjunglinlee@gmail.com> * Updated 2D Binning Functionality Interestingness function now compatible with 2D binning with SQL Executor. Fixed issue where some datapoints in heatmap data were of string type instead of integer. * documentation for custom actions (#134) * documentation for custom actions * fix config tests * fix documentaion links * Add default display Config Class documentation * delete hpi * doc resolved changes Co-authored-by: Caitlyn Chen <caitlynachen@berkeley.edu> Co-authored-by: Doris Lee <dorisjunglinlee@gmail.com> * Patch failing test (#134) * Patch failing test (#134) * Patch failing test (#134) * Added Heatmap generation to SQL Executor, Bug fix in PandasExecutor Added 2D Binning function to collect data for heatmaps in the SQL Executor and updated compiler test to reflect heatmap changes in SQL Executor Fixed issue within PandasExecutor where 2D binning function would not color heatmap using temporal variables * Updated Code Formatting with Black * Update Requirements to include psycopg2 * Update upload_car_data.py Updated to use newest car.csv file * Update Compiler tests to use correct test DB * Removed Benchmarking Code * Fixing Black Formatting * Add Toggle button for LuxSeries (#153) * add black * add groupby to history * add LuxSeries visualization implementation * remove groupby extending * run black * merge master into branch * run black * Reformat Warnings Labels (#151) * add format for warnings * fix small details * globally defined lux * fix formatting * Delete similarity.py * Rename similarity_old.py to similarity.py * fix commit * update master with changes to warning labels * fix formatting Co-authored-by: Caitlyn Chen <caitlynachen@berkeley.edu> * Make plot_config a global variable (#152) * plot_config made global config * docs and tests updates; black formatting * Delete Untitled.ipynb * cleanup * remove data encapsulation * black formatting * Update style.rst Co-authored-by: Doris Lee <dorisjunglinlee@gmail.com> * Patch documentation (#134) * code cleanup * making LuxDataFrame pickle-able * various simplification and rewrite to Compiler and Vis * changing `render_VSpec` to `to_code` * bugfix in filter (list comprehension lazily evaluated) * Moved Executor Parameters to Global Config * Black formatting * Fix issue with read_json and add tests for different file types (#156) * fix read_json bug and add tests * convert tests to reference lux-datasets * run black * remove comments * Update __init__.py * Update test_pandas_coverage.py new_df --> df * fix tests to work with lux-datasets * fix init * remove lxml dependency * remove html test Co-authored-by: Doris Lee <dorisjunglinlee@gmail.com> * Improved warning message stack trace for unexpected error (#145) * Moved table_name parameter to frame.py. Removed executor_type parameter executor_type parameter no longer necessary to maintain * Fixed reference to table_name parameter table_name is now a parameter within frame.py * bug fix patching #146 (#159) * remove sys.tracebacklimit to avoid `ERROR:root:Internal Python error in the inspect module` * changed SyntaxError to TypeError to reserved SyntaxError for Pandas native syntax problems * Ensure that recommendation and current_vis properties are accessible before df first printed (#159) * bugfix erased `name` dtype in LuxSeries (#140) * Adjusted Functions to Set SQL Connection Moved set_SQL_connection function to config. Added set_SQL_table function within frame.py to let users specify which database table will be associated with their dataframe * Update Makefile and pyproject.toml (#160) * add black to travis * reformat all code and adjust test * remove .idea * fix contributing doc * small change in contributing * update * reformat, update command to fix version * remove dev dependencies * first pass -- inline comments * _config/config.py * delete test notebook * action * line length 105 * executor * interestingness * processor * vislib * tests, travis, CONTRIBUTING * .format () changed * replace tabs with escape chars * update using black * more rewrites and merges into single line * update pyproject.toml and makefile * updating contributing doc * Update CONTRIBUTING.md Co-authored-by: Doris Lee <dorisjunglinlee@gmail.com> * Update README.md * Update SQLExecutor name parameter * Merging master branch with sql engine. Moving executor parameters to config * Parameter Bug Fix Lux DataFrame current_vis should be an empty list after recs are expired. Executor name for small_df and very_small_df checks should be "PandasExecutor" * Reference Fix in Warning Executor check here should look for name "PandasExecutor" * Black Formatting * Black formatting * bump version number and requirements * PATCH v0.2.1.1 * remove __future__ annotations dependency * remove channel inheritance in Enhance * bugfix 3-clause Vis example in 5-datetime.ipynb * update README * Fix Executor Reference Update current_vis() to reference lux.config.executor * Update frame.py * Moved set functions to global config * Cleaned up executor imports, Fixed issue in AltairRenderer Issue where Altair Renderer was not using lux.config.executor * Black formatting * Moved Executor Parameters to Global Config (#157) * Moved Executor Parameters to Global Config * Black formatting * Moved table_name parameter to frame.py. Removed executor_type parameter executor_type parameter no longer necessary to maintain * Fixed reference to table_name parameter table_name is now a parameter within frame.py * Adjusted Functions to Set SQL Connection Moved set_SQL_connection function to config. Added set_SQL_table function within frame.py to let users specify which database table will be associated with their dataframe * Update SQLExecutor name parameter * Fix Executor Reference Update current_vis() to reference lux.config.executor * Update frame.py * Moved set functions to global config Co-authored-by: 19thyneb <thyne.boonmark@gmail.com> Co-authored-by: Doris Lee <dorisjunglinlee@gmail.com> * save_as_html feature (#170) * note this requires unpkg depedency from latest npm release (for now download https://github.com/lux-org/lux-widget/blob/master/luxwidget/nbextension/static/index.js, rename it luxwidget.js and place it in the same directory as the exported HTML) * Updating documentation for lux-widget v0.1.2 release (#176) * added functionality to delete Vis * fixed deletion logic * add observer to automatically update deletions * able to refresh widget on setting intent * support for setting intent from frontend * quick fix to output * changed variable intentindex name * added better error msg for > 1 intent for vis * reverting some changes * Updated readme * updated readthedoc documentation * added config to default display documentation * Update README.md Co-authored-by: Doris Lee <dorisjunglinlee@gmail.com> * Fix bug caused by `groupby.agg` on column with many unique values (#174) * update export tutorial to add explanation for standalone argument * minor fixes and remove cell output in notebooks * added contributing doc * fix bugs and uncomment some tests * remove raise warning * remove unnecessary import * split up rename test into two parts * fix setting warning, fix data_type bugs and add relevant tests * remove ordinal data type * add test for small dataframe resetting index * add loc and iloc tests * fix attribute access directly to dataframe * add small changes to code * added test for qcut and cut * add check if dtype is Interval * added qcut test * fix Record KeyError * add tests * take care of reset_index case * small edits * add data_model to column_group Clause * small edits for row_group * fixes to row group Co-authored-by: Doris Lee <dorisjunglinlee@gmail.com> * Update save_as_html docs (#170) * Update README *remove jupyter lab url * Update README.md fix slack link * Fixed Index Issue in Pandas Executor Issue caused when user sets an index. The Pandas Executor was not correctly renaming this new index column to Record in execute_aggregate() * Making Lux more robust with missing values and NaN (#179) (#180) * improve datetime warning message with starter templates * Handling NaN value errors * skipping validator check for NaN filter values * adding special case for PandasExecutor to map filter NaN to isna() * fixing unevenness metric when bar values are NaN * eliminate 1-cardinality filters in Filter action (since equal to overall) * fixed deviation array unequal bug when NaN * Handling NaN filter and data type * fixed data type detection when int coerced to float when containing NaN * added test for applying NaN filter * Ensure that LuxSeries displayed when there is NaN * ensure that NaNs are not dropped in groupbys * exclude NaN values in deviation calculation * fix unnamed series issue * improved debugging message for LuxSeries * Override pd.Series with LuxSeries * Fixes for type checking and line charts with NaNs * exclude NaN for line charts to prevent large axes offsetting * improved type checking for float no-longer NaN columns * fixed and improved deviation calculation test * added float categorical test * bump version and requirement * Added tests for set_index functions * Black formatting * Update Pandas Executor to handle NA values Readded missing dropna parameter within execute_aggregate() groupby function call * Update to Config, and Compiler/Interestingness Tests Removed duplicate set_SQL_connection function from config. Updated tests to reflect these changes. Merged in recent changes in master branch. * Black formatting * Update Requirements.txt Updated to include numpy version requirement Co-authored-by: 19thyneb <thyne.boonmark@gmail.com> Co-authored-by: Doris Lee <dorisjunglinlee@gmail.com> Co-authored-by: cjachekang <47467363+cjachekang@users.noreply.github.com> Co-authored-by: Caitlyn Chen <caitlynachen@gmail.com> Co-authored-by: Caitlyn Chen <caitlynachen@berkeley.edu> Co-authored-by: Kunal Agarwal <32151899+westernguy2@users.noreply.github.com> Co-authored-by: jinimukh <46768380+jinimukh@users.noreply.github.com> Co-authored-by: Kunal Agarwal <kagarwal2@berkeley.edu> Co-authored-by: Jared Zhao <jaredzhao@berkeley.edu> Co-authored-by: Piyush Gupta <piyushg9794@gmail.com>
Configuration menu - View commit details
-
Copy full SHA for 2fa2dca - Browse repository at this point
Copy the full SHA 2fa2dcaView commit details
Commits on Jan 4, 2021
-
Update SQL Executor Documentation
Updated documentation in SQLExecutor.py. Updated example notebook for SQLExecutor
Configuration menu - View commit details
-
Copy full SHA for 7cc9626 - Browse repository at this point
Copy the full SHA 7cc9626View commit details -
Updated SQLExecutor Example Notebook
Updated example notebook for the SQL Executor and the script to upload the example dataset to a local Postgres database.
Configuration menu - View commit details
-
Copy full SHA for 1d517d8 - Browse repository at this point
Copy the full SHA 1d517d8View commit details -
Configuration menu - View commit details
-
Copy full SHA for f5a358c - Browse repository at this point
Copy the full SHA f5a358cView commit details -
Configuration menu - View commit details
-
Copy full SHA for 3a27d76 - Browse repository at this point
Copy the full SHA 3a27d76View commit details -
Update to SQL Executor Example Notebook (#193)
* Merging Recent SQL Executor changes * Fix to Validator Uses unique value metadata to verify if a value is valid * Fix Bug with Widget Rendering frame.py was trying to import luxWidget instead of luxwidget * Added Number of Observations to MetaData, Fixed Interestingness issue with SQL Executor Some interestingness functions required the number of observations in the data and visualization, so I added these values to the metadata to make the scoring work when using the SQL executor Added tests for SQL executor * Re-added Licensing Headers * Adding Recent frame.py changes * Adjusted SQL Executor Tests Removed lines that changed Year column type to datetime * Update Frame with new Action Registering * Resolving Conflicts in frame.py * Commenting out local SQL Executor tests SQL Executor tests interfering with travis build, commenting out for now * Update correlation.py * Update frame.py * bugfix: "number of remaining bars" text overcounts for colored bar charts * update number of bars calculation to account for when len(data) double counts * Fixing Code Format * Cleaning up Pandas Executor imports * Fix Validation Bug Issue where validator was relying on metadata which was not yet generated, moved metadata calculation before validation step in frame.py * Changed metadata variable name Renamed num_obs to length, removed ordinal variable from Executor mapping function * Adding support for setting intent on front end (#112) * added functionality to delete Vis * fixed deletion logic * add observer to automatically update deletions * able to refresh widget on setting intent * support for setting intent from frontend * quick fix to output * changed variable intentindex name * Make default_display a global setting (#121) * remove and register action functions * update changes inframe.py * update changes inframe.py * add documentation and changes * indentation and comments * new line * globally defined default display works with warning * no examples * add back space * new line * uncomment docstring Co-authored-by: Caitlyn Chen <caitlynachen@berkeley.edu> * Added script to generate Postgresql database Updated travis.yml file to create postgresql database in test instance. Added script to populate test database with data. * Update upload_car_data.py Updated database credentials * Updated script name in travis.yml * Removed unnecessary import from travis.yml * Added psycopg2 to requirements.txt * Creating Postgres test database in travis * Fixed directory issue * Updated SQL Executor Tests Added tests for basic SQL Executor functionality. * Update requirements.txt (#128) * basic scatterplot experiments * experiment results with manually binned heatmaps * experiment result * incorporated heatmap code into executor and renderer * additional experiments to evaluate scatter v.s. heatmap performance * experiment based on real estate and airbnb data * modified general sampling criteria, suppress SettingWithCopyWarning stemming from groupby .agg (#93) * decrease sampling parameter * change sampling strategy (above threshold keep 3/4 of data) * remove experiment dir * modified performance param * enforce lux-widget minimum version * update requirement.txt * separate dev and install requirements * replaced _exportedVisIdxs --> _selectedVisIdxs * bugfix: plot config error when current_vis is None * Added sql_executor example notebook, minor bug fix Added an example notebook to showcase how to use the sql-engine. Fixed variable reference in interestingness.py that was causing issues. * Add LuxSeries Implementation (#122) * add preliminary groupby fixes * preliminary LuxSeries implementation * add tests for new Series implementation * clean up the added code * minor code changes * fix issues with Vis with index * small fixes * remove comments * bugfix column group display empty Vis involving groupby index * bugfix Cylinders not showing up as bar charts Co-authored-by: Doris Lee <dorisjunglinlee@gmail.com> * add black to travis (#127) * add black to travis * reformat all code and adjust test * remove .idea * fix contributing doc * small change in contributing * update * reformat, update command to fix version * remove dev dependencies * fix doc failing from black format * Cleaned SQL Executor Example Notebook restarted kernel and cleared output * Update custom action reference to executor Now uses executor tied to the dataframe for execution * Updated Interestingness Tests (#133) * add black * update cars dataset and tests * Delete old dataset * Updated Interestingness Tests Updated tests to use the newly updated cars dataset * switch to local cars reference Co-authored-by: Kunal Agarwal <kagarwal2@berkeley.edu> Co-authored-by: Kunal Agarwal <32151899+westernguy2@users.noreply.github.com> Co-authored-by: 19thyneb <thyne.boonmark@gmail.com> Co-authored-by: Doris Lee <dorisjunglinlee@gmail.com> * fix broken link in docs * Updated Tests, Added benchmarking for SQL Executor Updated Compiler and Interestingness tests to work for SQL executor. Updated SQL Executor to have some benchmarking code for tracking query performance. * Merge with upstream branch, added preliminary benchmarking code * Better warning message for Vis and VisList (#135) * added functionality to delete Vis * fixed deletion logic * add observer to automatically update deletions * able to refresh widget on setting intent * support for setting intent from frontend * quick fix to output * changed variable intentindex name * added better error msg for > 1 intent for vis * reverting some changes * adding warning message for Vis intents being > 1 * passes tests and intent < 3 * minor change to error message, added test * run black * accounted for more edge cases and hid traceback * fixed typo * added tests * format w/ black * ran black again * Update Vis.py minor readability changes Co-authored-by: Doris Lee <dorisjunglinlee@gmail.com> * Pandas rewrite Performance optimizations (#136) * basic scatterplot experiments * experiment results with manually binned heatmaps * experiment result * incorporated heatmap code into executor and renderer * additional experiments to evaluate scatter v.s. heatmap performance * experiment based on real estate and airbnb data * modified general sampling criteria, suppress SettingWithCopyWarning stemming from groupby .agg (#93) * decrease sampling parameter * change sampling strategy (above threshold keep 3/4 of data) * remove experiment dir * modified performance param * enforce lux-widget minimum version * update requirement.txt * testing out modin (Recursion error) * create modin executor, all else in sync with master changes * rewrote .loc with column reference, speed up by 100x * replace agg("count") with .count() --> ~0.1ms speedup * run black * Added 2D Binning functionality to SQL Executor added 2D binning to replace scatterplots when using SQL executor. * Update README.md update slack link * Updated temporal detection and tests (#139) * Updated temporal detection and tests * Reformatted code with black * Update PandasExecutor.py * added stock date test Co-authored-by: Doris Lee <dorisjunglinlee@gmail.com> * Fix Inline comments breaking to new lines (#137) * add black to travis * reformat all code and adjust test * remove .idea * fix contributing doc * small change in contributing * update * reformat, update command to fix version * remove dev dependencies * first pass -- inline comments * _config/config.py * delete test notebook * action * line length 105 * executor * interestingness * processor * vislib * tests, travis, CONTRIBUTING * .format () changed * replace tabs with escape chars * update using black * more rewrites and merges into single line Co-authored-by: Doris Lee <dorisjunglinlee@gmail.com> * Improve warning message when values specified as attributes (#143) * Improve warning message when values specified as attributes (#142) * added test, ran black * bugfix test * Better warning message for Vis and VisList (#146) * added functionality to delete Vis * fixed deletion logic * add observer to automatically update deletions * able to refresh widget on setting intent * support for setting intent from frontend * quick fix to output * changed variable intentindex name * added better error msg for > 1 intent for vis * reverting some changes * adding warning message for Vis intents being > 1 * passes tests and intent < 3 * minor change to error message, added test * run black * accounted for more edge cases and hid traceback * fixed typo * added tests * format w/ black * ran black again * Update Vis.py minor readability changes * added check and tests for Vis list and | syntax * ran black Co-authored-by: Doris Lee <dorisjunglinlee@gmail.com> * Updated docs for JupyterLab (#148) * added functionality to delete Vis * fixed deletion logic * add observer to automatically update deletions * able to refresh widget on setting intent * support for setting intent from frontend * quick fix to output * changed variable intentindex name * added better error msg for > 1 intent for vis * reverting some changes * updated install and faq * added install_lab.sh script * Global shared variable in test (#144) (#149) * using global shared variable in test (#144) * modified fixture scope as session, resolved dependency test cases * run black Co-authored-by: Doris Lee <dorisjunglinlee@gmail.com> * Updated 2D Binning Functionality Interestingness function now compatible with 2D binning with SQL Executor. Fixed issue where some datapoints in heatmap data were of string type instead of integer. * documentation for custom actions (#134) * documentation for custom actions * fix config tests * fix documentaion links * Add default display Config Class documentation * delete hpi * doc resolved changes Co-authored-by: Caitlyn Chen <caitlynachen@berkeley.edu> Co-authored-by: Doris Lee <dorisjunglinlee@gmail.com> * Patch failing test (#134) * Patch failing test (#134) * Patch failing test (#134) * Added Heatmap generation to SQL Executor, Bug fix in PandasExecutor Added 2D Binning function to collect data for heatmaps in the SQL Executor and updated compiler test to reflect heatmap changes in SQL Executor Fixed issue within PandasExecutor where 2D binning function would not color heatmap using temporal variables * Updated Code Formatting with Black * Update Requirements to include psycopg2 * Update upload_car_data.py Updated to use newest car.csv file * Update Compiler tests to use correct test DB * Removed Benchmarking Code * Fixing Black Formatting * Add Toggle button for LuxSeries (#153) * add black * add groupby to history * add LuxSeries visualization implementation * remove groupby extending * run black * merge master into branch * run black * Reformat Warnings Labels (#151) * add format for warnings * fix small details * globally defined lux * fix formatting * Delete similarity.py * Rename similarity_old.py to similarity.py * fix commit * update master with changes to warning labels * fix formatting Co-authored-by: Caitlyn Chen <caitlynachen@berkeley.edu> * Make plot_config a global variable (#152) * plot_config made global config * docs and tests updates; black formatting * Delete Untitled.ipynb * cleanup * remove data encapsulation * black formatting * Update style.rst Co-authored-by: Doris Lee <dorisjunglinlee@gmail.com> * Patch documentation (#134) * code cleanup * making LuxDataFrame pickle-able * various simplification and rewrite to Compiler and Vis * changing `render_VSpec` to `to_code` * bugfix in filter (list comprehension lazily evaluated) * Moved Executor Parameters to Global Config * Black formatting * Fix issue with read_json and add tests for different file types (#156) * fix read_json bug and add tests * convert tests to reference lux-datasets * run black * remove comments * Update __init__.py * Update test_pandas_coverage.py new_df --> df * fix tests to work with lux-datasets * fix init * remove lxml dependency * remove html test Co-authored-by: Doris Lee <dorisjunglinlee@gmail.com> * Improved warning message stack trace for unexpected error (#145) * Moved table_name parameter to frame.py. Removed executor_type parameter executor_type parameter no longer necessary to maintain * Fixed reference to table_name parameter table_name is now a parameter within frame.py * bug fix patching #146 (#159) * remove sys.tracebacklimit to avoid `ERROR:root:Internal Python error in the inspect module` * changed SyntaxError to TypeError to reserved SyntaxError for Pandas native syntax problems * Ensure that recommendation and current_vis properties are accessible before df first printed (#159) * bugfix erased `name` dtype in LuxSeries (#140) * Adjusted Functions to Set SQL Connection Moved set_SQL_connection function to config. Added set_SQL_table function within frame.py to let users specify which database table will be associated with their dataframe * Update Makefile and pyproject.toml (#160) * add black to travis * reformat all code and adjust test * remove .idea * fix contributing doc * small change in contributing * update * reformat, update command to fix version * remove dev dependencies * first pass -- inline comments * _config/config.py * delete test notebook * action * line length 105 * executor * interestingness * processor * vislib * tests, travis, CONTRIBUTING * .format () changed * replace tabs with escape chars * update using black * more rewrites and merges into single line * update pyproject.toml and makefile * updating contributing doc * Update CONTRIBUTING.md Co-authored-by: Doris Lee <dorisjunglinlee@gmail.com> * Update README.md * Update SQLExecutor name parameter * Merging master branch with sql engine. Moving executor parameters to config * Parameter Bug Fix Lux DataFrame current_vis should be an empty list after recs are expired. Executor name for small_df and very_small_df checks should be "PandasExecutor" * Reference Fix in Warning Executor check here should look for name "PandasExecutor" * Black Formatting * Black formatting * bump version number and requirements * PATCH v0.2.1.1 * remove __future__ annotations dependency * remove channel inheritance in Enhance * bugfix 3-clause Vis example in 5-datetime.ipynb * update README * Fix Executor Reference Update current_vis() to reference lux.config.executor * Update frame.py * Moved set functions to global config * Cleaned up executor imports, Fixed issue in AltairRenderer Issue where Altair Renderer was not using lux.config.executor * Black formatting * Moved Executor Parameters to Global Config (#157) * Moved Executor Parameters to Global Config * Black formatting * Moved table_name parameter to frame.py. Removed executor_type parameter executor_type parameter no longer necessary to maintain * Fixed reference to table_name parameter table_name is now a parameter within frame.py * Adjusted Functions to Set SQL Connection Moved set_SQL_connection function to config. Added set_SQL_table function within frame.py to let users specify which database table will be associated with their dataframe * Update SQLExecutor name parameter * Fix Executor Reference Update current_vis() to reference lux.config.executor * Update frame.py * Moved set functions to global config Co-authored-by: 19thyneb <thyne.boonmark@gmail.com> Co-authored-by: Doris Lee <dorisjunglinlee@gmail.com> * save_as_html feature (#170) * note this requires unpkg depedency from latest npm release (for now download https://github.com/lux-org/lux-widget/blob/master/luxwidget/nbextension/static/index.js, rename it luxwidget.js and place it in the same directory as the exported HTML) * Updating documentation for lux-widget v0.1.2 release (#176) * added functionality to delete Vis * fixed deletion logic * add observer to automatically update deletions * able to refresh widget on setting intent * support for setting intent from frontend * quick fix to output * changed variable intentindex name * added better error msg for > 1 intent for vis * reverting some changes * Updated readme * updated readthedoc documentation * added config to default display documentation * Update README.md Co-authored-by: Doris Lee <dorisjunglinlee@gmail.com> * Fix bug caused by `groupby.agg` on column with many unique values (#174) * update export tutorial to add explanation for standalone argument * minor fixes and remove cell output in notebooks * added contributing doc * fix bugs and uncomment some tests * remove raise warning * remove unnecessary import * split up rename test into two parts * fix setting warning, fix data_type bugs and add relevant tests * remove ordinal data type * add test for small dataframe resetting index * add loc and iloc tests * fix attribute access directly to dataframe * add small changes to code * added test for qcut and cut * add check if dtype is Interval * added qcut test * fix Record KeyError * add tests * take care of reset_index case * small edits * add data_model to column_group Clause * small edits for row_group * fixes to row group Co-authored-by: Doris Lee <dorisjunglinlee@gmail.com> * Update save_as_html docs (#170) * Update README *remove jupyter lab url * Update README.md fix slack link * Fixed Index Issue in Pandas Executor Issue caused when user sets an index. The Pandas Executor was not correctly renaming this new index column to Record in execute_aggregate() * Making Lux more robust with missing values and NaN (#179) (#180) * improve datetime warning message with starter templates * Handling NaN value errors * skipping validator check for NaN filter values * adding special case for PandasExecutor to map filter NaN to isna() * fixing unevenness metric when bar values are NaN * eliminate 1-cardinality filters in Filter action (since equal to overall) * fixed deviation array unequal bug when NaN * Handling NaN filter and data type * fixed data type detection when int coerced to float when containing NaN * added test for applying NaN filter * Ensure that LuxSeries displayed when there is NaN * ensure that NaNs are not dropped in groupbys * exclude NaN values in deviation calculation * fix unnamed series issue * improved debugging message for LuxSeries * Override pd.Series with LuxSeries * Fixes for type checking and line charts with NaNs * exclude NaN for line charts to prevent large axes offsetting * improved type checking for float no-longer NaN columns * fixed and improved deviation calculation test * added float categorical test * bump version and requirement * Added tests for set_index functions * Black formatting * Update Pandas Executor to handle NA values Readded missing dropna parameter within execute_aggregate() groupby function call * Update to Config, and Compiler/Interestingness Tests Removed duplicate set_SQL_connection function from config. Updated tests to reflect these changes. Merged in recent changes in master branch. * Black formatting * Update Requirements.txt Updated to include numpy version requirement * Update SQL Executor Documentation Updated documentation in SQLExecutor.py. Updated example notebook for SQLExecutor * Updated SQLExecutor Example Notebook Updated example notebook for the SQL Executor and the script to upload the example dataset to a local Postgres database. * Black Formatting Co-authored-by: 19thyneb <thyne.boonmark@gmail.com> Co-authored-by: Doris Lee <dorisjunglinlee@gmail.com> Co-authored-by: cjachekang <47467363+cjachekang@users.noreply.github.com> Co-authored-by: Caitlyn Chen <caitlynachen@gmail.com> Co-authored-by: Caitlyn Chen <caitlynachen@berkeley.edu> Co-authored-by: Kunal Agarwal <32151899+westernguy2@users.noreply.github.com> Co-authored-by: jinimukh <46768380+jinimukh@users.noreply.github.com> Co-authored-by: Kunal Agarwal <kagarwal2@berkeley.edu> Co-authored-by: Jared Zhao <jaredzhao@berkeley.edu> Co-authored-by: Piyush Gupta <piyushg9794@gmail.com>
Configuration menu - View commit details
-
Copy full SHA for d187b39 - Browse repository at this point
Copy the full SHA d187b39View commit details -
Adjusted tests to reference correct PostgreSQL table
Configuration menu - View commit details
-
Copy full SHA for 1229809 - Browse repository at this point
Copy the full SHA 1229809View commit details
Commits on Jan 5, 2021
-
Update Travis file and SQL Executor Tests
Updated the travis.yml and sql executor test scripts to refer to the correct postgres database
Configuration menu - View commit details
-
Copy full SHA for c405f67 - Browse repository at this point
Copy the full SHA c405f67View commit details -
Configuration menu - View commit details
-
Copy full SHA for 7eb665e - Browse repository at this point
Copy the full SHA 7eb665eView commit details -
Configuration menu - View commit details
-
Copy full SHA for 86a35fa - Browse repository at this point
Copy the full SHA 86a35faView commit details -
Merge branch 'Database-Executor' of https://github.com/thyneb19/lux i…
…nto Database-Executor
Configuration menu - View commit details
-
Copy full SHA for d539b83 - Browse repository at this point
Copy the full SHA d539b83View commit details -
Merge pull request #196 from thyneb19/Database-Executor
Updating SQL Executor Test Suite
Configuration menu - View commit details
-
Copy full SHA for d3819b7 - Browse repository at this point
Copy the full SHA d3819b7View commit details
Commits on Jan 7, 2021
-
Configuration menu - View commit details
-
Copy full SHA for 06a8b9c - Browse repository at this point
Copy the full SHA 06a8b9cView commit details
Commits on Jan 8, 2021
-
Configuration menu - View commit details
-
Copy full SHA for 50a36e8 - Browse repository at this point
Copy the full SHA 50a36e8View commit details -
Configuration menu - View commit details
-
Copy full SHA for 7479129 - Browse repository at this point
Copy the full SHA 7479129View commit details -
Configuration menu - View commit details
-
Copy full SHA for 3966521 - Browse repository at this point
Copy the full SHA 3966521View commit details -
Configuration menu - View commit details
-
Copy full SHA for 6d1ad6c - Browse repository at this point
Copy the full SHA 6d1ad6cView commit details -
Configuration menu - View commit details
-
Copy full SHA for 085f036 - Browse repository at this point
Copy the full SHA 085f036View commit details
Commits on Jan 9, 2021
-
Merging the master branch changes into sql-engine (#208)
* Similarity as a default action (#182) * similarity formatting fixed * added another similarity test case; fixed bug where colored heatmap dimension is temporal (invalidate all 2 msr 1 temporal case) * filter and similarity together * filter and similarity together * remove filter * black line length * file reorg and clean; change sim metric Co-authored-by: Caitlyn Chen <caitlynachen@berkeley.edu> Co-authored-by: Doris Lee <dorisjunglinlee@gmail.com> * bump numpy min version for travis * Special character issue (#184) * rename col * broken * fixed period replacement bug * add tests * refine tests * refine tests * remove cols * fix tests * add agg * fixed tests * clean up PR Co-authored-by: Caitlyn Chen <caitlynachen@berkeley.edu> Co-authored-by: Doris Lee <dorisjunglinlee@gmail.com> * Colored bar interestingness bug (#189) * rewrote chi2 contingency with pd.crosstab * catching KeyError issue with chi2 contingency * padding interestingness with warning instead of error * interestingness now reuses ndim and nmsr computed in Compiler * bug fix for parser with int values * improve Vis repr to better display inferred intent when data is absent but fully compiled intent (all clauses) * Add sampling parameters as a global config (#192) * update export tutorial to add explanation for standalone argument * minor fixes and remove cell output in notebooks * added contributing doc * fix bugs and uncomment some tests * remove raise warning * remove unnecessary import * split up rename test into two parts * fix setting warning, fix data_type bugs and add relevant tests * remove ordinal data type * add test for small dataframe resetting index * add loc and iloc tests * fix attribute access directly to dataframe * add small changes to code * added test for qcut and cut * add check if dtype is Interval * added qcut test * fix Record KeyError * add tests * take care of reset_index case * small edits * add data_model to column_group Clause * small edits for row_group * fixes to row group * add config for start and cap for samples * finish sampling config and tests * black formatting * add documentation for sampling config * remove small added issues * minor changes to docs * implement heatmap flag and add tests * black formatting and documentation edits Co-authored-by: Doris Lee <dorisjunglinlee@gmail.com> * Coalesce all data_type attributes of frame into one (#185) * coalesce data_types into data_type_lookup * black reformat * changed to better variable names * lux not defined error * fixed * black format * Update CONTRIBUTING.md * Bug Fix: User-provided Index causes KeyError in Pandas Execution (#191) * Moved Executor Parameters to Global Config * Black formatting * Moved table_name parameter to frame.py. Removed executor_type parameter executor_type parameter no longer necessary to maintain * Fixed reference to table_name parameter table_name is now a parameter within frame.py * Adjusted Functions to Set SQL Connection Moved set_SQL_connection function to config. Added set_SQL_table function within frame.py to let users specify which database table will be associated with their dataframe * Update SQLExecutor name parameter * Fix Executor Reference Update current_vis() to reference lux.config.executor * Update frame.py * Moved set functions to global config * Fixed Index Issue in Pandas Executor Issue caused when user sets an index. The Pandas Executor was not correctly renaming this new index column to Record in execute_aggregate() * Added tests for set_index functions * Black formatting * Update Pandas Executor to handle NA values Readded missing dropna parameter within execute_aggregate() groupby function call * Updated Pandas Coverage Tests Commented out set_index case which has not been addressed yet * Black Formatting * Update to Pandas Executor Index Handling Cleaned up how execute_aggregrate renames index columns. Now retrieves the index name from vis.data instead of filtering out non-index columns. Created separate test function for when user specifies an index in read_csv. Co-authored-by: 19thyneb <thyne.boonmark@gmail.com> Co-authored-by: Doris Lee <dorisjunglinlee@gmail.com> * Initialize Config once only during __init__ (#194) * basic matplotlib chart example * migrate register default action to init * config class * move actions * fixed tests * changes * alright * fix plot_config * black reformat * black reformat Co-authored-by: Doris Lee <dorisjunglinlee@gmail.com> Co-authored-by: Caitlyn Chen <caitlynachen@berkeley.edu> Co-authored-by: Ujjaini Mukhopadhyay <ujjaini@berkeley.edu> * Update README.md * Series Bugfix for describe and convert_dtypes (#197) * bugfix for describe and convert_dtypes * added back metadata series test * black * default to pandas display when df.dtypes printed * Update Lux Docs (#195) * add black to travis * reformat all code and adjust test * remove .idea * fix contributing doc * small change in contributing * update * reformat, update command to fix version * remove dev dependencies * first pass -- inline comments * _config/config.py * delete test notebook * action * line length 105 * executor * interestingness * processor * vislib * tests, travis, CONTRIBUTING * .format () changed * replace tabs with escape chars * update using black * more rewrites and merges into single line * update pyproject.toml and makefile * coalesce data_types into data_type_lookup * black reformat * changed to better variable names * lux not defined error * fixed * black format * config doc updated * fix link for executor * more links * fixed overview * more links fixed * pandas methods no longer included * updates to some docstrings * black reformat * minor fixes * minor fix Co-authored-by: Doris Lee <dorisjunglinlee@gmail.com> * Supporting dataframe with integer columns (#203) * bugfix for describe and convert_dtypes * added back metadata series test * black * default to pandas display when df.dtypes printed * various fixes to support int columns * fixed merge conflict issues. vis.data shows None DF. * Merge master into sql-engine + minor mergeconflict fixes * Removing the PYNB * Cleaning up obsolete code Co-authored-by: Caitlyn Chen <caitlynachen@gmail.com> Co-authored-by: Caitlyn Chen <caitlynachen@berkeley.edu> Co-authored-by: Doris Lee <dorisjunglinlee@gmail.com> Co-authored-by: Kunal Agarwal <32151899+westernguy2@users.noreply.github.com> Co-authored-by: jinimukh <46768380+jinimukh@users.noreply.github.com> Co-authored-by: thyneb19 <thyneboonmark@berkeley.edu> Co-authored-by: 19thyneb <thyne.boonmark@gmail.com> Co-authored-by: Ujjaini Mukhopadhyay <ujjaini@berkeley.edu>
Configuration menu - View commit details
-
Copy full SHA for 289f670 - Browse repository at this point
Copy the full SHA 289f670View commit details
Commits on Jan 10, 2021
-
Configuration menu - View commit details
-
Copy full SHA for 812a27e - Browse repository at this point
Copy the full SHA 812a27eView commit details -
Configuration menu - View commit details
-
Copy full SHA for 0ed2f0e - Browse repository at this point
Copy the full SHA 0ed2f0eView commit details -
Updating sql-engine after merge with the travis build fix (#213)
* Similarity as a default action (#182) * similarity formatting fixed * added another similarity test case; fixed bug where colored heatmap dimension is temporal (invalidate all 2 msr 1 temporal case) * filter and similarity together * filter and similarity together * remove filter * black line length * file reorg and clean; change sim metric Co-authored-by: Caitlyn Chen <caitlynachen@berkeley.edu> Co-authored-by: Doris Lee <dorisjunglinlee@gmail.com> * bump numpy min version for travis * Special character issue (#184) * rename col * broken * fixed period replacement bug * add tests * refine tests * refine tests * remove cols * fix tests * add agg * fixed tests * clean up PR Co-authored-by: Caitlyn Chen <caitlynachen@berkeley.edu> Co-authored-by: Doris Lee <dorisjunglinlee@gmail.com> * Colored bar interestingness bug (#189) * rewrote chi2 contingency with pd.crosstab * catching KeyError issue with chi2 contingency * padding interestingness with warning instead of error * interestingness now reuses ndim and nmsr computed in Compiler * bug fix for parser with int values * improve Vis repr to better display inferred intent when data is absent but fully compiled intent (all clauses) * Add sampling parameters as a global config (#192) * update export tutorial to add explanation for standalone argument * minor fixes and remove cell output in notebooks * added contributing doc * fix bugs and uncomment some tests * remove raise warning * remove unnecessary import * split up rename test into two parts * fix setting warning, fix data_type bugs and add relevant tests * remove ordinal data type * add test for small dataframe resetting index * add loc and iloc tests * fix attribute access directly to dataframe * add small changes to code * added test for qcut and cut * add check if dtype is Interval * added qcut test * fix Record KeyError * add tests * take care of reset_index case * small edits * add data_model to column_group Clause * small edits for row_group * fixes to row group * add config for start and cap for samples * finish sampling config and tests * black formatting * add documentation for sampling config * remove small added issues * minor changes to docs * implement heatmap flag and add tests * black formatting and documentation edits Co-authored-by: Doris Lee <dorisjunglinlee@gmail.com> * Coalesce all data_type attributes of frame into one (#185) * coalesce data_types into data_type_lookup * black reformat * changed to better variable names * lux not defined error * fixed * black format * Update CONTRIBUTING.md * Bug Fix: User-provided Index causes KeyError in Pandas Execution (#191) * Moved Executor Parameters to Global Config * Black formatting * Moved table_name parameter to frame.py. Removed executor_type parameter executor_type parameter no longer necessary to maintain * Fixed reference to table_name parameter table_name is now a parameter within frame.py * Adjusted Functions to Set SQL Connection Moved set_SQL_connection function to config. Added set_SQL_table function within frame.py to let users specify which database table will be associated with their dataframe * Update SQLExecutor name parameter * Fix Executor Reference Update current_vis() to reference lux.config.executor * Update frame.py * Moved set functions to global config * Fixed Index Issue in Pandas Executor Issue caused when user sets an index. The Pandas Executor was not correctly renaming this new index column to Record in execute_aggregate() * Added tests for set_index functions * Black formatting * Update Pandas Executor to handle NA values Readded missing dropna parameter within execute_aggregate() groupby function call * Updated Pandas Coverage Tests Commented out set_index case which has not been addressed yet * Black Formatting * Update to Pandas Executor Index Handling Cleaned up how execute_aggregrate renames index columns. Now retrieves the index name from vis.data instead of filtering out non-index columns. Created separate test function for when user specifies an index in read_csv. Co-authored-by: 19thyneb <thyne.boonmark@gmail.com> Co-authored-by: Doris Lee <dorisjunglinlee@gmail.com> * Initialize Config once only during __init__ (#194) * basic matplotlib chart example * migrate register default action to init * config class * move actions * fixed tests * changes * alright * fix plot_config * black reformat * black reformat Co-authored-by: Doris Lee <dorisjunglinlee@gmail.com> Co-authored-by: Caitlyn Chen <caitlynachen@berkeley.edu> Co-authored-by: Ujjaini Mukhopadhyay <ujjaini@berkeley.edu> * Update README.md * Series Bugfix for describe and convert_dtypes (#197) * bugfix for describe and convert_dtypes * added back metadata series test * black * default to pandas display when df.dtypes printed * Update Lux Docs (#195) * add black to travis * reformat all code and adjust test * remove .idea * fix contributing doc * small change in contributing * update * reformat, update command to fix version * remove dev dependencies * first pass -- inline comments * _config/config.py * delete test notebook * action * line length 105 * executor * interestingness * processor * vislib * tests, travis, CONTRIBUTING * .format () changed * replace tabs with escape chars * update using black * more rewrites and merges into single line * update pyproject.toml and makefile * coalesce data_types into data_type_lookup * black reformat * changed to better variable names * lux not defined error * fixed * black format * config doc updated * fix link for executor * more links * fixed overview * more links fixed * pandas methods no longer included * updates to some docstrings * black reformat * minor fixes * minor fix Co-authored-by: Doris Lee <dorisjunglinlee@gmail.com> * Supporting dataframe with integer columns (#203) * bugfix for describe and convert_dtypes * added back metadata series test * black * default to pandas display when df.dtypes printed * various fixes to support int columns * fixed merge conflict issues. vis.data shows None DF. * Override Pandas DataFrames created from I/O pandas operations (#207) * update export tutorial to add explanation for standalone argument * minor fixes and remove cell output in notebooks * added contributing doc * fix bugs and uncomment some tests * remove raise warning * remove unnecessary import * split up rename test into two parts * fix setting warning, fix data_type bugs and add relevant tests * remove ordinal data type * add test for small dataframe resetting index * add loc and iloc tests * fix attribute access directly to dataframe * add small changes to code * added test for qcut and cut * add check if dtype is Interval * added qcut test * fix Record KeyError * add tests * take care of reset_index case * small edits * add data_model to column_group Clause * small edits for row_group * fixes to row group * add config for start and cap for samples * finish sampling config and tests * black formatting * add documentation for sampling config * remove small added issues * minor changes to docs * implement heatmap flag and add tests * black formatting and documentation edits * add pd.io equalities for DataFrames Co-authored-by: Doris Lee <dorisjunglinlee@gmail.com> * Merge master into sql-engine + minor mergeconflict fixes * Removing the PYNB * Cleaning up obsolete code * Configuration for topk and sort order (#206) * bugfix for describe and convert_dtypes * added back metadata series test * black * default to pandas display when df.dtypes printed * various fixes to support int columns * skip series vis for df.iterrows series element * config setting for modifying top K and sorting * note about regenerated config * Version lock for jupyter-client (#211) * move to single requirements-dev without lux-widget install manually * pin jedi version * pin jupyter-client version * add back old travis and requirement-dev * Mixed dtype issue (#205) * coalesce data_types into data_type_lookup * merge fixed * merge conflicts * add warning and suggestion on how to fix * formatting for warnings version * change to internal data * legibility update * test added * update test * test updated * xlrd in dev reqs * black * update link * changes to test logic, minor string format for warning Co-authored-by: Doris Lee <dorisjunglinlee@gmail.com> * Fixes issue where value_counts was not returning LuxSeries (#210) * add series equality and value counts test * black formatting * fix old value counts test instead * minor fix Co-authored-by: Doris Lee <dorisjunglinlee@gmail.com> * bump version * update README Co-authored-by: Caitlyn Chen <caitlynachen@gmail.com> Co-authored-by: Caitlyn Chen <caitlynachen@berkeley.edu> Co-authored-by: Doris Lee <dorisjunglinlee@gmail.com> Co-authored-by: Kunal Agarwal <32151899+westernguy2@users.noreply.github.com> Co-authored-by: jinimukh <46768380+jinimukh@users.noreply.github.com> Co-authored-by: thyneb19 <thyneboonmark@berkeley.edu> Co-authored-by: 19thyneb <thyne.boonmark@gmail.com> Co-authored-by: Ujjaini Mukhopadhyay <ujjaini@berkeley.edu>
Configuration menu - View commit details
-
Copy full SHA for af0e742 - Browse repository at this point
Copy the full SHA af0e742View commit details -
Configuration menu - View commit details
-
Copy full SHA for 96a3742 - Browse repository at this point
Copy the full SHA 96a3742View commit details -
Merge pull request #214 from thyneb19/Database-Executor
Merged in SQL-Engine changes, Cleaned up method to connect Lux to SQL…
Configuration menu - View commit details
-
Copy full SHA for 522c616 - Browse repository at this point
Copy the full SHA 522c616View commit details
Commits on Jan 12, 2021
-
Fixed SQLExecutor's Variable Handling
Issue where if Postgres database table did not have columns that were all lower case, SQLExecutor queries would fail. Updated the executor's handling to deal with non-lower cased variable names.
Configuration menu - View commit details
-
Copy full SHA for 973a93e - Browse repository at this point
Copy the full SHA 973a93eView commit details
Commits on Jan 19, 2021
-
Configuration menu - View commit details
-
Copy full SHA for 97d1281 - Browse repository at this point
Copy the full SHA 97d1281View commit details -
Merge pull request #236 from thyneb19/Database-Executor
Fixed Issue with SQLExecutor's Column handling
Configuration menu - View commit details
-
Copy full SHA for 395dfd6 - Browse repository at this point
Copy the full SHA 395dfd6View commit details -
Configuration menu - View commit details
-
Copy full SHA for 04e449f - Browse repository at this point
Copy the full SHA 04e449fView commit details -
Configuration menu - View commit details
-
Copy full SHA for 0defa44 - Browse repository at this point
Copy the full SHA 0defa44View commit details
Commits on Jan 21, 2021
-
Changed to handle other pandas and numpy integer types such as int64.
Configuration menu - View commit details
-
Copy full SHA for 02906f9 - Browse repository at this point
Copy the full SHA 02906f9View commit details -
Merge pull request #237 from thyneb19/Database-Executor
Merged in changes from master branch
Configuration menu - View commit details
-
Copy full SHA for 56ff766 - Browse repository at this point
Copy the full SHA 56ff766View commit details -
Configuration menu - View commit details
-
Copy full SHA for 9a96c55 - Browse repository at this point
Copy the full SHA 9a96c55View commit details -
Configuration menu - View commit details
-
Copy full SHA for daf9c83 - Browse repository at this point
Copy the full SHA daf9c83View commit details -
Configuration menu - View commit details
-
Copy full SHA for 5d9a999 - Browse repository at this point
Copy the full SHA 5d9a999View commit details -
Merge pull request #238 from thyneb19/Database-Executor
Additional Master branch changes, Update to travis.yml
Configuration menu - View commit details
-
Copy full SHA for 105942a - Browse repository at this point
Copy the full SHA 105942aView commit details
Commits on Jan 23, 2021
-
Configuration menu - View commit details
-
Copy full SHA for fabdf2e - Browse repository at this point
Copy the full SHA fabdf2eView commit details
Commits on Feb 8, 2021
-
Configuration menu - View commit details
-
Copy full SHA for 15f290e - Browse repository at this point
Copy the full SHA 15f290eView commit details
Commits on Feb 10, 2021
-
Now only does heatmap conversion here for the PandasExecutor since colored heatmap not yet implemented in SQLExecutor
Configuration menu - View commit details
-
Copy full SHA for cfdbf16 - Browse repository at this point
Copy the full SHA cfdbf16View commit details -
Configuration menu - View commit details
-
Copy full SHA for 660655c - Browse repository at this point
Copy the full SHA 660655cView commit details -
Configuration menu - View commit details
-
Copy full SHA for 04b43dc - Browse repository at this point
Copy the full SHA 04b43dcView commit details -
Configuration menu - View commit details
-
Copy full SHA for 1b8b99d - Browse repository at this point
Copy the full SHA 1b8b99dView commit details -
Merge pull request #261 from thyneb19/Database-Executor
Merge in Changes from Lux Main Branch
Configuration menu - View commit details
-
Copy full SHA for 4fd9a00 - Browse repository at this point
Copy the full SHA 4fd9a00View commit details
Commits on Feb 11, 2021
-
Configuration menu - View commit details
-
Copy full SHA for ca8065a - Browse repository at this point
Copy the full SHA ca8065aView commit details
Commits on Feb 15, 2021
-
Added Better Null Value Handling to SQLExecutor
SQLExecutor binning function was breaking if there was any Null value in the data it was trying to query. Adjusted querying to always filter out Null values from the data.
Configuration menu - View commit details
-
Copy full SHA for 8327fda - Browse repository at this point
Copy the full SHA 8327fdaView commit details
Commits on Feb 18, 2021
-
SQLExecutor execute_binning Fixes
Fixed issue where width_bucket query was not working with variables of integer type. Resolved by casting the variable to float. Fixed issue in creating bucket edges for histograms. Resolved by using min_max parameter of the dataframe rather than the min and max of a variable's unique values.
Configuration menu - View commit details
-
Copy full SHA for a7e2220 - Browse repository at this point
Copy the full SHA a7e2220View commit details -
Updated Tests to follow changes to SQLExecutor filtering
Configuration menu - View commit details
-
Copy full SHA for 4394ad6 - Browse repository at this point
Copy the full SHA 4394ad6View commit details -
Configuration menu - View commit details
-
Copy full SHA for d0ed14a - Browse repository at this point
Copy the full SHA d0ed14aView commit details -
Configuration menu - View commit details
-
Copy full SHA for 3e649c2 - Browse repository at this point
Copy the full SHA 3e649c2View commit details -
Merge pull request #267 from thyneb19/Database-Executor
Bug Fixes in Histogram Binning
Configuration menu - View commit details
-
Copy full SHA for b985393 - Browse repository at this point
Copy the full SHA b985393View commit details -
Configuration menu - View commit details
-
Copy full SHA for 6134ce5 - Browse repository at this point
Copy the full SHA 6134ce5View commit details -
Configuration menu - View commit details
-
Copy full SHA for 43e0e63 - Browse repository at this point
Copy the full SHA 43e0e63View commit details
Commits on Feb 20, 2021
-
Optimizing SQLExecutor 2D Binning
Changed SQLExecutor 2D binning to collect all necessary data via a single query versus one query for each x-axis bin. Updated SQLExecutor tests to reflect updated filter handling
Configuration menu - View commit details
-
Copy full SHA for b3ee36a - Browse repository at this point
Copy the full SHA b3ee36aView commit details -
Configuration menu - View commit details
-
Copy full SHA for de1e0a1 - Browse repository at this point
Copy the full SHA de1e0a1View commit details
Commits on Feb 21, 2021
-
Configuration menu - View commit details
-
Copy full SHA for 4572dd2 - Browse repository at this point
Copy the full SHA 4572dd2View commit details -
Merge pull request #283 from thyneb19/Database-Executor
Optimizing SQLExecutor Heatmap Aggregation
Configuration menu - View commit details
-
Copy full SHA for 5b0cd2b - Browse repository at this point
Copy the full SHA 5b0cd2bView commit details
Commits on Feb 22, 2021
-
Configuration menu - View commit details
-
Copy full SHA for c1ea16d - Browse repository at this point
Copy the full SHA c1ea16dView commit details
Commits on Feb 23, 2021
-
Added Null Value Filtering to SQLExecutor
There are cases where null values in a query break executor binning. Added Null value filtering to SQL queries to remove any null values from aggregated data
Configuration menu - View commit details
-
Copy full SHA for c8dfa12 - Browse repository at this point
Copy the full SHA c8dfa12View commit details -
Configuration menu - View commit details
-
Copy full SHA for cfa67b7 - Browse repository at this point
Copy the full SHA cfa67b7View commit details
Commits on Feb 25, 2021
-
Fixed Handling of String Filter Values
Issue caused by string values that contained apostrophes. Updated filter handling to process these values properly
Configuration menu - View commit details
-
Copy full SHA for 180556c - Browse repository at this point
Copy the full SHA 180556cView commit details
Commits on Feb 26, 2021
-
Added Better Handling for Lazy Execution
Previously, when a vis had no mark assigned the SQLExecutor would use refresh source to populate the vis' data. However, this causes an issue when the Lux compiler is trying to create colored barcharts in recommendation actions. Issue is resolved by approaching the problem similarly to the PandasExecutor. Take a sample of the original dataset and set that as the Vis' data. The vis will then have a mark assigned and execution will continue normally.
Configuration menu - View commit details
-
Copy full SHA for 45d6c07 - Browse repository at this point
Copy the full SHA 45d6c07View commit details -
Configuration menu - View commit details
-
Copy full SHA for 46f441c - Browse repository at this point
Copy the full SHA 46f441cView commit details -
Configuration menu - View commit details
-
Copy full SHA for 06e0919 - Browse repository at this point
Copy the full SHA 06e0919View commit details -
Configuration menu - View commit details
-
Copy full SHA for 4fa1534 - Browse repository at this point
Copy the full SHA 4fa1534View commit details
Commits on Feb 27, 2021
-
Updated SQLExecutor to Not Include Null Values in Metadata
Previously if a database table contained rows with null values, the SQLExecutor would include these in the cardinality and unique values lists. These inclusions would cause issues where the null value was included in barcharts and the interestingness calculations for these charts would break. Added addition test to SQLExecutor test suite to ensure that the executor was not including null values in its unique_values list. Included with this was an additional script to upload the aug_test dataset which was used for this test.
Configuration menu - View commit details
-
Copy full SHA for 18eb80d - Browse repository at this point
Copy the full SHA 18eb80dView commit details -
Configuration menu - View commit details
-
Copy full SHA for 4c19e4d - Browse repository at this point
Copy the full SHA 4c19e4dView commit details
Commits on Mar 2, 2021
-
Configuration menu - View commit details
-
Copy full SHA for 84d824e - Browse repository at this point
Copy the full SHA 84d824eView commit details -
Merge pull request #292 from thyneb19/Database-Executor
Better Null Handling in SQLExecutor, Merging Master branch changes
Configuration menu - View commit details
-
Copy full SHA for d4ee7da - Browse repository at this point
Copy the full SHA d4ee7daView commit details
Commits on Mar 6, 2021
-
Configuration menu - View commit details
-
Copy full SHA for 7027d2c - Browse repository at this point
Copy the full SHA 7027d2cView commit details -
Fixed Issue with SQLExecutor and Custom Actions
Issue with the check in custom_actions function. Did not have a case to check if actions were applicable for the SQLExecutor
Configuration menu - View commit details
-
Copy full SHA for 650355f - Browse repository at this point
Copy the full SHA 650355fView commit details
Commits on Mar 10, 2021
-
Merge pull request #300 from thyneb19/Database-Executor
Merging Changes from Master Branch
Configuration menu - View commit details
-
Copy full SHA for a1dea61 - Browse repository at this point
Copy the full SHA a1dea61View commit details
Commits on Mar 12, 2021
-
Created the LuxSQLTable object to differentiate between Lux' pandas and SQL functionality. Users can create a LuxSQLTable object and specify which table they would like to connect the object to within the constructor. All of Lux' recommendation functionality is still available, but users will not be able to perform pandas operations on the object as no data is stored locally.
Configuration menu - View commit details
-
Copy full SHA for 2dab7ed - Browse repository at this point
Copy the full SHA 2dab7edView commit details -
Merge pull request #303 from thyneb19/Database-Executor
Created LuxSQLTable Object
Configuration menu - View commit details
-
Copy full SHA for e36c8a1 - Browse repository at this point
Copy the full SHA e36c8a1View commit details
Commits on Mar 13, 2021
-
Configuration menu - View commit details
-
Copy full SHA for 04591af - Browse repository at this point
Copy the full SHA 04591afView commit details -
Added query parameter to Vis objects
To make Lux' SQLExecutor more transparent, added a query parameter to Vis objects so that users can see what query was used to gather the data for that visualization. Updated syntax in SQLExecutor tests to reflect the LuxSQLTable Changes
Configuration menu - View commit details
-
Copy full SHA for fa917fb - Browse repository at this point
Copy the full SHA fa917fbView commit details -
Configuration menu - View commit details
-
Copy full SHA for 2876de9 - Browse repository at this point
Copy the full SHA 2876de9View commit details -
Configuration menu - View commit details
-
Copy full SHA for df3ee00 - Browse repository at this point
Copy the full SHA df3ee00View commit details
Commits on Mar 14, 2021
-
Revert "Added query parameter to Vis objects"
This reverts commit fa917fb.
Configuration menu - View commit details
-
Copy full SHA for c3de6c6 - Browse repository at this point
Copy the full SHA c3de6c6View commit details -
Merge pull request #305 from thyneb19/Database-Executor
Merging in Master branch changes
Configuration menu - View commit details
-
Copy full SHA for ce2017b - Browse repository at this point
Copy the full SHA ce2017bView commit details -
Update python-app.yml to set up Postgres in test instance
Added the postgres service and scripts to populate the database with tables used in testing the SQLExecutor.
Configuration menu - View commit details
-
Copy full SHA for 4019070 - Browse repository at this point
Copy the full SHA 4019070View commit details -
Removed Example Notebooks for SQLExecutor
These will be moved to the lux-binder-sql instance.
Configuration menu - View commit details
-
Copy full SHA for bca4e5e - Browse repository at this point
Copy the full SHA bca4e5eView commit details -
Update to Script Uploading Car dataset to Postgres
Changed to use sqlalchemy
Configuration menu - View commit details
-
Copy full SHA for d19d2c2 - Browse repository at this point
Copy the full SHA d19d2c2View commit details -
Updated yml file to properly set up Postgres database for the test instance.
Configuration menu - View commit details
-
Copy full SHA for a7134b0 - Browse repository at this point
Copy the full SHA a7134b0View commit details -
Merge pull request #307 from thyneb19/Database-Executor
Update python-app.yml to set up Postgres Database in the test instance
Configuration menu - View commit details
-
Copy full SHA for af0fe9d - Browse repository at this point
Copy the full SHA af0fe9dView commit details
Commits on Mar 16, 2021
-
Configuration menu - View commit details
-
Copy full SHA for 626cc5f - Browse repository at this point
Copy the full SHA 626cc5fView commit details -
Configuration menu - View commit details
-
Copy full SHA for 0d1c557 - Browse repository at this point
Copy the full SHA 0d1c557View commit details -
Configuration menu - View commit details
-
Copy full SHA for 3a0fbd2 - Browse repository at this point
Copy the full SHA 3a0fbd2View commit details -
Configuration menu - View commit details
-
Copy full SHA for 87fe7d7 - Browse repository at this point
Copy the full SHA 87fe7d7View commit details -
Configuration menu - View commit details
-
Copy full SHA for 916f73a - Browse repository at this point
Copy the full SHA 916f73aView commit details -
Configuration menu - View commit details
-
Copy full SHA for 4ad6ec4 - Browse repository at this point
Copy the full SHA 4ad6ec4View commit details
Commits on Mar 17, 2021
-
Configuration menu - View commit details
-
Copy full SHA for 6fe8433 - Browse repository at this point
Copy the full SHA 6fe8433View commit details -
Merging changes after the update for the setup script for GitHub test…
… environment. Also includes length calculation changes
Configuration menu - View commit details
-
Copy full SHA for 2fcfb8f - Browse repository at this point
Copy the full SHA 2fcfb8fView commit details -
Configuration menu - View commit details
-
Copy full SHA for b1b56d7 - Browse repository at this point
Copy the full SHA b1b56d7View commit details -
Removed unnecessary print statement and redundant initialization of test dataframe
Configuration menu - View commit details
-
Copy full SHA for be2d1a2 - Browse repository at this point
Copy the full SHA be2d1a2View commit details
Commits on Mar 18, 2021
-
Some changes to datatype, test SQL Executor, count queries to count(1…
…) for SQL Executor
Configuration menu - View commit details
-
Copy full SHA for e8f6106 - Browse repository at this point
Copy the full SHA e8f6106View commit details -
Configuration menu - View commit details
-
Copy full SHA for e2e1482 - Browse repository at this point
Copy the full SHA e2e1482View commit details -
Merge pull request #311 from dj-khandelwal/sql-engine
Update Datetime handling with SQLExecutor, Bug Fixes with SQLExecutor Metadata Calculation
Configuration menu - View commit details
-
Copy full SHA for a6bd2fe - Browse repository at this point
Copy the full SHA a6bd2feView commit details -
Configuration menu - View commit details
-
Copy full SHA for 799f47d - Browse repository at this point
Copy the full SHA 799f47dView commit details -
Removed unnecessary parameter initialization in the LuxSQLTable init function as they are being set in the super constructor.
Configuration menu - View commit details
-
Copy full SHA for 8f1e21f - Browse repository at this point
Copy the full SHA 8f1e21fView commit details -
Configuration menu - View commit details
-
Copy full SHA for 0e760c2 - Browse repository at this point
Copy the full SHA 0e760c2View commit details -
Issue when running test_vis in Github Actions. Adjusted test_scatter_chart and test_colored_scatter_chart
Configuration menu - View commit details
-
Copy full SHA for 7f5c1b8 - Browse repository at this point
Copy the full SHA 7f5c1b8View commit details -
Merge pull request #312 from thyneb19/Database-Executor
Merge Master Branch Changes Updated test_vis.py
Configuration menu - View commit details
-
Copy full SHA for 247387d - Browse repository at this point
Copy the full SHA 247387dView commit details -
Configuration menu - View commit details
-
Copy full SHA for 460e6e2 - Browse repository at this point
Copy the full SHA 460e6e2View commit details -
Merge pull request #313 from thyneb19/Database-Executor
Black Reformatting
Configuration menu - View commit details
-
Copy full SHA for c8a9471 - Browse repository at this point
Copy the full SHA c8a9471View commit details
Commits on Mar 19, 2021
-
Updated LuxSQLTable notification
- Text -> [Toggle Table/Lux] - Caption's appearance with preview table only - Caption has table name
Configuration menu - View commit details
-
Copy full SHA for 34b5c45 - Browse repository at this point
Copy the full SHA 34b5c45View commit details -
Configuration menu - View commit details
-
Copy full SHA for 39d8f41 - Browse repository at this point
Copy the full SHA 39d8f41View commit details -
Configuration menu - View commit details
-
Copy full SHA for d68b16d - Browse repository at this point
Copy the full SHA d68b16dView commit details -
Configuration menu - View commit details
-
Copy full SHA for f190a55 - Browse repository at this point
Copy the full SHA f190a55View commit details -
Merge pull request #314 from sophiahhuang/sql-engine
Updating the LuxSQLTable Frontend
Configuration menu - View commit details
-
Copy full SHA for fcad97a - Browse repository at this point
Copy the full SHA fcad97aView commit details -
Remove redundantly added parameters
"name" parameter was being added again unnecessarily in lux series and tests for series
Configuration menu - View commit details
-
Copy full SHA for ae26397 - Browse repository at this point
Copy the full SHA ae26397View commit details
Commits on Mar 22, 2021
-
Update config error handling and LuxSQLTable description
Lux config now shoots an error if a user specifies a non-existent executor type
Configuration menu - View commit details
-
Copy full SHA for 562be13 - Browse repository at this point
Copy the full SHA 562be13View commit details
Commits on Mar 23, 2021
-
Clean up Vis.py Add greater connection visibility in LuxSQLTable
Removed unnecessary hyperparameter transferring in the Vis object. Update LuxSQLTable to display have more verbose display notification.
Configuration menu - View commit details
-
Copy full SHA for e6b2f29 - Browse repository at this point
Copy the full SHA e6b2f29View commit details -
Configuration menu - View commit details
-
Copy full SHA for d9073af - Browse repository at this point
Copy the full SHA d9073afView commit details -
Configuration menu - View commit details
-
Copy full SHA for 922f2a7 - Browse repository at this point
Copy the full SHA 922f2a7View commit details
Commits on Mar 25, 2021
-
Configuration menu - View commit details
-
Copy full SHA for 7b67f06 - Browse repository at this point
Copy the full SHA 7b67f06View commit details -
Update test_interestingness.py
Update test_interestingness to test for deviation_from_overall changes when using the SQLExecutor
Configuration menu - View commit details
-
Copy full SHA for 0323be0 - Browse repository at this point
Copy the full SHA 0323be0View commit details -
Added _length Parameter to LuxSQLTable
The _length parameter keeps track of the number of datapoints within the table/view that a LuxSQLTable is connected to. Added a len() function to make this parameter accessible. Unable to override the __len__() function as doing so breaks an assertion within the parent DataFrame class Updated interestingness.py to use the new len() function
Configuration menu - View commit details
-
Copy full SHA for bea42cc - Browse repository at this point
Copy the full SHA bea42ccView commit details -
Black Reformatting, Reverting_length change in LuxDataFrame
Adding back in the _length parameter to the LuxDataFrame
Configuration menu - View commit details
-
Copy full SHA for e9afa92 - Browse repository at this point
Copy the full SHA e9afa92View commit details
Commits on Mar 26, 2021
-
Configuration menu - View commit details
-
Copy full SHA for d296c9b - Browse repository at this point
Copy the full SHA d296c9bView commit details -
Update LuxSQLTable __len__() and metadata computation
Rather than referencing the _length parameter throughout the code, update and use the LuxSQLTable len() function. Added _setup_done parameter to the LuxSQLTable. This will check if the initial setup of the table, retrieving and populating attributes, is completed. This will inform which len() function to use, as the parent len() is required while populating the columns of the LuxSQLTable.
Configuration menu - View commit details
-
Copy full SHA for 7c7dcd3 - Browse repository at this point
Copy the full SHA 7c7dcd3View commit details -
Configuration menu - View commit details
-
Copy full SHA for 8d6cf4b - Browse repository at this point
Copy the full SHA 8d6cf4bView commit details -
Rename _repr_html_() to _ipython_display_()
Configuration menu - View commit details
-
Copy full SHA for e350ab4 - Browse repository at this point
Copy the full SHA e350ab4View commit details
Commits on Mar 27, 2021
-
Configuration menu - View commit details
-
Copy full SHA for 5d1a2f4 - Browse repository at this point
Copy the full SHA 5d1a2f4View commit details -
Revert "Revert "Updated LuxSQLTable repr""
This reverts commit 5d1a2f4.
Configuration menu - View commit details
-
Copy full SHA for 48c1b57 - Browse repository at this point
Copy the full SHA 48c1b57View commit details -
Revert "Update LuxSQLTable __len__() and metadata computation"
This reverts commit 7c7dcd3.
Configuration menu - View commit details
-
Copy full SHA for b5998c7 - Browse repository at this point
Copy the full SHA b5998c7View commit details -
Merge pull request #327 from thyneb19/Database-Executor
Merge in Master branch changes, add len() functionality to the LuxSQLTable
Configuration menu - View commit details
-
Copy full SHA for 75c5cae - Browse repository at this point
Copy the full SHA 75c5caeView commit details -
Revert "Revert "Update LuxSQLTable __len__() and metadata computation""
This reverts commit b5998c7.
Configuration menu - View commit details
-
Copy full SHA for 6f597c2 - Browse repository at this point
Copy the full SHA 6f597c2View commit details
Commits on Apr 3, 2021
-
Cleaned up datatype and SQLExecutor checks
Updated _is_datetime_number() in the PandasExecutor to use the is_integer_dtype() function to check if a series is of int dtype. Cleaned up SQLExecutor checks in frame.py
Configuration menu - View commit details
-
Copy full SHA for 7999ad6 - Browse repository at this point
Copy the full SHA 7999ad6View commit details
Commits on Apr 7, 2021
-
Update LuxSQLTable __len__() and metadata computation"" (#331)
* Revert "Revert "Update LuxSQLTable __len__() and metadata computation"" This reverts commit b5998c7. * Cleaned up datatype and SQLExecutor checks Updated _is_datetime_number() in the PandasExecutor to use the is_integer_dtype() function to check if a series is of int dtype. Cleaned up SQLExecutor checks in frame.py
Configuration menu - View commit details
-
Copy full SHA for db736d1 - Browse repository at this point
Copy the full SHA db736d1View commit details -
Configuration menu - View commit details
-
Copy full SHA for e92dbd6 - Browse repository at this point
Copy the full SHA e92dbd6View commit details -
Configuration menu - View commit details
-
Copy full SHA for 5399097 - Browse repository at this point
Copy the full SHA 5399097View commit details
Commits on Apr 8, 2021
-
Merge pull request #347 from thyneb19/Database-Executor
Merging in Master branch changes to sql-engine branch
Configuration menu - View commit details
-
Copy full SHA for 2d24a3b - Browse repository at this point
Copy the full SHA 2d24a3bView commit details -
Configuration menu - View commit details
-
Copy full SHA for 6922d3b - Browse repository at this point
Copy the full SHA 6922d3bView commit details -
Merge pull request #348 from thyneb19/Database-Executor
Black Reformatting
Configuration menu - View commit details
-
Copy full SHA for bf3cb0f - Browse repository at this point
Copy the full SHA bf3cb0fView commit details
Commits on Apr 9, 2021
-
Configuration menu - View commit details
-
Copy full SHA for 694c7d7 - Browse repository at this point
Copy the full SHA 694c7d7View commit details
Commits on Apr 11, 2021
-
Configuration menu - View commit details
-
Copy full SHA for 40b85b1 - Browse repository at this point
Copy the full SHA 40b85b1View commit details -
Configuration menu - View commit details
-
Copy full SHA for 2298f13 - Browse repository at this point
Copy the full SHA 2298f13View commit details -
Removed psycopg2 from Lux requirements
Aiming to simplify the initial Lux installation. Will include a notice in the SQL documentation letting users know that they will have to install the library themselves if the want to use the LuxSQLTable functionality.
Configuration menu - View commit details
-
Copy full SHA for 801f3cd - Browse repository at this point
Copy the full SHA 801f3cdView commit details -
Configuration menu - View commit details
-
Copy full SHA for 284f5ba - Browse repository at this point
Copy the full SHA 284f5baView commit details -
Merge pull request #352 from thyneb19/Database-Executor
Removed psycopg2 from Lux requirements
Configuration menu - View commit details
-
Copy full SHA for 1e02ad6 - Browse repository at this point
Copy the full SHA 1e02ad6View commit details -
Configuration menu - View commit details
-
Copy full SHA for 68c7747 - Browse repository at this point
Copy the full SHA 68c7747View commit details -
Configuration menu - View commit details
-
Copy full SHA for f11e772 - Browse repository at this point
Copy the full SHA f11e772View commit details -
Merge branch 'Database-Executor' of https://github.com/thyneb19/lux i…
…nto Database-Executor
Configuration menu - View commit details
-
Copy full SHA for a309361 - Browse repository at this point
Copy the full SHA a309361View commit details -
Merge pull request #353 from thyneb19/Database-Executor
Merging in master branch changes
Configuration menu - View commit details
-
Copy full SHA for 1632005 - Browse repository at this point
Copy the full SHA 1632005View commit details -
Configuration menu - View commit details
-
Copy full SHA for c94b5a6 - Browse repository at this point
Copy the full SHA c94b5a6View commit details -
Configuration menu - View commit details
-
Copy full SHA for 50f8562 - Browse repository at this point
Copy the full SHA 50f8562View commit details
Commits on Apr 12, 2021
-
Separate Pandas and SQL test suite
Separated and moved the SQLExecutor tests to the tests_sql folder. Updated the make file to include a command to test both the pandas and SQL functionalities. Updated the github workflow to also run the tests_sql folder
Configuration menu - View commit details
-
Copy full SHA for f1268ef - Browse repository at this point
Copy the full SHA f1268efView commit details -
Separate Pandas and SQL test suite (#354)
Separated and moved the SQLExecutor tests to the tests_sql folder. Updated the make file to include a command to test both the pandas and SQL functionalities. Updated the github workflow to also run the tests_sql folder
Configuration menu - View commit details
-
Copy full SHA for edaad70 - Browse repository at this point
Copy the full SHA edaad70View commit details -
Configuration menu - View commit details
-
Copy full SHA for 549c1fd - Browse repository at this point
Copy the full SHA 549c1fdView commit details -
Configuration menu - View commit details
-
Copy full SHA for 5600bbd - Browse repository at this point
Copy the full SHA 5600bbdView commit details -
Merge pull request #355 from thyneb19/Database-Executor
Fixing merge conflicts with Master branch
Configuration menu - View commit details
-
Copy full SHA for 5f1d10c - Browse repository at this point
Copy the full SHA 5f1d10cView commit details -
Configuration menu - View commit details
-
Copy full SHA for 94f9aa1 - Browse repository at this point
Copy the full SHA 94f9aa1View commit details -
Configuration menu - View commit details
-
Copy full SHA for 8da2a6b - Browse repository at this point
Copy the full SHA 8da2a6bView commit details -
Need to set the executor type to "Pandas" at the start of the PandasExecutor test suite. Fixed column name references in the SQLExecutor tests
Configuration menu - View commit details
-
Copy full SHA for aa66626 - Browse repository at this point
Copy the full SHA aa66626View commit details -
Configuration menu - View commit details
-
Copy full SHA for 51133a3 - Browse repository at this point
Copy the full SHA 51133a3View commit details
Commits on Apr 15, 2021
-
Added documentation for SQL Executor.
1. Added documentation for SQL Execution Engine. 2. Added SQL Executor gif in images folder.
Configuration menu - View commit details
-
Copy full SHA for a6cef02 - Browse repository at this point
Copy the full SHA a6cef02View commit details -
Merge pull request #361 from NiStannum/sql-engine
Sql Executor documentation
Configuration menu - View commit details
-
Copy full SHA for 1933463 - Browse repository at this point
Copy the full SHA 1933463View commit details
Commits on Apr 16, 2021
-
Configuration menu - View commit details
-
Copy full SHA for 20619e4 - Browse repository at this point
Copy the full SHA 20619e4View commit details -
Configuration menu - View commit details
-
Copy full SHA for d04b8fc - Browse repository at this point
Copy the full SHA d04b8fcView commit details -
Configuration menu - View commit details
-
Copy full SHA for 34c2276 - Browse repository at this point
Copy the full SHA 34c2276View commit details
Commits on Apr 17, 2021
-
Configuration menu - View commit details
-
Copy full SHA for a6d524c - Browse repository at this point
Copy the full SHA a6d524cView commit details -
Configuration menu - View commit details
-
Copy full SHA for 3d7b447 - Browse repository at this point
Copy the full SHA 3d7b447View commit details -
Configuration menu - View commit details
-
Copy full SHA for 3b84282 - Browse repository at this point
Copy the full SHA 3b84282View commit details
Commits on Apr 23, 2021
-
Configuration menu - View commit details
-
Copy full SHA for 5c6935f - Browse repository at this point
Copy the full SHA 5c6935fView commit details
Commits on Apr 25, 2021
-
The LuxTracer can be used to keep track of executed code. It is currently being used in the executors to track which lines of code were used to generate individual charts' data.
Configuration menu - View commit details
-
Copy full SHA for c0ff273 - Browse repository at this point
Copy the full SHA c0ff273View commit details
Commits on Apr 26, 2021
-
This executor uses SQL query templates from a specified query file. Rather than having hard coded queries written in the executor itself, this executor leaves the query writing to users. Currently works with Postgresql.
Configuration menu - View commit details
-
Copy full SHA for 7d79328 - Browse repository at this point
Copy the full SHA 7d79328View commit details
Commits on Apr 27, 2021
-
Added additional code parameters to Vis objects
Added the _trace_code and _query parameters to Lux Vis objects. The _trace_code parameter will store the code used to execute the Vis data, and the _query parameter will store the SQL query used to first aggregate the data for the Vis in the SQLExecutor case.
Configuration menu - View commit details
-
Copy full SHA for 3a7d0b6 - Browse repository at this point
Copy the full SHA 3a7d0b6View commit details -
Lux now only traces the code when a user calls the to_code() function of a Vis object. It does so by starting the tracer and re-executing the Vis object. Cleaned up handling of for loops in the tracing processor.
Configuration menu - View commit details
-
Copy full SHA for 8c380bc - Browse repository at this point
Copy the full SHA 8c380bcView commit details -
Vis objects' _source parameter is now set within the execution function.
Configuration menu - View commit details
-
Copy full SHA for 96cb9f0 - Browse repository at this point
Copy the full SHA 96cb9f0View commit details -
Update test_pandas_coverage.py
Updated the compare_vis() function to use .equals to compare the source dataframes.
Configuration menu - View commit details
-
Copy full SHA for 6ef2e52 - Browse repository at this point
Copy the full SHA 6ef2e52View commit details -
Configuration menu - View commit details
-
Copy full SHA for c504998 - Browse repository at this point
Copy the full SHA c504998View commit details -
Fixed bug where found_variable could be an empty list and was not set to "df"
Configuration menu - View commit details
-
Copy full SHA for fb3b908 - Browse repository at this point
Copy the full SHA fb3b908View commit details -
Configuration menu - View commit details
-
Copy full SHA for 8efea47 - Browse repository at this point
Copy the full SHA 8efea47View commit details -
Started work on MYSQL generalized database executor
Added functionality with scatter and bar charts. The query template file for compatibility with MYSQL is also included
Configuration menu - View commit details
-
Copy full SHA for f252c6a - Browse repository at this point
Copy the full SHA f252c6aView commit details
Commits on Apr 28, 2021
-
Updated GeneralDatabaseExecutor
Updated to work with the MySQL case, need to change how the executor uses quotations around different Database queries. Updated the MySQL query template
Configuration menu - View commit details
-
Copy full SHA for 7f36df7 - Browse repository at this point
Copy the full SHA 7f36df7View commit details
Commits on Apr 30, 2021
-
Needed to update Executor files' code format to remove wrapped lines of code. Fixed code formatting for the Pandas executor visualizations.
Configuration menu - View commit details
-
Copy full SHA for d21b102 - Browse repository at this point
Copy the full SHA d21b102View commit details
Commits on May 1, 2021
-
Changed the line formatting to fit the Lux Tracing use case
Configuration menu - View commit details
-
Copy full SHA for 19ceaf4 - Browse repository at this point
Copy the full SHA 19ceaf4View commit details
Commits on May 3, 2021
-
Configuration menu - View commit details
-
Copy full SHA for 8bba390 - Browse repository at this point
Copy the full SHA 8bba390View commit details -
Configuration menu - View commit details
-
Copy full SHA for 03cc858 - Browse repository at this point
Copy the full SHA 03cc858View commit details -
Configuration menu - View commit details
-
Copy full SHA for 121d6fb - Browse repository at this point
Copy the full SHA 121d6fbView commit details -
Configuration menu - View commit details
-
Copy full SHA for b802545 - Browse repository at this point
Copy the full SHA b802545View commit details
Commits on May 6, 2021
-
Update to General Database Executor and Query Templates
Added in variable names to the templates to make it clearer what the inputs need to be
Configuration menu - View commit details
-
Copy full SHA for db649fa - Browse repository at this point
Copy the full SHA db649faView commit details -
Update Lux Config to default to SQL Executor
When a SQL connection is made to the Lux config, now defaults to using the Postgres SQLExecutor rather than the GeneralDatabaseExecutor
Configuration menu - View commit details
-
Copy full SHA for 4c5632c - Browse repository at this point
Copy the full SHA 4c5632cView commit details -
Merge pull request #374 from thyneb19/Capstone
Adding in General Database Executor and Code Exporting
Configuration menu - View commit details
-
Copy full SHA for 18c968e - Browse repository at this point
Copy the full SHA 18c968eView commit details
Commits on May 11, 2021
-
Configuration menu - View commit details
-
Copy full SHA for 731ced6 - Browse repository at this point
Copy the full SHA 731ced6View commit details -
Configuration menu - View commit details
-
Copy full SHA for 12d1c76 - Browse repository at this point
Copy the full SHA 12d1c76View commit details -
Configuration menu - View commit details
-
Copy full SHA for f8a49b0 - Browse repository at this point
Copy the full SHA f8a49b0View commit details -
Merge pull request #375 from dj-khandelwal/sql-engine
Changes for the addition of the JoinedSQLTable Class
Configuration menu - View commit details
-
Copy full SHA for 2ae9ef7 - Browse repository at this point
Copy the full SHA 2ae9ef7View commit details
Commits on May 27, 2021
-
Update to Code tracing and Generalized Database Executor
Updated code tracing to use autopep8 to properly format exported code. Updated Generalized Database Executor to handle histogram binning for relational databases that do not have width_bucket functionality.
Configuration menu - View commit details
-
Copy full SHA for d5dbbfa - Browse repository at this point
Copy the full SHA d5dbbfaView commit details
Commits on Jun 1, 2021
-
Updated MySQL template and Heatmap Handling for GeneralDatabase Executor
Added proper heatmap aggregation when working with relational databases that do not have a width_bucket function. Updated the MySQL database template to include a heatmap template query.
Configuration menu - View commit details
-
Copy full SHA for a23ac63 - Browse repository at this point
Copy the full SHA a23ac63View commit details
Commits on Jun 3, 2021
-
Configuration menu - View commit details
-
Copy full SHA for dd252bb - Browse repository at this point
Copy the full SHA dd252bbView commit details
Commits on Jun 4, 2021
-
Replaced the previous postgres only SQL executor with the GeneralDatabaseExecutor which currently has templates for both postgres and mysql
Configuration menu - View commit details
-
Copy full SHA for 4b62cf3 - Browse repository at this point
Copy the full SHA 4b62cf3View commit details -
Configuration menu - View commit details
-
Copy full SHA for 5fdc6a1 - Browse repository at this point
Copy the full SHA 5fdc6a1View commit details
Commits on Jun 7, 2021
-
Fixed code formatting and PandasExecutor bug for code Export
Updated SQLExecutor code to not wrap lines, this helps with the format of exported python code. Issue when exporting Pandas colored barchart aggregation code. Updated the selection of columns to be included in the final barchart to be more explicit.
Configuration menu - View commit details
-
Copy full SHA for ad2e287 - Browse repository at this point
Copy the full SHA ad2e287View commit details
Commits on Jun 10, 2021
-
Updated formatting options to clean up exported visualization generating code
Configuration menu - View commit details
-
Copy full SHA for 4603d5d - Browse repository at this point
Copy the full SHA 4603d5dView commit details
Commits on Jun 14, 2021
-
Added tests for Lux code export
Added pytest cases to test if exported python code is runnable
Configuration menu - View commit details
-
Copy full SHA for 43d1255 - Browse repository at this point
Copy the full SHA 43d1255View commit details
Commits on Jun 17, 2021
-
Configuration menu - View commit details
-
Copy full SHA for a196020 - Browse repository at this point
Copy the full SHA a196020View commit details -
Fixed indentation issue in code tracing, updated code export tests
Fixed issue in tracing_utils where some indents were being unnecessarily removed. Updated code export tests to properly execute code
Configuration menu - View commit details
-
Copy full SHA for 0402bf7 - Browse repository at this point
Copy the full SHA 0402bf7View commit details
Commits on Jun 22, 2021
-
Configuration menu - View commit details
-
Copy full SHA for 04bab06 - Browse repository at this point
Copy the full SHA 04bab06View commit details
Commits on Jun 23, 2021
-
Configuration menu - View commit details
-
Copy full SHA for ea10789 - Browse repository at this point
Copy the full SHA ea10789View commit details -
Updated black formatting rules to exclude the Executor files. This ensures that the code lines are unwrapped, which cleans up the formatting of Vis objects' exported python code.
Configuration menu - View commit details
-
Copy full SHA for d6aff00 - Browse repository at this point
Copy the full SHA d6aff00View commit details -
Configuration menu - View commit details
-
Copy full SHA for 196fc12 - Browse repository at this point
Copy the full SHA 196fc12View commit details -
Merge pull request #387 from thyneb19/General-DB-Executor
Update to SQLExecutor and Visualization Code Exporting
Configuration menu - View commit details
-
Copy full SHA for 1a695e2 - Browse repository at this point
Copy the full SHA 1a695e2View commit details -
Configuration menu - View commit details
-
Copy full SHA for 68a85f6 - Browse repository at this point
Copy the full SHA 68a85f6View commit details
Commits on Jun 30, 2021
-
Use os.path.join to create paths to Lux modules and files, enables compatibility with both Windows and Mac directories.
Configuration menu - View commit details
-
Copy full SHA for a2e3fd7 - Browse repository at this point
Copy the full SHA a2e3fd7View commit details -
Configuration menu - View commit details
-
Copy full SHA for 90f5322 - Browse repository at this point
Copy the full SHA 90f5322View commit details
Commits on Jul 1, 2021
-
Added script to upload airbnb_nyc data to test suite
Updated test setup file to upload the airbnb_nyc dataset to the test database
Configuration menu - View commit details
-
Copy full SHA for a8814b2 - Browse repository at this point
Copy the full SHA a8814b2View commit details -
Configuration menu - View commit details
-
Copy full SHA for e4f50b3 - Browse repository at this point
Copy the full SHA e4f50b3View commit details -
Configuration menu - View commit details
-
Copy full SHA for a484767 - Browse repository at this point
Copy the full SHA a484767View commit details -
Configuration menu - View commit details
-
Copy full SHA for 317056d - Browse repository at this point
Copy the full SHA 317056dView commit details -
Moved database connection setup to the pytest global configuration.
Configuration menu - View commit details
-
Copy full SHA for 31d6dfb - Browse repository at this point
Copy the full SHA 31d6dfbView commit details -
Configuration menu - View commit details
-
Copy full SHA for a5bbb1b - Browse repository at this point
Copy the full SHA a5bbb1bView commit details
Commits on Jul 6, 2021
-
Update to SQL Templates and Code Export
Updated reading of the default Postgres and MySQL templates to be from a python script rather than a txt file. Can now import these template strings as a module. Updated python code export to wrap data generating code in a function. Users can now provide their original SQL table or dataframe and their vis specification, and the function will output the data used to generate the appropriate visualization.
Configuration menu - View commit details
-
Copy full SHA for 42d5d9e - Browse repository at this point
Copy the full SHA 42d5d9eView commit details
Commits on Jul 7, 2021
-
Wrapped the exported altair code into a function which can be called to generate an Altair visualization.
Configuration menu - View commit details
-
Copy full SHA for 3ad5e67 - Browse repository at this point
Copy the full SHA 3ad5e67View commit details -
Configuration menu - View commit details
-
Copy full SHA for f465675 - Browse repository at this point
Copy the full SHA f465675View commit details
Commits on Jul 17, 2021
-
Dynamically renames the plot_data function according to the type of chart being plotted
Configuration menu - View commit details
-
Copy full SHA for 60864ca - Browse repository at this point
Copy the full SHA 60864caView commit details -
Configuration menu - View commit details
-
Copy full SHA for 78a1484 - Browse repository at this point
Copy the full SHA 78a1484View commit details -
Configuration menu - View commit details
-
Copy full SHA for 48a4d92 - Browse repository at this point
Copy the full SHA 48a4d92View commit details
Commits on Aug 3, 2021
-
Added more processing to fix issues with exported Lux Executor code. There were some cases where the autopep8 formatter was not working as we wanted, so additional formatting on our end was required.
Configuration menu - View commit details
-
Copy full SHA for 4a18cbc - Browse repository at this point
Copy the full SHA 4a18cbcView commit details
Commits on Aug 6, 2021
-
Formatting Changes for Exported Executor Code
Fixed issue where unnecessary lines of executed code were causing issues with autopep8 formatting. Made changes to the code tracing to exclude these lines of code
Configuration menu - View commit details
-
Copy full SHA for 82d46f2 - Browse repository at this point
Copy the full SHA 82d46f2View commit details -
Configuration menu - View commit details
-
Copy full SHA for a6ab295 - Browse repository at this point
Copy the full SHA a6ab295View commit details -
Updated code export tests to try running the exported data creation function, then running that function to create visualization data
Configuration menu - View commit details
-
Copy full SHA for c745d3b - Browse repository at this point
Copy the full SHA c745d3bView commit details
Commits on Aug 7, 2021
-
Configuration menu - View commit details
-
Copy full SHA for 9dc1451 - Browse repository at this point
Copy the full SHA 9dc1451View commit details -
Configuration menu - View commit details
-
Copy full SHA for 455362f - Browse repository at this point
Copy the full SHA 455362fView commit details -
Added Lux Config Parameter for Heatmap Threshold
Added a global config parameter for heatmap start threshold, number of datapoints before Lux generates heatmaps instead of scatterplots.
Configuration menu - View commit details
-
Copy full SHA for 4820413 - Browse repository at this point
Copy the full SHA 4820413View commit details
Commits on Aug 10, 2021
-
Fixed issues where Lux heatmap settings were not being reset after code export tests
Configuration menu - View commit details
-
Copy full SHA for 81049d2 - Browse repository at this point
Copy the full SHA 81049d2View commit details -
Fix to heatmap determination in SQLExecutor
Changed a check in the execute function to properly compare the number of data points included in a scatterplot to the heatmap threshold. If the number of data points is greater than or equal to the threshold, change the mark for the chart to be a heatmap
Configuration menu - View commit details
-
Copy full SHA for 3325119 - Browse repository at this point
Copy the full SHA 3325119View commit details
Commits on Sep 10, 2021
-
Configuration menu - View commit details
-
Copy full SHA for c8fff34 - Browse repository at this point
Copy the full SHA c8fff34View commit details