Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: auto Feature Engineering #2381

Merged
merged 8 commits into from
Oct 18, 2022
Merged

Conversation

explcre
Copy link
Contributor

@explcre explcre commented Aug 21, 2022

  • What kind of change does this PR introduce? (Bug fix, feature, docs update, ...)
    2022 gitlink code link
    Auto Feature Engineering.

  • What is the current behavior? (You can also link to an open issue here)

  • What is the new behavior (if this is a feature change)?

  • Developed an automated feature engineering pipeline, including feature generation and selection, based on AutoX and
    OpenMLDB sql with Python.
  • The program automatically generates sql query which meets OpenMLDB standard and get data from it through web request.
  • The data is transformed by OpenMLDB sql to get time series and statistics features, and then we select the most important k
    features based on some algorithms.

@github-actions github-actions bot added the sdk openmldb java/python sdk label Aug 21, 2022
@codecov
Copy link

codecov bot commented Aug 21, 2022

Codecov Report

Base: 75.61% // Head: 75.60% // Decreases project coverage by -0.01% ⚠️

Coverage data is based on head (34b3519) compared to base (ba29780).
Patch has no changes to coverable lines.

Additional details and impacted files
@@             Coverage Diff              @@
##               main    #2381      +/-   ##
============================================
- Coverage     75.61%   75.60%   -0.02%     
  Complexity      392      392              
============================================
  Files           644      644              
  Lines        121410   121410              
  Branches       1060     1060              
============================================
- Hits          91807    91789      -18     
- Misses        29366    29384      +18     
  Partials        237      237              
Impacted Files Coverage Δ
...s/query_response_time/deploy_query_response_time.h 81.25% <0.00%> (-18.75%) ⬇️
...atistics/query_response_time/query_response_time.h 78.26% <0.00%> (-4.35%) ⬇️
src/rpc/rpc_client.h 85.13% <0.00%> (-4.06%) ⬇️
.../query_response_time/deploy_query_response_time.cc 97.10% <0.00%> (-2.90%) ⬇️
src/sdk/db_sdk.cc 66.14% <0.00%> (-0.45%) ⬇️
src/catalog/client_manager.cc 42.20% <0.00%> (-0.29%) ⬇️
src/nameserver/name_server_impl.cc 43.56% <0.00%> (-0.13%) ⬇️
src/client/tablet_client.cc 57.43% <0.00%> (-0.12%) ⬇️
src/tablet/tablet_impl.cc 62.65% <0.00%> (ø)
hybridse/src/vm/runner.cc 68.11% <0.00%> (+0.03%) ⬆️
... and 2 more

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

☔ View full report at Codecov.
📢 Do you have feedback about the report comment? Let us know in this issue.

@github-actions
Copy link
Contributor

github-actions bot commented Aug 21, 2022

Linux Test Report

568 tests   561 ✔️  26m 13s ⏱️
  57 suites      7 💤
  51 files        0

Results for commit 34b3519.

♻️ This comment has been updated with latest results.

@github-actions
Copy link
Contributor

github-actions bot commented Aug 21, 2022

SDK Test Report

  83 files    83 suites   1m 44s ⏱️
174 tests 168 ✔️ 6 💤 0
220 runs  214 ✔️ 6 💤 0

Results for commit 34b3519.

♻️ This comment has been updated with latest results.

@tobegit3hub tobegit3hub changed the title feat: Auto Feature Engineering feat: auto Feature Engineering Aug 23, 2022
@dl239
Copy link
Collaborator

dl239 commented Sep 1, 2022

auto-fe is a tool? whether to move to openmldb_tool dir @vagetablechicken

@vagetablechicken
Copy link
Collaborator

auto-fe is a tool? whether to move to openmldb_tool dir @vagetablechicken

It will take so many dependencies. It' better to be a standalone project

@vagetablechicken vagetablechicken enabled auto-merge (squash) October 18, 2022 07:09
@vagetablechicken vagetablechicken merged commit 3786fcd into 4paradigm:main Oct 18, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
sdk openmldb java/python sdk
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants