Sklearn Integration

[gaurav274]

Search before asking

• I have searched the EvaDB issues and found no similar feature requests.

Description

Expand our integrations with ML libraries.

• Sklearn Linear Model support Adding support for Sklearn linear regression in EvaDB #1162
• Sklearn documentation under AI engines Add Model Training Notebook Examples and Improve documentation.  #999
• Use auto-sklearn for automl.

Use case

No response

Are you willing to submit a PR?

• Yes I'd like to help by submitting a PR!

[jineetd]

I would like to pick up this issue and contribute to the integration.

[xzdandy]

Hi @jineetd, thanks for bringing in the linear model support from Sklearn to EvaDB. I will take care of the documentation. You can think about ideas how we can scale the support to other models from Sklearn. Thanks!

[xzdandy]

The integration test failed on circle ci. @jineetd Please take a look.

self = <test.integration_tests.long.test_model_train.ModelTrainTests testMethod=test_sklearn_regression>

    def test_sklearn_regression(self):
        create_predict_function = """
            CREATE FUNCTION IF NOT EXISTS PredictHouseRent FROM
            ( SELECT number_of_rooms, number_of_bathrooms, days_on_market, rental_price FROM HomeRentals )
            TYPE Sklearn
            PREDICT 'rental_price';
        """
        execute_query_fetch_all(self.evadb, create_predict_function)
    
        predict_query = """
            SELECT PredictHouseRent(number_of_rooms, number_of_bathrooms, days_on_market, rental_price) FROM HomeRentals LIMIT 10;
        """
>       result = execute_query_fetch_all(self.evadb, predict_query)

test/integration_tests/long/test_model_train.py:87: 
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 
evadb/server/command_handler.py:93: in execute_query_fetch_all
    res_batch = execute_query(
evadb/server/command_handler.py:72: in execute_query
    res_batch = execute_statement(
evadb/server/command_handler.py:53: in execute_statement
    batch_list = list(output)
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 

self = <evadb.executor.plan_executor.PlanExecutor object at 0x7fe4bf7db910>
do_not_raise_exceptions = False, do_not_print_exceptions = False

    def execute_plan(
        self,
        do_not_raise_exceptions: bool = False,
        do_not_print_exceptions: bool = False,
    ) -> Iterator[Batch]:
        """execute the plan tree"""
        try:
            execution_tree = self._build_execution_tree(self._plan)
            output = execution_tree.exec()
            if output is not None:
                yield from output
        except Exception as e:
            if do_not_raise_exceptions is False:
                if do_not_print_exceptions is False:
                    logger.exception(str(e))
>               raise ExecutorError(e)
E               evadb.executor.executor_utils.ExecutorError: 'sqft'

evadb/executor/plan_executor.py:183: ExecutorError

Circle CI

[xzdandy]

The above error will be fixed in #1209

[xzdandy]

auto-sklearn does not work python3.10

So we will drop the auto-sklearn integration for now.

Reference: automl/auto-sklearn#1694