Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

High version is not compatible with CatBoost #8567

Closed
jackpgao opened this issue Jan 8, 2020 · 3 comments
Closed

High version is not compatible with CatBoost #8567

jackpgao opened this issue Jan 8, 2020 · 3 comments
Assignees
Labels
bug Confirmed user-visible misbehaviour in official release comp-ml Machine Learning

Comments

@jackpgao
Copy link

jackpgao commented Jan 8, 2020

  • With the following config, we can use a trained catboost model to predict data.
cat catboost/models/trips_price_model.xml
<models>
    <model>
        <!-- Model type. Now catboost only. -->
        <type>catboost</type>
        <!-- Model name. -->
        <name>trip_price</name>
        <!-- Path to trained model. -->
        <path>/data1/clickhouse/catboost/models/trip_price.bin</path>
        <!-- Update interval. -->
        <lifetime>0</lifetime>
    </model>
</models>
  • result
SELECT
    modelEvaluate('trip_price', trip_distance, toYear(pickup_datetime), cab_type) AS prediction,
    total_amount
FROM trips_mergetree_all
LIMIT 5

┌─────────prediction─┬─total_amount─┐
│  9.2453150661348159.2 │
│ 10.36861217291890110.8 │
│  9.9311514013028778.8 │
│ 18.99718626398957314.5 │
│   7.110474997133876.3 │
└────────────────────┴──────────────┘

5 rows in set. Elapsed: 0.009 sec.


SELECT version()

┌─version()──┐
│ 19.11.9.52 │
└────────────┘
  • but the higher version can not parsed the catboost model config file.

  • error.log

2020.01.08 14:24:15.691965 [ 1 ] {} <Warning> ExternalModelsLoader: /data1/clickhouse/catboost/models/trips_price_model.xml: file contains unknown node 'model', expected 'models'
SELECT version()

┌─version()────┐
│ 19.19.1.1957 │
└──────────────┘

1 rows in set. Elapsed: 0.002 sec.


SELECT
    modelEvaluate('trip_price', trip_distance, toYear(pickup_datetime), cab_type) AS prediction,
    total_amount
FROM trips_mergetree_all
LIMIT 5

Received exception from server (version 19.19.1):
Code: 36. DB::Exception: Received from 127.0.0.1:9000. DB::Exception: external model 'trip_price' not found.

image

@jackpgao jackpgao added the bug Confirmed user-visible misbehaviour in official release label Jan 8, 2020
@alexey-milovidov alexey-milovidov added the comp-ml Machine Learning label Jan 8, 2020
@JamalSale
Copy link

Confirm, have the same issue with

SELECT version()

┌─version()──┐
│ 19.17.6.36 │
└────────────┘

@KochetovNicolai
Copy link
Member

That was the reason: 42692ad
Unfortunately, I've missed the slides source, so can't fix mistake there.

@githubxiaowei
Copy link

So, is this fixed?
I got 'external model not found' error in the version 21.10.2.15.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Confirmed user-visible misbehaviour in official release comp-ml Machine Learning
Projects
None yet
Development

No branches or pull requests

5 participants