Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

small improvements to duckdb docs #128

Merged
merged 2 commits into from
Feb 14, 2023
Merged

small improvements to duckdb docs #128

merged 2 commits into from
Feb 14, 2023

Conversation

TyDunn
Copy link
Collaborator

@TyDunn TyDunn commented Feb 13, 2023

I am unable to load data from the chess.com API to DuckDB after following the instructions in the docs. I get the following error when I try to run it:

Traceback (most recent call last):
  File "/usr/local/lib/python3.10/site-packages/dlt/destinations/sql_client.py", line 138, in _wrap
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.10/site-packages/dlt/destinations/duckdb/sql_client.py", line 35, in open_connection
    self._conn.execute(f"SET {k} = '{v}'")
duckdb.BinderException: Binder Error: Catalog "chess_data" does not exist!

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/Users/ty/Documents/dlthub/test-duckdb/chess.py", line 111, in <module>
    info = p.run(
  File "/usr/local/lib/python3.10/site-packages/dlt/pipeline/pipeline.py", line 99, in _wrap
    step_info = f(self, *args, **kwargs)
  File "/usr/local/lib/python3.10/site-packages/dlt/pipeline/pipeline.py", line 130, in _wrap
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.10/site-packages/dlt/pipeline/pipeline.py", line 477, in run
    self.sync_destination(destination, dataset_name)
  File "/usr/local/lib/python3.10/site-packages/dlt/pipeline/pipeline.py", line 73, in _wrap
    rv = f(self, *args, **kwargs)
  File "/usr/local/lib/python3.10/site-packages/dlt/pipeline/pipeline.py", line 519, in sync_destination
    remote_state = self._restore_state_from_destination()
  File "/usr/local/lib/python3.10/site-packages/dlt/pipeline/pipeline.py", line 954, in _restore_state_from_destination
    job_client.sql_client.open_connection()
  File "/usr/local/lib/python3.10/site-packages/dlt/destinations/sql_client.py", line 140, in _wrap
    raise DestinationConnectionError(type(self).__name__, self.dataset_name, str(ex), ex)
dlt.destinations.exceptions.DestinationConnectionError: Connection with DuckDbSqlClient to dataset name chess_data failed. Please check if you configured the credentials at all and provided the right credentials values. You can be also denied access or your internet connection may be down. The actual reason given is: Binder Error: Catalog "chess_data" does not exist!

@TyDunn TyDunn requested a review from rudolfix February 13, 2023 15:44
@netlify
Copy link

netlify bot commented Feb 13, 2023

Deploy Preview for dlt-hub-docs ready!

Name Link
🔨 Latest commit 1a1d586
🔍 Latest deploy log https://app.netlify.com/sites/dlt-hub-docs/deploys/63ea5ba8d1954f0008cbce38
😎 Deploy Preview https://deploy-preview-128--dlt-hub-docs.netlify.app
📱 Preview on mobile
Toggle QR Code...

QR Code

Use your smartphone camera to open QR code link.

To edit notification comments on pull requests, go to your Netlify site settings.

@TyDunn
Copy link
Collaborator Author

TyDunn commented Feb 13, 2023

@rudolfix I followed the docs exactly. How can I avoid getting this error?

@rudolfix
Copy link
Collaborator

ducklabs released duckdb 0.7 yesterday where the programming interface was changed freely. the situation above is normal but was silently handled. now the exception they raise is different. I'll switch the duckdb to next version and try to release. you can also do pip install duckdb==0.6.1 which will downgrade

@rudolfix
Copy link
Collaborator

I'm merging the PR. I will fix it starting from devel

Copy link
Collaborator

@rudolfix rudolfix left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

thanks for the fixes!

@rudolfix rudolfix merged commit e128552 into devel Feb 14, 2023
@rudolfix rudolfix deleted the duckdb branch February 14, 2023 20:36
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants