Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

The limit on the maximum number of generated addresses cannot be changed for function url #49232

Closed
alexey-milovidov opened this issue Apr 26, 2023 · 3 comments · Fixed by #49356
Assignees
Labels
easy task Good for first contributors unexpected behaviour

Comments

@alexey-milovidov
Copy link
Member

play-eu :) SELECT _path, count() FROM url('https://clickhouse-public-datasets.s3.amazonaws.com/wikistat/original/pageviews-20200101-{00..23}{00..59}00.gz', LineAsString) GROUP BY _path ORDER BY _path

SELECT
    _path,
    count()
FROM url('https://clickhouse-public-datasets.s3.amazonaws.com/wikistat/original/pageviews-20200101-{00..23}{00..59}00.gz', LineAsString)
GROUP BY _path
ORDER BY _path ASC

Query id: 90cd5580-a567-4af1-9b6f-ea99035053b1


0 rows in set. Elapsed: 0.022 sec. 

Received exception from server (version 23.4.1):
Code: 36. DB::Exception: Received from localhost:9000. DB::Exception: Table function 'remote': first argument generates too many result addresses. (BAD_ARGUMENTS)

play-eu :) SET table_function_remote_max_addresses = 1000000

SET table_function_remote_max_addresses = 1000000

Query id: 31702a49-0a8b-4580-88fc-a87ef2079764

Ok.

0 rows in set. Elapsed: 0.001 sec. 

play-eu :) SELECT _path, count() FROM url('https://clickhouse-public-datasets.s3.amazonaws.com/wikistat/original/pageviews-20200101-{00..23}{00..59}00.gz', LineAsString) GROUP BY _path ORDER BY _path

SELECT
    _path,
    count()
FROM url('https://clickhouse-public-datasets.s3.amazonaws.com/wikistat/original/pageviews-20200101-{00..23}{00..59}00.gz', LineAsString)
GROUP BY _path
ORDER BY _path ASC

Query id: 1e18851a-f9d7-43e4-84ef-3ffd34fb4b14


0 rows in set. Elapsed: 0.001 sec. 

Received exception from server (version 23.4.1):
Code: 36. DB::Exception: Received from localhost:9000. DB::Exception: Table function 'remote': first argument generates too many result addresses. (BAD_ARGUMENTS)

Also, take a look at the exception message. It is wrong.

@alexey-milovidov alexey-milovidov added unexpected behaviour easy task Good for first contributors labels Apr 26, 2023
@Ziy1-Tan
Copy link
Contributor

take

@Ziy1-Tan
Copy link
Contributor

@alexey-milovidov Seems like SET glob_expansion_max_elements = 1000000 will work for function url?
微信图片_20230428231434

@alexey-milovidov
Copy link
Member Author

@Ziy1-Tan ok. Then only the error message has to be fixed.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
easy task Good for first contributors unexpected behaviour
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants