3rd Party multi-modal model gemini-2.0-flash-001 responds with MANY '-' and whitespaces in tables causing >1000 chunks for 1 page

[JohanBekker]

Describe the bug
3rd Party multi-modal model gemini-2.0-flash-001 sometimes uses a lot of -'s to describe a markdown table, exploding the number of tokens for the page. With a chunk size of <=512, this sometimes leads to >1000 chunks for a single page.

Files
https://www.asml.com/en/investors/annual-report/2023

Job ID
0d446037-f53b-4cd0-8978-dfd346e50915

Client:
Please remove untested options:

• Python Library
• API

Additional context
Response for page 347 of the ASML annual report is added as file because it didn't fit in here.

page_347.json

[JohanBekker]

Could I get a response to this? It has been >3 weeks, gemini flash 2.0 mode is completely unusable because of this.

https://www.asml.com/en/investors/annual-report/2023
192b4682-e427-4e95-8769-173c0789aefb
ab7723d8-e381-4334-9660-7a12dacc8cc3
fb3bd4e3-f27e-49cf-8539-d58fe7eac570

[TLTP1995]

same issue. It either posts
, /n or "-"