Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

YahooWeb failing with "Header line too long" error #377

Closed
fabrica64 opened this issue Apr 16, 2024 · 2 comments · Fixed by #384
Closed

YahooWeb failing with "Header line too long" error #377

fabrica64 opened this issue Apr 16, 2024 · 2 comments · Fixed by #384
Labels
In Progress Actively being worked on. module malfunction report about malfunctioning module

Comments

@fabrica64
Copy link
Contributor

$ /Applications/Gnucash.app/Contents/MacOS/gnucash-cli --quotes dump yahooweb AAPL
Application Path /Applications/Gnucash.app/Contents/MacOS/gnucash-cli
Finance::Quote reported a failure for symbol AAPL: 500 Header line too long (limit is 8192)

I don't know if it is just for me but from April 15 I get this error trying to use YahooWeb

MacOS 14.4.1 (Apple Silicon)
Perl 5.38.2
Finance::Quote 1.60

It happens also in Windows 10 with Strawberry Perl 5.28.1 and Finance::Quote 1.59

@finance-quote finance-quote deleted a comment from carlosala Apr 16, 2024
@finance-quote finance-quote deleted a comment from fabrica64 Apr 16, 2024
@finance-quote finance-quote deleted a comment from zinglo Apr 16, 2024
@finance-quote finance-quote deleted a comment from andershm Apr 16, 2024
@bpschuck
Copy link
Contributor

@fabrica64

I don't know if it is just for me but from April 15 I get this error trying to use YahooWeb

I believe Yahoo may have changed the format which affect the various regex screen scraping that the YahooWeb module uses.

Thanks.

@bpschuck bpschuck added module malfunction report about malfunctioning module In Progress Actively being worked on. labels Apr 16, 2024
@bpschuck
Copy link
Contributor

Adding this as notes for when I (or someone else) works on pull request.

I can fix the "500 Header line too long (limit is 8192)" error by adding

use LWP::Protocol::http;
push(@LWP::Protocol::http::EXTRA_SOCK_OPTS, MaxLineLength => 0);

near the top of the YahooWeb.pm module. BUT, the format of the page returned has also changed. Good news is that it includes JSON which is easier to parse.

bpschuck added a commit that referenced this issue May 17, 2024
	* Fixed AEX.pm
	* Removed throttling from AlphaVantage.pm - Issue #363
	* Added CurrencyFreaks.pm - new currency module
	* YahooJSON.pm - added more error handling - Issue #390
	* Fixed MarketWatch.pm module - Issue #389
	* Fool.pm - Rewrote Fool.pm and added back to F::Q. Issue #379.
	* New Module! StockData.pm. Methods stockdata, nyse, nasdaq.
	* Modified yahooJSON.pm module in order handle EU consent redirects better.
  * TwelveData.pm - Added "last" to data being returned
	* BorsaItaliana.pm - New module for Borsa Italiana, Italian traded bonds using ISIN
	* YahooWeb.pm - Issue #377. Modified YahooWeb to account for changes from Yahoo.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
In Progress Actively being worked on. module malfunction report about malfunctioning module
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants