Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Already on GitHub? Sign in to your account

Ruby1.9.1 - Cannot convert foreign chars to UTF8 - needed for JSON/Mongo output #89

Closed
urbanadventurer opened this Issue Sep 23, 2012 · 1 comment

Comments

Projects
None yet
1 participant
Owner

urbanadventurer commented Sep 23, 2012

ruby1.9.1 ./whatweb --debug --log-json j.log http://r25.yahoo.co.jp/fushigi/rxr_detail/?id=20120920-00026223-r25
/usr/lib/ruby/1.9.1/rubygems/custom_require.rb:36:in require': iconv will be deprecated in the future, use String#encode instead. ERROR Logging failed: http://r25.yahoo.co.jp/fushigi/rxr_detail/?id=20120920-00026223-r25 - "\xE3" from ASCII-8BIT to UTF-8 /usr/lib/ruby/1.9.1/json/common.rb:216:inencode': "\xE3" from ASCII-8BIT to UTF-8 (Encoding::UndefinedConversionError)
from /usr/lib/ruby/1.9.1/json/common.rb:216:in generate' from /usr/lib/ruby/1.9.1/json/common.rb:216:ingenerate'
from /home/dc/projects/whatweb/whatweb-new/lib/output.rb:626:in block in out' from <internal:prelude>:10:insynchronize'
from /home/dc/projects/whatweb/whatweb-new/lib/output.rb:625:in out' from ./whatweb:958:inblock (2 levels) in

'
from ./whatweb:956:in each' from ./whatweb:956:inblock in '

Owner

urbanadventurer commented Sep 23, 2012

this does NOT work -
obj.encode!("UTF-8",{:invalid=>:replace,:undef=>:replace})

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment