Non-ascii characters in the URL result in malformed data

[dcelasun]

Consider the hello world example:

#!/usr/bin/env python
# -*- coding: utf-8 -*-

from bottle import route, run
@route('/hello/<name>')
def index(name='World'):
    return '<b>Hello %s!</b>' % name

run(host='localhost', port=8080)

Here, calling the url http://localhost/hello/ŞĞÜ results in:

Hello ���!

Any ideas?

[iurisilvio]

It works fine here, maybe it is just your browser with wrong encoding.

[dcelasun]

I've tested with Firefox and Chrome (on Linux and Windows) and it gave me garbled text.

What's your environment?

[dcelasun]

Found a fix! Encoding the string in latin-1 and then decoding in utf-8 works. Why is this necessary?

@bottle.route('/hello/<name>')
def index(name='World'):
    return '<b>Hello %s!</b>' % (name.encode('latin-1').decode('utf-8'))

[defnull]

Because WSGI 3333 (the Python3 WSGI standard) requires all incoming data to be latin1-encoded unicode and a framework has no way to guess the correct encoding.

Bottle assumes utf-8 in many places already, though. This should be cleaned up in a future release (it breaks backward compatibility, so it's not that easy)

[coffeeowl]

I guess I have the same problem. I am writing a webapp and unfortunately some URLs might contain non-latin characters. As a result I get a garbage instead of normal URL parameters and can query a DB with them. I am not sure what are the consequences of my hack, but it was easy to fix, I have changed the encoding to utf-8 on this line - https://github.com/defnull/bottle/blob/master/bottle.py#L82
And yes, I am using Python3.

[blastrock]

I had this same bug, it took me a while to understand what was going on. I couldn't find anywhere in the documentation where this is mentioned, please someone document it and include that encode("latin1") trick until you fix it.
To fix it and keep backward compatibility, maybe you can put a parameter in bottle.run() to tell that the encoding should be UTF-8 and have this parameter set to latin1 by default.

Btw, coffeeowl's fix does not work for me.