BaseRequest.url gives UnicodeEncodeError in test run, but not in shell

[carn1x]

Take the following code:

from webob.request import BaseRequest
req = BaseRequest.blank('http://mysite.com/%D0%B4%D1%8D%D0%BB%D1%8C%D1%8D%D0%BD%D0%B9%D1%82')
print req.environ['PATH_INFO']
print req.path

If I run this via a django shell, I get:

>>> req = BaseRequest.blank('http://mysite.com/%D0%B4%D1%8D%D0%BB%D1%8C%D1%8D%D0%BD%D0%B9%D1%82')
>>> print req.environ['PATH_INFO']
/дэльэнйт
>>> print req.path
/%D0%B4%D1%8D%D0%BB%D1%8C%D1%8D%D0%BD%D0%B9%D1%82

Where as running it as part of a Django test case I get the following from the first print:

/дÑ�лÑ�Ñ�нйÑ

Followed by the exception:

File "/code/frontend/tests/test_views.py", line 55, in test_event
    print req.path
File "/virtualenv/frontend/local/lib/python2.7/site-packages/webob/request.py", line 485, in path
    bpath = bytes_(self.path_info, self.url_encoding)
File "/virtualenv/frontend/local/lib/python2.7/site-packages/webob/descriptors.py", line 68, in fget
    return req.encget(key, encattr=encattr)
File "/virtualenv/frontend/local/lib/python2.7/site-packages/webob/request.py", line 175, in encget
    return val.decode(encoding)
File "/virtualenv/frontend/lib/python2.7/encodings/utf_8.py", line 16, in decode
    return codecs.utf_8_decode(input, errors, True)
UnicodeEncodeError: 'ascii' codec can't encode characters in position 1-16: ordinal not in range(128)

I get that this is probably some weird configuration with my test suite, however both run via the same method in the same environment (Django's manage.py test vs manage.py shell) and so I'm struggling to identify what's different. We're also running a ton of other unicode related tests without issue.

Thanks for any light shed on this.

[digitalresistor]

Somewhere in your code you have a from __future__ import unicode_literals:

>>> from __future__ import unicode_literals
>>> from webob.request import BaseRequest
>>> req = BaseRequest.blank('http://mysite.com/%D0%B4%D1%8D%D0%BB%D1%8C%D1%8D%D0%BD%D0%B9%D1%82')
>>> print req.environ['PATH_INFO']
/д�л��нй�

[carn1x]

Ahh thanks very much. I was actually aiming to fix a larger issue, and mistakenly drilled down to thinking webob was the problem. Eliminating unicode_literals however absolves webob and shifts the issue more towards webtest / django-webtest.