[issue20140] UnicodeDecodeError in ntpath.py when home dir contains non-ascii signs

Change by Eryk Sun : -- resolution: -> out of date stage: needs patch -> resolved status: open -> closed ___ Python tracker ___ ___

[issue20140] UnicodeDecodeError in ntpath.py when home dir contains non-ascii signs

Eryk Sun added the comment: > It might be worth testing a patch that changes expanduser to > decode the environment variables If expanduser() is passed a unicode path, it can use _winreg.ExpandEvironmentStrings(u'%USERPROFILE%') instead of decoding os.environ['USERPROFILE']. In 2.7, os.envir

[issue20140] UnicodeDecodeError in ntpath.py when home dir contains non-ascii signs

Robert Collins added the comment: Given two (or more) parameters where one is unicode and one is not, upcasting will occur multiples times in path.join on windows: - '\\' is str and will cast up safely in all codecs - the other str (or bytes) parameter will be upcast using sys.defaultencoding

[issue20140] UnicodeDecodeError in ntpath.py when home dir contains non-ascii signs

Vinay Sajip added the comment: > There is a bug in distlib.resources. As far as I know, this is no longer the case - a change was made in distlib.resources to get around the problem: https://bitbucket.org/vinay.sajip/distlib/src/471427909ebbba2f4fa9f4cbc34f17bd2d31b8e3/distlib/resources.py?at=

[issue20140] UnicodeDecodeError in ntpath.py when home dir contains non-ascii signs

Serhiy Storchaka added the comment: Yes, the implementation of os.path is alright. There is a bug in distlib.resources. And the lack of os.path documentation. -- ___ Python tracker

[issue20140] UnicodeDecodeError in ntpath.py when home dir contains non-ascii signs

Lin Wei added the comment: The patch (http://bugs.python.org/issue9291#msg206938) for #9291 actually helps with this issue, at least for me. By the way, @Serhiy do you mean that the problem is merely documentation, while the implementation is alright? -- nosy: +Lin.Wei __

[issue20140] UnicodeDecodeError in ntpath.py when home dir contains non-ascii signs

Serhiy Storchaka added the comment: This looks to me as documentation issue. Unfortunately it is not explicitly documented that os.path.join() shouldn't mix str and unicode components (except ascii-only str, such as '.'). There is relevant note in 3.x documentation. It should be adapted to 2.7

[issue20140] UnicodeDecodeError in ntpath.py when home dir contains non-ascii signs

honglei jiang added the comment: Python：canopy-1.3.0.1715.win-x86_64\ OS：Win8.1 64 >>>directory 'F:\\Flask\\EmberJS\\\xd6\xd0\xce\xc4\\Prj\\static' >>>os.path.isdir(directory) True >>>filename u'todomvc/architecture-examples/angularjs/index.html' >>>os.path.join(directory,filename) Traceback (mo

[issue20140] UnicodeDecodeError in ntpath.py when home dir contains non-ascii signs

Jarek Śmiejczak added the comment: @Vinay.Sajip After adding change you suggested i'm getting different error: --- C:\Users\Jarosław>pip install virtualenv Downloading/unpacking virtualenv Running setup.py (path:c:\users\jarosa~1\appdata\local\temp\pip_build_Jaros│a \virtualenv\setup.py) egg_in

[issue20140] UnicodeDecodeError in ntpath.py when home dir contains non-ascii signs

Vinay Sajip added the comment: Jarek: I can't easily test this in my environment; perhaps you can help. Could you change, in the file c:\python27\lib\site-packages\pip\_vendor\distlib\resources.py, line 40 from base = os.path.join(get_cache_base(), 'resource-cache') to

[issue20140] UnicodeDecodeError in ntpath.py when home dir contains non-ascii signs

Vinay Sajip added the comment: It's not failing specifically because of distlib or os.path.join functionality: it's failing because, given a Unicode path C:\Users\Jarosław\..., Python is attempting to decode it using the default, ASCII codec. I'll certainly look at updating distlib to handle t

[issue20140] UnicodeDecodeError in ntpath.py when home dir contains non-ascii signs

STINNER Victor added the comment: > https://gist.github.com/jarekps/2729ee1917ea372e6642 Copy of the output: --- C:\Users\Jarosław>pip Traceback (most recent call last): File "c:\python27\Scripts\pip-script.py", line 9, in load_entry_point('pip==1.5', 'console_scripts', 'pip')() File "c:\pytho

[issue20140] UnicodeDecodeError in ntpath.py when home dir contains non-ascii signs

New submission from Jarek Śmiejczak: Full traceback: https://gist.github.com/jarekps/2729ee1917ea372e6642 Error's starts in pip but after investigation of traceback it looks like it is python's issue (version 2.7.5). Windows version: 8.1 Enterprise x64 with Polish language pack. Feel free to as