BUG: parser_source as a filename with non utf-8 encoding in Windows f…

…ilesystem (GH6807)
pandas-dev · Apr 30, 2014 · 79df67a · 79df67a
1 parent ac189a2
commit 79df67a
Show file tree

Hide file tree

Showing 2 changed files with 2 additions and 1 deletion.
diff --git a/doc/source/release.rst b/doc/source/release.rst
@@ -449,6 +449,7 @@ Bug Fixes
 - Moved ``Panel.shift`` to ``NDFrame.slice_shift`` and fixed to respect multiple dtypes. (:issue:`6959`)
 - Bug in enabling ``subplots=True`` in ``DataFrame.plot`` only has single column raises ``TypeError``, and ``Series.plot`` raises ``AttributeError`` (:issue:`6951`)
 - Bug in ``DataFrame.plot`` draws unnecessary axes when enabling ``subplots`` and ``kind=scatter`` (:issue:`6951`)
+- Bug in ``read_csv`` from a filesystem with non-utf-8 encoding (:issue:`6807`)
 
 pandas 0.13.1
 -------------

diff --git a/pandas/parser.pyx b/pandas/parser.pyx
@@ -535,7 +535,7 @@ cdef class TextReader:
 
         if isinstance(source, basestring):
             if not isinstance(source, bytes):
-                source = source.encode('utf-8')
+                source = source.encode(sys.getfilesystemencoding() or 'utf-8') 
 
             if self.memory_map:
                 ptr = new_mmap(source)