/scrapy

Add option to set JSON output encoding #1965

Closed
redapple opened this Issue May 2, 2016 · 2 comments

Comments

Assignees
No one assigned
Labels
discuss enhancement help-wanted
Projects
None yet
Milestone
No milestone
3 participants
@redapple @mgachhui @kmike
@redapple
Contributor

redapple commented May 2, 2016

Some users may prefer UTF-8 encoding of characters when using JSON output, instead of the the default \UXXXX espace sequences. See #1963 (comment).

The option to turn off ensure_ascii and/or output encoding for JsonItemExporter could be interesting.

@redapple redapple added enhancement discuss help-wanted labels May 2, 2016

@redapple redapple referenced this issue May 2, 2016

Closed

The encoding problem in outputing data to file #1963

@mgachhui
Contributor

mgachhui commented May 10, 2016

The options method @wi-cuckoo mentioned in #1963 seems doable. What if we extend the crawler by adding an encoding option as -e? As far as I can tell, it'll make sense for XML and CSV as well, in addition to JSON.

dracony added a commit to dracony/scrapy that referenced this issue Jun 6, 2016

@dracony
added option to turn off ensure_ascii for Json exporters. See #1965
559af9c

@dracony dracony referenced this issue Jun 6, 2016

Merged

[MRG+1] Added option to turn off ensure_ascii for JSON exporters #2034

dracony added a commit to dracony/scrapy that referenced this issue Jun 6, 2016

@dracony
added option to turn off ensure_ascii for Json exporters. See #1965
a7cfec6

dracony added a commit to dracony/scrapy that referenced this issue Jun 6, 2016

@dracony
added option to turn off ensure_ascii for Json exporters. See #1965
ba86319
@kmike
Owner

kmike commented Sep 18, 2016

Fixed by #2034.

@kmike kmike closed this Sep 18, 2016

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment