Skip to content

Problems with special characters in project name #4402

Description

@b2m

This issue describes problems with special characters in the project name and other fields from metadata.json.

To Reproduce

Steps to reproduce the behavior:

  1. Create a project with special characters in the project name ("Testing äüöß").
  2. Close OpenRefine and check metadata.json (everything ok!)
  3. Reopen OpenRefine and check special characters in the project name ("Testing äüöß").
  4. Close OpenRefine and check metadata.json (not ok!)
  5. Reopen OpenRefine and check special characters in the project name ("Testing äüöß")

Current Results

The special characters are somehow completely wrong and their number doubles with each restart of OpenRefine.

Expected Behavior

Reading and writing metadata to metadata.json preserves special characters.

Screenshots

After creating the project (step 1):

openrefine_special_chars_1

First restart (step 3):

openrefine_special_chars_2

Second restart (step 5):

openrefine_special_chars_3

Versions

  • Operating System: Windows 10
  • Browser Version: Firefox 95
  • JRE: 11.0.13 (using the bundled version "openrefine-win-with-java-3.5.1.zip")
  • OpenRefine: observed in 3.5.0, 3.5.1 and 3.5.2

Additional context

  1. The list of garbled up characters grows exponentially which results in realy large metadata.json files and OutOfMemory errors.
  2. This might be related or even be the same problem as described in Out of memory errors from large metadata.json files being parsed during OpenRefine Project Open #3431.
  3. I also observed this problem in metadata.json in the fields .importOptionMetadata and .preferences.entries."exporters.templating.template".

Metadata

Metadata

Assignees

Labels

Type: BugIssues related to software defects or unexpected behavior, which require resolution.encodingSelection of encoding at import time, or encoding issues in data cleaning

Type

No type

Fields

No fields configured for issues without a type.

Projects

No projects

Milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions