Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add Column by Fetching URL silently fails on malformed URLs #6137

Closed
tfmorris opened this issue Nov 5, 2023 · 0 comments · Fixed by #6141
Closed

Add Column by Fetching URL silently fails on malformed URLs #6137

tfmorris opened this issue Nov 5, 2023 · 0 comments · Fixed by #6141
Assignees
Labels
error handling Improving the ways errors are reported to users fetch urls About fetching URLs in a project Type: Bug Issues related to software defects or unexpected behavior, which require resolution.
Milestone

Comments

@tfmorris
Copy link
Member

tfmorris commented Nov 5, 2023

If an invalid URL is used for the Add Column by Fetching URLs operation, the operation silently results in a null value instead of an error, making it much more difficult for the user to figure out what the problem is. This was recently on the forum as a cause of confusion for a user: https://forum.openrefine.org/t/fetching-urls-with-arabic-values/1036/1

This behavior was checked by a test, so I coded the new HTTP support to mimic it, but I think the test is wrong and we should fix both it and the code so that URL/URI errors get reported to the user in an intelligible fashion.

To Reproduce

Steps to reproduce the behavior:

  1. Create a project with a cell containing the text: https://transliterate.qcri.org/ar2en/احمد احمد
  2. Select Add a Column by Fetching URLs
  3. For "On error:" select "store error"

Current Results

The operation silently fails with no error stored in the cell.

Expected Behavior

The cell value should be set to an EvalError with the appropriate error code/message.

Versions

  • OpenRefine: 3.8-snapshot (ie current HEAD)
@tfmorris tfmorris added Type: Bug Issues related to software defects or unexpected behavior, which require resolution. fetch urls About fetching URLs in a project error handling Improving the ways errors are reported to users labels Nov 5, 2023
@tfmorris tfmorris self-assigned this Nov 5, 2023
tfmorris added a commit to tfmorris/OpenRefine that referenced this issue Nov 5, 2023
@tfmorris tfmorris added this to the 3.8 milestone Nov 5, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
error handling Improving the ways errors are reported to users fetch urls About fetching URLs in a project Type: Bug Issues related to software defects or unexpected behavior, which require resolution.
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant