Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Auto-saving during an import of large files can result in java heap errors #3

Closed
tfmorris opened this issue Oct 15, 2012 · 2 comments
Closed
Labels
imported from old code repo Issue imported from Google Code in 2010 Priority: Medium Represents important issues that need to be addressed but are not urgent Type: Bug Issues related to software defects or unexpected behavior, which require resolution.
Milestone

Comments

@tfmorris
Copy link
Member

Original author: dfhu...@gmail.com (May 09, 2010 04:42:40)

C:\Users\tguidry\Documents\Downloads\gridworks-1.0a4-r93878>gridworks \m 1024m
13:57:27.463 [ gridworks_server] Initializing context: '/' from 'C:\User
s\tguidry\Documents\Downloads\gridworks-1.0a4-r93878\webapp' (0ms)
13:57:27.885 [ project_manager] Using workspace directory: C:\Users\tgu
idry\AppData\Local\Gridworks (422ms)
13:57:27.887 [ project_manager] Loading workspace: C:\Users\tguidry\App
Data\Local\Gridworks\workspace.json (2ms)
13:58:59.236 [ create-project_command] Importing 'dw_sales_invoice query.xml'
(91349ms)
14:02:28.431 [ project_manager] Saved workspace (209195ms)
14:12:20.078 [ project_manager] Saved workspace (591647ms)
14:12:30.689 [ project_manager] Saved workspace (10611ms)
14:12:41.147 [ org.mortbay.log] Error for /command/create-project-from-
upload (10458ms)
java.lang.OutOfMemoryError: Java heap space
14:17:28.035 [ project_manager] Saved workspace (286888ms)

Original issue: http://code.google.com/p/google-refine/issues/detail?id=3

@tfmorris
Copy link
Member Author

From dfhu...@gmail.com on May 12, 2010 05:37:15:
Fixed in r627. Thad, could you please verify?

@tfmorris
Copy link
Member Author

From thadguidry on May 13, 2010 16:19:01:
Verified with 1 GB Aggregate load test. No auto-save occurred within 6 mins.

tfmorris referenced this issue in tfmorris/OpenRefine Jul 3, 2014
Resolved conflicts with master branch
antoine2711 added a commit that referenced this issue Apr 18, 2022
antoine2711 added a commit that referenced this issue Jun 21, 2022
antoine2711 added a commit that referenced this issue Jun 21, 2022
antoine2711 added a commit that referenced this issue Jun 21, 2022
antoine2711 added a commit that referenced this issue Jun 21, 2022
zyadtaha added a commit to zyadtaha/OpenRefine that referenced this issue Aug 13, 2024
# This is the 1st commit message:

Add Standard Module Header

# This is the commit message OpenRefine#2:

Improves NGramFingerprintKeyer and adds tests (OpenRefine#6736)

* Improves NGramFingerprintKeyer and adds tests
- change NGramFingerprintKeyer to use a character set (aka character class) in regex which handles the OR condition intrinsically.  As an example `[$\u20AC]` would match a dollar or euro sign.  See https://rules.sonarsource.com/javascript/RSPEC-6035/

* move NGramKeyer test from KeyerTests to NGramFingerprintKeyerTest
# This is the commit message OpenRefine#3:

Translated using Weblate (Catalan)

Currently translated at 100.0% (12 of 12 strings)

Translated using Weblate (Catalan)

Currently translated at 100.0% (62 of 62 strings)

Translated using Weblate (Catalan)

Currently translated at 100.0% (349 of 349 strings)

Translated using Weblate (Catalan)

Currently translated at 100.0% (908 of 908 strings)

Co-authored-by: Hosted Weblate <hosted@weblate.org>
Co-authored-by: Robert Garrigós <robert@garrigos.cat>
Translate-URL: https://hosted.weblate.org/projects/openrefine/openrefine-control-evaluation-errors/ca/
Translate-URL: https://hosted.weblate.org/projects/openrefine/openrefine-operation-descriptions/ca/
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/ca/
Translate-URL: https://hosted.weblate.org/projects/openrefine/wikidata/ca/
Translation: OpenRefine/OpenRefine Control Evaluation Errors
Translation: OpenRefine/OpenRefine Operation Descriptions
Translation: OpenRefine/Translations
Translation: OpenRefine/wikibase

# This is the commit message OpenRefine#4:

build(deps): bump cypress in /main/tests/cypress in the cypress group (OpenRefine#6759)

Bumps the cypress group in /main/tests/cypress with 1 update: [cypress](https://github.com/cypress-io/cypress).


Updates `cypress` from 13.13.1 to 13.13.2
- [Release notes](https://github.com/cypress-io/cypress/releases)
- [Changelog](https://github.com/cypress-io/cypress/blob/develop/CHANGELOG.md)
- [Commits](cypress-io/cypress@v13.13.1...v13.13.2)

---
updated-dependencies:
- dependency-name: cypress
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: cypress
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
# This is the commit message OpenRefine#5:

build(deps): bump org.xerial:sqlite-jdbc from 3.46.0.0 to 3.46.0.1 (OpenRefine#6760)

Bumps [org.xerial:sqlite-jdbc](https://github.com/xerial/sqlite-jdbc) from 3.46.0.0 to 3.46.0.1.
- [Release notes](https://github.com/xerial/sqlite-jdbc/releases)
- [Changelog](https://github.com/xerial/sqlite-jdbc/blob/master/CHANGELOG)
- [Commits](xerial/sqlite-jdbc@3.46.0.0...3.46.0.1)

---
updated-dependencies:
- dependency-name: org.xerial:sqlite-jdbc
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
# This is the commit message OpenRefine#6:

build(deps): bump org.owasp.encoder:encoder from 1.2.3 to 1.3.0 (OpenRefine#6761)

Bumps [org.owasp.encoder:encoder](https://github.com/owasp/owasp-java-encoder) from 1.2.3 to 1.3.0.
- [Release notes](https://github.com/owasp/owasp-java-encoder/releases)
- [Commits](OWASP/owasp-java-encoder@v1.2.3...v1.3.0)

---
updated-dependencies:
- dependency-name: org.owasp.encoder:encoder
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
# This is the commit message OpenRefine#7:

build(deps): bump org.clojure:clojure from 1.11.3 to 1.11.4 (OpenRefine#6763)

Bumps [org.clojure:clojure](https://github.com/clojure/clojure) from 1.11.3 to 1.11.4.
- [Changelog](https://github.com/clojure/clojure/blob/master/changes.md)
- [Commits](clojure/clojure@clojure-1.11.3...clojure-1.11.4)

---
updated-dependencies:
- dependency-name: org.clojure:clojure
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
# This is the commit message OpenRefine#8:

build(deps): bump com.google.apis:google-api-services-drive (OpenRefine#6762)

Bumps com.google.apis:google-api-services-drive from v3-rev20240628-2.0.0 to v3-rev20240722-2.0.0.

---
updated-dependencies:
- dependency-name: com.google.apis:google-api-services-drive
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
# This is the commit message OpenRefine#9:

Make test failures easier to understand

# This is the commit message OpenRefine#10:

Increase TSV/CSV column limit to 32K (from 512). Fixes OpenRefine#6723

# This is the commit message OpenRefine#11:

Clean up file export. Fixes OpenRefine#6549 (OpenRefine#6749)

- don't percent encode period (.) or any other safe characters
- use upper case UTF-8 character set designator per spec
- construct a safe USASCII fallback filename
- for Safari browsers, send the filename as native UTF-8
  without rfc5987 encoding since it doesn't support it
# This is the commit message OpenRefine#12:

add missing parameter for JavaDocs in MediaInfoEdit
@wetneb do you think I worded the parameter description well enough?
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
imported from old code repo Issue imported from Google Code in 2010 Priority: Medium Represents important issues that need to be addressed but are not urgent Type: Bug Issues related to software defects or unexpected behavior, which require resolution.
Projects
None yet
Development

No branches or pull requests

1 participant