Skip to content

Arrow IPC serializers and parsers#968

Merged
schloerke merged 10 commits into
rstudio:mainfrom
JosiahParry:master
Mar 11, 2025
Merged

Arrow IPC serializers and parsers#968
schloerke merged 10 commits into
rstudio:mainfrom
JosiahParry:master

Conversation

@JosiahParry
Copy link
Copy Markdown
Contributor

This PR adds support for the Arrow IPC format with an IPC serializer and parser.

PR task list:

  • Update NEWS
  • Add tests
  • Update documentation with devtools::document()

@CLAassistant
Copy link
Copy Markdown

CLAassistant commented Dec 17, 2024

CLA assistant check
All committers have signed the CLA.

@JosiahParry
Copy link
Copy Markdown
Contributor Author

Please let me know if there is anything needed for this PR.

@schloerke schloerke requested a review from gadenbuie January 10, 2025 18:20
Comment thread NEWS.md Outdated
Comment thread R/parse-body.R Outdated
@schloerke schloerke added this to the v1.3.0 milestone Jan 29, 2025
@schloerke schloerke removed this from the v1.3.0 milestone Feb 18, 2025
@JosiahParry
Copy link
Copy Markdown
Contributor Author

@gadenbuie I've added the suffix _stream to both the serializer and the parsers. Please let me know if this is sufficient!
Thanks!

@JosiahParry
Copy link
Copy Markdown
Contributor Author

The 3 failing R CMD checks fail installing plumber dependencies. I believe repairing CI is out of the scope of this PR.

@schloerke schloerke merged commit dcf7692 into rstudio:main Mar 11, 2025
@schloerke
Copy link
Copy Markdown
Collaborator

Thank you, @JosiahParry !

@eitsupi
Copy link
Copy Markdown
Contributor

eitsupi commented Mar 11, 2025

The arrow package is a very heavy dependency, so if nanoarrow is sufficient, why not use nanoarrow?
For example, I think bigrquerystorage has moved from arrow to nanoarrow. (meztez/bigrquerystorage#60)

@JosiahParry
Copy link
Copy Markdown
Contributor Author

It’s possible to have multiple parsers and serializers for the same type. It may be a good idea to make a nanoarrow option too!

schloerke added a commit that referenced this pull request Dec 12, 2025
* main:
  fix(docker): Use `pak` to install plumber (#1007)
  ci(check): Test with no depends packages (#1006)
  chore(docker): Update docker workflow. Add latest version to docker being pushed (#1003)
  ci(docker): Add workflow dispatch (#1002)
  Arrow IPC serializers and parsers (#968)
  Increment version number to 1.3.0.9000
  v1.3.0 (#987)
  bug: Validate APIs using `@redocly/cli` (#986)
  Fix broken link (#983)
  bug: Use `req$PATH_INFO` when accessing path location (#888)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants