Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Go] Adding Avro OCF reader #36760

Closed
loicalleyne opened this issue Jul 18, 2023 · 0 comments · Fixed by #37115
Closed

[Go] Adding Avro OCF reader #36760

loicalleyne opened this issue Jul 18, 2023 · 0 comments · Fixed by #37115
Assignees
Milestone

Comments

@loicalleyne
Copy link
Contributor

Describe the enhancement requested

Request : Add a reader that reads Avro serialized data into arrow format.

Components:

  • avro schema converter
  • avro data reader

Component(s)

Go

@loicalleyne loicalleyne changed the title Adding Avro OCF reader [Go] Adding Avro OCF reader Jul 19, 2023
loicalleyne added a commit to loicalleyne/arrow that referenced this issue Jul 25, 2023
loicalleyne added a commit to loicalleyne/arrow that referenced this issue Jul 25, 2023
loicalleyne added a commit to loicalleyne/arrow that referenced this issue Aug 1, 2023
loicalleyne added a commit to loicalleyne/arrow that referenced this issue Aug 10, 2023
loicalleyne added a commit to loicalleyne/arrow that referenced this issue Aug 10, 2023
loicalleyne added a commit to loicalleyne/arrow that referenced this issue Aug 10, 2023
loicalleyne added a commit to loicalleyne/arrow that referenced this issue Aug 10, 2023
loicalleyne added a commit to loicalleyne/arrow that referenced this issue Aug 10, 2023
loicalleyne added a commit to loicalleyne/arrow that referenced this issue Aug 21, 2023
loicalleyne added a commit to loicalleyne/arrow that referenced this issue Aug 25, 2023
loicalleyne added a commit to loicalleyne/arrow that referenced this issue Sep 1, 2023
loicalleyne added a commit to loicalleyne/arrow that referenced this issue Sep 6, 2023
to match apacheGH-36760: [Go] Adding avro ocf reader - schema converter apache#36796
loicalleyne added a commit to loicalleyne/arrow that referenced this issue Sep 7, 2023
loicalleyne added a commit to loicalleyne/arrow that referenced this issue Sep 7, 2023
loicalleyne added a commit to loicalleyne/arrow that referenced this issue Sep 7, 2023
to match apacheGH-36760: [Go] Adding avro ocf reader - schema converter apache#36796
loicalleyne added a commit to loicalleyne/arrow that referenced this issue Sep 7, 2023
loicalleyne pushed a commit to loicalleyne/arrow that referenced this issue Sep 19, 2023
loicalleyne added a commit to loicalleyne/arrow that referenced this issue Sep 29, 2023
loicalleyne added a commit to loicalleyne/arrow that referenced this issue Oct 6, 2023
loicalleyne added a commit to loicalleyne/arrow that referenced this issue Oct 6, 2023
loicalleyne added a commit to loicalleyne/arrow that referenced this issue Nov 2, 2023
loicalleyne added a commit to loicalleyne/arrow that referenced this issue Nov 13, 2023
loicalleyne added a commit to loicalleyne/arrow that referenced this issue Nov 13, 2023
to match apacheGH-36760: [Go] Adding avro ocf reader - schema converter apache#36796
loicalleyne added a commit to loicalleyne/arrow that referenced this issue Nov 13, 2023
to match apacheGH-36760: [Go] Adding avro ocf reader - schema converter apache#36796
loicalleyne added a commit to loicalleyne/arrow that referenced this issue Nov 13, 2023
zeroshade added a commit that referenced this issue Nov 27, 2023
### Rationale for this change

### What changes are included in this PR?
Avro reader 

### Are these changes tested?
Local integration tests, no unit tests yet.

### Are there any user-facing changes?
New Avro reader API

* Closes: #36760

Lead-authored-by: Loïc Alleyne <loicalleyne@gmail.com>
Co-authored-by: Sutou Kouhei <kou@clear-code.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Raúl Cumplido <raulcumplido@gmail.com>
Co-authored-by: sgilmore10 <74676073+sgilmore10@users.noreply.github.com>
Co-authored-by: Dewey Dunnington <dewey@fishandwhistle.net>
Co-authored-by: Alenka Frim <AlenkaF@users.noreply.github.com>
Co-authored-by: mwish <maplewish117@gmail.com>
Co-authored-by: James Duong <duong.james@gmail.com>
Co-authored-by: Dewey Dunnington <dewey@voltrondata.com>
Co-authored-by: Antoine Pitrou <antoine@python.org>
Co-authored-by: Felipe Oliveira Carvalho <felipekde@gmail.com>
Co-authored-by: Dane Pitkin <48041712+danepitkin@users.noreply.github.com>
Co-authored-by: Kevin Gurney <kgurney@mathworks.com>
Co-authored-by: Matt Topol <zotthewizard@gmail.com>
Co-authored-by: Curt Hagenlocher <curt@hagenlocher.org>
Co-authored-by: Jacob Wujciak-Jens <jacob@wujciak.de>
Co-authored-by: Hyunseok Seo <hsseo0501@gmail.com>
Co-authored-by: Joris Van den Bossche <jorisvandenbossche@gmail.com>
Co-authored-by: James Duong <james.duong@improving.com>
Co-authored-by: Nic Crane <thisisnic@gmail.com>
Co-authored-by: Ivan Chesnov <ivan.chesnov@dremio.com>
Co-authored-by: Diego Fernández Giraldo <aiguo.fernandez@gmail.com>
Co-authored-by: Bryce Mecum <petridish@gmail.com>
Co-authored-by: Jonathan Keane <jkeane@gmail.com>
Co-authored-by: Peter Andreas Entschev <peter@entschev.com>
Co-authored-by: abandy <abandy@live.com>
Co-authored-by: Lei Hou <leihou@mathworks.com>
Co-authored-by: Yue <niyue.com@gmail.com>
Co-authored-by: davidhcoe <13318837+davidhcoe@users.noreply.github.com>
Co-authored-by: Tsutomu Katsube <tsuto.katsube@gmail.com>
Co-authored-by: Divyansh200102 <146909065+Divyansh200102@users.noreply.github.com>
Co-authored-by: Thomas Newton <thomas.w.newton@gmail.com>
Co-authored-by: Jeremy Aguilon <jeraguilon@gmail.com>
Co-authored-by: prmoore77 <prmoore77@hotmail.com>
Co-authored-by: Jiaxing Liang <58449896+sfc-gh-jliang@users.noreply.github.com>
Co-authored-by: orgadish <48453207+orgadish@users.noreply.github.com>
Co-authored-by: Maximilian Muecke <muecke.maximilian@gmail.com>
Co-authored-by: Gavin Murrison <2135106+voidstar69@users.noreply.github.com>
Co-authored-by: William Ayd <william.ayd@icloud.com>
Co-authored-by: Laurent Goujon <laurentgo@users.noreply.github.com>
Co-authored-by: Jin Shang <shangjin1997@gmail.com>
Co-authored-by: Alexander Grueneberg <com.github@agrueneberg.info>
Co-authored-by: Paul Spangler <7519484+spanglerco@users.noreply.github.com>
Co-authored-by: Gang Wu <ustcwg@gmail.com>
Co-authored-by: Michael Lui <mikelui@users.noreply.github.com>
Co-authored-by: patrick <100629128+p-a-a-a-trick@users.noreply.github.com>
Co-authored-by: Dan Homola <dan.homola@hotmail.cz>
Co-authored-by: Ben Harkins <60872452+benibus@users.noreply.github.com>
Co-authored-by: Nick Hughes <nick@intervaliq.com>
Co-authored-by: Fernando Mayer <fernandomayer@gmail.com>
Co-authored-by: Rok Mihevc <rok@mihevc.org>
Co-authored-by: Francis <455954986@qq.com>
Co-authored-by: Donald Tolley <tolleybot@gmail.com>
Co-authored-by: Judah Rand <17158624+judahrand@users.noreply.github.com>
Co-authored-by: Eero Lihavainen <eero.lihavainen@nitor.com>
Co-authored-by: Benjamin Schmidt <bmschmidt@gmail.com>
Co-authored-by: Phillip LeBlanc <phillip@leblanc.tech>
Co-authored-by: Pierre Moulon <pmoulon@gmail.com>
Co-authored-by: Benjamin Kietzman <bengilgit@gmail.com>
Co-authored-by: Fokko Driesprong <fokko@tabular.io>
Co-authored-by: Bryan Cutler <cutlerb@gmail.com>
Co-authored-by: Diogo Teles Sant'Anna <diogoteles@google.com>
Co-authored-by: Fatemah Panahi <fatemehp@users.noreply.github.com>
Co-authored-by: Junming Chen <junming.chen.r@outlook.com>
Co-authored-by: Chris Larsen <clarsen@euphoriaaudio.com>
Co-authored-by: Dan Stone <wotbrew@gmail.com>
Co-authored-by: Tim Schaub <tschaub@users.noreply.github.com>
Co-authored-by: Will Jones <willjones127@gmail.com>
Co-authored-by: Kevin Gurney <kevin.p.gurney@gmail.com>
Co-authored-by: Sarah Gilmore <sgilmore@mathworks.com>
Co-authored-by: jeremy <jeraguilon@gmail.com>
Co-authored-by: Dan Homola <dan.homola@gooddata.com>
Co-authored-by: Sutou Kouhei <kou@cozmixng.org>
Co-authored-by: anjakefala <anja@voltrondata.com>
Co-authored-by: Antoine Pitrou <pitrou@free.fr>
Co-authored-by: Jeremy Aguilon <jaguilon@hudson-trading.com>
Co-authored-by: Weston Pace <weston.pace@gmail.com>
Co-authored-by: scoder <stefan_ml@behnel.de>
Co-authored-by: voidstar69 <voidstar69@gmail.com>
Co-authored-by: Dewey Dunnington <dewey@dunnington.ca>
Co-authored-by: Ivan Chesnov <xxxlaykxxx@gmail.com>
Co-authored-by: mwish <1506118561@qq.com>
Co-authored-by: David Li <li.davidm96@gmail.com>
Signed-off-by: Matt Topol <zotthewizard@gmail.com>
@zeroshade zeroshade added this to the 15.0.0 milestone Nov 27, 2023
dgreiss pushed a commit to dgreiss/arrow that referenced this issue Feb 19, 2024
### Rationale for this change

### What changes are included in this PR?
Avro reader 

### Are these changes tested?
Local integration tests, no unit tests yet.

### Are there any user-facing changes?
New Avro reader API

* Closes: apache#36760

Lead-authored-by: Loïc Alleyne <loicalleyne@gmail.com>
Co-authored-by: Sutou Kouhei <kou@clear-code.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Raúl Cumplido <raulcumplido@gmail.com>
Co-authored-by: sgilmore10 <74676073+sgilmore10@users.noreply.github.com>
Co-authored-by: Dewey Dunnington <dewey@fishandwhistle.net>
Co-authored-by: Alenka Frim <AlenkaF@users.noreply.github.com>
Co-authored-by: mwish <maplewish117@gmail.com>
Co-authored-by: James Duong <duong.james@gmail.com>
Co-authored-by: Dewey Dunnington <dewey@voltrondata.com>
Co-authored-by: Antoine Pitrou <antoine@python.org>
Co-authored-by: Felipe Oliveira Carvalho <felipekde@gmail.com>
Co-authored-by: Dane Pitkin <48041712+danepitkin@users.noreply.github.com>
Co-authored-by: Kevin Gurney <kgurney@mathworks.com>
Co-authored-by: Matt Topol <zotthewizard@gmail.com>
Co-authored-by: Curt Hagenlocher <curt@hagenlocher.org>
Co-authored-by: Jacob Wujciak-Jens <jacob@wujciak.de>
Co-authored-by: Hyunseok Seo <hsseo0501@gmail.com>
Co-authored-by: Joris Van den Bossche <jorisvandenbossche@gmail.com>
Co-authored-by: James Duong <james.duong@improving.com>
Co-authored-by: Nic Crane <thisisnic@gmail.com>
Co-authored-by: Ivan Chesnov <ivan.chesnov@dremio.com>
Co-authored-by: Diego Fernández Giraldo <aiguo.fernandez@gmail.com>
Co-authored-by: Bryce Mecum <petridish@gmail.com>
Co-authored-by: Jonathan Keane <jkeane@gmail.com>
Co-authored-by: Peter Andreas Entschev <peter@entschev.com>
Co-authored-by: abandy <abandy@live.com>
Co-authored-by: Lei Hou <leihou@mathworks.com>
Co-authored-by: Yue <niyue.com@gmail.com>
Co-authored-by: davidhcoe <13318837+davidhcoe@users.noreply.github.com>
Co-authored-by: Tsutomu Katsube <tsuto.katsube@gmail.com>
Co-authored-by: Divyansh200102 <146909065+Divyansh200102@users.noreply.github.com>
Co-authored-by: Thomas Newton <thomas.w.newton@gmail.com>
Co-authored-by: Jeremy Aguilon <jeraguilon@gmail.com>
Co-authored-by: prmoore77 <prmoore77@hotmail.com>
Co-authored-by: Jiaxing Liang <58449896+sfc-gh-jliang@users.noreply.github.com>
Co-authored-by: orgadish <48453207+orgadish@users.noreply.github.com>
Co-authored-by: Maximilian Muecke <muecke.maximilian@gmail.com>
Co-authored-by: Gavin Murrison <2135106+voidstar69@users.noreply.github.com>
Co-authored-by: William Ayd <william.ayd@icloud.com>
Co-authored-by: Laurent Goujon <laurentgo@users.noreply.github.com>
Co-authored-by: Jin Shang <shangjin1997@gmail.com>
Co-authored-by: Alexander Grueneberg <com.github@agrueneberg.info>
Co-authored-by: Paul Spangler <7519484+spanglerco@users.noreply.github.com>
Co-authored-by: Gang Wu <ustcwg@gmail.com>
Co-authored-by: Michael Lui <mikelui@users.noreply.github.com>
Co-authored-by: patrick <100629128+p-a-a-a-trick@users.noreply.github.com>
Co-authored-by: Dan Homola <dan.homola@hotmail.cz>
Co-authored-by: Ben Harkins <60872452+benibus@users.noreply.github.com>
Co-authored-by: Nick Hughes <nick@intervaliq.com>
Co-authored-by: Fernando Mayer <fernandomayer@gmail.com>
Co-authored-by: Rok Mihevc <rok@mihevc.org>
Co-authored-by: Francis <455954986@qq.com>
Co-authored-by: Donald Tolley <tolleybot@gmail.com>
Co-authored-by: Judah Rand <17158624+judahrand@users.noreply.github.com>
Co-authored-by: Eero Lihavainen <eero.lihavainen@nitor.com>
Co-authored-by: Benjamin Schmidt <bmschmidt@gmail.com>
Co-authored-by: Phillip LeBlanc <phillip@leblanc.tech>
Co-authored-by: Pierre Moulon <pmoulon@gmail.com>
Co-authored-by: Benjamin Kietzman <bengilgit@gmail.com>
Co-authored-by: Fokko Driesprong <fokko@tabular.io>
Co-authored-by: Bryan Cutler <cutlerb@gmail.com>
Co-authored-by: Diogo Teles Sant'Anna <diogoteles@google.com>
Co-authored-by: Fatemah Panahi <fatemehp@users.noreply.github.com>
Co-authored-by: Junming Chen <junming.chen.r@outlook.com>
Co-authored-by: Chris Larsen <clarsen@euphoriaaudio.com>
Co-authored-by: Dan Stone <wotbrew@gmail.com>
Co-authored-by: Tim Schaub <tschaub@users.noreply.github.com>
Co-authored-by: Will Jones <willjones127@gmail.com>
Co-authored-by: Kevin Gurney <kevin.p.gurney@gmail.com>
Co-authored-by: Sarah Gilmore <sgilmore@mathworks.com>
Co-authored-by: jeremy <jeraguilon@gmail.com>
Co-authored-by: Dan Homola <dan.homola@gooddata.com>
Co-authored-by: Sutou Kouhei <kou@cozmixng.org>
Co-authored-by: anjakefala <anja@voltrondata.com>
Co-authored-by: Antoine Pitrou <pitrou@free.fr>
Co-authored-by: Jeremy Aguilon <jaguilon@hudson-trading.com>
Co-authored-by: Weston Pace <weston.pace@gmail.com>
Co-authored-by: scoder <stefan_ml@behnel.de>
Co-authored-by: voidstar69 <voidstar69@gmail.com>
Co-authored-by: Dewey Dunnington <dewey@dunnington.ca>
Co-authored-by: Ivan Chesnov <xxxlaykxxx@gmail.com>
Co-authored-by: mwish <1506118561@qq.com>
Co-authored-by: David Li <li.davidm96@gmail.com>
Signed-off-by: Matt Topol <zotthewizard@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants