Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Use standalone ArrowTypes package #212

Merged
merged 11 commits into from Jul 7, 2021
Merged

Use standalone ArrowTypes package #212

merged 11 commits into from Jul 7, 2021

Conversation

omus
Copy link
Contributor

@omus omus commented Jun 14, 2021

Fixes: #209.

The one big hangup with this change is the inclusion of the Manifest.toml. The manifest allows use to dev src/ArrowTypes which means any changes to that code will immediately be reflected during local development. Additionally, since the manifest is committed the CI should also work the same way. Unfortunately, this can lead to changes to ArrowTypes.jl going unregistered (like what has currently happened).

Alternatively, we may want to not commit the Manifest.toml file and instead document how to setup a manifest file for local development and never commit it. This approach is more setup for developers but ensures that the CI is testing what users of the packages will ultimately end up seeing. I'm in favor of this approach

@omus omus requested a review from quinnj June 14, 2021 20:36
@omus omus force-pushed the cv/non-relative-ArrowTypes branch from 0ea2423 to 30c89ca Compare June 14, 2021 20:39
@codecov
Copy link

codecov bot commented Jun 14, 2021

Codecov Report

Merging #212 (47eb66b) into main (a43a235) will decrease coverage by 2.96%.
The diff coverage is n/a.

Impacted file tree graph

@@            Coverage Diff             @@
##             main     #212      +/-   ##
==========================================
- Coverage   86.08%   83.11%   -2.97%     
==========================================
  Files          26       26              
  Lines        3025     3092      +67     
==========================================
- Hits         2604     2570      -34     
- Misses        421      522     +101     
Impacted Files Coverage Δ
src/Arrow.jl 56.52% <ø> (ø)
src/ArrowTypes/src/ArrowTypes.jl 74.52% <0.00%> (-22.90%) ⬇️
src/FlatBuffers/builder.jl 73.86% <0.00%> (-4.93%) ⬇️
src/arraytypes/list.jl 87.20% <0.00%> (-4.40%) ⬇️
src/arraytypes/fixedsizelist.jl 80.41% <0.00%> (-3.46%) ⬇️
src/metadata/Message.jl 73.55% <0.00%> (-3.18%) ⬇️
src/FlatBuffers/table.jl 50.72% <0.00%> (-3.13%) ⬇️
src/metadata/Schema.jl 79.05% <0.00%> (-2.98%) ⬇️
src/arraytypes/compressed.jl 97.43% <0.00%> (-2.57%) ⬇️
src/append.jl 90.54% <0.00%> (-2.52%) ⬇️
... and 9 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update a43a235...47eb66b. Read the comment docs.

@omus
Copy link
Contributor Author

omus commented Jun 14, 2021

As 1.3 seems to be failing on the Manifest.toml I'll switch this over to using the other idea

@quinnj
Copy link
Member

quinnj commented Jun 15, 2021

Yes, I'm in favor of not committing the manifest file

@omus
Copy link
Contributor Author

omus commented Jun 15, 2021

Expecting CI to fail until #213 is merged and registered

.github/workflows/ci.yml Outdated Show resolved Hide resolved
@omus omus force-pushed the cv/non-relative-ArrowTypes branch 2 times, most recently from fbbd33c to 2905ae3 Compare June 17, 2021 13:48
@@ -17,6 +18,7 @@ TimeZones = "f269a46b-ccf7-5d73-abea-4c690281aa53"
UUIDs = "cf7118a7-6976-5b1a-9a39-7adc72f591a4"

[compat]
ArrowTypes = "1.1"
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The Arrow.jl package should only requires ArrowTypes.jl 1.0 but the tests require 1.1.

@omus
Copy link
Contributor Author

omus commented Jun 17, 2021

@quinnj please approve the CI to run when you get the chance. There may be a little debugging to do on the CI side before this is ready

@quinnj
Copy link
Member

quinnj commented Jun 17, 2021

I don't have an option to approve CI; that would seem to indicate something in the ci.yml file that's causing CI not to run

@ericphanson
Copy link
Member

something in the ci.yml file that's causing CI not to run

If I edit it in the GitHub editor, it has syntax highlighting and shows errors:

Screenshot 2021-06-25 at 19 44 23

@omus omus force-pushed the cv/non-relative-ArrowTypes branch from d128552 to 28d077e Compare June 25, 2021 18:04
@omus
Copy link
Contributor Author

omus commented Jun 25, 2021

RTM. CI is now functional

codecov.yaml Outdated Show resolved Hide resolved
README.md Outdated Show resolved Hide resolved
Co-authored-by: Eric Hanson <5846501+ericphanson@users.noreply.github.com>
Copy link
Contributor

@jrevels jrevels left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM. What are the follow ups for registration?

@omus
Copy link
Contributor Author

omus commented Jul 6, 2021

LGTM. What are the follow ups for registration?

Should just be the registration. ArrowTypes version 1.1.0 has already been registered. Once this change is merged and registered any package which only depends on ArrowTypes.jl should be able to extend Arrow.jl without having to use Arrow.jl as a dependency.

@omus
Copy link
Contributor Author

omus commented Jul 6, 2021

I'm just validating that adding Arrow support through ArrowTypes.jl is fully working

@omus
Copy link
Contributor Author

omus commented Jul 7, 2021

I'm just validating that adding Arrow support through ArrowTypes.jl is fully working

We're good here. My validation brought up some things I need to work through which are independent from these changes.

@omus omus merged commit 533d5e8 into main Jul 7, 2021
@omus omus deleted the cv/non-relative-ArrowTypes branch July 7, 2021 13:44
@omus omus mentioned this pull request Jul 7, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

ArrowTypes as standalone package doesn't interoperate with Arrow.ArrowTypes
4 participants