-
Notifications
You must be signed in to change notification settings - Fork 7
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Radical changes proposal #3
Comments
I agree, it is not optimized for anything right now. I am not tied to any naming or representation, things were just set up to figure out the API. Should we start benchmarks first? |
Yeah, definitely, we are figuring out API design in dataHaskell :) |
You are also welcome to fork into datahaskell github org, and I can give hackage perms if you help me figure that out :) . It'll be a busy week for me and I don't want to be a blocker. |
Great, AFAIK there's an admin interface in every package page in which you can also add maintainers. 😁 |
I'm not sure switching to MVector will achieve anything.
|
Arrow might be a more worthwhile target: https://arrow.apache.org/ |
Two cents:
I’m a beginner Haskeller. Yesterday I went through a productive day at #haskell-beginners (functional programming) Slack and figured out |
I've been researching about different possible implementations of a dataframe, and it looks like having a
Vector (Vector a)
is quite slower than having other types. Given that Haskell is compiled to machine code it would be ideal to be as fast as a C++ implementation, or at least be somewhere close.( Source )
It would be great if we could migrate to
MVector
or a representation as MutableArrayArray to make this much more faster, and take advantage of libraries like vector-algorithms to make sorting easier. Also, having a stateful representation of our dataframe makes much more sense to me, for people coming from R, Python and even F#.PS: I would really love to rename the
RFrame
type to something likeDataFrame
orDataTable
orTable
or ..., right now it gives the impression that it we are trying to clone R in some way 😄Pinging @ejconlon
The text was updated successfully, but these errors were encountered: