Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

create neon based rust code integration #464

Closed
marcmo opened this issue Sep 13, 2019 · 0 comments
Closed

create neon based rust code integration #464

marcmo opened this issue Sep 13, 2019 · 0 comments
Assignees
@marcmo
Labels
native implemented in the rust part (natively)
Projects
chipmunk feature planing

Comments

@marcmo
Copy link
Member

marcmo commented Sep 13, 2019

currently we use the indexer as a cli tool. to gain more flexibility and to shift more of our functionality to the rust part, we need to create a tighter integration.
neon allows rust libraries to be linked to node applications.
@marcmo marcmo added the indexer label Sep 13, 2019
@marcmo marcmo self-assigned this Sep 13, 2019
@marcmo marcmo added this to ToDo in chipmunk feature planing via automation Sep 13, 2019
@marcmo marcmo moved this from ToDo to In Progress in chipmunk feature planing Sep 13, 2019
marcmo added a commit that referenced this issue Sep 13, 2019
@marcmo
[#464](refactor) indexer: move types to correct modules so we can acc…
097346b 
…ess them with neon
marcmo added a commit that referenced this issue Sep 13, 2019
@marcmo
[#464](refactor) improved error handling for launcher and updater
c744770 
also use log4rs for logging
marcmo added a commit that referenced this issue Sep 13, 2019
@marcmo
[#464](feat) neon interfaces and bindings of indexer functionality
78ce665
marcmo added a commit to marcmo/chipmunk that referenced this issue Sep 25, 2019
@marcmo
[esrlabs#464](feat) implement progress support and cancel support for…
d407de4 
… indexing

indexer needs to be able to deliver events in channel
enable shutdown and progress report
use log crate for logging
increase version of indexer cli
marcmo added a commit to marcmo/chipmunk that referenced this issue Sep 25, 2019
@marcmo
[esrlabs#464](feat): indexer integration via neon
e85b0e9 
* basic event mechanism setup for neon integration
* add argument to index API for TAG
marcmo added a commit to marcmo/chipmunk that referenced this issue Sep 26, 2019
@marcmo
[esrlabs#464](feat): first test for using the newly created neon libr…
0d49419 
…ary for indexing
@marcmo marcmo added native implemented in the rust part (natively) and removed indexer labels Oct 2, 2019
marcmo added a commit to marcmo/chipmunk that referenced this issue Oct 15, 2019
@marcmo
[esrlabs#464](feat) add support to neon integration for dlt
014df50 
neon: wip on typescript side
marcmo added a commit that referenced this issue Oct 18, 2019
@marcmo
[#464](feat) add support to neon integration for dlt
b103eaa 
neon: wip on typescript side
add support for progress reporting in dlt
more general rust channels for js
working tests for dlt indexing
marcmo added a commit to marcmo/chipmunk that referenced this issue Oct 30, 2019
@marcmo
[esrlabs#464](feat): integrate dlt indexing as neon based service
3c9571a 
* we need the event emitter for all the async communication via neon
  thus it needs to be a little more general.
  also: results for longrunning async operations will now be always
  streamed.
* progress reporting and passing chunks from rust to js
* detect duplicate files rake task
marcmo added a commit to marcmo/chipmunk that referenced this issue Oct 30, 2019
@marcmo
[esrlabs#464](feat): integrate dlt indexing as neon based service
dad4c00 
* we need the event emitter for all the async communication via neon
  thus it needs to be a little more general.
  also: results for longrunning async operations will now be always
  streamed.
* progress reporting and passing chunks from rust to js
* detect duplicate files rake task
DmitryAstafyev pushed a commit that referenced this issue Oct 30, 2019
@marcmo @DmitryAstafyev
[#464](feat): integrate dlt indexing as neon based service
b555ae8 
* we need the event emitter for all the async communication via neon
  thus it needs to be a little more general.
  also: results for longrunning async operations will now be always
  streamed.
* progress reporting and passing chunks from rust to js
* detect duplicate files rake task
marcmo added a commit to marcmo/chipmunk that referenced this issue Nov 13, 2019
@marcmo
[esrlabs#464](feat) remodel neon integration, add concatenation support
8f3c71d 
* add option to get notifications from indexing/parsing
* add indexer error reporting
* tests running and usecases seem to work
* convert timespan operation results to stream semantics
* support for async discover timespan action (neon binding);
* support for async file concatenation
* updated package-lock files
* lvin removed from concatenation
* integration of neon based file concatenation
marcmo added a commit to marcmo/chipmunk that referenced this issue Nov 13, 2019
@marcmo
[esrlabs#464](feat) remodel neon integration, add concatenation support
2f835dd 
* add option to get notifications from indexing/parsing
* add indexer error reporting
* tests running and usecases seem to work
* convert timespan operation results to stream semantics
* support for async discover timespan action (neon binding);
* support for async file concatenation
* updated package-lock files
* lvin removed from concatenation
* integration of neon based file concatenation
marcmo added a commit that referenced this issue Nov 13, 2019
@marcmo
[#464](feat) remodel neon integration, add concatenation support
fadf6f9 
* add option to get notifications from indexing/parsing
* add indexer error reporting
* tests running and usecases seem to work
* convert timespan operation results to stream semantics
* support for async discover timespan action (neon binding);
* support for async file concatenation
* updated package-lock files
* lvin removed from concatenation
* integration of neon based file concatenation
marcmo added a commit to marcmo/chipmunk that referenced this issue Nov 18, 2019
@marcmo
[esrlabs#464](feat) port rest of chipmunk functionality to neon inter…
1a1c14c 
…face

* prepare merger api for streaming
* add neon based async merger function
* support of async merging
* timestamp discovery over neon interface
* no lvin anymore -- remove indexer_cli from build
@marcmo marcmo closed this as completed Dec 4, 2019
chipmunk feature planing automation moved this from In Progress to done Dec 4, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@marcmo marcmo

Labels
native implemented in the rust part (natively)
Projects
chipmunk feature planing
  
done
Milestone
No milestone
Development

No branches or pull requests
1 participant
@marcmo