GitHub - aipescience/DBIngestor: This library provides wrappers to data ingestion into various DB systems, such as MySQL, SQLite3, and ODBC compatible systems. You can use this C++ library to ingest data in any format (you need to implement the reading routines though). The library provides an ingestion buffer that allows for multiple rows to be ingested at one time. This greatly improves ingestion performance. Further assertion and conversion functions are provided for elementary data transformation and processing. These can easily be extended by custom functions and many examples for implementing such functions are provided in the source.

aipescience / DBIngestor Public

Notifications You must be signed in to change notification settings
Fork 1
Star 6

This library provides wrappers to data ingestion into various DB systems, such as MySQL, SQLite3, and ODBC compatible systems. You can use this C++ library to ingest data in any format (you need to implement the reading routines though). The library provides an ingestion buffer that allows for multiple rows to be ingested at one time. This great…

Apache-2.0 license

6 stars 1 fork Branches Tags Activity

Star

Notifications

Branches Tags

Name		Name	Last commit message	Last commit date
Latest commit History 25 Commits
DBIngestor		DBIngestor
Modules		Modules
examples/HelloWorld		examples/HelloWorld
CMakeLists.txt		CMakeLists.txt
DBIngestor.doxyfile		DBIngestor.doxyfile
INSTALL		INSTALL
LICENSE		LICENSE
NOTICE		NOTICE
README		README

Repository files navigation

DBIngestor library
------------------

This library provides wrappers to data ingestion into various DB systems,
such as MySQL, SQLite3, and ODBC compatible systems. You can use
this C++ library to ingest data in any format (you need to implement
the reading routines though). The library provides an ingestion buffer
that allows for multiple rows to be ingested at one time. This greatly
improves ingestion performance. Further assertion and conversion functions
are provided for elementary data transformation and processing. These can
easily be extended by custom functions and many examples for implementing
such functions are provided in the source.

An instructive example on how to write ingestors using the DBIngestor
library is found in the example directory. Also have a look at the
AsciiIngest project found at:

https://github.com/adrpar/AsciiIngest

or contact the author for further help and instructions:

apartl@aip.de

Implementation Limitations:
---------------------------

Currently resume ingest is only supported for MySQL and ODBC (but not BulkODBC)
DB abastractors... If you need support for BulkODBC or Sqlite3, just drop me a
line