Join GitHub today
GitHub is home to over 28 million developers working together to host and review code, manage projects, and build software together.Sign up
Oracle support #244
We're migrating Oracle to PostgreSQL right now. I'm using ora2pg to dump out the oracle databases per table, then using a shell script to convert the .sql files with inline COPY data into .csv files that pgloader can load into postgres. Some of our tables are 7+ billion rows and would not load as a regular .sql file, pgloader makes short work of it though. If pgloader could read the data directly out of the .sql files it would cut out a step that is really just rearranging the data to shoehorn it into a format pgloader will accept. In any case, if someone wants me to write up the process we're using currently, I could do that.
I think it would be even better if pgloader would connect to Oracle directly like it does for MySQL or MS SQL. What is needed is:
Also, I would need a test database available for me to develop against, and some sponsoring for the time spent working on the feature.
It sounds way better to have pgloader connects to Oracle directly rather than tweak other tools output so that we can use an existing supported format here... anyway thanks for the details of your use case, I'm quite happy to see pgloader used on 7+ billion rows files ;-)
Also, pgloader supports COPY files already, so if you just cut the inline COPY parts of the sql files into per-table files, you should be good to go.