Skip to content

robhudson/mdn-pgloader

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

5 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Instructions for setting up docker containers, importing data, and running
pgloader.

Create docker machine:

    docker-machine create --driver virtualbox --virtualbox-memory 4096 --virtualbox-disk-size 100000 pgloader

Configure environment settings:

    eval "$(docker-machine env pgloader)"
    export COMPOSE_FILE=$(pwd)/compose.yml
    export COMPOSE_PROJECT_NAME=pgloader

Start the machines:

    docker-compose up -d

Shell into the "hub":

    docker-compose run hub /bin/bash

Once inside the "hub" container, import the kuma dump file that was placed
in the 'pgloader/data/' folder:

    mysql --default-character-set=utf8 -h mysql -ukuma -pkuma kuma < /tmp/data/kuma.sql

From the mysql shell, remove the custom collation which seems to break pgloader:

    ALTER TABLE taggit_tag MODIFY name VARCHAR(100) CHARACTER SET utf8 COLLATE utf8_bin DEFAULT NULL;
    ALTER TABLE wiki_documenttag MODIFY name VARCHAR(100) CHARACTER SET utf8 COLLATE utf8_bin DEFAULT NULL;
    ALTER TABLE wiki_localizationtag MODIFY name VARCHAR(100) CHARACTER SET utf8 COLLATE utf8_bin DEFAULT NULL;
    ALTER TABLE wiki_reviewtag MODIFY name VARCHAR(100) CHARACTER SET utf8 COLLATE utf8_bin DEFAULT NULL;

Once the kuma data is imported you can run pgloader:

    ./build/bin/pgloader -v /root/command-file

About

A set of docker containers to test using pgloader on MDN data

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published