Skip to content
Permalink
Browse files
Improve bulk CI docs (#104)
  • Loading branch information
keith-turner authored and ctubbsii committed Jul 24, 2019
1 parent a9b6b24 commit 3d23c26795f0b1746d38fc2c53c8ebdcc6f50b31
Showing 1 changed file with 9 additions and 0 deletions.
@@ -30,6 +30,9 @@ for i in $(seq 1 10); do
./bin/cingest bulk /tmp/bt/$i
done
# Optionally, copy data before importing. This can be useful in debugging problems.
hadoop distcp hdfs://$NAMENODE/tmp/bt hdfs://$NAMENODE/tmp/bt-copy
for i in $(seq 1 10); do
(
echo table ci
@@ -53,6 +56,12 @@ scan -t accumulo.metadata -b ~blip -e ~blip~
scan -t accumulo.metadata -c loaded
```

Additionally check that no rfiles exists in the source dir.

```bash
hadoop fs -ls -R /tmp/bt | grep rf
```

The referenced counts output by `cingest verify` should equal :

```

0 comments on commit 3d23c26

Please sign in to comment.