Skip to content
This repository was archived by the owner on Feb 17, 2023. It is now read-only.

Commonjava/pathmap-migrator

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

73 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Indy path mapped storage migrator

This command line tools is used to do one-off migration task from legacy file based storage to new path mapped storage

How to use

There are two commands here: scan and migrate

scan: generate files to store all paths

Usage: java -jar ${package}.jar scan [options]

Options:
-B (--batch) : Batch of paths to process each time
-b (--base) : Base dir of storage for all indy artifacts
-w (--workdir) : Work dir to store all generated working files
-f (--filter) : Regex style filter string to filter some files which are unwanted
-t (--threads) : Threads will run concurrently to scan against repos for pkg types

migrate: read all files for paths and migrate them to cassandra db

Note: Before this command, please use "scan" to generate all paths files first

Usage: java -jar ${package}.jar migrate [options]

Options:
-w (--workdir) : Work dir to store all generated working files
-b (--base) : Base dir of storage for all indy artifacts
-H (--host) : Cassandra server hostname
-P (--port) : Cassandra server port
-k (--keyspace) : Cassandra server keyspace
-p (--password) : Cassandra server password
-u (--user) : Cassandra server username
-d (--dedupe) : If to use checksum to dedupe all files in file storage
-t (--threads) : Threads which will run migrating concurrently -i (--indexGA) : Determine if to index GA cache during migrate operation -c (--cacheTable): Indy cache table in cassandra, should come with keyspace together -g (--indexGAStorePattern): The store pattern for stores which will be cached in GA cache

For migrate command, when it start, there will be a "status" file generated in ${workDir} to record current processing status, and will be updated every 30 seconds.

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Contributors 3

  •  
  •  
  •  

Languages