Migration from artifactory to artifact-keeper

[agangadharan-navaera]

When trying to migrate artifacts from artifactory to artifact-keeper I am using the following url:
{{ArtifactKeeperBaseUrl}}/api/v1/migrations

And with the following config:
{
"source_connection_id": "{{ConnectionID}}",
"job_type": "full",
"config": {
"include_repos": ["repo-gradle-release-local"],
"conflict_resolution": "skip",
"concurrent_transfers": 2,
"throttle_delay_ms": 50,
"verify_checksums": true,
"dry_run": false
}
}

But it seems that artifact-keeper is only downloading the first 100 artifacts. What should be done to download all the artifacts from a repo?

[itxashancode]

I’ve seen this before - the migration API caps results at 100 unless you override it. Add a "limit": 0 (or -1 depending on the version) inside the config object to tell it to fetch all artifacts. Example:

{
 "source_connection_id": "{{ConnectionID}}",
 "job_type": "full",
 "config": {
 "include_repos": ["repo-gradle-release-local"],
 "conflict_resolution": "skip",
 "concurrent_transfers": 2,
 "throttle_delay_ms": 50,
 "verify_checksums": true,
 "dry_run": false,
 "limit": 0
 }
}

If that field isn’t recognized, you’ll need to paginate: repeatedly call the migration endpoint with an "offset" that increments by by.

[agangadharan-navaera]

Thank you. I tried with both limit 0 and limit -1 but still it just considers the first 100 artifacts. I think this is a bug that needs to be solved. I have created an issue for it (#671)

[itxashancode]

Glad it helped! 😊 If it answered your question, feel free to close the disscussion. And a follow would mean a lot, always happy to connect with people building cool things!