Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

glcon (gleaner?) multiple gleaner batch --source --source only runs one #219

Open
valentinedwv opened this issue Jun 27, 2023 · 1 comment
Assignees
Labels
bug Something isn't working good first issue Good for newcomers

Comments

@valentinedwv
Copy link
Member

valentinedwv commented Jun 27, 2023

glcon (gleaner?) multiple gleaner batch --source --source only runs one source, the last source
version: v3.0.9_...4

earthcube@ip-172-31-2-108:~/indexing$ ./glcon gleaner batch  --source geocodes_demo_datasets --source geocodes_json_datasets --cfgName gctest
batch called
 100% |██████████████████████████████████████████████| (28/28, 12 it/s)        
RunStats:
  Start: 2023-06-27 17:00:07.535442623 +0000 UTC m=+0.147208177
  Repositories:
    - name: geocodes_json_datasets
      SitemapHttpError: 0 
      SitemapIssues: 0 
      SitemapSummoned: 28 
      SitemapStored: 28 
      SitemapCount: 28 
 100% |██████████████████████████████████████████████| (21/21, 74 it/s)        
earthcube@ip-172-31-2-108:~/indexing$ 

isolated in
v1, err = configTypes.PruneSources(v1, runSources)

Test and debugging needed
so add a test for prune sources to make sure it works

oh wait... source is cli/batch is a single string.

same for gleaner cmd

@valentinedwv valentinedwv added the bug Something isn't working label Jun 27, 2023
@ylyangtw ylyangtw self-assigned this Jun 27, 2023
@valentinedwv valentinedwv added the good first issue Good for newcomers label Jun 27, 2023
@valentinedwv
Copy link
Member Author

When you create a branch, do it manually from 'dev' rather than the GitHub interface which will create one using main

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working good first issue Good for newcomers
Projects
None yet
Development

No branches or pull requests

2 participants