Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Generate current-full.csv and current-federal.csv daily and publish at a public URL #1075

Closed
2 tasks done
h-m-f-t opened this issue Sep 26, 2023 · 2 comments
Closed
2 tasks done

Generate current-full.csv and current-federal.csv daily and publish at a public URL #1075

h-m-f-t opened this issue Sep 26, 2023 · 2 comments
Assignees
@zandercymatics
Labels
dev
Milestone
Nov 15: Analysts ...

Comments

@h-m-f-t
Copy link
Member

h-m-f-t commented Sep 26, 2023 •
edited
Loading

Issue Description

#996 prepared 3 different reports and made them available as on-demand CSV exports. For this issue, we should provide the capability to generate 2 of those reports – current-full.csv and current-federal.csv – and have them accessible through an API.

Acceptance criteria

  • Save the files (delete/overwrite any prior copies) and make them available at a public URL
  • Cameron can use the public URL to replace the http_url value in our Git scraping instance.

Issue Links

⛔ Blocked by #996
Dependency of #1403, #1317 (That ticket is for notification for when this process fails to complete properly.)
@h-m-f-t h-m-f-t mentioned this issue Sep 26, 2023
Closed
8 tasks
@h-m-f-t h-m-f-t mentioned this issue Sep 26, 2023
Closed
7 tasks
@vickyszuchin
Copy link

Comment for consideration (from Neil during refinement meeting),

Automation in Github Actions is pretty accessible with what we already do.

@vickyszuchin
Copy link

Decision in refinement meeting (10/12) to break the notification AC into a separate ticket.

cc: @PaulKuykendall

@h-m-f-t h-m-f-t changed the title Publish current-full.csv and current-federal.csv at a public URL and update daily Generate current-full.csv and current-federal.csv daily and publish at a public URL Oct 13, 2023
@PaulKuykendall PaulKuykendall mentioned this issue Nov 10, 2023
Open
1 task
@h-m-f-t h-m-f-t mentioned this issue Nov 16, 2023
Closed
This was referenced Nov 27, 2023
Closed
Closed
Merged
zandercymatics added a commit that referenced this issue Dec 5, 2023
@zandercymatics
Merge pull request #1419 from cisagov/za/1403-add-aws-bucket
23e94c7 
Ticket #1075/#1403: Add AWS Bucket for generating current-full.csv and current-federal.csv
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@zandercymatics zandercymatics

Labels
dev
Projects
.gov Product Board
Archived in project
Milestone
Nov 15: Analysts admin (manage.get.gov)
4 participants
@h-m-f-t @PaulKuykendall @zandercymatics @vickyszuchin