Create Script to Transfer Data from one sheet to the other

[kevindphan]

Overview

Bonnie would like a script to be created to transfer the data from this sheet over to this sheet. Additionally, we want to grab all the github names of each repository, count and save all the topic tags used, and query all repositories per org tag.

Action Items

Resources/Instructions

from source sheet over to target sheet

• Related Issue [BACKEND]: Extend Alias API to Provide all Alias for a Particular Organization Tag #942
• Research for aliases and popular Github tags Make a list of top 50 topic tags #382

[cnk]

Running a script to get all the topics for all the repositories for all organizations we know about is going to be problematic unless we find a more efficient way to query this than what I am trying. I am doing a call for each org to get a list of its repositories and then one call per repo for the topics. I can do about 1/4 of our current org list before I run out of API calls for the hour.

I am still working on getting an initial run so we have tags to look at. (I need an hour break to get the last set of orgs crawled)

[cnk]

This is what I could get with 3 runs with our current set of orgs. Hope that helps for launch but we will need to redesign this if we want it to work on an ongoing basis.

topics.txt

[mariastudnicka]

@ExperimentsInHonesty @cnk commented that she ran the test for 3 hours and aliases aren't appearing as we had thought. She was, however, seeing patterns and a lot of themes such as open data, election data, air quality et al. She made the recommendation that we'd potentially use this as a jumping off point to reach out to other orgs — i.e., inviting others to contribute to CTI instead.

[ExperimentsInHonesty]

I am still auditing the spreadsheet I will have an update by the end of next week