Skip to content

Add H1 2023 data #2

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
khxu merged 4 commits into from
Oct 31, 2023
Merged

Add H1 2023 data #2

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
4 commits
Select commit Hold shift + click to select a range
585858d
add h1 2023 data
khxu Oct 31, 2023
3a726c1
switch over to python frictionless framework
khxu Oct 31, 2023
dd54cc4
bump version
khxu Oct 31, 2023
de2d8cf
add government_iso2_code column
khxu Oct 31, 2023
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 2 additions & 2 deletions CITATION.cff
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -3,8 +3,8 @@ message: "If you use this dataset, please cite it as below."
authors:
- name: "GitHub, Inc."
title: "GitHub Transparency Data"
version: 1.0.0
date-released: 2023-02-17
version: 1.0.1
date-released: 2023-10-31
license: CC-BY-4.0
url: https://github.com/github/transparency
type: dataset
Expand Down
12 changes: 12 additions & 0 deletions Pipfile
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,12 @@
[[source]]
url = "https://pypi.org/simple"
verify_ssl = true
name = "pypi"

[packages]
frictionless = "*"

[dev-packages]

[requires]
python_version = "3.11"
647 changes: 647 additions & 0 deletions Pipfile.lock
View file
Open in desktop

Large diffs are not rendered by default.

22 changes: 20 additions & 2 deletions data/appeals_and_other_reinstatements/abuse_related_violations.csv
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -5,6 +5,24 @@ year,type,count
2022,"account access restricted, but later unrestricted",58
2022,account hidden and access restricted,8822
2022,"account hidden and access restricted, but partially reinstated",25
2022,"account hidden and access restricted, but full reinstated",115
2022,"account hidden and access restricted, but fully reinstated",115
2022,projects disabled,4507
2022,"projects disabled, but later re-enabled",6
2022,"projects disabled, but later re-enabled",6
2021,account hidden,4585
2021,"account hidden, but later unhidden",341
2021,account access restricted,69
2021,"account access restricted, but later unrestricted",23
2021,account hidden and access restricted,4240
2021,"account hidden and access restricted, but partially reinstated",8
2021,"account hidden and access restricted, but fully reinstated",28
2021,projects disabled,2257
2021,"projects disabled, but later re-enabled",55
2020,account hidden,4826
2020,"account hidden, but later unhidden",415
2020,account access restricted,47
2020,"account access restricted, but later unrestricted",15
2020,account hidden and access restricted,1178
2020,"account hidden and access restricted, but partially reinstated",12
2020,"account hidden and access restricted, but fully reinstated",29
2020,projects disabled,2405
2020,"projects disabled, but later re-enabled",4
10 changes: 10 additions & 0 deletions ...r_reinstatements/by_calendar_year_half/abuse_related_violations_by_calendar_year_half.csv
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,10 @@
year,half,type,count
2023,1,account hidden,9735
2023,1,"account hidden, but later unhidden",256
2023,1,account access restricted,4151
2023,1,"account access restricted, but later unrestricted",101
2023,1,account hidden and access restricted,4169
2023,1,"account hidden and access restricted, but partially reinstated",169
2023,1,"account hidden and access restricted, but fully reinstated",88
2023,1,projects disabled,4346
2023,1,"projects disabled, but later re-enabled",128
17 changes: 17 additions & 0 deletions ..._reinstatements/by_calendar_year_half/trade_controls_compliance_by_calendar_year_half.csv
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,17 @@
year,half,government,government_iso2_code,type,count
2023,1,,,Not subject to trade controls,201
2023,1,Crimea,,Approved,91
2023,1,Crimea,,Denied,22
2023,1,Crimea,,Other action taken,0
2023,1,Donetsk People's Republic,,Approved,32
2023,1,Donetsk People's Republic,,Denied,10
2023,1,Donetsk People's Republic,,Other action taken,0
2023,1,Luhansk People's Republic,,Approved,13
2023,1,Luhansk People's Republic,,Denied,1
2023,1,Luhansk People's Republic,,Other action taken,0
2023,1,Syria,SY,Approved,133
2023,1,Syria,SY,Denied,25
2023,1,Syria,SY,Other action taken,0
2023,1,Unknown,,Approved,201
2023,1,Unknown,,Denied,0
2023,1,Unknown,,Other action taken,3
77 changes: 48 additions & 29 deletions data/appeals_and_other_reinstatements/trade_controls_compliance.csv
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,29 +1,48 @@
year,government,type,count
2022,,Not subject to trade controls,212
2022,Crimea,Approved,251
2022,Crimea,Denied,38
2022,Crimea,Other action taken,1
2022,Donetsk People's Republic,Approved,96
2022,Donetsk People's Republic,Denied,72
2022,Donetsk People's Republic,Other action taken,1
2022,Luhansk People's Republic,Approved,20
2022,Luhansk People's Republic,Denied,18
2022,Luhansk People's Republic,Other action taken,1
2022,Syria,Approved,224
2022,Syria,Denied,25
2022,Syria,Other action taken,2
2022,Unknown,Approved,223
2022,Unknown,Other action taken,2
2021,,Not subject to trade controls,47
2021,Crimea,Approved,1069
2021,Crimea,Denied,119
2021,Crimea,Other action taken,4
2021,Iran,Approved,76
2021,Iran,Denied,0
2021,Iran,Other action taken,0
2021,Syria,Approved,152
2021,Syria,Denied,17
2021,Syria,Other action taken,2
2021,Unknown,Approved,58
2021,Unknown,Denied,1
2021,Unknown,Other action taken,2
year,government,government_iso2_code,type,count
2022,,,Not subject to trade controls,212
2022,Crimea,,Approved,251
2022,Crimea,,Denied,38
2022,Crimea,,Other action taken,1
2022,Donetsk People's Republic,,Approved,96
2022,Donetsk People's Republic,,Denied,72
2022,Donetsk People's Republic,,Other action taken,1
2022,Luhansk People's Republic,,Approved,20
2022,Luhansk People's Republic,,Denied,18
2022,Luhansk People's Republic,,Other action taken,1
2022,Syria,SY,Approved,224
2022,Syria,SY,Denied,25
2022,Syria,SY,Other action taken,2
2022,Unknown,,Approved,223
2022,Unknown,,Other action taken,2
2021,,,Not subject to trade controls,47
2021,Crimea,,Approved,1069
2021,Crimea,,Denied,119
2021,Crimea,,Other action taken,4
2021,Iran,IR,Approved,76
2021,Iran,IR,Denied,0
2021,Iran,IR,Other action taken,0
2021,Syria,SY,Approved,152
2021,Syria,SY,Denied,17
2021,Syria,SY,Other action taken,2
2021,Unknown,,Approved,58
2021,Unknown,,Denied,1
2021,Unknown,,Other action taken,2
2020,,,Not subject to trade controls,36
2020,Crimea,,Approved,804
2020,Crimea,,Denied,77
2020,Crimea,,Other action taken,4
2020,Cuba,CU,Approved,1
2020,Cuba,CU,Denied,0
2020,Cuba,CU,Other action taken,0
2020,Iran,IR,Approved,1120
2020,Iran,IR,Denied,207
2020,Iran,IR,Other action taken,55
2020,North Korea,KP,Approved,4
2020,North Korea,KP,Denied,0
2020,North Korea,KP,Other action taken,0
2020,Syria,SY,Approved,105
2020,Syria,SY,Denied,18
2020,Syria,SY,Other action taken,1
2020,Unknown,,Approved,88
2020,Unknown,,Denied,14
2020,Unknown,,Other action taken,2
3 changes: 3 additions & 0 deletions ...tomated_detection/by_calendar_year_half/cseai_and_tvec_reported_by_calendar_year_half.csv
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,3 @@
year,half,detection_type,abuse_type,count
2023,1,automated detection,CSEAI,2
2023,1,staff,CSEAI,12
2 changes: 2 additions & 0 deletions data/dmca/by_calendar_year_half/circumvention_claims_by_calendar_year_half.csv
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,2 @@
year,half,count
2023,1,221
4 changes: 4 additions & 0 deletions data/dmca/by_calendar_year_half/dmca_takedowns_summary_by_calendar_year_half.csv
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,4 @@
year,half,type,count
2023,1,Takedown notices or counter notice reversal,1086
2023,1,"Counter notices, retractions, or reversals",11
2023,1,Notices of legal actions filed,0
3 changes: 2 additions & 1 deletion data/dmca/dmca_notices_and_projects_taken_down_by_calendar_year_half.csv
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -14,4 +14,5 @@ H2-2020,23028,1134
H1-2021,7860,982
H2-2021,11416,846
H1-2022,15883,1200
H2-2022,9618,1121
H2-2022,9618,1121
H1-2023,14159,1086
8 changes: 7 additions & 1 deletion data/dmca/dmca_notices_and_projects_taken_down_by_month.csv
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -94,4 +94,10 @@ year,month,Takedown Notices Processed,Takedowns
2022,9,220,1562
2022,10,180,1218
2022,11,186,1689
2022,12,134,1134
2022,12,134,1134
2023,1,167,1074
2023,2,203,1748
2023,3,138,5060
2023,4,169,2887
2023,5,186,1687
2023,6,223,1703
8 changes: 7 additions & 1 deletion data/dmca/dmca_takedowns_by_month.csv
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -22,4 +22,10 @@ year,month,Takedown Notices Processed,"Retractions, Reversals, and Counter Notic
2022,9,220,4,1562,0,0,6,0,6,1556,0,0,4,0,0,0
2022,10,180,1,1218,0,0,1,0,1,1217,0,0,1,0,0,0
2022,11,186,4,1689,7,0,1,0,8,1681,3,0,1,0,0,0
2022,12,134,6,1134,1,1,6,0,8,1126,1,1,4,0,0,0
2022,12,134,6,1134,1,1,6,0,8,1126,1,1,4,0,0,0
2023,1,167,4,1074,1,0,3,0,4,1070,1,0,3,0,0,0
2023,2,203,1,1748,0,0,5,0,5,1743,0,0,1,0,0,0
2023,3,138,0,5060,0,0,0,0,0,5060,0,0,0,0,0,0
2023,4,169,2,2887,0,0,11,0,11,2876,0,0,2,0,0,0
2023,5,186,1,1687,0,0,1,0,1,1686,0,0,1,0,0,0
2023,6,223,3,1703,1,0,7,0,8,1695,1,0,2,0,0,0
6 changes: 6 additions & 0 deletions ...government_takedowns/by_calendar_year_half/government_takedowns_by_calendar_year_half.csv
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,6 @@
year,half,government,government_iso2_code,type,count_received,count_processed,count_repos_affected,count_pages_affected,count_accounts_affected
2023,1,Russia,RU,Terms of service,3,3,3,3,3
2023,1,Russia,RU,Local law,3,0,0,0,0
2023,1,India,IN,Terms of service,2,2,2,0,2
2023,1,United States,US,Terms of service,1,1,1,0,1
2023,1,Singapore,SG,Terms of service,1,1,138,0,138
10 changes: 9 additions & 1 deletion data/government_takedowns/government_takedowns.csv
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,4 +1,12 @@
year,government,government_iso2_code,type,count_received,count_processed,count_repos_affected,count_pages_affected,count_accounts_affected
2021,Russia,RU,Local law,19,17,21,15,16
2021,Hong Kong,HK,Local law,1,1,9,3,7
2021,China,CN,Local law,2,2,38,0,27
2021,Brazil,BR,Terms of service,1,1,15,15,1
2021,China,CN,Terms of service,2,2,6,0,2
2021,Netherlands,NL,Terms of service,1,1,2,0,2
2021,United Kingdom,UK,Terms of service,1,1,86,86,1
2021,United States,US,Terms of service,9,8,8,0,8
2022,Russia,RU,Local law,6,0,0,0,0
2022,Russia,RU,Terms of service,5,5,7,7,12
2022,Australia,AU,Terms of service,1,1,8,0,5
2022,Australia,AU,Terms of service,1,1,8,0,5
7 changes: 7 additions & 0 deletions ...er_information/by_calendar_year_half/cross_border_data_requests_by_calendar_year_half.csv
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,7 @@
year,half,government,government_iso2_code,count
2023,1,Brazil,BR,2
2023,1,Canada,CA,1
2023,1,Germany,DE,2
2023,1,France,FR,2
2023,1,India,IN,4
2023,1,Poland,PL,2
2 changes: 2 additions & 0 deletions ...er_information/by_calendar_year_half/requests_accounts_affected_by_calendar_year_half.csv
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,2 @@
year,half,count_accounts_affected
2023,1,550
6 changes: 6 additions & 0 deletions ...formation/by_calendar_year_half/requests_received_and_disclosed_by_calendar_year_half.csv
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,6 @@
year,half,type,count_requests_received,count_disclosed
2023,1,criminal or government agency subpoena,166,156
2023,1,criminal court order,59,42,
2023,1,criminal search warrant,13,12
2023,1,cross-border request,13,1
2023,1,civil subpoena,5,5
4 changes: 4 additions & 0 deletions ...endar_year_half/user_notifications_of_legal_request_disclosures_by_calendar_year_half.csv
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,4 @@
year,half,type,count
2023,1,exigent circumstances,2
2023,1,notification,7
2023,1,gag order,207
6 changes: 5 additions & 1 deletion data/requests_to_disclose_user_information/cross_border_data_requests.csv
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -13,4 +13,8 @@ year,government,government_iso2_code,count
2021,Brazil,BR,1
2021,Japan,JP,1
2021,Germany,DE,3
2021,India,IN,10
2021,India,IN,10
2020,Germany,DE,6
2020,India,IN,2
2019,Germany,DE,7
2019,India,IN,1
2 changes: 2 additions & 0 deletions data/requests_to_disclose_user_information/national_security_letters_and_orders.csv
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,4 +1,6 @@
year,month_range,type,count
2023,Jan-Jun,National security letters and orders received,0-249
2023,Jan-Jun,Affected accounts,750-999
2022,Jul-Dec,National security letters and orders received,0-249
2022,Jul-Dec,Affected accounts,250-499
2022,Jan-Jun,National security letters and orders received,0-249
Expand Down
Loading