Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Google Search API] Extract all data from College Knowledge Graph #670

Closed
schaferyan opened this issue Feb 24, 2023 · 2 comments
Closed
Assignees
Labels
status: queued Ready to work on

Comments

@schaferyan
Copy link

A customer requested some data from Knowledge Graphs about Colleges that we don't currently seem to be parsing. Specifically the Average cost after aid, Graduation rate, and Acceptance rate:

image

Playground | Search Inspector

@schaferyan schaferyan added the status: queued Ready to work on label Feb 27, 2023
@tanys123 tanys123 self-assigned this Feb 28, 2023
@tanys123 tanys123 added the status: wip Work in progress label Feb 28, 2023
@tanys123 tanys123 closed this as completed Mar 1, 2023
@schaferyan
Copy link
Author

schaferyan commented Mar 4, 2023

I am reopening this as the customer who initially reported/requested this informed me that for many searches the institution_stats field still isn't being scraped. She included a list of Colleges where this seems to be the case. I have verified that for at least some of these we are not scraping this section of the Knowledge Graph,

2023-03-03_16-06
2023-03-03_16-03

Playground

American University - not currently scraping institution_stats, "Cost by Household Income," or "Graduation rate" Playground

Andrew College, Boston College, Canisius College, Creighton University, Fordham University, Georgetown University - We are scraping the institution_stats but we are not scraping the "College facts" section. Playground Boston | Playground Canisius

Davenport University - not scraping institutional_stats, also not scraping other information below the description and above notable alumni. Playground

DePaul University (looks like no knowledge graph)

Fairfield University, Florida State University, University of Chicago - not scraping institutional_stats, also not scraping "Cost by Household Income" and "Graduation Rate" below notable alumni and above "People also search for". Playground

Grambling State University
Johns Hopkins University
Keiser University
Kennesaw State University
Kent State University
Lesley University
Long Beach State University
Marshall University
Michigan State University
Minnesota State University, Mankato
Mississippi State University
North Dakota State University
Northwestern University
Oklahoma Panhandle State University
Pennsylvania State Univ. Erie, the Behrend College
Pennsylvania State University
Rollins College
Seattle University
Stanford University
Syracuse University
Texas A&M University-Corpus Christi
The Citadel
The Ohio State University
U.S. Air Force Academy
U.S. Military Academy
U.S. Naval Academy
University at Albany
University of California, Los Angeles

University of Colorado, Colorado Springs
University of Florida
University of Gloucestershire
University of Louisville
University of Miami (Florida)
University of Pennsylvania
University of Saint Katherine
University of South Carolina - Beaufort - NAIA
University of South Carolina Upstate
University of Toledo
University of Utah
University of Virginia
Utah State University
Valdosta State University
Vanderbilt University
Virginia Commonwealth University- Div I
West Virginia University
Wheaton College (Illinois)
Xavier University
Youngstown State University

@schaferyan schaferyan reopened this Mar 4, 2023
@schaferyan
Copy link
Author

I updated my comment to include some more playground links, and notes for some of the searches in the list

@dimitryzub dimitryzub removed the status: wip Work in progress label Apr 4, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
status: queued Ready to work on
Projects
None yet
Development

No branches or pull requests

3 participants