New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Question: What APIs should ED offer? #1

Open
gbinal opened this Issue Nov 30, 2016 · 62 comments

Comments

Projects
None yet
@gbinal

gbinal commented Nov 30, 2016

This is an open prompt. Please share any ideas you have for APIs that the Department of Education should offer that it doesn't.

@metzgr metzgr changed the title from Question: What APIs should Ed offer? to Question: What APIs should ED offer? Nov 30, 2016

@hrecht

This comment has been minimized.

Show comment
Hide comment
@hrecht

hrecht Jan 17, 2017

Thanks for starting this effort!
An IPEDS API is sorely needed. The existing custom data download tool is extremely limiting, with a low data limit per download, untidy output and variable names, and difficulty getting data across years. The complete data files are not developer-friendly either, given that there are ~900 files each saved within .zip files, a mix of wide and long data, and no complete data dictionary. An API would save countless hours spent wrangling IPEDS data.

hrecht commented Jan 17, 2017

Thanks for starting this effort!
An IPEDS API is sorely needed. The existing custom data download tool is extremely limiting, with a low data limit per download, untidy output and variable names, and difficulty getting data across years. The complete data files are not developer-friendly either, given that there are ~900 files each saved within .zip files, a mix of wide and long data, and no complete data dictionary. An API would save countless hours spent wrangling IPEDS data.

@hrecht hrecht referenced this issue Jan 17, 2017

Closed

License? #1

@fgregg

This comment has been minimized.

Show comment
Hide comment
@fgregg

fgregg Jan 17, 2017

Hi @gbinal, I second @hrecht's request. The IPEDS dataset is very high value and very hard to work with right now. Here's a quick survey of projects on github dedicated to making it easier to work with IPEDS.

And just today, I was heartened to learn that bulk data for recent years is available. Unfortunately, it's only available in a proprietary Access DB format. So, I add to the pile this script to convert to a postgres db. https://github.com/datamade/ipeds-db

fgregg commented Jan 17, 2017

Hi @gbinal, I second @hrecht's request. The IPEDS dataset is very high value and very hard to work with right now. Here's a quick survey of projects on github dedicated to making it easier to work with IPEDS.

And just today, I was heartened to learn that bulk data for recent years is available. Unfortunately, it's only available in a proprietary Access DB format. So, I add to the pile this script to convert to a postgres db. https://github.com/datamade/ipeds-db

@metzgr

This comment has been minimized.

Show comment
Hide comment
@metzgr

metzgr Jan 18, 2017

Contributor

Thank you for excellent your feedback, @hrecht and @fgregg! This is very helpful.

Contributor

metzgr commented Jan 18, 2017

Thank you for excellent your feedback, @hrecht and @fgregg! This is very helpful.

@jengoree

This comment has been minimized.

Show comment
Hide comment
@jengoree

jengoree Jan 23, 2017

Please create APIs for the Public Elementary/Secondary Listing and the School District / Local Education Agency (LEA) Listing, so that organizations providing digital services to schools can keep up to date on every teacher's school.

jengoree commented Jan 23, 2017

Please create APIs for the Public Elementary/Secondary Listing and the School District / Local Education Agency (LEA) Listing, so that organizations providing digital services to schools can keep up to date on every teacher's school.

@metzgr

This comment has been minimized.

Show comment
Hide comment
@metzgr

metzgr Jan 23, 2017

Contributor

Thanks, @jengoree! We'll take this back.

Contributor

metzgr commented Jan 23, 2017

Thanks, @jengoree! We'll take this back.

@kinlane

This comment has been minimized.

Show comment
Hide comment
@kinlane

kinlane commented Feb 1, 2017

@metzgr

This comment has been minimized.

Show comment
Hide comment
@metzgr

metzgr Feb 3, 2017

Contributor

Of course. :) Thanks, Kin Lane!! Come back to ED!

Contributor

metzgr commented Feb 3, 2017

Of course. :) Thanks, Kin Lane!! Come back to ED!

@kinlane

This comment has been minimized.

Show comment
Hide comment
@kinlane

kinlane Feb 3, 2017

Thanks! I'll just keep simmering on the outside until y'all are ready. I get about 3 people email me a month wanting to use my broken prototype. At some point it will be real! Always happy to brainstorm it. Keep up the fight for the kids you guys.

kinlane commented Feb 3, 2017

Thanks! I'll just keep simmering on the outside until y'all are ready. I get about 3 people email me a month wanting to use my broken prototype. At some point it will be real! Always happy to brainstorm it. Keep up the fight for the kids you guys.

@mattayes

This comment has been minimized.

Show comment
Hide comment
@mattayes

mattayes Feb 22, 2017

I echo @hrecht and @fgregg's comments: An IPEDS API would be indispensable.

Ideally, in addition to providing an API, ED would work to harmonize the survey across years, similar to how IPUMS USA harmonizes U.S. census microdata.

mattayes commented Feb 22, 2017

I echo @hrecht and @fgregg's comments: An IPEDS API would be indispensable.

Ideally, in addition to providing an API, ED would work to harmonize the survey across years, similar to how IPUMS USA harmonizes U.S. census microdata.

@hrecht

This comment has been minimized.

Show comment
Hide comment
@hrecht

hrecht Feb 22, 2017

Completely agreed with @mattayes about harmonizing across years - one major challenge with IPEDS data is that categorical variable levels change between years. I.e. in one year a variable's possible values are 4, 5, 6 and the next year they're 10, 15, 20. This is a massive unnecessary challenge, especially given there is no comprehensive changelog between data years.

hrecht commented Feb 22, 2017

Completely agreed with @mattayes about harmonizing across years - one major challenge with IPEDS data is that categorical variable levels change between years. I.e. in one year a variable's possible values are 4, 5, 6 and the next year they're 10, 15, 20. This is a massive unnecessary challenge, especially given there is no comprehensive changelog between data years.

@ismorgan

This comment has been minimized.

Show comment
Hide comment
@ismorgan

ismorgan Feb 24, 2017

Thank you @mattayes for your suggestion and @hrecht for your continued feedback!

ismorgan commented Feb 24, 2017

Thank you @mattayes for your suggestion and @hrecht for your continued feedback!

@psmnolan

This comment has been minimized.

Show comment
Hide comment
@psmnolan

psmnolan Mar 9, 2017

@ismorgan @gbinal Even just the crosswalk harmonizing across years (similar to what Delta Cost did) would be unbelievably helpful. Do you have that somewhere? Could someone make it public?

psmnolan commented Mar 9, 2017

@ismorgan @gbinal Even just the crosswalk harmonizing across years (similar to what Delta Cost did) would be unbelievably helpful. Do you have that somewhere? Could someone make it public?

@ismorgan

This comment has been minimized.

Show comment
Hide comment
@ismorgan

ismorgan Mar 10, 2017

Thank you @psmnolan; we will look into this and let you know.

ismorgan commented Mar 10, 2017

Thank you @psmnolan; we will look into this and let you know.

@obxkid413

This comment has been minimized.

Show comment
Hide comment
@obxkid413

obxkid413 Mar 15, 2017

Hi, I was curious if there had been any discussion about creating a public developer API for NAEP (National Assessment for Educational Progress) data. Currently, there is the NAEP Data Explorer, but pulling multiple subjects and grades can be a time consuming process. Thanks for any information on this! It is much appreciated.

  • Jon

obxkid413 commented Mar 15, 2017

Hi, I was curious if there had been any discussion about creating a public developer API for NAEP (National Assessment for Educational Progress) data. Currently, there is the NAEP Data Explorer, but pulling multiple subjects and grades can be a time consuming process. Thanks for any information on this! It is much appreciated.

  • Jon
@ismorgan

This comment has been minimized.

Show comment
Hide comment
@ismorgan

ismorgan Mar 16, 2017

Thanks @obxkid413. We'll add that to the list for consideration.

ismorgan commented Mar 16, 2017

Thanks @obxkid413. We'll add that to the list for consideration.

@hrecht

This comment has been minimized.

Show comment
Hide comment
@hrecht

hrecht Mar 16, 2017

That NAEP data could be a great contender to add to data.gov and take advantage of their existing infrastructure. While several NAEP datasets are indexed there, they all appear to be external links rather than hosted on data.gov. https://catalog.data.gov/dataset?q=naep&sort=score+desc%2C+name+asc&as_sfid=AAAAAAVRDo5xTYcT-Gm_F97t-VSB6rA8CDMIO1QdQ2fHBd0rlFdQ2C1fi4o1kMKTc8Pt4INfh9sLOVE39Ivwi2Rek0n7unxcVfMI1g93mVubLXGW6nVWMSVReCF9440hdUTbWW8%3D&as_fid=8c6b33f8d84eec26ba65c6fd1db525773849367f (perhaps more relevant for #2 )

hrecht commented Mar 16, 2017

That NAEP data could be a great contender to add to data.gov and take advantage of their existing infrastructure. While several NAEP datasets are indexed there, they all appear to be external links rather than hosted on data.gov. https://catalog.data.gov/dataset?q=naep&sort=score+desc%2C+name+asc&as_sfid=AAAAAAVRDo5xTYcT-Gm_F97t-VSB6rA8CDMIO1QdQ2fHBd0rlFdQ2C1fi4o1kMKTc8Pt4INfh9sLOVE39Ivwi2Rek0n7unxcVfMI1g93mVubLXGW6nVWMSVReCF9440hdUTbWW8%3D&as_fid=8c6b33f8d84eec26ba65c6fd1db525773849367f (perhaps more relevant for #2 )

@benjaminrobinson

This comment has been minimized.

Show comment
Hide comment
@benjaminrobinson

benjaminrobinson Mar 16, 2017

I also contend that an API for EdFacts would be really great!

benjaminrobinson commented Mar 16, 2017

I also contend that an API for EdFacts would be really great!

@ismorgan

This comment has been minimized.

Show comment
Hide comment
@ismorgan

ismorgan commented Mar 21, 2017

@Mhcase

This comment has been minimized.

Show comment
Hide comment
@Mhcase

Mhcase Apr 14, 2017

API for Common Core of Data and / or EDFacts.

Mhcase commented Apr 14, 2017

API for Common Core of Data and / or EDFacts.

@s-ster

This comment has been minimized.

Show comment
Hide comment
@s-ster

s-ster Apr 20, 2017

IPEDS, please!

s-ster commented Apr 20, 2017

IPEDS, please!

@ismorgan

This comment has been minimized.

Show comment
Hide comment
@ismorgan

ismorgan Apr 21, 2017

Thanks @Mhcase and @s-ster! We've noted your suggestions.

ismorgan commented Apr 21, 2017

Thanks @Mhcase and @s-ster! We've noted your suggestions.

@ismorgan

This comment has been minimized.

Show comment
Hide comment
@ismorgan

ismorgan May 8, 2017

For those who have requested an IPEDS API, have you checked out the College Scorecard API? The Scorecard API includes a number of commonly-used IPEDS variables. Does this meet most of your needs? Check out the Scorecard documentation page and current list of variables and let us know if it does not meet your needs. @hrecht @fgregg @mattayes @psmnolan @benjaminrobinson @s-ster

ismorgan commented May 8, 2017

For those who have requested an IPEDS API, have you checked out the College Scorecard API? The Scorecard API includes a number of commonly-used IPEDS variables. Does this meet most of your needs? Check out the Scorecard documentation page and current list of variables and let us know if it does not meet your needs. @hrecht @fgregg @mattayes @psmnolan @benjaminrobinson @s-ster

@hrecht

This comment has been minimized.

Show comment
Hide comment
@hrecht

hrecht May 8, 2017

@ismorgan I have explored the Scorecard API but no it does not meet the need for heavy IPEDS users. It includes a few hundred IPEDS variables but nowhere near all of them, particularly the detailed data that is most useful for researchers. The 2010s IPEDS complete data files include over 1500 variables per year.

For example, when I was working on education finance research at a previous job, defining comparable institution groups over time involved the following variables (plus others): ("fips", "stabbr", "instnm", "sector", "pset4flg", "instcat", "ccbasic", "control", "deggrant", "opeflag", "opeind", "opeid", "carnegie", "hloffer") One of the main reasons so many variables was required is that IPEDS changed its variable definitions and variables that it included every few years.
(Code at https://github.com/UrbanInstitute/ed-data/blob/master/scripts/get-data/ipedsIdentifiers.R which eventually was used for http://collegeaffordability.urban.org/)

Many of these are not in the scorecard. And that's just for defining institutions, let alone financial, enrollment, etc data.

Here are the variables included in the IPEDS 2009+ complete data files: https://raw.githubusercontent.com/UrbanInstitute/ipeds-scraper/master/data/dictionary.csv

The scorecard API is a great resource but is not a substitute for full IPEDS data.

hrecht commented May 8, 2017

@ismorgan I have explored the Scorecard API but no it does not meet the need for heavy IPEDS users. It includes a few hundred IPEDS variables but nowhere near all of them, particularly the detailed data that is most useful for researchers. The 2010s IPEDS complete data files include over 1500 variables per year.

For example, when I was working on education finance research at a previous job, defining comparable institution groups over time involved the following variables (plus others): ("fips", "stabbr", "instnm", "sector", "pset4flg", "instcat", "ccbasic", "control", "deggrant", "opeflag", "opeind", "opeid", "carnegie", "hloffer") One of the main reasons so many variables was required is that IPEDS changed its variable definitions and variables that it included every few years.
(Code at https://github.com/UrbanInstitute/ed-data/blob/master/scripts/get-data/ipedsIdentifiers.R which eventually was used for http://collegeaffordability.urban.org/)

Many of these are not in the scorecard. And that's just for defining institutions, let alone financial, enrollment, etc data.

Here are the variables included in the IPEDS 2009+ complete data files: https://raw.githubusercontent.com/UrbanInstitute/ipeds-scraper/master/data/dictionary.csv

The scorecard API is a great resource but is not a substitute for full IPEDS data.

@mattayes

This comment has been minimized.

Show comment
Hide comment
@mattayes

mattayes May 8, 2017

@ismorgan I second @hrecht, well said.

mattayes commented May 8, 2017

@ismorgan I second @hrecht, well said.

@hrecht

This comment has been minimized.

Show comment
Hide comment
@hrecht

hrecht May 8, 2017

Also note @ismorgan that I built the dictionary linked above by writing a python scraper for the complete data files. I contacted NCES/IPEDS about the existence of full data dictionaries and they informed me that none existed.

This is a massive problem for years prior to 2009, for which only HTML dictionaries are available - that's 1 dictionary file per "complete data file" per year. They're insanely difficult to parse, so I had to open them in a browser when needed for reference.

hrecht commented May 8, 2017

Also note @ismorgan that I built the dictionary linked above by writing a python scraper for the complete data files. I contacted NCES/IPEDS about the existence of full data dictionaries and they informed me that none existed.

This is a massive problem for years prior to 2009, for which only HTML dictionaries are available - that's 1 dictionary file per "complete data file" per year. They're insanely difficult to parse, so I had to open them in a browser when needed for reference.

@psmnolan

This comment has been minimized.

Show comment
Hide comment
@psmnolan

psmnolan May 9, 2017

I'll "third" @hrecht

The big problem is twofold: HTML format of dictionaries and lack of effective crosswalk between years (as @mattayes noted).

@btskinner wrote a solid scraper in R for those less comfortable with Python. For those interested in institutional finance data, Delta Cost built a solid longitudinal crosswalk and set of weights, but that hasn't been updated in two IPEDS cycles.

@metzgr @gbinal Can you comment on where DoE stands with regard to really integrating IPEDS or even creating an API? Surely your researchers have a tool. I think it'd be worth some community work, but duplication is waste. Bao Le and Richard Reeves are the IPEDS point-persons at NCES and do great work.

psmnolan commented May 9, 2017

I'll "third" @hrecht

The big problem is twofold: HTML format of dictionaries and lack of effective crosswalk between years (as @mattayes noted).

@btskinner wrote a solid scraper in R for those less comfortable with Python. For those interested in institutional finance data, Delta Cost built a solid longitudinal crosswalk and set of weights, but that hasn't been updated in two IPEDS cycles.

@metzgr @gbinal Can you comment on where DoE stands with regard to really integrating IPEDS or even creating an API? Surely your researchers have a tool. I think it'd be worth some community work, but duplication is waste. Bao Le and Richard Reeves are the IPEDS point-persons at NCES and do great work.

@hrecht

This comment has been minimized.

Show comment
Hide comment
@hrecht

hrecht May 9, 2017

Totally agreed with @psmnolan. Also seconding that a well-formatted single .CSV with a complete data dictionary (even on an ftp server) would be a massive improvement to the current options of the complete data files or custom data downloader. This was also suggested by @rebeccawilliams in #2 . Census and many others provide FTP bulk downloads, so researchers are very familiar with getting data that way. If needed, splitting into one .CSV per year could also make sense. (And posting it on data.gov too would be great.)

The recent Access databases seem to be an attempt to address this issue, but Access files are a less open and unusable option for most, since using them requires using Windows and purchasing MS Office. I hope that efforts can be shifted to non-proprietary data formats (especially .CSV) in the future.

I think we all fully recognize the considerable investment that building and maintaining an API entails - it would be fantastic, but in the mean time, improved bulk data downloads would satisfy pretty much all heavy IPEDS users.

hrecht commented May 9, 2017

Totally agreed with @psmnolan. Also seconding that a well-formatted single .CSV with a complete data dictionary (even on an ftp server) would be a massive improvement to the current options of the complete data files or custom data downloader. This was also suggested by @rebeccawilliams in #2 . Census and many others provide FTP bulk downloads, so researchers are very familiar with getting data that way. If needed, splitting into one .CSV per year could also make sense. (And posting it on data.gov too would be great.)

The recent Access databases seem to be an attempt to address this issue, but Access files are a less open and unusable option for most, since using them requires using Windows and purchasing MS Office. I hope that efforts can be shifted to non-proprietary data formats (especially .CSV) in the future.

I think we all fully recognize the considerable investment that building and maintaining an API entails - it would be fantastic, but in the mean time, improved bulk data downloads would satisfy pretty much all heavy IPEDS users.

@hrecht

This comment has been minimized.

Show comment
Hide comment
@hrecht

hrecht May 9, 2017

Would there be interest in a community conference call or some other live discussion between IPEDS data users/stakeholders and the IPEDS/NCES staff and the @usedgov team to discuss user needs and data options? @ismorgan @metzger @gbinal @fgregg @mattayes @psmnolan @benjaminrobinson @s-ster

hrecht commented May 9, 2017

Would there be interest in a community conference call or some other live discussion between IPEDS data users/stakeholders and the IPEDS/NCES staff and the @usedgov team to discuss user needs and data options? @ismorgan @metzger @gbinal @fgregg @mattayes @psmnolan @benjaminrobinson @s-ster

@ismorgan

This comment has been minimized.

Show comment
Hide comment
@ismorgan

ismorgan May 10, 2017

Thanks everyone for the feedback. I think setting up a call to discuss options for making IPEDS data more accessible is a great idea. We will circle back once we've figured out some things on our end. @hrecht @fgregg @mattayes @psmnolan @benjaminrobinson @s-ster

ismorgan commented May 10, 2017

Thanks everyone for the feedback. I think setting up a call to discuss options for making IPEDS data more accessible is a great idea. We will circle back once we've figured out some things on our end. @hrecht @fgregg @mattayes @psmnolan @benjaminrobinson @s-ster

@psmnolan

This comment has been minimized.

Show comment
Hide comment
@psmnolan

psmnolan May 17, 2017

It looks like the institutional research association is hosting the IPEDS for a discussion on dissemination. I'll raise our concerns there as well and report back. The agenda is below:

"
2. IPEDS at the AIR Forum

Please join your AIR colleagues at the following IPEDS Sessions being present by NCES staff at the AIR Forum. We also hope that you will stop by the IPEDS booth in the exhibit hall (open Wed. 7:30am-5:30pm and Thur. 7:45am-3:00pm). NCES staff will be present throughout the conference, including these times at the IPEDS booth:
Wed., May 31: 7:30-8:30am, 12-1:30pm, 4:30-5:30pm
Thur., June 1: 7:45-8:45am, 11:30am-1:00pm, 1:45-2:45pm

IPEDS Update
Tuesday,May 30, 2017 (1:00 PM - 2:30 PM) - Salon 12
Richard Reeves, National Center for Education Statistics

IPEDS Update: Data Dissemination and Use
Wednesday, May 31, 2017 (11:15 AM - 12:00 PM)- University of DC Room
Sam Barbett, National Center for Education Statistics
Moussa Ezzeddine, National Center for Education Statistics
Richard Reeves, National Center for Education Statistics
"

psmnolan commented May 17, 2017

It looks like the institutional research association is hosting the IPEDS for a discussion on dissemination. I'll raise our concerns there as well and report back. The agenda is below:

"
2. IPEDS at the AIR Forum

Please join your AIR colleagues at the following IPEDS Sessions being present by NCES staff at the AIR Forum. We also hope that you will stop by the IPEDS booth in the exhibit hall (open Wed. 7:30am-5:30pm and Thur. 7:45am-3:00pm). NCES staff will be present throughout the conference, including these times at the IPEDS booth:
Wed., May 31: 7:30-8:30am, 12-1:30pm, 4:30-5:30pm
Thur., June 1: 7:45-8:45am, 11:30am-1:00pm, 1:45-2:45pm

IPEDS Update
Tuesday,May 30, 2017 (1:00 PM - 2:30 PM) - Salon 12
Richard Reeves, National Center for Education Statistics

IPEDS Update: Data Dissemination and Use
Wednesday, May 31, 2017 (11:15 AM - 12:00 PM)- University of DC Room
Sam Barbett, National Center for Education Statistics
Moussa Ezzeddine, National Center for Education Statistics
Richard Reeves, National Center for Education Statistics
"

@benjaminrobinson

This comment has been minimized.

Show comment
Hide comment
@benjaminrobinson

benjaminrobinson Jul 10, 2017

Any updates on this?

benjaminrobinson commented Jul 10, 2017

Any updates on this?

@metzgr

This comment has been minimized.

Show comment
Hide comment
@metzgr

metzgr Jul 13, 2017

Contributor

Hi all, We hope to have more information for you soon. We're excited there's so much interest in a call/other public forum formats. Thanks for your patience!

Contributor

metzgr commented Jul 13, 2017

Hi all, We hope to have more information for you soon. We're excited there's so much interest in a call/other public forum formats. Thanks for your patience!

@hrecht

This comment has been minimized.

Show comment
Hide comment
@hrecht

hrecht Jul 13, 2017

Sounds like there were some updates shared at the May conference listed above - are those online anywhere or can you share them?

hrecht commented Jul 13, 2017

Sounds like there were some updates shared at the May conference listed above - are those online anywhere or can you share them?

@kheuton

This comment has been minimized.

Show comment
Hide comment
@kheuton

kheuton Aug 1, 2017

@metzgr Thanks for the great talk at STATS-DC! I'd love an API that makes it easy to find demographic information for school districts. I had to navigate a handful of different census websites to download custom excel files to link shapefiles of boundaries, expenditure, poverty, and enrollment demographics

kheuton commented Aug 1, 2017

@metzgr Thanks for the great talk at STATS-DC! I'd love an API that makes it easy to find demographic information for school districts. I had to navigate a handful of different census websites to download custom excel files to link shapefiles of boundaries, expenditure, poverty, and enrollment demographics

@psmnolan

This comment has been minimized.

Show comment
Hide comment
@psmnolan

psmnolan Aug 1, 2017

psmnolan commented Aug 1, 2017

@metzgr

This comment has been minimized.

Show comment
Hide comment
@metzgr

metzgr Aug 2, 2017

Contributor

@psmnolan What a cool idea! Please share what you can.

@psmnolan @hrecht We've since spoken to IPEDS leadership about an API and are exploring options for soliciting public feedback, keeping in mind that you've all offered to jump on a call. As you might expect, people want some back-and-forth about this. At this point, we can't commit to anything... but we'll keep at it! Thanks all for your patience.

And I'll see if I can get some more information on those IPEDS presentations in May.

@kheuton Your (great) idea is well-noted.

Also, some sad news: Ivy's left ED. I'll be your main POC from now on.

Contributor

metzgr commented Aug 2, 2017

@psmnolan What a cool idea! Please share what you can.

@psmnolan @hrecht We've since spoken to IPEDS leadership about an API and are exploring options for soliciting public feedback, keeping in mind that you've all offered to jump on a call. As you might expect, people want some back-and-forth about this. At this point, we can't commit to anything... but we'll keep at it! Thanks all for your patience.

And I'll see if I can get some more information on those IPEDS presentations in May.

@kheuton Your (great) idea is well-noted.

Also, some sad news: Ivy's left ED. I'll be your main POC from now on.

@metzgr

This comment has been minimized.

Show comment
Hide comment
@metzgr

metzgr Aug 14, 2017

Contributor

@psmnolan @hrecht Got my hands on ED's slides on updates to IPEDS. Hope this helps!

2017 IPEDS Update for AIR Forum _FINAL.pdf

Contributor

metzgr commented Aug 14, 2017

@psmnolan @hrecht Got my hands on ED's slides on updates to IPEDS. Hope this helps!

2017 IPEDS Update for AIR Forum _FINAL.pdf

@sawest

This comment has been minimized.

Show comment
Hide comment
@sawest

sawest Aug 30, 2017

I think the next API needed is for FAFSA!!!

My community college would like to develop an applications system that handles admissions as well as submit application to FAFSA automatically. The student could then keep track of their application process in one easy location rather than multiple locations. They could also fill out 1 application rather than multiple applications.

sawest commented Aug 30, 2017

I think the next API needed is for FAFSA!!!

My community college would like to develop an applications system that handles admissions as well as submit application to FAFSA automatically. The student could then keep track of their application process in one easy location rather than multiple locations. They could also fill out 1 application rather than multiple applications.

@metzgr

This comment has been minimized.

Show comment
Hide comment
@metzgr

metzgr Sep 1, 2017

Contributor

Thanks for this suggestion, @sawest!

Contributor

metzgr commented Sep 1, 2017

Thanks for this suggestion, @sawest!

@disandavis

This comment has been minimized.

Show comment
Hide comment
@disandavis

disandavis Sep 21, 2017

It would be great to have an API of national and state educational standards so we can link our digital content to relevant standards for any US teacher.

disandavis commented Sep 21, 2017

It would be great to have an API of national and state educational standards so we can link our digital content to relevant standards for any US teacher.

@leeprevost

This comment has been minimized.

Show comment
Hide comment
@leeprevost

leeprevost Dec 22, 2017

dittos to @jengoree to add primary/secondary and lea apis.

leeprevost commented Dec 22, 2017

dittos to @jengoree to add primary/secondary and lea apis.

@suufi

This comment has been minimized.

Show comment
Hide comment
@suufi

suufi Jan 10, 2018

I'd love it if you guys could add an API where we could get a list of school systems in the US.

suufi commented Jan 10, 2018

I'd love it if you guys could add an API where we could get a list of school systems in the US.

@benjaminrobinson

This comment has been minimized.

Show comment
Hide comment
@benjaminrobinson

benjaminrobinson Jan 10, 2018

Will there ever be a call?

benjaminrobinson commented Jan 10, 2018

Will there ever be a call?

@AlexanderOrtiz

This comment has been minimized.

Show comment
Hide comment
@AlexanderOrtiz

AlexanderOrtiz Jan 10, 2018

Is there an open contract to fulfill this request?

AlexanderOrtiz commented Jan 10, 2018

Is there an open contract to fulfill this request?

@metzgr

This comment has been minimized.

Show comment
Hide comment
@metzgr

metzgr Apr 18, 2018

Contributor

Hi all, we lost access to GitHub and recently regained it. @benjaminrobinson @AlexanderOrtiz, unfortunately, this project is in a bit of a holding pattern; there may not be a call for a while and there is no contract in place yet to fulfill these requests. We still welcome your feedback; we're compiling these comments for when there are resources and staff to act on them. Thanks for your patience!

Contributor

metzgr commented Apr 18, 2018

Hi all, we lost access to GitHub and recently regained it. @benjaminrobinson @AlexanderOrtiz, unfortunately, this project is in a bit of a holding pattern; there may not be a call for a while and there is no contract in place yet to fulfill these requests. We still welcome your feedback; we're compiling these comments for when there are resources and staff to act on them. Thanks for your patience!

@AlexanderOrtiz

This comment has been minimized.

Show comment
Hide comment
@AlexanderOrtiz

AlexanderOrtiz Apr 18, 2018

I understand and am willing to wait. Having an API to access the data is important to my institution.

AlexanderOrtiz commented Apr 18, 2018

I understand and am willing to wait. Having an API to access the data is important to my institution.

@benjaminrobinson

This comment has been minimized.

Show comment
Hide comment
@benjaminrobinson

benjaminrobinson Apr 18, 2018

Thanks for the update @metzgr. Sad to hear the project fell off track/out of favor. Hopeful for the future!

benjaminrobinson commented Apr 18, 2018

Thanks for the update @metzgr. Sad to hear the project fell off track/out of favor. Hopeful for the future!

@psmnolan

This comment has been minimized.

Show comment
Hide comment
@psmnolan

psmnolan Apr 24, 2018

psmnolan commented Apr 24, 2018

@metzgr

This comment has been minimized.

Show comment
Hide comment
@metzgr

metzgr Apr 24, 2018

Contributor

@psmnolan SO AWESOME. Thanks for sharing!

Contributor

metzgr commented Apr 24, 2018

@psmnolan SO AWESOME. Thanks for sharing!

@sdcduncan

This comment has been minimized.

Show comment
Hide comment
@sdcduncan

sdcduncan May 9, 2018

Wow. They did a great job.
Well. Sad for me. I was just getting ready to launch my project at kickstarter.com
The preview site is at: The preview site

Will report back when launched.

sdcduncan commented May 9, 2018

Wow. They did a great job.
Well. Sad for me. I was just getting ready to launch my project at kickstarter.com
The preview site is at: The preview site

Will report back when launched.

@sdcduncan

This comment has been minimized.

Show comment
Hide comment
@sdcduncan

sdcduncan May 24, 2018

The project is now live at:
Kickstarter.com Project: us-ipeds-colleges

I will appreciate your support. At least at this point, I believe I will be able to provide much more data elements - practically, all that are published by IPEDS throughout the years.

sdcduncan commented May 24, 2018

The project is now live at:
Kickstarter.com Project: us-ipeds-colleges

I will appreciate your support. At least at this point, I believe I will be able to provide much more data elements - practically, all that are published by IPEDS throughout the years.

@mchingos

This comment has been minimized.

Show comment
Hide comment
@mchingos

mchingos Aug 9, 2018

The Urban Institute’s Education Policy Program has developed an Education Data Portal that aggregates an abundance of PK-12 and higher education data, making it easier for researchers, practitioners, and policymakers to generate rigorous, accurate, and actionable insights.

This resource will eventually include all major national datasets on schools, districts, and colleges, for all available years. The current version contains large portions of data from the Common Core of Data and IPEDS. This fall we plan to add the Civil Rights Data Collection and the College Scorecard.
The data are available for download or can be easily accessed using Stata and R packages.

Though the portal is still in beta, we hope you’ll find it useful. In the coming months, we will continue to add datasets, including data beyond education that help capture the full picture of students’ lives. We also plan to release a user-friendly interface, making it easier for anyone, regardless of statistical training, to access this rich repository of information.

Please check it out and send us your feedback!

mchingos commented Aug 9, 2018

The Urban Institute’s Education Policy Program has developed an Education Data Portal that aggregates an abundance of PK-12 and higher education data, making it easier for researchers, practitioners, and policymakers to generate rigorous, accurate, and actionable insights.

This resource will eventually include all major national datasets on schools, districts, and colleges, for all available years. The current version contains large portions of data from the Common Core of Data and IPEDS. This fall we plan to add the Civil Rights Data Collection and the College Scorecard.
The data are available for download or can be easily accessed using Stata and R packages.

Though the portal is still in beta, we hope you’ll find it useful. In the coming months, we will continue to add datasets, including data beyond education that help capture the full picture of students’ lives. We also plan to release a user-friendly interface, making it easier for anyone, regardless of statistical training, to access this rich repository of information.

Please check it out and send us your feedback!

@metzgr

This comment has been minimized.

Show comment
Hide comment
@metzgr

metzgr Aug 9, 2018

Contributor

@mchingos This is amazing! Thank you for your team's great work.

Contributor

metzgr commented Aug 9, 2018

@mchingos This is amazing! Thank you for your team's great work.

@sdcduncan

This comment has been minimized.

Show comment
Hide comment
@sdcduncan

sdcduncan Aug 19, 2018

An IPEDS data access system is under construction.
A demonstration of the current progress is available now at:
https://www.youtube.com/watch?v=7OvT8orlVsI

Comment and question welcome.

sdcduncan commented Aug 19, 2018

An IPEDS data access system is under construction.
A demonstration of the current progress is available now at:
https://www.youtube.com/watch?v=7OvT8orlVsI

Comment and question welcome.

@sdcduncan

This comment has been minimized.

Show comment
Hide comment
@sdcduncan

sdcduncan Sep 14, 2018

Update to IPEDS data access system with charting ability and example:
https://www.youtube.com/watch?v=aWzopizHGtM

Questions and Comments welcome.

sdcduncan commented Sep 14, 2018

Update to IPEDS data access system with charting ability and example:
https://www.youtube.com/watch?v=aWzopizHGtM

Questions and Comments welcome.

@wingrunr21

This comment has been minimized.

Show comment
Hide comment
@wingrunr21

wingrunr21 Sep 18, 2018

I'd echo previous votes for a FAFSA API

wingrunr21 commented Sep 18, 2018

I'd echo previous votes for a FAFSA API

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment