Some redirect/dead domains appearing in DAP info

[tdlowden]

I took a look at all the domains in the DAP section by agency, and found many that redirect or that are just plain broken:

Redirects:
GSA: advantage.gov & gsadvantage.gov>> gsaadvantage.gov
GSA: fedrooms.gov>> gsa.gov/fedrooms
DOT: dottrafficrecords.gov & dottrcc.gov>> http://www.dot.gov/trcc
ED: education.gov>> ed.gov
HUD: hud.govnationalhousing.gov & nationalhousinglocator.gov & nhl.gov & nls.gov & disasterhousing.gov>> http://portal.hud.gov/hudportal/HUD
FCC: broadband.gov>> https://www.fcc.gov/national-broadband-plan

Dead:
DOT: http://safertruck.gov/
DNI: http://www.intelink.gov/
CNCS: http://americorpsweek.gov/
FERC: http://fercalt.gov/

[konklone]

@tdlowden Is this still an issue?

[djharrity]

A few more remain:

ED: collegenavigator.gov >> nces.ed.gov/collegenavigator
HHS: pandemicflu.gov >> flu.gov
HHS: nlm.gov >> mom.nih.gov

[CrazyPython]

The single non-18F opened issue hasn't been resolved in over a year. Developed in the open, not yet open source.

[konklone]

@CrazyPython: @tdlowden is a GSA employee, and the owner of the project.

[tdlowden]

@konklone, for my initial issue, some have been resolved, some have not:

Redirects:

RESOLVED
GSA: advantage.gov & gsadvantage.gov>> gsaadvantage.gov
GSA: fedrooms.gov>> gsa.gov/fedrooms
DOT: dottrafficrecords.gov & dottrcc.gov>> http://www.dot.gov/trcc

UNRESOLVED
ED: education.gov>> ed.gov
HUD: nationalhousinglocator.gov & nhl.gov & nls.gov & disasterhousing.gov>> http://portal.hud.gov/hudportal/HUD
FCC: broadband.gov>> https://www.fcc.gov/national-broadband-plan

Dead:

RESOLVED
DOT: http://safertruck.gov/ (no longer dead)
FERC: http://fercalt.gov/ (technically not dead)

UNRESOLVED
DNI: http://www.intelink.gov/
CNCS: http://americorpsweek.gov/

From what I can tell, @djharrity's additions have all be resolved, at least in the DAP section.

[konklone]

@tdlowden I don't believe these are detection issues.

• education.gov redirects, but www.education.gov does not redirect, so it's eligible.
• HUD's redirects are handled using JavaScript (self.location.replace('http://portal.hud.gov/portal/page/portal/HUD');) instead of a server-side redirect. We have consistently told server operators to employ server-side redirects -- a general web best practice and much more feasible to detect -- if they want to be seen as a "redirect domain".
• broadband.gov redirects server-side, but www.broadband.gov redirects client-side using HTML (<META HTTP-EQUIV="refresh" CONTENT="0 ;URL=http://www.fcc.gov/national-broadband-plan">) which we also don't detect as a redirect, for the same reasons as JS-based redirects.

The dead domains aren't dead:

• https://www.intelink.gov works over HTTPS, even though it doesn't work over HTTP.
• http://americorpsweek.gov returns a custom error page hosted by the server. They should take this offline if they want to be seen as a "dead" domain.

[tdlowden]

@konklone thanks for clarifications. Makes sense. I was just going off of clicking the links on the Pulse pages, which obviously don't prepend https or www.

Really weird about the education.gov example. At least www.education.gov is DAP implemented. As for non-server-side redirects, I get why they should stay in the list as a matter of best practice. Hope those agencies eventually make those changes.

[tdlowden]

@konklone, based on these clarifications, I think you can close this issue.

[konklone]

👍

[CrazyPython]

Understand. Happy to help close an issue for you guys.