Skip to content
Permalink
Browse files

crawls

  • Loading branch information...
ToSBackCrawler committed Jul 11, 2019
1 parent 8083724 commit 055d7757a8f8166bea93fae287917c6b4561bdb3
Showing with 3,328 additions and 1,216 deletions.
  1. +21 −13 crawl/aeropostale.com/Privacy Policy.txt
  2. +2 −17 crawl/aetna.com/Privacy Policy.txt
  3. +1 −1 crawl/agame.com/Privacy Policy.txt
  4. +24 −24 crawl/allstate.com/Privacy Policy.txt
  5. +3 −9 crawl/apple.com/Apple Transparency Report.txt
  6. +2 −2 crawl/bloomingdales.com/Privacy Policy.txt
  7. +1 −1 crawl/careerpath.com/Privacy Policy.txt
  8. +1 −57 crawl/daum.net/Privacy Policy.txt
  9. +38 −14 crawl/debka.com/Privacy Policy.txt
  10. +1 −1 crawl/elpasotimes.com/Privacy Policy.txt
  11. +2 −1 crawl/fidelity.com/Privacy Policy.txt
  12. +1 −2 crawl/fitbit.com/Privacy Policy.txt
  13. +3 −3 crawl/freecode.com/Terms of Use.txt
  14. +2 −2 crawl/gartner.com/Privacy Policy.txt
  15. +106 −150 crawl/hautelook.com/Privacy Policy.txt
  16. +1 −1 crawl/hickoryfarms.com/Privacy Policy.txt
  17. +74 −95 crawl/homedecorators.com/Privacy Policy.txt
  18. +4 −2 crawl/howstuffworks.com/Privacy Policy.txt
  19. +22 −110 crawl/hsbc.com/Privacy Policy.txt
  20. +1 −1 crawl/ign.com/Privacy Policy.txt
  21. +1 −1 crawl/imdb.com/Privacy Policy.txt
  22. +1 −1 crawl/indeed.com/Privacy Policy.txt
  23. +53 −8 crawl/intuit.com/Privacy Policy.txt
  24. +3 −2 crawl/landsend.com/Privacy Policy.txt
  25. +1 −1 crawl/nike.com/Privacy Policy.txt
  26. +14 −1 crawl/noaa.gov/Privacy Policy.txt
  27. +5 −7 crawl/npr.org/Privacy Policy.txt
  28. +3 −3 crawl/officemax.com/Privacy Policy.txt
  29. +1 −1 crawl/okcupid.com/Privacy Policy.txt
  30. +1 −1 crawl/paypal.com/Privacy Policy.txt
  31. +2 −6 crawl/pbskids.org/Privacy Policy.txt
  32. +746 −4 crawl/peekyou.com/Privacy Policy.txt
  33. +1 −1 crawl/pollen.com/Privacy Policy.txt
  34. +1 −1 crawl/search-results.com/Privacy Policy.txt
  35. +1 −1 crawl/sencha.com/Privacy Policy.txt
  36. +106 −53 crawl/shopstyle.com/Terms of Service.txt
  37. +97 −165 crawl/sony.com/Privacy Policy.txt
  38. +288 −208 crawl/sourceforge.net/Privacy Policy.txt
  39. +2 −2 crawl/spiegel.de/Privacy Policy.txt
  40. +2 −2 crawl/starwoodhotels.com/Privacy Policy.txt
  41. +2 −1 crawl/stumbleupon.com/Privacy Policy.txt
  42. +2 −2 crawl/tealium.com/Privacy Policy.txt
  43. +13 −13 crawl/timewarnercable.com/Terms of Service.txt
  44. +60 −60 crawl/tube8.com/Privacy Policy.txt
  45. +37 −37 crawl/urbandictionary.com/Privacy Policy.txt
  46. +1 −1 crawl/usanetwork.com/Privacy Policy.txt
  47. +1 −4 crawl/webmd.com/Privacy Policy.txt
  48. +79 −80 crawl/wellsfargo.com/Privacy Policy.txt
  49. +1 −1 crawl/whitepages.com/Privacy Policy.txt
  50. +11 −10 crawl/xanga.com/Privacy Policy.txt
  51. +13 −13 crawl/y8.com/Privacy Policy.txt
  52. +720 −0 logs/empty.log
  53. +735 −0 logs/errors.log
  54. +12 −19 logs/modified.log
  55. +2 −0 logs/run.log
@@ -152,11 +152,14 @@ Help? - Contact Us
<li> Low Rise Jeans </li>
<li> Curvy </li>
<li> Cheeky </li>
<li> Real Jeans </li>
<li> Overalls </li>
<li> Cropped Jegging </li>
<li> Bootcut </li>
<li> Skinny </li>
<li> Wide Leg </li>
<li> Boyfriend </li>
<li> Mom Jeans </li>
<li> Real Denim </li>
<li> Flex Effects </li>
<li> Eco-Friendly Repreve </li>
</ul>Close submenu ( Guys Jeans ) Guys Jeans <ul>
@@ -166,14 +169,14 @@ Help? - Contact Us
<li> Slim </li>
<li> Straight </li>
<li> Slim Bootcut </li>
<li> Relaxed </li>
<li> Flex Effects </li>
<li> Destroyed Denim </li>
<li> Athletic Skinny </li>
<li> Real Denim </li>
<li> Carpenter </li>
<li> Loose </li>
<li> Dad </li>
<li> Relaxed </li>
<li> Carpenter </li>
<li> Real Denim </li>
<li> Flex Effects </li>
</ul>Close submenu ( Shorts ) Shorts <ul>
<li> View Home </li>
<li> Open submenu ( Girls ) Girls </li>
@@ -402,11 +405,14 @@ Select Country </li>
<li> Low Rise Jeans </li>
<li> Curvy </li>
<li> Cheeky </li>
<li> Real Jeans </li>
<li> Overalls </li>
<li> Cropped Jegging </li>
<li> Bootcut </li>
<li> Skinny </li>
<li> Wide Leg </li>
<li> Boyfriend </li>
<li> Mom Jeans </li>
<li> Real Denim </li>
<li> Flex Effects </li>
<li> Eco-Friendly Repreve </li>
</ul>
@@ -420,14 +426,14 @@ Select Country </li>
<li> Slim </li>
<li> Straight </li>
<li> Slim Bootcut </li>
<li> Relaxed </li>
<li> Flex Effects </li>
<li> Destroyed Denim </li>
<li> Athletic Skinny </li>
<li> Real Denim </li>
<li> Carpenter </li>
<li> Loose </li>
<li> Dad </li>
<li> Relaxed </li>
<li> Carpenter </li>
<li> Real Denim </li>
<li> Flex Effects </li>
</ul>
</li>
</ul>
@@ -572,14 +578,15 @@ SLIM &amp.
THICK
CURVY JEAN Booty-enhancing jean with a magic gap-proof waistband that highlights your curves.
Now Available In: Get Ahead of the Curve #INAEROJEANS 20 Fits &amp.
90 Washes Sizes 00-18, Short, Regular &amp.
Long REAL DENIM
90 Washes REAL DENIM
Old School Fits &amp.
Washes.
New School Comfort FLEX EFFECTS
Our innovative 4-way, 360 stretch denim.
SERIOUSLY STRETCHY
2-way seriously stretchy denim.
MAX STRETCH FOR GUYS
2-way seriously stretchy denim.
REAL DENIM
Old School Fits &amp.
Washes.
@@ -589,7 +596,8 @@ Our innovative 4-way, 360 stretch denim.
<li>1</li>
<li>2</li>
<li>3</li>
</ul> Previous Real Jeans Overalls Cropped Jeggings Ankle Jeggings Bootcut (Online Only) Skinny (Online Only) Jeggings High Rise Jeggings Low Rise Jeggings Curvy Jeans Cheeky Jeans Real Jeans Overalls Cropped Jeggings Ankle Jeggings Bootcut (Online Only) Skinny (Online Only) Jeggings High Rise Jeggings Low Rise Jeggings Curvy Jeans Cheeky Jeans Real Jeans Next FLEX EFFECTS
<li>4</li>
</ul> Previous Boyfriend Overalls Cropped Jeggings Ankle Jeggings Bootcut (Online Only) Skinny (Online Only) Jeggings Skinny Jeans High Rise Jeans Slim Jeans Low Rise Jeans Dad Jeans Curvy Jeans Straight Jeans Cheeky Jeans Slim Bootcut (Online Only) Wide Leg Loose Mom Boyfriend Overalls Cropped Jeggings Ankle Jeggings Bootcut (Online Only) Skinny (Online Only) Jeggings Skinny Jeans High Rise Jeans Slim Jeans Low Rise Jeans Dad Jeans Next FLEX EFFECTS
Our innovative 4-way, 360 stretch denim.
Our best selling denim fabric - now in fits featured for back to school FLEX EFFECTS Our innovative 4-way, 360 stretch denim.
Our best selling denim fabric - now in fits featured for back to school Shop Girls Shop Guys In Stores &amp.
@@ -3,8 +3,7 @@
<p>Aetna.com works best with Safari 8 and above.
<u>Learn more</u> &gt;</p>
<p>If your browser is in Private mode, pages that use personal or geographic information may not work.
<u>Learn more about private mode.</u> &gt;</p>
<ul>
<u>Learn more about private mode.</u> &gt;</p> Login <ul>
<li>
<p>Español</p>   </li>
</ul>
@@ -21,7 +20,7 @@
<li> Providers   </li>
<li> Agents/Brokers   </li>
<li> About Us   </li>
</ul> Search Individuals Individuals overview Get a quote Get a quote <ul>
</ul> Login   Search Individuals Individuals overview Get a quote Get a quote <ul>
<li> Medicare </li>
<li> Health insurance </li>
<li> Vision insurance </li>
@@ -274,20 +273,6 @@ analysis </li>
<ul>
</ul>
<ul>
<li> For individuals </li>
<li> For employers </li>
<li> For providers </li>
<li> For brokers </li>
<li> About us </li>
<li> Contact </li>
<li> News &amp.
analysis </li>
</ul>
<ul>
<li>
</li>
</ul>
<ul>
<li>
<p>Español</p>   </li>
</ul>
@@ -210,8 +210,8 @@ Watergirl 4: Crystal Temple </li>
<li> Madalin Stunt Cars 2 </li>
<li> Hill Racing Challenge </li>
<li> Highway Rider Extreme: Motorbike Game 3D </li>
<li> Uphill Rush 7: Waterpark </li>
<li> Madalin Cars Multiplayer </li>
<li> Uphill Rush 7: Waterpark </li>
<li> Country Ride: Race Car Game </li>
<li> Agame Stunt Cars </li>
<li> Happy Wheels </li>
@@ -3,7 +3,7 @@ Skip Navigation Explore Allstate <ul>
<li>Find An Agent</li>
<li>Contact Us</li>
<li>Español</li>
<li>denver, CO 80201</li>
<li>Set Your Location</li>
<li> Search </li>
</ul>
<i>
@@ -146,22 +146,20 @@ Vehicle</li>
<ul>
<li>
</li>
<li> Get a Quote <p>Your location is set for <br>denver, CO 80201</p>
<p>Enter a valid US ZIP Code to set your location.</p> Edit location <p>Select a product to get a quote.</p> Retrieve a saved quote <ul>
<li> Auto </li>
<li> Home </li>
<li> Renters </li>
<li> Life </li>
<li> Condo </li>
<li> Motorcycle </li>
<li> Boat </li>
<li> ATV/Rec.
Vehicle </li>
<li> Business Insurance </li>
<li> More Insurance </li>
<li> Find An Agent </li>
</ul>
</li>
<li> Get a quote <p>Get a quote in </p> AutoHomeRentersLifeCondoMotorcycleBoatATVBusiness<ul>
<li>Home</li>
<li>Renters</li>
<li>Life</li>
<li>Condo</li>
<li>Motorcycle</li>
<li>Boat</li>
<li>ATV</li>
<li>Business</li>
</ul>Auto + Add another product to saveHomeRentersLife<ul>
<li>Home</li>
<li>Renters</li>
<li>Life</li>
</ul>+ Add another product to save Get a quote Retrieve a saved quote </li>
<li> Insurance &amp.
More <ul>
<li>Roadside</li>
@@ -210,15 +208,16 @@ Investments</li>
<li>Business Insurance</li>
</ul>
</li>
<li> Get A Quote in <p>80201</p>
<p>80201 Edit location </p> Select a ProductAutoHomeRentersLifeCondoMotorcycleBoatATV/Rec.
<li> Get A Quote in <p>
</p>
<p> Edit location </p> Select a ProductAutoHomeRentersLifeCondoMotorcycleBoatATV/Rec.
VehicleBusiness InsuranceMore InsuranceGet A Quote <p>Retrieve a saved quote</p>
</li>
<li>Find A Local Agent</li>
<li>My Account Log in</li>
</ul> My Account Log in <p>Log in to My Account</p> Forgot user ID Forgot password <p>Remember My User ID</p>
<p>What's This?</p> Register new account <ul>
<li>denver, CO 80201</li>
<li>Update Zip Code</li>
<li>Contact Us</li>
<li>Español</li>
</ul>
@@ -272,10 +271,10 @@ Initiatives </li>
<li>
<li>About Allstate</li>
<li>Privacy Statement</li>
</ol> Find An Agent Close <p>Agents near 80201</p>
</ol> Find An Agent Close <p>Agents near </p>
<ul>
<li>Loading...</li>
</ul> Advanced agent search <p> 80201 Edit location </p> Select a ProductAutoHomeRentersLifeCondoMotorcycleBoatATV/Rec.
</ul> Advanced agent search <p> Edit location </p> Select a ProductAutoHomeRentersLifeCondoMotorcycleBoatATV/Rec.
VehicleBusiness InsuranceGet a quote <p>Retrieve a saved quote</p>
<p>24-hour support</p>
<p>1-800-ALLSTATE</p>
@@ -554,7 +553,7 @@ We may still contact you about your Allstate policy, billing issues, claims and
We won't share your personal information with Allstate companies for marketing purposes except as allowed by Vermont law.<p>
</p>
<p>Top</p>
<p>80201Edit Location</p> Select a ProductAutoHomeRentersLifeCondoMotorcycleBoatATV/Rec.
<p>Edit Location</p> Select a ProductAutoHomeRentersLifeCondoMotorcycleBoatATV/Rec.
VehicleBusiness Insurance<p>Retrieve a saved quote</p>
<p>© 2019 Allstate Insurance Company</p> Connect With Us <ul>
<li> Company </li>
@@ -599,7 +598,8 @@ Security</li>
<i>
</i>
<p>City, State</p>
<p>denver, CO</p> Oops! You have entered an invalid ZIP.
<p>
</p> Oops! You have entered an invalid ZIP.
Please try again.
Location data not available.
Please enter zip code.
@@ -8,9 +8,7 @@ This report provides information on government requests received.</p> Government
<li> Device <p>Device requests are based on device identifiers such as Apple serial number, IMEI or MEID.</p>
<p>Device requests generally seek information regarding customers associated with devices and device connections to Apple services - for example, law enforcement investigations on behalf of customers regarding lost or stolen devices.</p>
<p>Additionally, Apple regularly receives multi-device requests related to fraud investigations.</p>
<p>View Device Requests</p> Device Requests by Year - Worldwide 70k60k50k40k30k20k10k0k79%201878%201767%201659%201560%201473%2013 <ul>
<li> Requests Received</li>
<li> Requests where Data Provided</li>
<p>View Device Requests</p> Device Requests by Year - Worldwide <ul>
</ul>
</li>
<li> Financial Identifier <p>Financial Identifier requests are based on financial identifiers such as credit/debit card or iTunes Gift Card.</p>
@@ -22,9 +20,7 @@ This report provides information on government requests received.</p> Government
Account requests generally seek information regarding customers’ Apple ID accounts, such as account holder name and address and account connections to Apple services - for example, law enforcement investigations where an account may have been used unlawfully.
Account requests may also seek customers’ content data, such as photos, email, iOS device backups, contacts or calendars.<br>
</p>
<p>View Account Requests</p> Account Requests by Year - Worldwide 10k9k8k7k6k5k4k3k2k1k0k82%201881%201775%201667%201560%201454%2013 <ul>
<li> Requests Received</li>
<li> Requests where Data Provided</li>
<p>View Account Requests</p> Account Requests by Year - Worldwide <ul>
</ul>
</li>
<li> Account Preservation <p>Account Preservation requests are based on account identifiers such as an Apple ID or email address.   </p>
@@ -38,9 +34,7 @@ Account requests may also seek customers’ content data, such as photos, email,
<p>View Account Restriction/Deletion Requests</p> Account Restriction/Deletion Requests - Worldwide Report Period Requests Received Requests where Account Restricted Requests where Account Deleted 2018 H2 15 2 2 2018 H1 5 3 2 2017 H2 7 7 0 2017 H1 14 14 0 2016 H2 14 1 5 2016 H1 3 - 3 2015 H2 3 - 3 2015 H1 1 - 0 2014 H2 2 - 0 2014 H1 -Not Applicable -Not Applicable -Not Applicable 2013 H2 -Not Applicable -Not Applicable -Not Applicable 2013 H1 -Not Applicable -Not Applicable -Not Applicable </li>
<li> Emergency <p>Emergency requests relate to circumstances involving imminent danger of death or serious physical injury to any person, and generally seek information regarding customers’ connections to Apple services - for example, instances where law enforcement believe a person is missing and in danger.  </p>
<p>Apple began reporting on Emergency requests as a separate category in Transparency Report Period January 1 - June 30, 2015.  Prior to this, emergency requests were reported in applicable Account and/or Device request categories.</p>
<p>View Emergency Requests</p> Emergency Requests by Year - Worldwide 1000900800700600500400300200100088%201882%2017N/A2016N/A2015N/A2014N/A2013 <ul>
<li> Requests Received</li>
<li> Requests where Data Provided</li>
<p>View Emergency Requests</p> Emergency Requests by Year - Worldwide <ul>
</ul>
</li>
<li> United States National Security <p>U.S.
@@ -595,8 +595,8 @@ If you receive anything with the Bloomingdale’s brand that seems suspicious, y
<li> Terms of Use </li>
<li> What is the shipping policy? </li>
<li> CA Privacy Rights </li>
</ul> SAVE 10%: Sign Up for Emails or Texts! FREE SHIPPING EVERY DAY! PLUS, FREE RETURNS Loyallists: No Minimum.
Everyone Else: $150+ Info/Exclusions CUSTOMER SERVICE <ul>
</ul> SAVE 10%: Sign Up for Emails or Texts! FREE SHIPPING EVERY DAY! PLUS, FREE RETURNS <p>Loyallists: No Minimum.
Everyone Else: $150+</p> Info/Exclusions CUSTOMER SERVICE <ul>
<li>1-800-777-0000</li>
<li>FAQs &amp.
Help</li>
@@ -1,4 +1,4 @@
&lt;iframe src="//www.googletagmanager.com/ns.html?id=GTM-NXB4FH&amp;noscript=true&amp;browser_id=20190710011398d9b992728749d18f0cfba2ba1a074a"
&lt;iframe src="//www.googletagmanager.com/ns.html?id=GTM-NXB4FH&amp;noscript=true&amp;browser_id=201907110115f498814580eb4b8399dfadc3cdc187af"
height="0" width="0" style="display:none;visibility:hidden"&gt;&lt;/iframe&gt.
Skip to Content Hello.
Sign in to find your next job.
@@ -196,60 +196,4 @@ GDPR 등 적용되는 법률에 따라, 이용자는 자신의 개인정보를
<li>시행일자: 2019년 6월 11일</li>
</ul>
<p>카카오는 이용자 여러분의 정보를 소중히 생각하며, 이용자가 더욱 안심하고 서비스를 이용할 수 있도록 최선의 노력을 다할것을 약속드립니다.</p> 맨위로 <small>Copyright ⓒ Kakao Corp.
All rights reserved.</small>
<strong>Daum</strong>로그인서비스 바로가기<ul>
<li>메일</li>
<li>카페</li>
<li>뉴스</li>
<li>쇼핑</li>
</ul>전체서비스 더보기<strong>더보기 1열</strong>
<ul>
<li>같이가치</li>
<li>게임</li>
<li>금융</li>
<li>뉴스</li>
<li>다음웹툰</li>
</ul>
<strong>더보기 2열</strong>
<ul>
<li>메일</li>
<li>방금그곡</li>
<li>백과사전</li>
<li>부동산</li>
<li>브런치</li>
<li>블로그</li>
</ul>
<strong>더보기 3열</strong>
<ul>
<li>쇼핑</li>
<li>스포츠</li>
<li>어학사전</li>
<li>연예</li>
<li>영화</li>
</ul>
<strong>더보기 4열</strong>
<ul>
<li>자동차</li>
<li>주소록</li>
<li>주식시세</li>
</ul>
<strong>더보기 5열</strong>
<ul>
<li>카카오맵</li>
<li>카페</li>
<li>티스토리</li>
<li>항공권</li>
<li>전체보기</li>
</ul>실시간 이슈검색어<ol>
<li>1위 강지환상승619</li>
<li>2위 김혜수상승156</li>
<li>3위 이랜드몰상승83</li>
<li>4위 금태섭상승80</li>
<li>5위 조선생존기상승69</li>
<li>6위 나이키상승63</li>
<li>7위 현대건설상승63</li>
<li>8위 임은경상승52</li>
<li>9위 윤보미상승38</li>
<li>10위 메이저리그 올스타전상승33</li>
<li>1위 강지환상승619</li>
</ol>
All rights reserved.</small>

0 comments on commit 055d775

Please sign in to comment.
You can’t perform that action at this time.