Skip to content

Commit

Permalink
Version 20240417.02. Update TLDs list.
Browse files Browse the repository at this point in the history
  • Loading branch information
Arkiver2 committed Apr 17, 2024
1 parent 6b0824c commit 6e61565
Show file tree
Hide file tree
Showing 3 changed files with 2 additions and 3 deletions.
2 changes: 1 addition & 1 deletion pipeline.py
Original file line number Diff line number Diff line change
Expand Up @@ -83,7 +83,7 @@ def search(self, text):
#
# Update this each time you make a non-cosmetic change.
# It will be added to the WARC files and reported to the tracker.
VERSION = '20240413.01'
VERSION = '20240417.02'
#USER_AGENT = 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/86.0.4240.183 Safari/537.36'
TRACKER_ID = 'urls'
TRACKER_HOST = 'legacy-api.arpa.li'
Expand Down
1 change: 0 additions & 1 deletion static-tlds.txt
Original file line number Diff line number Diff line change
Expand Up @@ -85,7 +85,6 @@ auspost
author
auto
autos
avianca
aw
aws
ax
Expand Down
2 changes: 1 addition & 1 deletion user-agents.txt
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/124.0.0.0 Safari/537.36
Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/124.0.0.0 Safari/537.36 Edg/123.0.2420.97
Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/124.0.0.0 Safari/537.36 OPR/109.0.0.0
Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:125.0) Gecko/20100101 Firefox/125.0
Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:125.0) Gecko/20100101 Firefox/125.0

0 comments on commit 6e61565

Please sign in to comment.