[question] hostname_replace plugin: what results do you ignore?

[return42]

I open this issue to share some experience about results (domains) that can be ignored.

For reference: collected lists

• https://github.com/stroobants-dev/ublock-origin-shitty-copies-filter
• https://github.com/jhchabran/code-search-blacklist (see comment)

---

Updated 12/04/2022: Here is my current hostname_replace: setup:

  # block bload domains

  'com\.de': false
  '(.*\.)?codegrepper\.com': false
  '(.*\.)?w3schools\.com': false
  '(.*\.)?geeksforgeeks\.org': false
  '(.*\.)?stackshare\.io': false
  '(.*\.)?tutorialspoint\.com': false
  '(.*\.)?answeright\.com': false
  '(.*\.)?askdev\.info': false
  '(.*\.)?askdev\.io': false
  '(.*\.)?blogmepost\.com': false
  '(.*\.)?c-sharpcorner\.com': false
  '(.*\.)?code-examples\.net': false
  '(.*\.)?codeflow\.site': false
  '(.*\.)?gitmemory\.cn': false
  '(.*\.)?gitmemory\.com': false
  '(.*\.)?intellipaat\.com': false
  '(.*\.)?javaer101\.com': false
  '(.*\.)?programmerstart\.com': false
  '(.*\.)?programmersought\.com': false
  '(.*\.)?qastack\.com': false
  '(.*\.)?roboflow\.ai': false
  '(.*\.)?stackanswers\.net': false
  '(.*\.)?stackoom\.com': false
  '(.*\.)?stackovernet\.com': false
  '(.*\.)?stackovernet\.xyz': false
  '(.*\.)?stackoverrun\.com': false
  '(.*\.)?thetopsites\.net': false
  '(.*\.)?ubuntugeeks\.com': false
  '(.*\.)?cyberciti\.biz': false
  '(.*\.)?ispycode\.com': false
  '(.*\.)?reposhub\.com': false
  '(.*\.)?githubmemory\.com': false
  '(.*\.)?issueexplorer\.com': false
  '(.*\.)?tabnine\.com': false
  '(.*\.)?gitcode\.net': false
  '(.*\.)?command-not-found\.com': false
  '(.*\.)?im-coder\.com': false
  '(.*\.)?i-harness\.com': false

  # ublock-origin-shitty-copies-filter/stackoverflow-copycats.txt

  '(.*\.)?code-examples\.net': false
  '(.*\.)?kotaeta\.com': false
  '(.*\.)?answer-id\.com': false
  '(.*\.)?code\.i-harness\.com': false
  '(.*\.)?living-sun\.com': false
  '(.*\.)?qastack\.jp': false
  '(.*\.)?qastack\.ru': false
  '(.*\.)?qastack\.it': false
  '(.*\.)?qastack\.mx': false
  '(.*\.)?qastack\.com\.br': false
  '(.*\.)?qastack\.info\.tr': false
  '(.*\.)?qastack\.in\.th': false
  '(.*\.)?qastack\.com\.de': false
  '(.*\.)?qastack\.fr': false
  '(.*\.)?qastack\.cn': false
  '(.*\.)?qastack\.com\.ua': false
  '(.*\.)?qastack\.co\.in': false
  '(.*\.)?qastack\.kr': false
  '(.*\.)?qastack\.vn': false
  '(.*\.)?qastack\.net\.bd': false
  '(.*\.)?qa-stack\.pl': false
  '(.*\.)?qastack\.id': false
  '(.*\.)?coder\.work': false
  '(.*\.)?it-swarm-ja\.tech': false
  '(.*\.)?it-swarm\.jp\.net': false
  '(.*\.)?it-mure\.jp\.net': false
  '(.*\.)?it-swarm-ja\.com': false
  '(.*\.)?it-swarm\.com\.ru': false
  '(.*\.)?codeflow\.site': false
  '(.*\.)?codeguides\.site': false
  '(.*\.)?overcoder\.net': false
  '(.*\.)?coderoad\.ru': false
  '(.*\.)?generacodice\.blog': false
  '(.*\.)?generacodice\.it': false
  '(.*\.)?generacodice\.com': false
  '(.*\.)?javaer101\.com': false
  '(.*\.)?voidcc\.com': false
  '(.*\.)?siwib\.org': false
  '(.*\.)?fluffyfables\.com': false
  '(.*\.)?fixes\.pub': false
  '(.*\.)?knews\.vip': false
  '(.*\.)?isolution\.pro': false
  '(.*\.)?uwenku\.com': false
  '(.*\.)?lycaeum\.dev': false
  '(.*\.)?brocante\.dev': false
  '(.*\.)?classmethod\.dev': false
  '(.*\.)?stormcrow\.dev': false
  '(.*\.)?athabasca-foto\.com': false
  '(.*\.)?zsharp\.org': false
  '(.*\.)?projectbackpack\.org': false
  '(.*\.)?waymanamechurch\.org': false
  '(.*\.)?sunflowercreations\.org': false
  '(.*\.)?cfadnc\.org': false
  '(.*\.)?fitforlearning\.org': false
  '(.*\.)?panaindustrial\.com': false
  '(.*\.)?sierrasummit2005\.org': false
  '(.*\.)?theshuggahpies\.com': false
  '(.*\.)?pcbconline\.org': false
  '(.*\.)?nuomiphp\.com': false
  '(.*\.)?ubuntu\.buildwebhost\.com': false
  '(.*\.)?ubuntuaa\.com': false
  '(.*\.)?debugcn\.com': false
  '(.*\.)?sch22\.org': false
  '(.*\.)?gupgallery\.com': false
  '(.*\.)?amuddycup\.com': false
  '(.*\.)?ecnf2016\.org': false
  '(.*\.)?softwareuser\.asklobster\.com': false
  '(.*\.)?domainelespailles\.net': false
  '(.*\.)?ec-europe\.org': false
  '(.*\.)?pakostnici\.com': false
  '(.*\.)?try2explore\.com': false
  '(.*\.)?laravelquestions\.com': false
  '(.*\.)?itectec\.com': false
  '(.*\.)?stackovergo\.com': false
  '(.*\.)?faithcov\.org': false
  '(.*\.)?noblenaz\.org': false
  '(.*\.)?py4u\.net': false
  '(.*\.)?culinarydegree\.info': false
  '(.*\.)?safehavenpetrescue\.org': false
  '(.*\.)?qapicks\.com': false
  '(.*\.)?issues-world\.com': false
  '(.*\.)?narkive\.jp': false
  '(.*\.)?ourladylakes\.org': false
  '(.*\.)?intellipaat\.com': false
  '(.*\.)?article\.docway\.net': false
  '(.*\.)?xiu2\.net': false
  '(.*\.)?codehero\.jp': false
  '(.*\.)?quabr\.com': false
  '(.*\.)?webdevqa\.jp\.net': false
  '(.*\.)?qapicks\.com': false
  '(.*\.)?exceptionshub\.com': false
  '(.*\.)?newbedev\.com': false
  '(.*\.)?codenong\.com': false
  '(.*\.)?cainiaojiaocheng\.com': false
  '(.*\.)?routinepanic\.com': false
  '(.*\.)?pythonwd\.com': false
  '(.*\.)?tutorialmore\.com': false
  '(.*\.)?alwaysemmyhope\.com': false
  '(.*\.)?pretagteam\.com': false
  '(.*\.)?titanwolf\.org': false
  '(.*\.)?coderedirect\.com': false
  '(.*\.)?ostack\.cn': false
  '(.*\.)?easysavecode\.com': false
  '(.*\.)?webdevdesigner\.com': false
  '(.*\.)?ghcc\.net': false
  '(.*\.)?developreference\.com': false
  '(.*\.)?semicolonworld\.com': false
  '(.*\.)?tipsfordev\.com': false
  '(.*\.)?qi-u\.com': false
  '(.*\.)?stackqna\.com': false
  '(.*\.)?xsprogram\.com': false
  '(.*\.)?stackoom\.com': false
  '(.*\.)?it-swarm-fr\.com': false
  '(.*\.)?imtqy\.com': false
  '(.*\.)?christfever\.in': false
  '(.*\.)?codersatellite\.com': false
  '(.*\.)?cndgn\.com': false
  '(.*\.)?coredump\.biz': false
  '(.*\.)?farath\.com': false
  '(.*\.)?devbugfix\.com': false
  '(.*\.)?tech\.wayne-chu\.com': false
  '(.*\.)?stackify\.dev': false
  '(.*\.)?webknox\.com': false
  '(.*\.)?stackfinder\.jp\.net': false
  '(.*\.)?coder-solution-jp\.com': false
  '(.*\.)?jpndev\.com': false
  '(.*\.)?uebu-kaihatsu\.jp\.net': false
  '(.*\.)?sqlite\.in': false
  '(.*\.)?stackguides\.com': false
  '(.*\.)?younggeeks\.in': false
  '(.*\.)?answerlib\.com': false
  '(.*\.)?edupro\.id': false
  '(.*\.)?python-stack\.de': false
  '(.*\.)?stackfinder\.ru': false
  '(.*\.)?stackfault\.net': false
  '(.*\.)?howtofix\.io': false
  '(.*\.)?buzzphp\.com': false
  '(.*\.)?desenv-web-rp\.com': false
  '(.*\.)?askdev\.vn': false
  '(.*\.)?quares\.ru': false
  '(.*\.)?examplefiles\.net': false
  '(.*\.)?codewdw\.com': false
  '(.*\.)?jpcodeqa\.com': false
  '(.*\.)?tutorialguruji\.com': false

  # ublock-origin-shitty-copies-filter/github-copycats.txt

  '(.*\.)?bleepcoder.com': false
  '(.*\.)?githubja.com': false
  '(.*\.)?gitmemory.com': false
  '(.*\.)?giters.com': false
  '(.*\.)?githubmemory.com': false
  '(.*\.)?wenyanet.com': false
  '(.*\.)?issueexplorer.com': false
  '(.*\.)?opensourcelibs.com': false
  '(.*\.)?awesomeopensource.com': false
  '(.*\.)?findbestopensource.com': false
  '(.*\.)?githubhelp.com': false
  '(.*\.)?pythonissues.com': false
  '(.*\.)?golangrepo.com': false
  '(.*\.)?gitmemory.cn': false
  '(.*\.)?githubmate.com': false
  '(.*\.)?reposhub.com': false
  '(.*\.)?gitanswer.com': false
  '(.*\.)?githubplus.com': false
  '(.*\.)?pythonrepo.com': false
  '(.*\.)?bestofcpp.com': false
  '(.*\.)?github.innominds.com': false
  '(.*\.)?www.higithub.com': false

[k2s]

based on https://github.com/jhchabran/code-search-blacklist I generated this settings with simple nodejs code:

hostname_replace:
   '(.*\.)?codegrepper\.com': false
   '(.*\.)?w3schools\.com': false
   '(.*\.)?geeksforgeeks\.org': false
   '(.*\.)?stackshare\.io': false
   '(.*\.)?tutorialspoint\.com': false
   '(.*\.)?answeright\.com': false
   '(.*\.)?askdev\.info': false
   '(.*\.)?askdev\.io': false
   '(.*\.)?blogmepost\.com': false
   '(.*\.)?c-sharpcorner\.com': false
   '(.*\.)?code-examples\.net': false
   '(.*\.)?codeflow\.site': false
   '(.*\.)?gitmemory\.cn': false
   '(.*\.)?gitmemory\.com': false
   '(.*\.)?intellipaat\.com': false
   '(.*\.)?javaer101\.com': false
   '(.*\.)?programmerstart\.com': false
   '(.*\.)?programmersought\.com': false
   '(.*\.)?qastack\.com': false
   '(.*\.)?roboflow\.ai': false
   '(.*\.)?stackanswers\.net': false
   '(.*\.)?stackoom\.com': false
   '(.*\.)?stackovernet\.com': false
   '(.*\.)?stackovernet\.xyz': false
   '(.*\.)?stackoverrun\.com': false
   '(.*\.)?thetopsites\.net': false
   '(.*\.)?ubuntugeeks\.com': false
   '(.*\.)?cyberciti\.biz': false
   '(.*\.)?ispycode\.com': false
   '(.*\.)?reposhub\.com': false
   '(.*\.)?githubmemory\.com': false
   '(.*\.)?issueexplorer\.com': false
   '(.*\.)?tabnine\.com': false
   '(.*\.)?gitcode\.net': false
   '(.*\.)?command-not-found\.com': false
   '(.*\.)?im-coder\.com': false
   '(.*\.)?i-harness\.com': false

[peepo5]

codegrepper is finally gone woohoo

[catfluoride]

'(.*\.)?amazon\.(.*\.)?'

Because I don't buy stuff on Amazon but Amazon's results pollute my searches results whenever I want to look for reviews on specialized websites.

[masterofobzene]

Just here to reference another idea to filter sites.
User configurable negative words that append to search words automatically.

#1258 (comment)

[user451421541757324]

I found this list.

[masterofobzene]

Nice, but forget it, these guys are not interested. Unsubscribing from this conversation as I lost all interest on searx due to its bad performance, constant blockades by the search engines and the lack of commitment on the team to fix it or make it better (they are more interested in discussing the "skins" used by the engine. I switched to startpage. Good luck though.

[return42]

I found this list.

@user451421541757324 thanks for pointing out 👍

Nice, but forget it, these guys are not interested. Unsubscribing from this conversation as I lost all interest on searx due to its bad performance,

@masterofobzene not sure .. do you mix the searx project with the SearXNG project?

the lack of commitment on the team to fix it or make it better

Here at SearXNG we active fix bugs, take a look at our issue tracker https://github.com/searxng/searxng/issues?q=is%3Aissue+is%3Aclosed

due to its bad performance, constant blockades by the search engines a

The SearXNG community maintains a lot of well working instances:

• https://searx.space/
• and we monitor the uptime https://uptime.searxng.org/

[Bnyro]

I don't specifically block any URLs, I only redirect a bunch of them to alternative, FOSS frontends:

  '(.*\.)?youtube\.com$': 'piped.video'
  '(.*\.)?youtu\.be$': 'piped.video'
  '(.*\.)?stackoverflow\.com$': 'code.whatever.social'
  'translate\.google\.com$': 'libretranslate.com'
  '(.*\.)?twitter\.com$': 'nitter.net'
  '(.*\.)?x\.com$': 'nitter.net'
  '(.*\.)?wikipedia.org$': 'wikiless.whateveritworks.org'
  '(.*\.)?quora.com$': 'quetre.iket.me'
  '(.*\.)?imdb\.com$': 'libremdb.iket.me'
  '(.*\.)?medium\.com$': 'scribe.rip'
  '(.*\.)?fandom\.com$': 'breezewiki.com'
  '(.*\.)?genius\.com$': 'intellectual.inspirill.net'
  '(.*\.)?reddit\.com$': 'reddit.smnz.de'
  '(.*\.)?tiktok.com$': 'proxitok.pabloferreiro.es'
  '(.*\.)?imgur.com$': 'rimgo.luncar.icu'

[Sommerwiesel]

Would also add:
'(.*.)?fextralife.com': false

to the list imo.

Also AnonymousOverflow finaly supports all stack pages, so these lines might be interesting too (using my instance of AnonymousOverflow as an example):

  # AnonymousOverflow
  '(.*\.)?stackoverflow\.com$': 'soflow.nerdvpn.de/exchange/stackoverflow.com'
  '(.*\.)?superuser\.com$': 'soflow.nerdvpn.de/exchange/superuser.com'
  '(.*\.)?serverfault\.com$': 'soflow.nerdvpn.de/exchange/serverfault.com'
  '(.*\.)?mathoverflow\.net$': 'soflow.nerdvpn.de/exchange/mathoverflow.net'
  '(.*\.)?stackapps\.com$': 'soflow.nerdvpn.de/exchange/stackapps.com'
  '(.*\.)?askubuntu\.com$': 'soflow.nerdvpn.de/exchange/askubuntu.com'
  '(.*\.)?stackexchange\.com$': 'soflow.nerdvpn.de/exchange/stackexchange.com'

[extremelyonline]

A user of my instance reported that AnonymousOverflow would sometimes redirect to a wrong question, for example:

https://code.whatever.social/questions/136332/setting-up-dnsmasq-for-a-local-network
https://soflow.nerdvpn.de/questions/136332/setting-up-dnsmasq-for-a-local-network

It seems that the support for all stack pages is incomplete

[Bnyro]

That's due to the fact that the question is from ServerFault, and not from StackOverflow (https://serverfault.com/questions/136332/setting-up-dnsmasq-for-a-local-network).

Such links can be opened by modifying the URL to https://code.whatever.social/exchange/serverfault.com/questions/136332/setting-up-dnsmasq-for-a-local-network (see httpjamesm/AnonymousOverflow#17 (comment)). So you would need to replace serverfault.com with code.whatever.social/exchange/serverfault.com/ which currently is not supported by SearXNG unfortunately, because only the base url / origin /netloc can be modified atm.

[Sommerwiesel]

@extremelyonline Your info is outdated, they already fixed that problem just like Bnyro described,

@Bnyro My hostname replace already takes that into consideration, I have the proper "/exchange/" path for every site, i.e. for serverfault:

'(.*\.)?serverfault\.com$': 'soflow.nerdvpn.de/exchange/serverfault.com'

It doesn't really matter that it isn't fully supported, the replacement works the way I have it listed above for all stack pages.

See for yourself here: search.nerdvpn.de

Screenshot for askubuntu:
Screenshot-20240420-183922-Mull.png

[Bnyro]

Oh right, I completely missed your message above @Sommerwiesel. I can confirm that this works very well, added the rule to my own instance too now :) (I previously only rewrote normal stackoverflow links because I didn't know that would work already)

[extremelyonline]

@Bnyro @Sommerwiesel Thank you for your messages and sorry for the noise.

I too confirm that the rules work and added them. Thank you again!

The only issue left is the redirection of meta.stackoverflow.com