You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
When I noticed my website is listed in pathological category, I was shocked, as my platform is the only one there which publicly can be identified in comparing with others, Cloud workers, headless browsers etc, all them is the traffic nobody can identify.. yet my business is there.
When I posted about it in Issues, I used an AI (Claude to be specific) to adjust my writings, so I do not make mistake as it was too important to be understood as I am not native English speaking person, on which I was flagged as spam and Ai generated issue and immediately closed personally by XE, requesting apologies to him on his email. I did of course sent email explained that I used an AI to correct my text, it is his repo and I didn't respect it and I asked for revaluation of my platform. But no answers and still my transparent, correct, verified platform and model are flagged like worst of its kind.
Why, because my crawlers ended up in honeypot/maze trap, which I admit and I solved issues that placed me there.
My platform never again went into that direction, our crawlers, or our queue for index. It can be verified that we respect it all.
running this shows you that request is refused and site never contacted
WE DO NOT follow hidden links, if link is invisible to a person, It is dropped before it is even queued.
WE DO NOT touch /.within.website/ namespace, it cannot be queued, it cannot be read, and redirect doesn't push us into it.
WE DO NOT read links out of scripts, links come only from real html parse.
and
WE DO NOT train models on what we crawl, we are an index.
I asked revaluation of my business, asked XE to check any domain by using our service, where they can see that we respect all above, robots.txt, etc..
So community. I am writing here, as I do not want to end up again on XE bad side, and to be forced to send emails of apologies to XE, because I wrote on wrong place or used AI to recheck my text.
I want to ask you community, what to do in this case, I am solo bootstrapped founder, I need to understand where to complain, where to post about my business is wrongly placed in the category where I am fighting from day one I will not be in, as I want my business to be the most transparent and honest web indexes there. To respect all website owners demands, but decision to be in their hands, not to be marked with pathological category.
All 22 addresses list have published reverse DNS under lyrenth.com This is the same test Google publishes for verifying GoogleBot. Anyone can check one of addresses in 1 second.
copy this in your terminal:
dig -x 46.225.147.220 +short
My crawlers sign requests with Web Bot Auth (RFC 9421) the public key directory is on our site:
data/bots/_deny-pathological.yaml contains the line -import: (data)/bots/lyrenth.yaml
I am asking for that import and file to be removed. As my platform does not belong there.
I would like to understand what qualifies crawler to be on a ALLOW list, as I believe I meet all standards other entries on ALLOW list, and in some ways even more stricter standards I implemented. Again If I am wrong about it, tell me what I am missing and I will implement it.
reacted with thumbs up emoji reacted with thumbs down emoji reacted with laugh emoji reacted with hooray emoji reacted with confused emoji reacted with heart emoji reacted with rocket emoji reacted with eyes emoji
Uh oh!
There was an error while loading. Please reload this page.
When I noticed my website is listed in pathological category, I was shocked, as my platform is the only one there which publicly can be identified in comparing with others, Cloud workers, headless browsers etc, all them is the traffic nobody can identify.. yet my business is there.
When I posted about it in Issues, I used an AI (Claude to be specific) to adjust my writings, so I do not make mistake as it was too important to be understood as I am not native English speaking person, on which I was flagged as spam and Ai generated issue and immediately closed personally by XE, requesting apologies to him on his email. I did of course sent email explained that I used an AI to correct my text, it is his repo and I didn't respect it and I asked for revaluation of my platform. But no answers and still my transparent, correct, verified platform and model are flagged like worst of its kind.
Why, because my crawlers ended up in honeypot/maze trap, which I admit and I solved issues that placed me there.
My platform never again went into that direction, our crawlers, or our queue for index. It can be verified that we respect it all.
running this shows you that request is refused and site never contacted
copy this in your terminal:
curl -s -X POST https://api.lyrenth.com/v1/public/aidocument
-H "Content-Type: application/json"
-d '{"url":"https://xeiaso.net/.within.website/x/cmd/anubis/api/check"}'
You may check it all:
WE DO NOT follow hidden links, if link is invisible to a person, It is dropped before it is even queued.
WE DO NOT touch /.within.website/ namespace, it cannot be queued, it cannot be read, and redirect doesn't push us into it.
WE DO NOT read links out of scripts, links come only from real html parse.
and
WE DO NOT train models on what we crawl, we are an index.
I asked revaluation of my business, asked XE to check any domain by using our service, where they can see that we respect all above, robots.txt, etc..
Our crawler policy page is https://www.lyrenth.com/crawler-policy you can read it.
So community. I am writing here, as I do not want to end up again on XE bad side, and to be forced to send emails of apologies to XE, because I wrote on wrong place or used AI to recheck my text.
I want to ask you community, what to do in this case, I am solo bootstrapped founder, I need to understand where to complain, where to post about my business is wrongly placed in the category where I am fighting from day one I will not be in, as I want my business to be the most transparent and honest web indexes there. To respect all website owners demands, but decision to be in their hands, not to be marked with pathological category.
All 22 addresses list have published reverse DNS under lyrenth.com This is the same test Google publishes for verifying GoogleBot. Anyone can check one of addresses in 1 second.
copy this in your terminal:
dig -x 46.225.147.220 +short
My crawlers sign requests with Web Bot Auth (RFC 9421) the public key directory is on our site:
https://api.lyrenth.com/.well-known/http-message-signatures-directory
I even publish UA, policy pages, contact address and machine readable IP list.
https://www.lyrenth.com/bot/ip-ranges.json
data/bots/_deny-pathological.yaml contains the line -import: (data)/bots/lyrenth.yaml
I am asking for that import and file to be removed. As my platform does not belong there.
I would like to understand what qualifies crawler to be on a ALLOW list, as I believe I meet all standards other entries on ALLOW list, and in some ways even more stricter standards I implemented. Again If I am wrong about it, tell me what I am missing and I will implement it.
With respect, Aleksandar
All reactions