Conversation

We switched to Iocaine.

2
3
1
@the what's the difference?
1
0
0

@shroomie Anubis indiscriminately shows everyone the same Proof-of-Work prompt, with takes power both as in processing power and as in i.e the battery power of your phone

in that sense it’s expensive, makes visiting a site on older hardware a pain in the ass, and makes it impossible to visit a site without JavaScript – Even if the site you wanna visit otherwise doesn’t need it, but Anubis does.

Iocaine has none of those issues. The conditions for when Iocaine gets triggered are 100% programmable in Roto or Lua, it’s 100% static, works without Javascript because there’s zero clientside logic, etc. It also doesn’t require a cookie like Anubis does.

But Iocaine also actively does harm to unwanted crawlers by serving them garbage, gobbledygook. And that too is configurable.

2
2
1

@the I feel like I missed something, what’s the issue with anubis?
(Unless the meme is hyperbole)

1
0
0

@the @shroomie hmmm, how does it detect bots, if not with a proof of work?

1
0
1

@green @shroomie

By whichever rules we program, it shows infinite amounts of garbage. Yes, program.

Instead of just being a catch-all, where it indiscriminately just hits everyone with a PoW <small>(which can be circumvented by just using a headless browser with WASM)</small>, Iocaine is configured by literally programming the rules yourself.

A small example config pulls from the ai.robots.txt list and blocks anything with those useragents, but with it being programmable one can use all kinds of semantics and data from the requests to filter on the basis of literally anything. This could range from IP addresses, to certain HTTP headers, and I think you could even go crazy and ingest metrics data directly from your reverse proxy to figure out the exact timing of requests and correlate them that way.

Point is, possibilities are endless

When a crawler is caught, it gets a page such as this one that never ends. You can try visiting https://starlightnet.work with a useragent like WhatsApp/2 or GPTBot for our minimal garbage page

1
0
1

@green @shroomie Although this is very early, anecdotal evidence, Iocaine has so far worked.

ChatGPT refuses to summarize https://starlightnet.work or just spits out garbage. Proton’s new AI chatbot even just plain dies. ↓

0
0
1