shakedown.social is one of the many independent Mastodon servers you can use to participate in the fediverse.
A community for live music fans with roots in the jam scene. Shakedown Social is run by a team of volunteers (led by @clifff and @sethadam1) and funded by donations.

Administered by:

Server stats:

261
active users

#Anubis

1 post1 participant0 posts today

@cadey a fait une présentation d'#Anubis dans les lightning talks de #BSDCan ce soir. Elle sera bientôt visible en ligne sur le site de la conférence, si vous voulez en savoir plus sur cet outil qui protège l'instance mastodon de Tetaneutral.net contre les scrapers depuis quelques mois.
bsdcan.org
Encore merci pour cet ouil !

www.bsdcan.orgBSDCan ConferenceBSDCan is a technical BSD conference held in Ottawa, Ontario, Canada.

We know how hard it could be to handle the ever-increasing number of bad actors scraping your websites too well. Therefore, we decided to sponsor #Anubis¹ as a tool that helps users to block or at least slow down these bad actors.

We are currently evaluating how we could integrate Anubis or some similar solution to our stack and make it available as a uberspace command and backend.

¹ github.com/TecharoHQ/anubis
#BadRobots #AIBots

Weighs the soul of incoming HTTP requests to stop AI crawlers - TecharoHQ/anubis
GitHubGitHub - TecharoHQ/anubis: Weighs the soul of incoming HTTP requests to stop AI crawlersWeighs the soul of incoming HTTP requests to stop AI crawlers - TecharoHQ/anubis

Bane of the javascriptless:

Getting around anubis'd websites in (not just) links2.

If you enable the "Fake Firefox (improves privacy)" option in links2 (Setup - Network Options - HTTP options - Header options), links2 then pretends to be the tor browser, imitating the same headers and user-agent - this results in websites that use anubis to bully you and expecting the completion of some javascript challenge. If you do not enable this option, you can get around the annoying anime girl.

Presumably you could use the links2 user-agent in any other browser. I suppose this is true for lynx as well.

> Links (2.28; NetBSD 9.3 amd64; GNU C 7.5; text)

You can also use wget's user-agent, which currently lets you get past anubis as well.

> Wget/1.25.0

You can check what headers your browser is sending at wtfismyip.com/headers .

Replied in thread

@lukeshu So I guess #Anubis has an explicit exception to handle #Lynx and will instead rely on rate-limits and other static means to detect #scrapers and handle with #UserAgent #abuse cases, like #fail2ban-style autobanning of violating IPs...

  • This makes sense for a #WAF like Anubis and would've been the only viable option I'm aware of.

I wounder if anyone has tried using Anubis on @torproject / #Tor to protect #OnionService|s since that would be a reasonable application for it as well.