Shakedown Social

0 posts0 participants0 posts today

Kevin Karhan :verified:<a href="https://mastodon.social/@khobochka" class="u-url mention" rel="nofollow noopener noreferrer" target="_blank">@khobochka</a> guess why I <a href="https://github.com/greyhat-academy/lists.d/blob/main/scrapers.ipv4.block.list.tsv" rel="nofollow noopener noreferrer" target="_blank">maintain</a> a <a href="https://infosec.space/tags/Scraper" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#Scraper</a> <a href="https://infosec.space/tags/blocklist" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#blocklist</a>?<ul><li>In fact I know multiple people and organizations that decide to basically redirect <a href="https://infosec.space/tags/ValueRemoving" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#ValueRemoving</a> <a href="https://infosec.space/tags/Scrapers" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#Scrapers</a> like <a href="https://infosec.space/tags/GPTbot" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#GPTbot</a>, <a href="https://infosec.space/tags/ByteSpider" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#ByteSpider</a> (which <a href="https://www.youtube.com/watch?v=Hi5sd3WEh0c" rel="nofollow noopener noreferrer" target="_blank">literally</a> <a href="https://infosec.space/tags/DDoS" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#DDoS</a>'d <a href="https://infosec.space/tags/MattKC" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#MattKC</a> because <a href="https://infosec.space/tags/ClownFlare" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#ClownFlare</a> are a criminally incompetent <a href="https://infosec.space/tags/RogueISP" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#RogueISP</a>!) to <a href="https://infosec.space/tags/Hetzner" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#Hetzner</a>'s <a href="http://hil-speed.hetzner.com/" rel="nofollow noopener noreferrer" target="_blank">10GB Speedtest file</a> which can be found at <code>http://hil-speed.hetzner.com/10GB.bin</code> as an extra middlefinger!</li></ul><a href="https://infosec.space/tags/Cloudflare" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#Cloudflare</a> <a href="https://infosec.space/tags/hetznered" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#hetznered</a> <a href="https://infosec.space/tags/ByteDance" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#ByteDance</a> <a href="https://infosec.space/tags/ChatGPT" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#ChatGPT</a>

Kevin Karhan :verified:<a href="https://lgbtqia.space/@alice" class="u-url mention" rel="nofollow noopener noreferrer" target="_blank">@alice</a> <a href="https://infosec.space/tags/Funfact" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#Funfact</a>: <a href="https://infosec.space/tags/ValueRemoving" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#ValueRemoving</a> <a href="https://infosec.space/tags/RentSeekers" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#RentSeekers</a> like <a href="https://infosec.space/tags/ClownFlare" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#ClownFlare</a> aren't even good at stoping <a href="https://infosec.space/tags/bots" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#bots</a> literally <a href="https://infosec.space/tags/DDoS" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#DDoS</a>'ing a site offline as <a href="https://infosec.space/tags/MattKC" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#MattKC</a> <a href="https://www.youtube.com/watch?v=Hi5sd3WEh0c" rel="nofollow noopener noreferrer" target="_blank">learned</a>.<a href="https://infosec.space/tags/Cloudflare" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#Cloudflare</a> <a href="https://infosec.space/tags/EpicFail" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#EpicFail</a> <a href="https://infosec.space/tags/TikTok" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#TikTok</a> <a href="https://infosec.space/tags/ByteDance" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#ByteDance</a> <a href="https://infosec.space/tags/ByteSpider" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#ByteSpider</a> <a href="https://infosec.space/tags/Crawlers" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#Crawlers</a> <a href="https://infosec.space/tags/DontDoCloud" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#DontDoCloud</a>

Kevin Karhan :verified:<a href="https://oxytodon.com/@fuchsiii" class="u-url mention" rel="nofollow noopener noreferrer" target="_blank">@fuchsiii</a> <a href="https://a.bloodyno.se/users/lynn" class="u-url mention" rel="nofollow noopener noreferrer" target="_blank">@lynn</a> <a href="https://buff.tomboyfan.club/users/LunaDragofelis" class="u-url mention" rel="nofollow noopener noreferrer" target="_blank">@LunaDragofelis</a> also in case anyone needs to be convinced how much of a useless value-remover ClownFlare / CloudFlare are in "preventing DDoS attacks":<a href="https://hasthebig.gay/users/MattKC" class="u-url mention" rel="nofollow noopener noreferrer" target="_blank">@MattKC</a> <a href="https://www.youtube.com/watch?v=Hi5sd3WEh0c" rel="nofollow noopener noreferrer" target="_blank">had been DDoS'd by ByteDance's Crawler</a> into downtime!<a href="https://infosec.space/tags/CloudFlare" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#CloudFlare</a> <a href="https://infosec.space/tags/ClownFlare" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#ClownFlare</a> <a href="https://infosec.space/tags/MattKC" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#MattKC</a> <a href="https://infosec.space/tags/DDoS" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#DDoS</a> <a href="https://infosec.space/tags/ByteDance" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#ByteDance</a> <a href="https://infosec.space/tags/ByteSpider" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#ByteSpider</a> <a href="https://infosec.space/tags/TikTok" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#TikTok</a> <a href="https://infosec.space/tags/NetworkSecurity" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#NetworkSecurity</a> <a href="https://infosec.space/tags/Hosting" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#Hosting</a> <a href="https://infosec.space/tags/ITsec" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#ITsec</a> <a href="https://infosec.space/tags/ComSec" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#ComSec</a>

Kevin Karhan :verified:<a href="https://cyberplace.social/@GossiTheDog" class="u-url mention" rel="nofollow noopener noreferrer" target="_blank">@GossiTheDog</a> Well, they can be forced to if not face <a href="https://infosec.space/tags/accountability" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#accountability</a>, at least take <a href="https://infosec.space/tags/consequences" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#consequences</a>.<ol><li>Violating <a href="https://infosec.space/tags/telco" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#telco</a> laws got <a href="https://social.bund.de/@BNetzA" class="u-url mention" rel="nofollow noopener noreferrer" target="_blank">@BNetzA</a> to knock on their door.</li><li><a href="https://infosec.space/tags/DropKiwifarms" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#DropKiwifarms</a> worked as a unified effort</li><li>Customers yeeting <a href="https://infosec.space/tags/ClownFlare" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#ClownFlare</a> did force them to yeet <a href="https://infosec.space/tags/KiwiFarms" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#KiwiFarms</a>.</li><li><a href="https://infosec.space/tags/Cloudflare" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#Cloudflare</a> has been a <a href="https://infosec.space/tags/RogueISP" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#RogueISP</a> for over a decade now as they accept gross violations of their own <a href="https://infosec.space/tags/ToS" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#ToS</a> and host <a href="https://infosec.space/tags/Daesh" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#Daesh</a> propaganda sites...</li><li>Pretty shure <a href="https://infosec.space/tags/Brazil" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#Brazil</a> will hold CloudFlare contempt and force them to either fire <a href="https://infosec.space/tags/Twitter" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#Twitter</a> as client or get <a href="https://infosec.space/tags/blocked" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#blocked</a> as well...</li><li>CloudFlare will then yeet <a href="https://infosec.space/tags/Shitter" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#Shitter</a> because <a href="https://infosec.space/tags/ApartheidEmeralBoy" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#ApartheidEmeralBoy</a> is known to bounce checks and refusing to pay on time, so he doesn't even make this something worth risking.</li><li>Cloudflare is and will always remain a shitty hoster - period! </li><li>I still block <a href="https://infosec.space/tags/Cloudflare" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#Cloudflare</a>'s entire <a href="https://infosec.space/tags/ASN" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#ASN</a> as a security measure since they shield <a href="https://infosec.space/tags/cybercriminals" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#cybercriminals</a>.</li><li>Their entire <a href="https://infosec.space/tags/ValueRemoving" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#ValueRemoving</a> business is just a form of <a href="https://infosec.space/tags/racketeering" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#racketeering</a> that should not only not exist, but be illegal to begin with.</li><li>Every half-decent <a href="https://infosec.space/tags/hoster" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#hoster</a> offers <a href="https://infosec.space/tags/DDoS" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#DDoS</a> protevtion these days eithout ClownFlare.</li><li>ClownFlare doesn't even prevent DDoS attacks, but lets <a href="https://infosec.space/tags/ByteSpider" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#ByteSpider</a> <a href="https://www.youtube.com/watch?v=Hi5sd3WEh0c" rel="nofollow noopener noreferrer" target="_blank">DDoS their customers</a>!</li></ol>

Kevin Karhan :verified:<a href="https://chaos.social/@Cyb3rrunn3r" class="u-url mention" rel="nofollow noopener noreferrer" target="_blank">@Cyb3rrunn3r</a> <a href="https://chaos.social/@quincy" class="u-url mention" rel="nofollow noopener noreferrer" target="_blank">@quincy</a> TBH, <a href="https://infosec.space/tags/ClownFlare" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#ClownFlare</a> is a <a href="https://infosec.space/tags/ValueRemoving" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#ValueRemoving</a> <a href="https://infosec.space/tags/RentSeeker" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#RentSeeker</a> and their use has been inexcuseable even before the whole <a href="https://infosec.space/tags/KiwiFarms" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#KiwiFarms</a> shitshow, as <a href="https://infosec.space/tags/CloudFlare" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#CloudFlare</a> proubly hosts <a href="https://infosec.space/tags/Daesh" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#Daesh</a> <a href="https://infosec.space/tags/Propaganda" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#Propaganda</a> and <a href="https://infosec.space/tags/Cybercrime" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#Cybercrime</a> sites and refuses to process <a href="https://infosec.space/tags/AbuseReports" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#AbuseReports</a>, to the point they only yeeted KiwiFarms when masses of bigger customers said: "it's us or them" and even <a href="https://social.bund.de/@BNetzA" class="u-url mention" rel="nofollow noopener noreferrer" target="_blank">@BNetzA</a> knocked on their Office doors in Munich...<ul><li>Unlike <a href="https://infosec.space/tags/Akamai" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#Akamai</a> or other <a href="https://infosec.space/tags/CDN" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#CDN</a>|s they provide neither convenience nor security, as <a href="https://infosec.space/tags/MattKC" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#MattKC</a> had been <a href="https://infosec.space/tags/DDoS" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#DDoS</a>'d by <a href="https://infosec.space/tags/ByteDance" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#ByteDance</a>'s <a href="https://infosec.space/tags/Crawler" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#Crawler</a> known as <a href="https://infosec.space/tags/ByteSpider" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#ByteSpider</a> <a href="https://www.youtube.com/watch?v=Hi5sd3WEh0c" rel="nofollow noopener noreferrer" target="_blank">in spite of ClownFlare being tasked with preventing that shit from happening</a>.</li></ul>

Kevin Karhan :verified:<a href="https://tech.lgbt/@xogium" class="u-url mention" rel="nofollow noopener noreferrer" target="_blank">@xogium</a> this issue of excessive crawlers is sadly nothing new. <a href="https://hasthebig.gay/users/MattKC" class="u-url mention" rel="nofollow noopener noreferrer" target="_blank">@MattKC</a> / <a href="https://infosec.space/tags/MattKC" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#MattKC</a> experienced the same with <a href="https://infosec.space/tags/ByteSpider" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#ByteSpider</a>, the <a href="https://infosec.space/tags/Scraper" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#Scraper</a> used by <a href="https://infosec.space/tags/TikTok" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#TikTok</a> which results basically in his site getting <a href="https://infosec.space/tags/DDoS" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#DDoS</a>'d despite <a href="https://infosec.space/tags/ClownFlare" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#ClownFlare</a> being tasked to prevent it!<a href="https://youtu.be/Hi5sd3WEh0c" rel="nofollow noopener noreferrer" translate="no" target="_blank">https://youtu.be/Hi5sd3WEh0c</a>Personally, I've run out of patience and tolerance for such actions by <a href="https://infosec.space/tags/GAFAMs" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#GAFAMs</a> and <a href="https://infosec.space/tags/TechBros" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#TechBros</a> and I'm so close to just <a href="https://github.com/greyhat-academy/lists.d/blob/1bb1f185d8e4451e541d820dde96b19f40c44eae/blocklists.list.tsv#L23" rel="nofollow noopener noreferrer" target="_blank">blocklist their entire ASN</a> as a matter of principle!<ul><li>It's just that I'd likely have to make an entire dedicaded blocklist and toolup some script to pull a BGP feed or rather IP assignments data <a href="https://ipinfo.io/AS32934" rel="nofollow noopener noreferrer" target="_blank">for their entire ASN</a> and submit these in <a href="https://infosec.space/tags/git" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#git</a> as branch updates, merge that and block said network in it's entirely <a href="https://github.com/greyhat-academy/lists.d/blob/main/milintel.ipv4.block.list.tsv" rel="nofollow noopener noreferrer" target="_blank">as I did with the DoD networks</a>.</li></ul>

Neil CraigWe recently noticed a fair bit of traffic on www.bbc.co.uk & www.bbc.com from a User Agent which identifies itself as "ByteSpider" (& has a @bytedance.com email address).Lots of docs on the web state it doesn't obey robots.txt but ByteDance have told us it *does*:> *...in the robots.txt files* *> user-agent:Bytespider* *> Disallow:/*Thought that might be worth documenting as it might be a recent change & several of us searched but found zero docs from ByteDance<a href="https://mastodon.social/tags/SEO" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#SEO</a> <a href="https://mastodon.social/tags/ByteSpider" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#ByteSpider</a> <a href="https://mastodon.social/tags/RobotsTXT" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#RobotsTXT</a>

Recent searches

Search options

Administered by:

Server stats:

#bytespider