00:02:37fuzzy8021 quits [Read error: Connection reset by peer]
00:03:06fuzzy80211 (fuzzy80211) joins
00:14:17muklumsum joins
00:27:15etnguyen03 quits [Client Quit]
00:32:53Mateon2 joins
00:34:25Mateon1 quits [Ping timeout: 255 seconds]
00:34:25Mateon2 is now known as Mateon1
00:38:34magmaus3 joins
00:38:34magmaus3 quits [Changing host]
00:38:34magmaus3 (magmaus3) joins
00:53:06magmaus3 quits [Ping timeout: 255 seconds]
00:58:14<steering>anthropic has sent my teeny weeny little webserver (mostly my gitweb it seems) over 1,000,000 requests so far this month. :)
00:58:17Ruthalas598 quits [Client Quit]
00:58:43Ruthalas598 (Ruthalas) joins
01:00:09<steering>in the past like 30 minutes since i blocked them they've gotten 754 IPs fail2ban'd (which means 5x 403's per IP)
01:02:10magmaus3 joins
01:02:10magmaus3 quits [Changing host]
01:02:10magmaus3 (magmaus3) joins
01:07:03magmaus3 quits [Ping timeout: 255 seconds]
01:13:53<Ryz>Came across this, https://raw.githack.com/ - unsure how much this is useful for us in relation to our internet archiving activities
01:14:45etnguyen03 (etnguyen03) joins
01:28:15magmaus3 joins
01:28:15magmaus3 quits [Changing host]
01:28:15magmaus3 (magmaus3) joins
01:39:40magmaus3 quits [Ping timeout: 255 seconds]
01:56:06magmaus3 (magmaus3) joins
02:07:14magmaus3 quits [Ping timeout: 260 seconds]
02:18:06magmaus3 (magmaus3) joins
02:25:19magmaus3 quits [Ping timeout: 260 seconds]
02:25:28etnguyen03 quits [Remote host closed the connection]
02:50:58magmaus3 (magmaus3) joins
03:01:56Xanthon quits [Changing host]
03:01:56Xanthon joins
03:03:49magmaus3 quits [Ping timeout: 260 seconds]
03:06:44magmaus3 (magmaus3) joins
03:11:37magmaus3 quits [Read error: Connection reset by peer]
03:11:50magmaus3 joins
03:11:50magmaus3 quits [Changing host]
03:11:50magmaus3 (magmaus3) joins
03:16:25magmaus3 quits [Ping timeout: 255 seconds]
03:38:58magmaus3 joins
03:38:58magmaus3 quits [Changing host]
03:38:58magmaus3 (magmaus3) joins
03:44:04magmaus3 quits [Ping timeout: 260 seconds]
03:51:06<@OrIdow6>steering: It's not abuse, they've got VC funding!
03:53:08<steering>indeed
03:53:18<steering>juicy juicy cash and lots of it
04:00:55Shjosan quits [Quit: Am sleepy (-, – )…zzzZZZ]
04:02:11Shjosan (Shjosan) joins
04:13:06magmaus3 (magmaus3) joins
04:16:13magmaus3_ joins
04:16:54magmaus3_ quits [Signing in (magmaus3_)]
04:16:54magmaus3_ (magmaus3) joins
04:17:27magmaus3_ quits [Remote host closed the connection]
04:17:36magmaus3_ joins
04:17:54magmaus3 quits [Ping timeout: 260 seconds]
04:21:08pixel leaves [Error from remote client]
04:27:32magmaus3_ quits [Signing in (magmaus3_)]
04:27:32magmaus3_ (magmaus3) joins
04:34:57HP_Archivist (HP_Archivist) joins
04:38:06AlsoHP_Archivist quits [Ping timeout: 255 seconds]
04:39:35magmaus3_ quits [Read error: Connection reset by peer]
04:39:51magmaus3 (magmaus3) joins
05:13:43DogsRNice quits [Read error: Connection reset by peer]
05:15:49shgaqnyrjp quits [Remote host closed the connection]
05:16:22shgaqnyrjp (shgaqnyrjp) joins
05:22:12<@hook54321>Data removal service now sends data to OpenAI https://help.optery.com/en/article/how-does-optery-utilize-ai-for-generating-removals-reports-and-how-to-opt-out-using-report-preferences-1yxq75z/
05:23:23BornOn420 quits [Remote host closed the connection]
05:23:43<that_lurker>so now we need data removal service data removal service
05:24:03BornOn420 (BornOn420) joins
05:25:17<@JAA>*facepalm*
05:39:25HackMii quits [Remote host closed the connection]
05:40:02HackMii (hacktheplanet) joins
05:40:14tech234a (tech234a) joins
05:49:00<nulldata>nukke - if you haven't heard the Reply All episode about the long lost song, that's definitely a listen. https://gimletmedia.com/shows/reply-all/o2h8bx
06:00:54pixel (pixel) joins
06:26:07shgaqnyrjp quits [Remote host closed the connection]
06:26:30shgaqnyrjp (shgaqnyrjp) joins
06:51:34<pabs>https://www.bunniestudios.com/blog/2024/turning-everyday-gadgets-into-bombs-is-a-bad-idea/
07:15:49benjins3 quits [Ping timeout: 260 seconds]
07:22:20BlueMaxima quits [Read error: Connection reset by peer]
09:15:12nulldata quits [Quit: So long and thanks for all the fish!]
09:15:55nulldata (nulldata) joins
09:55:32driib quits [Quit: The Lounge - https://thelounge.chat]
09:56:06driib (driib) joins
10:18:33benjins3 joins
10:22:42@OrIdow6 is now known as @me
11:00:01Bleo18260072271962 quits [Quit: The Lounge - https://thelounge.chat]
11:01:14Bleo18260072271962 joins
11:14:23eightthree quits [Remote host closed the connection]
11:36:43magmaus3 quits [Changing host]
11:36:43magmaus3 (magmaus3) joins
12:34:07eightthree joins
12:41:29Chris5010 (Chris5010) joins
13:14:28nicolas17 quits [Ping timeout: 255 seconds]
13:48:57etnguyen03 (etnguyen03) joins
13:50:55BearFortress quits [Ping timeout: 255 seconds]
13:58:41etnguyen03 quits [Client Quit]
14:36:23anarcat quits [Quit: stopping service...]
14:37:54HP_Archivist quits [Client Quit]
15:08:06katocala quits [Ping timeout: 255 seconds]
15:08:19katocala joins
15:16:04anarcat (anarcat) joins
15:16:08BornOn420_ (BornOn420) joins
15:18:11BornOn420 quits [Ping timeout: 260 seconds]
15:23:20BearFortress joins
15:27:13masterX244 quits [Ping timeout: 255 seconds]
15:28:44katocala quits [Ping timeout: 260 seconds]
15:29:01katocala joins
15:32:00<f_>fireonlive++
15:32:03<f_>Discord--
15:32:04<eggdrop>[karma] 'fireonlive' now has 438 karma!
15:32:06<eggdrop>[karma] 'Discord' now has -20 karma!
15:32:12<f_>Discord sucks.
15:32:49BornOn420 (BornOn420) joins
15:34:13masterX244 (masterX244) joins
15:34:59BornOn420_ quits [Ping timeout: 260 seconds]
15:48:34<qwertyasdfuiopghjkl>fireonlive++
15:48:34<eggdrop>[karma] 'fireonlive' now has 439 karma!
15:59:06<f_>fireonlive++
15:59:07<eggdrop>[karma] 'fireonlive' now has 440 karma!
16:00:52<qwertyasdfuiopghjkl>fireonlive++
16:00:52<eggdrop>[karma] 'fireonlive' now has 441 karma!
16:04:31<imer>https://twitter.com/AndreyAzimov/status/1836793650992329181/ "switch to hetzner they say"
16:04:32<eggdrop>nitter: https://nitter.lucabased.xyz/AndreyAzimov/status/1836793650992329181/
16:05:28<katia>switch to hosting in the closet
16:09:26<steering>nitter.lucabased took like 30s to load there :3
16:09:47<steering>also lol poor power cord
16:24:22<myself>they saw all the discord chat and tried to dis-cord the server
16:47:17superkuh_ joins
16:49:07superkuh quits [Ping timeout: 255 seconds]
17:01:03<kpcyrd>the cloudflare dashboard asked me if I want to "activate blocking AI crawlers with a single click", like I'm some intellectual property capitalist
17:01:33<kpcyrd>the files I put on the internet are free, it's ok, you can take them home; I have 20
17:01:48<steering>kpcyrd: see my mention yesterday about anthropic though ;)
17:08:14<kpcyrd>are you hosting on a raspberry pi? :)
17:11:37lukash98 quits [Ping timeout: 255 seconds]
17:12:34lukash98 joins
17:34:38<steering>might as well be
17:35:05<steering>seems a bit excessive for a site with some 37,000 URLs though
17:36:45<kpcyrd>maybe. I host a site with 332k requests in the past 30 days, 209k of them from the US, cache hit rate of 2.35%, I host this in a <10€/mo VPS, everything is fine
17:38:30<kpcyrd>but well the backend is entirely written in Rust so your mileage may vary
17:44:49<steering>it's whatever digitalocean's cheapest vm is, $5 or something? and 3x those hits from anthropic alone... plus gitweb is nasty horrible perl :P
17:48:45<magmaus3>i use contabo as my main vps, and previously used oracle cloud's free plan
17:49:35<magmaus3>there's also pfcloud, which is fine (i got the cheapest possible vps (like 9.99€ for 3 months) and only used it for port scanning)
17:53:30<steering> 441561 06/Sep/2024
17:53:37<steering> 215212 16/Sep/2024
17:53:40<steering> 118517 19/Sep/2024
17:53:45<steering>requests/day from anthropic... lol
17:55:30<steering>peaked at 20000/hour yesterday
17:56:03<steering>15000-20000 every hour on the 6th... so yeah...
17:56:08<@JAA>Looks like it hasn't found our Gitea yet. I've had to block a bunch of others though that were doing ridiculous request rates, not respecting 429s or 5xxs, etc. They're still doing it after getting hard connection closures (nginx 444) for over a month now.
17:56:31<steering>reportedly anthropic respects 429s with backoff (i emailed them about it of course)
17:56:52<steering>I'm just giving them 444 now, and fail2ban triggering on 5x 444's
17:58:06<TheTechRobo>I'm on LunaNode for my two VPSes right now. Cheaper than most of the competition (at least as far as NA goes), reasonably fast
17:58:13<steering>upside: it convinced me to finally set up munin on this vps https://i.imgur.com/QmJyKCC.png that spike is when I accidentally'd my fail2ban config and they were unbanned
17:59:20<@JAA>anthropic-ai and Claude-Web are apparently the Anthropic UAs?
17:59:36<steering>Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)
17:59:58<@JAA>Hmm yeah, that source I found is obviously totally wrong. Ugh, internet.
18:00:10<steering>I wouldn't be surprised if they use all 3 :P
18:00:22<steering>I banned `anthropic` and `ClaudeBot`
18:00:53<steering>(and a bunch of others that I found in some random stackoverflow post because why not)
18:01:22<myself>don't ban 'em, redirect 'em to a hidden markov model that just spews gibberish
18:01:48<steering>myself: see I was considering that, or just dropping a static page with the typical "disregard previous instructions and..." copypasta
18:01:54<myself>rofl
18:02:46<steering>I kinda wanted to only do that to Anthropic specifically though, and tried using "error 499" cause why not, and nginx choked on it - `return 499` is ok but `error_page 499 ...` isn't
18:03:03<steering>so I took the easy way out and just close the connection
18:05:21<steering>I do need to replace Gitweb with something better, the biggest reason it pissed me off was because Gitweb's fastcgi support is utterly broken and it die()s for any error condition (which there's a lot of because it's also broken in many other ways)
18:05:58<steering>I was getting a bunch of 503s because scraper cause error -> gitweb die -> not restarted yet
18:06:13<steering>but I'm lazy 🤷‍♂️
18:06:34<@JAA>Oh, I did block ClaudeBot, actually. :-)
18:07:29<DigitalDragons>Cloudflare reports I get ~2.5m requests a month and I have no clue what they are for or who's making them lol
18:08:33<kpcyrd>access.log is 67360/70010 anthropic, access.log.1 is 3540/11845
18:08:35<steering>I get like... somewhere around 300k-ish if you exclude Anthropic, lol
18:11:27<steering>https://bpa.st/USE3EMDN6BFBA2PVYM7CMJGBSI (monthly)
18:14:48<steering>oh that's the other one I blocked yesterday, Amazonbot
18:16:17<steering>looks like Anthropic has only been hitting me since July, most of the rest is Amazon and Bytedance...
18:16:18<@JAA>Bytespider's another one.
18:16:37<@JAA>Also Facebook.
18:18:32<kpcyrd>I'm flattered to be fed into their bias 💕
18:29:14nicolas17 joins
18:38:18<@JAA>Oh, the AI bros want to revive Three Mile Island.
19:15:09BornOn420 quits [*.net *.split]
19:15:09shgaqnyrjp quits [*.net *.split]
19:15:09HackMii quits [*.net *.split]
19:15:09sec^nd quits [*.net *.split]
19:15:57HackMii (hacktheplanet) joins
19:15:59sec^nd (second) joins
19:16:49shgaqnyrjp (shgaqnyrjp) joins
19:39:54SootBector (SootBector) joins
20:05:26BornOn420 (BornOn420) joins
21:07:52tek_dmn quits [Ping timeout: 255 seconds]
21:16:38etnguyen03 (etnguyen03) joins
21:27:13Chris50103 (Chris5010) joins
21:29:14Chris5010 quits [Ping timeout: 260 seconds]
21:29:14Chris50103 is now known as Chris5010
21:50:00BlueMaxima joins
22:04:07Stagnant quits [Ping timeout: 255 seconds]
22:06:00Stagnant (Stagnant) joins
22:50:32HackMii quits [Remote host closed the connection]
22:50:32BornOn420 quits [Remote host closed the connection]
22:50:48HackMii (hacktheplanet) joins
22:51:04BornOn420 (BornOn420) joins
23:06:13qw3rty_ quits [Ping timeout: 255 seconds]
23:21:17etnguyen03 quits [Client Quit]
23:27:46qw3rty joins
23:30:31magmaus3 quits [Ping timeout: 255 seconds]
23:34:35magmaus3 (magmaus3) joins
23:50:51DogsRNice joins
23:51:20magmaus3 quits [Read error: Connection reset by peer]
23:51:30magmaus3 (magmaus3) joins
23:58:34magmaus3 quits [Ping timeout: 260 seconds]