00:02:37 | | fuzzy8021 quits [Read error: Connection reset by peer] |
00:03:06 | | fuzzy80211 (fuzzy80211) joins |
00:14:17 | | muklumsum joins |
00:27:15 | | etnguyen03 quits [Client Quit] |
00:32:53 | | Mateon2 joins |
00:34:25 | | Mateon1 quits [Ping timeout: 255 seconds] |
00:34:25 | | Mateon2 is now known as Mateon1 |
00:38:34 | | magmaus3 joins |
00:38:34 | | magmaus3 is now authenticated as magmaus3 |
00:38:34 | | magmaus3 quits [Changing host] |
00:38:34 | | magmaus3 (magmaus3) joins |
00:53:06 | | magmaus3 quits [Ping timeout: 255 seconds] |
00:58:14 | <steering> | anthropic has sent my teeny weeny little webserver (mostly my gitweb it seems) over 1,000,000 requests so far this month. :) |
00:58:17 | | Ruthalas598 quits [Client Quit] |
00:58:43 | | Ruthalas598 (Ruthalas) joins |
01:00:09 | <steering> | in the past like 30 minutes since i blocked them they've gotten 754 IPs fail2ban'd (which means 5x 403's per IP) |
01:02:10 | | magmaus3 joins |
01:02:10 | | magmaus3 is now authenticated as magmaus3 |
01:02:10 | | magmaus3 quits [Changing host] |
01:02:10 | | magmaus3 (magmaus3) joins |
01:07:03 | | magmaus3 quits [Ping timeout: 255 seconds] |
01:13:53 | <Ryz> | Came across this, https://raw.githack.com/ - unsure how much this is useful for us in relation to our internet archiving activities |
01:14:45 | | etnguyen03 (etnguyen03) joins |
01:28:15 | | magmaus3 joins |
01:28:15 | | magmaus3 is now authenticated as magmaus3 |
01:28:15 | | magmaus3 quits [Changing host] |
01:28:15 | | magmaus3 (magmaus3) joins |
01:39:40 | | magmaus3 quits [Ping timeout: 255 seconds] |
01:56:06 | | magmaus3 (magmaus3) joins |
02:07:14 | | magmaus3 quits [Ping timeout: 260 seconds] |
02:18:06 | | magmaus3 (magmaus3) joins |
02:25:19 | | magmaus3 quits [Ping timeout: 260 seconds] |
02:25:28 | | etnguyen03 quits [Remote host closed the connection] |
02:50:58 | | magmaus3 (magmaus3) joins |
03:01:56 | | Xanthon quits [Changing host] |
03:01:56 | | Xanthon joins |
03:03:49 | | magmaus3 quits [Ping timeout: 260 seconds] |
03:06:44 | | magmaus3 (magmaus3) joins |
03:11:37 | | magmaus3 quits [Read error: Connection reset by peer] |
03:11:50 | | magmaus3 joins |
03:11:50 | | magmaus3 is now authenticated as magmaus3 |
03:11:50 | | magmaus3 quits [Changing host] |
03:11:50 | | magmaus3 (magmaus3) joins |
03:16:25 | | magmaus3 quits [Ping timeout: 255 seconds] |
03:38:58 | | magmaus3 joins |
03:38:58 | | magmaus3 is now authenticated as magmaus3 |
03:38:58 | | magmaus3 quits [Changing host] |
03:38:58 | | magmaus3 (magmaus3) joins |
03:44:04 | | magmaus3 quits [Ping timeout: 260 seconds] |
03:51:06 | <@OrIdow6> | steering: It's not abuse, they've got VC funding! |
03:53:08 | <steering> | indeed |
03:53:18 | <steering> | juicy juicy cash and lots of it |
04:00:55 | | Shjosan quits [Quit: Am sleepy (-, – )…zzzZZZ] |
04:02:11 | | Shjosan (Shjosan) joins |
04:13:06 | | magmaus3 (magmaus3) joins |
04:16:13 | | magmaus3_ joins |
04:16:54 | | magmaus3_ quits [Signing in (magmaus3_)] |
04:16:54 | | magmaus3_ (magmaus3) joins |
04:17:27 | | magmaus3_ quits [Remote host closed the connection] |
04:17:36 | | magmaus3_ joins |
04:17:54 | | magmaus3 quits [Ping timeout: 260 seconds] |
04:21:08 | | pixel leaves [Error from remote client] |
04:27:32 | | magmaus3_ quits [Signing in (magmaus3_)] |
04:27:32 | | magmaus3_ (magmaus3) joins |
04:34:57 | | HP_Archivist (HP_Archivist) joins |
04:38:06 | | AlsoHP_Archivist quits [Ping timeout: 255 seconds] |
04:39:35 | | magmaus3_ quits [Read error: Connection reset by peer] |
04:39:51 | | magmaus3 (magmaus3) joins |
05:13:43 | | DogsRNice quits [Read error: Connection reset by peer] |
05:15:49 | | shgaqnyrjp quits [Remote host closed the connection] |
05:16:22 | | shgaqnyrjp (shgaqnyrjp) joins |
05:22:12 | <@hook54321> | Data removal service now sends data to OpenAI https://help.optery.com/en/article/how-does-optery-utilize-ai-for-generating-removals-reports-and-how-to-opt-out-using-report-preferences-1yxq75z/ |
05:23:23 | | BornOn420 quits [Remote host closed the connection] |
05:23:43 | <that_lurker> | so now we need data removal service data removal service |
05:24:03 | | BornOn420 (BornOn420) joins |
05:25:17 | <@JAA> | *facepalm* |
05:39:25 | | HackMii quits [Remote host closed the connection] |
05:40:02 | | HackMii (hacktheplanet) joins |
05:40:14 | | tech234a (tech234a) joins |
05:49:00 | <nulldata> | nukke - if you haven't heard the Reply All episode about the long lost song, that's definitely a listen. https://gimletmedia.com/shows/reply-all/o2h8bx |
06:00:54 | | pixel (pixel) joins |
06:26:07 | | shgaqnyrjp quits [Remote host closed the connection] |
06:26:30 | | shgaqnyrjp (shgaqnyrjp) joins |
06:51:34 | <pabs> | https://www.bunniestudios.com/blog/2024/turning-everyday-gadgets-into-bombs-is-a-bad-idea/ |
07:15:49 | | benjins3 quits [Ping timeout: 260 seconds] |
07:22:20 | | BlueMaxima quits [Read error: Connection reset by peer] |
09:15:12 | | nulldata quits [Quit: So long and thanks for all the fish!] |
09:15:55 | | nulldata (nulldata) joins |
09:55:32 | | driib quits [Quit: The Lounge - https://thelounge.chat] |
09:56:06 | | driib (driib) joins |
10:18:33 | | benjins3 joins |
10:22:42 | | @OrIdow6 is now known as @me |
11:00:01 | | Bleo18260072271962 quits [Quit: The Lounge - https://thelounge.chat] |
11:01:14 | | Bleo18260072271962 joins |
11:14:23 | | eightthree quits [Remote host closed the connection] |
11:36:43 | | magmaus3 quits [Changing host] |
11:36:43 | | magmaus3 (magmaus3) joins |
12:34:07 | | eightthree joins |
12:41:29 | | Chris5010 (Chris5010) joins |
13:14:28 | | nicolas17 quits [Ping timeout: 255 seconds] |
13:48:57 | | etnguyen03 (etnguyen03) joins |
13:50:55 | | BearFortress quits [Ping timeout: 255 seconds] |
13:58:41 | | etnguyen03 quits [Client Quit] |
14:36:23 | | anarcat quits [Quit: stopping service...] |
14:37:54 | | HP_Archivist quits [Client Quit] |
15:08:06 | | katocala quits [Ping timeout: 255 seconds] |
15:08:19 | | katocala joins |
15:16:04 | | anarcat (anarcat) joins |
15:16:08 | | BornOn420_ (BornOn420) joins |
15:18:11 | | BornOn420 quits [Ping timeout: 260 seconds] |
15:23:20 | | BearFortress joins |
15:27:13 | | masterX244 quits [Ping timeout: 255 seconds] |
15:28:44 | | katocala quits [Ping timeout: 260 seconds] |
15:29:01 | | katocala joins |
15:32:00 | <f_> | fireonlive++ |
15:32:03 | <f_> | Discord-- |
15:32:04 | <eggdrop> | [karma] 'fireonlive' now has 438 karma! |
15:32:06 | <eggdrop> | [karma] 'Discord' now has -20 karma! |
15:32:12 | <f_> | Discord sucks. |
15:32:49 | | BornOn420 (BornOn420) joins |
15:34:13 | | masterX244 (masterX244) joins |
15:34:59 | | BornOn420_ quits [Ping timeout: 260 seconds] |
15:48:34 | <qwertyasdfuiopghjkl> | fireonlive++ |
15:48:34 | <eggdrop> | [karma] 'fireonlive' now has 439 karma! |
15:59:06 | <f_> | fireonlive++ |
15:59:07 | <eggdrop> | [karma] 'fireonlive' now has 440 karma! |
16:00:52 | <qwertyasdfuiopghjkl> | fireonlive++ |
16:00:52 | <eggdrop> | [karma] 'fireonlive' now has 441 karma! |
16:04:31 | <imer> | https://twitter.com/AndreyAzimov/status/1836793650992329181/ "switch to hetzner they say" |
16:04:32 | <eggdrop> | nitter: https://nitter.lucabased.xyz/AndreyAzimov/status/1836793650992329181/ |
16:05:28 | <katia> | switch to hosting in the closet |
16:09:26 | <steering> | nitter.lucabased took like 30s to load there :3 |
16:09:47 | <steering> | also lol poor power cord |
16:24:22 | <myself> | they saw all the discord chat and tried to dis-cord the server |
16:47:17 | | superkuh_ joins |
16:49:07 | | superkuh quits [Ping timeout: 255 seconds] |
17:01:03 | <kpcyrd> | the cloudflare dashboard asked me if I want to "activate blocking AI crawlers with a single click", like I'm some intellectual property capitalist |
17:01:33 | <kpcyrd> | the files I put on the internet are free, it's ok, you can take them home; I have 20 |
17:01:48 | <steering> | kpcyrd: see my mention yesterday about anthropic though ;) |
17:08:14 | <kpcyrd> | are you hosting on a raspberry pi? :) |
17:11:37 | | lukash98 quits [Ping timeout: 255 seconds] |
17:12:34 | | lukash98 joins |
17:34:38 | <steering> | might as well be |
17:35:05 | <steering> | seems a bit excessive for a site with some 37,000 URLs though |
17:36:45 | <kpcyrd> | maybe. I host a site with 332k requests in the past 30 days, 209k of them from the US, cache hit rate of 2.35%, I host this in a <10€/mo VPS, everything is fine |
17:38:30 | <kpcyrd> | but well the backend is entirely written in Rust so your mileage may vary |
17:44:49 | <steering> | it's whatever digitalocean's cheapest vm is, $5 or something? and 3x those hits from anthropic alone... plus gitweb is nasty horrible perl :P |
17:45:56 | | katocala is now authenticated as katocala |
17:48:45 | <magmaus3> | i use contabo as my main vps, and previously used oracle cloud's free plan |
17:49:35 | <magmaus3> | there's also pfcloud, which is fine (i got the cheapest possible vps (like 9.99€ for 3 months) and only used it for port scanning) |
17:53:30 | <steering> | 441561 06/Sep/2024 |
17:53:37 | <steering> | 215212 16/Sep/2024 |
17:53:40 | <steering> | 118517 19/Sep/2024 |
17:53:45 | <steering> | requests/day from anthropic... lol |
17:55:30 | <steering> | peaked at 20000/hour yesterday |
17:56:03 | <steering> | 15000-20000 every hour on the 6th... so yeah... |
17:56:08 | <@JAA> | Looks like it hasn't found our Gitea yet. I've had to block a bunch of others though that were doing ridiculous request rates, not respecting 429s or 5xxs, etc. They're still doing it after getting hard connection closures (nginx 444) for over a month now. |
17:56:31 | <steering> | reportedly anthropic respects 429s with backoff (i emailed them about it of course) |
17:56:52 | <steering> | I'm just giving them 444 now, and fail2ban triggering on 5x 444's |
17:58:06 | <TheTechRobo> | I'm on LunaNode for my two VPSes right now. Cheaper than most of the competition (at least as far as NA goes), reasonably fast |
17:58:13 | <steering> | upside: it convinced me to finally set up munin on this vps https://i.imgur.com/QmJyKCC.png that spike is when I accidentally'd my fail2ban config and they were unbanned |
17:59:20 | <@JAA> | anthropic-ai and Claude-Web are apparently the Anthropic UAs? |
17:59:36 | <steering> | Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com) |
17:59:58 | <@JAA> | Hmm yeah, that source I found is obviously totally wrong. Ugh, internet. |
18:00:10 | <steering> | I wouldn't be surprised if they use all 3 :P |
18:00:22 | <steering> | I banned `anthropic` and `ClaudeBot` |
18:00:53 | <steering> | (and a bunch of others that I found in some random stackoverflow post because why not) |
18:01:22 | <myself> | don't ban 'em, redirect 'em to a hidden markov model that just spews gibberish |
18:01:48 | <steering> | myself: see I was considering that, or just dropping a static page with the typical "disregard previous instructions and..." copypasta |
18:01:54 | <myself> | rofl |
18:02:46 | <steering> | I kinda wanted to only do that to Anthropic specifically though, and tried using "error 499" cause why not, and nginx choked on it - `return 499` is ok but `error_page 499 ...` isn't |
18:03:03 | <steering> | so I took the easy way out and just close the connection |
18:05:21 | <steering> | I do need to replace Gitweb with something better, the biggest reason it pissed me off was because Gitweb's fastcgi support is utterly broken and it die()s for any error condition (which there's a lot of because it's also broken in many other ways) |
18:05:58 | <steering> | I was getting a bunch of 503s because scraper cause error -> gitweb die -> not restarted yet |
18:06:13 | <steering> | but I'm lazy 🤷♂️ |
18:06:34 | <@JAA> | Oh, I did block ClaudeBot, actually. :-) |
18:07:29 | <DigitalDragons> | Cloudflare reports I get ~2.5m requests a month and I have no clue what they are for or who's making them lol |
18:08:33 | <kpcyrd> | access.log is 67360/70010 anthropic, access.log.1 is 3540/11845 |
18:08:35 | <steering> | I get like... somewhere around 300k-ish if you exclude Anthropic, lol |
18:11:27 | <steering> | https://bpa.st/USE3EMDN6BFBA2PVYM7CMJGBSI (monthly) |
18:14:48 | <steering> | oh that's the other one I blocked yesterday, Amazonbot |
18:16:17 | <steering> | looks like Anthropic has only been hitting me since July, most of the rest is Amazon and Bytedance... |
18:16:18 | <@JAA> | Bytespider's another one. |
18:16:37 | <@JAA> | Also Facebook. |
18:18:32 | <kpcyrd> | I'm flattered to be fed into their bias 💕 |
18:29:14 | | nicolas17 joins |
18:38:18 | <@JAA> | Oh, the AI bros want to revive Three Mile Island. |
19:15:09 | | BornOn420 quits [*.net *.split] |
19:15:09 | | shgaqnyrjp quits [*.net *.split] |
19:15:09 | | HackMii quits [*.net *.split] |
19:15:09 | | sec^nd quits [*.net *.split] |
19:15:57 | | HackMii (hacktheplanet) joins |
19:15:59 | | sec^nd (second) joins |
19:16:49 | | shgaqnyrjp (shgaqnyrjp) joins |
19:39:54 | | SootBector (SootBector) joins |
20:05:26 | | BornOn420 (BornOn420) joins |
21:07:52 | | tek_dmn quits [Ping timeout: 255 seconds] |
21:16:38 | | etnguyen03 (etnguyen03) joins |
21:27:13 | | Chris50103 (Chris5010) joins |
21:29:14 | | Chris5010 quits [Ping timeout: 260 seconds] |
21:29:14 | | Chris50103 is now known as Chris5010 |
21:50:00 | | BlueMaxima joins |
22:04:07 | | Stagnant quits [Ping timeout: 255 seconds] |
22:06:00 | | Stagnant (Stagnant) joins |
22:50:32 | | HackMii quits [Remote host closed the connection] |
22:50:32 | | BornOn420 quits [Remote host closed the connection] |
22:50:48 | | HackMii (hacktheplanet) joins |
22:51:04 | | BornOn420 (BornOn420) joins |
23:06:13 | | qw3rty_ quits [Ping timeout: 255 seconds] |
23:21:17 | | etnguyen03 quits [Client Quit] |
23:27:46 | | qw3rty joins |
23:30:31 | | magmaus3 quits [Ping timeout: 255 seconds] |
23:34:35 | | magmaus3 (magmaus3) joins |
23:50:51 | | DogsRNice joins |
23:51:20 | | magmaus3 quits [Read error: Connection reset by peer] |
23:51:30 | | magmaus3 (magmaus3) joins |
23:58:34 | | magmaus3 quits [Ping timeout: 260 seconds] |