HomeSearchPrevious dayNext day

00:22:43qwertyasdfuiopghjkl quits [Ping timeout: 255 seconds]
00:25:23qwertyasdfuiopghjkl (qwertyasdfuiopghjkl) joins
00:34:42benjins joins
00:42:10Mateon2 joins
00:43:52Mateon1 quits [Ping timeout: 258 seconds]
00:43:53Mateon2 is now known as Mateon1
00:54:27etnguyen03 (etnguyen03) joins
02:23:01etnguyen03 quits [Client Quit]
02:29:17etnguyen03 (etnguyen03) joins
02:30:21<imer>rip
02:31:41<imer>JAA: troubleshooting storage media past "its obviously dead/dying due to $defectiveSectors" is such a pain
02:33:09<imer>still seing the odd blip on one of my drives that I can only assume is maybe bad cabling.. but it happens so rarely and hasn't caused issues aside from having to tell zfs to put it back into action i've been putting that off..
02:34:22<@JAA>imer: The thing is, I'm not entirely sure it's obviously dying. There were weird CPU hangs in IOMMU, and SMART says the self-check failed, and we're well past their endurance rating, and now those two opaque flags that could mean just about anything (I read somewhere that some SSDs report an issue after a hard shutdown, maybe?). So... ¯\_(ツ)_/¯
02:37:33<imer>"we're well past their endurance rating" weeeell, thats a hint haha
02:38:01<@JAA>It is, but then again, SSDs frequently do last well beyond it.
02:38:12<@JAA>Rating is 300 TBW, these are at just under 1 PB.
02:43:11<nicolas17>if exceeding the endurance had caused sectors to become unwritable, there wouldn't be 100% available spare
02:43:32<nicolas17>maybe the media is fine, the controller is what fried itself?
02:44:57<nicolas17>JAA: it's also possible one of the SSDs is fine (even if both are past their endurance rating), but the other caused such fucked up errors that it confused and hanged the OS
02:45:16<@JAA>Yeah
02:45:33<@JAA>But good luck with debugging that. :-|
02:45:53<nicolas17>where is this server?
02:46:01<@JAA>FWIW, reading data off them worked fine without any stalls etc.
02:46:09<nicolas17>oh what
02:46:12<nicolas17>they're both readable now?
02:46:26<@JAA>I think it was stalling in writes.
02:46:53<nicolas17>anything important to recover from them or were the AB jobs restarted anyway?
02:47:01<@JAA>But I successfully pulled complete images of each drive plus most files.
02:47:28<@JAA>Actually, s/most/all/ (and I pulled those for convenience because working with the image files would be annoying).
02:48:07<@JAA>Well, the data from those jobs, of course. Also a bunch of data from older jobs.
02:48:19<@JAA>And it's Hetzner in Helsinki.
02:48:39<nicolas17>jfc I just realized my laptop backups have been broken for a week
02:48:48<nicolas17>should be fixed now x_x
02:49:57decky_e joins
02:50:47<@JAA>Server will be decomm'd anyway as there are better alternatives now and it lacks ECC. But yeah, I'd like to know what broke and how to spot it before it happens again elsewhere.
02:51:18<nicolas17>hope you did a cursory check of SMART in the other servers at least :p
02:54:49qwertyasdfuiopghjkl quits [Ping timeout: 255 seconds]
02:56:38etnguyen03 quits [Client Quit]
02:56:45qwertyasdfuiopghjkl (qwertyasdfuiopghjkl) joins
03:05:07etnguyen03 (etnguyen03) joins
03:12:00etnguyen03 quits [Ping timeout: 260 seconds]
03:17:39sec^nd quits [Remote host closed the connection]
03:18:01HackMii_ (hacktheplanet) joins
03:18:12sec^nd (second) joins
03:21:09HackMii quits [Ping timeout: 240 seconds]
04:11:18katocala quits [Remote host closed the connection]
04:14:47katocala joins
05:23:58sonick (sonick) joins
06:11:57thalia quits [Quit: Connection closed for inactivity]
06:21:05Hackerpcs quits [Quit: Hackerpcs]
08:59:32sralracer joins
09:15:13nulldata quits [Quit: So long and thanks for all the fish!]
09:16:04nulldata (nulldata) joins
09:20:39Sidpatchy7 joins
09:22:25Sidpatchy quits [Ping timeout: 260 seconds]
09:22:25Sidpatchy7 is now known as Sidpatchy
09:59:44driib quits [Quit: The Lounge - https://thelounge.chat]
10:00:12driib (driib) joins
10:06:19HackMii_ quits [Remote host closed the connection]
10:06:59HackMii (hacktheplanet) joins
10:21:49awauwa joins
10:59:30nicolas17 quits [Ping timeout: 258 seconds]
11:00:02Bleo18260072271962 quits [Quit: The Lounge - https://thelounge.chat]
11:02:41Bleo18260072271962 joins
11:03:07nicolas17 joins
11:03:42sonick quits [Quit: Connection closed for inactivity]
13:08:45magmaus3 quits [Ping timeout: 260 seconds]
13:26:52magmaus3 (magmaus3) joins
14:08:13Hackerpcs (Hackerpcs) joins
14:14:14Hackerpcs quits [Remote host closed the connection]
14:15:29Hackerpcs (Hackerpcs) joins
14:21:40magmaus3 quits [Ping timeout: 260 seconds]
14:23:29magmaus3 (magmaus3) joins
14:23:46qwertyasdfuiopghjkl quits [Ping timeout: 255 seconds]
14:25:45Hackerpcs quits [Ping timeout: 260 seconds]
14:27:06Hackerpcs (Hackerpcs) joins
14:30:21qwertyasdfuiopghjkl (qwertyasdfuiopghjkl) joins
14:44:29andrew0 (andrew) joins
14:46:45andrew quits [Ping timeout: 260 seconds]
14:46:45andrew0 is now known as andrew
14:46:56magmaus3 quits [Read error: Connection reset by peer]
14:47:06magmaus3 (magmaus3) joins
15:00:16MrMcNuggets (MrMcNuggets) joins
15:15:38Hackerpcs quits [Remote host closed the connection]
15:18:32Hackerpcs (Hackerpcs) joins
15:20:10shgaqnyrjp quits [Remote host closed the connection]
15:20:10HackMii quits [Remote host closed the connection]
15:20:40HackMii (hacktheplanet) joins
15:20:47shgaqnyrjp (shgaqnyrjp) joins
15:28:45Hackerpcs quits [Ping timeout: 260 seconds]
15:30:44Hackerpcs (Hackerpcs) joins
15:39:50Hackerpcs quits [Ping timeout: 260 seconds]
15:43:02Hackerpcs (Hackerpcs) joins
15:44:11Hackerpcs quits [Read error: Connection reset by peer]
16:03:28<nulldata>https://wordpress.org/news/2024/10/spoon/
16:03:54<nulldata>Links to https://freewp.com/ which says it's not a fork lol
17:56:55nicolas17 quits [Ping timeout: 260 seconds]
17:57:43MrMcNuggets quits [Client Quit]
18:00:53nicolas17 joins
18:07:17awauwa quits [Client Quit]
18:49:19<steering>so I blocked AWS on my servers a while back
18:49:36<steering>turns out .mp domains no longer work for me because the TLD's nameservers... use AWS :D
18:55:51razul277 joins
18:58:10razul27 quits [Ping timeout: 260 seconds]
18:58:10razul277 is now known as razul27
20:25:15etnguyen03 (etnguyen03) joins
20:36:45Juest quits [Ping timeout: 260 seconds]
20:41:45pixel leaves [Error from remote client]
20:47:49DogsRNice joins
21:04:37Juest (Juest) joins
21:13:59Juesto (Juest) joins
21:16:18Juest quits [Ping timeout: 258 seconds]
21:16:18Juesto is now known as Juest
21:22:19stan joins
21:43:25stan quits [Ping timeout: 255 seconds]
21:50:25stan joins
22:02:41BlueMaxima joins
22:25:04sralracer quits [Client Quit]
22:45:31stan quits [Ping timeout: 255 seconds]
22:59:56lunik11 quits [Quit: :x]
23:00:33lunik11 joins
23:13:06Ctrl-S quits [Read error: Connection reset by peer]
23:13:13Ctrl-S joins
23:15:49th3z0l4 joins
23:16:35tech234a quits [Ping timeout: 615 seconds]
23:19:18tech234a (tech234a) joins
23:23:47Hackerpcs (Hackerpcs) joins
23:31:02etnguyen03 quits [Quit: Konversation terminated!]
23:55:20etnguyen03 (etnguyen03) joins

HomeSearchPrevious dayNext day