00:01:31<pabs>https://sfconservancy.org/news/2023/sep/14/fossy-videos/
00:16:26Jake quits [Client Quit]
00:17:25Jake (Jake) joins
00:25:09Jake quits [Client Quit]
00:47:16<project10>https://www.bleepingcomputer.com/news/security/hackers-steal-53-million-worth-of-cryptocurrency-from-coinex/ $53M in hot wallets
00:50:33Jake (Jake) joins
00:51:39<fireonlive>https://mkx9delh5a.execute-api.ca-central-1.amazonaws.com/uploads/87d21bf9a1a697d7/image.png
00:53:45Arcorann (Arcorann) joins
00:55:45<@JAA>It was never going to get released anyway.
01:08:05etnguyen03 quits [Ping timeout: 265 seconds]
01:11:30Jake quits [Client Quit]
01:13:44<nulldata>https://lemmy.ml/comment/3823147
01:15:06<@JAA>Nippy. Kind. Langur.
01:15:07qwertyasdfuiopghjkl (qwertyasdfuiopghjkl) joins
01:16:57etnguyen03 (etnguyen03) joins
01:17:04Jake (Jake) joins
01:29:24icedice quits [Client Quit]
01:57:17etnguyen03 quits [Ping timeout: 252 seconds]
02:23:11BearFortress joins
02:44:12etnguyen03 (etnguyen03) joins
03:58:59Peroniko quits [Client Quit]
04:17:02HP_Archivist quits [Read error: Connection reset by peer]
04:17:31HP_Archivist (HP_Archivist) joins
04:20:17DogsRNice quits [Read error: Connection reset by peer]
04:42:50etnguyen03 quits [Ping timeout: 252 seconds]
04:43:56etnguyen03 (etnguyen03) joins
04:54:02BlueMaxima joins
05:12:28etnguyen03 quits [Client Quit]
05:57:26nicolas17 quits [Client Quit]
06:37:35Dango360 quits [Read error: Connection reset by peer]
07:27:59parfait quits [Ping timeout: 265 seconds]
07:59:58<imer>> No need for death threats. Unity already committed suicide.
07:59:58<imer>ouch
08:16:28BlueMaxima quits [Read error: Connection reset by peer]
08:51:41Jake quits [Client Quit]
09:22:10Jake (Jake) joins
09:54:26efeafewa quits [Ping timeout: 265 seconds]
10:12:08driib quits [Quit: The Lounge - https://thelounge.chat]
10:12:44driib (driib) joins
10:21:35nulldata quits [Client Quit]
10:22:02nulldata (nulldata) joins
11:20:45icedice (icedice) joins
11:33:02icedice quits [Client Quit]
11:42:36BigBrain_ quits [Remote host closed the connection]
11:43:06BigBrain_ (bigbrain) joins
11:43:22sec^nd quits [Remote host closed the connection]
11:45:18sec^nd (second) joins
11:53:53HackMii_ quits [Remote host closed the connection]
11:53:53BigBrain_ quits [Remote host closed the connection]
11:54:20BigBrain_ (bigbrain) joins
11:54:31HackMii_ (hacktheplanet) joins
11:55:27pie_ quits []
11:55:29pie_ joins
12:00:05pie_ quits [Ping timeout: 252 seconds]
12:20:54pie_ joins
12:27:59icedice (icedice) joins
12:28:02icedice quits [Remote host closed the connection]
12:28:20icedice (icedice) joins
12:58:56Peroniko joins
13:02:32<Peroniko>Hi, is there any script or something that can be used to automatically pull any amount of RSS feeds, possibly wait when all the RSS feeds are achived, save already archived links to local db so that they won't be archived again, and archive new links using S3Keys or something.
13:03:32superkuh quits [Remote host closed the connection]
13:03:47superkuh joins
13:05:16etnguyen03 (etnguyen03) joins
13:08:10<Peroniko>I've put together something using ChatGPT, it works, but it sucks because for no reason some feeds are not checked and archived: https://pastebin.com/5gbaFWgD
13:10:30<immibis>why did you give every domain its own table?
13:12:11<immibis>submitting a task and then waiting for it to finish also defeats the purpose of a thread pool
13:19:33<Peroniko>Every domain for every table looks more organized to me
13:19:47<Peroniko>Also that way I can check if domain are archived or not
13:27:24<Peroniko>domains*
14:05:21icedice quits [Client Quit]
14:05:37icedice (icedice) joins
14:12:58<TheTechRobo>I don't think making a new table for each domain is the best idea
14:13:05<TheTechRobo>It also means you probably can't scale as well
14:14:50Arcorann quits [Ping timeout: 252 seconds]
14:20:09<Peroniko>Maybe making a new table for every TLD? No idea how databases work, just going along where it takes me.
14:22:01Shjosan quits [Quit: Am sleepy (-, – )…zzzZZZ]
14:22:50Shjosan (Shjosan) joins
14:22:50Shjosan quits [Remote host closed the connection]
14:23:53Shjosan (Shjosan) joins
14:27:41<TheTechRobo>I think you'd probably have one big table, and an index. I'm not an SQL god thiugh so I could be wrong
14:28:05<TheTechRobo>Gracious I'm terrible at articulating what I'm trying to say right now
14:47:44nicolas17 joins
14:50:22parfait (kdqep) joins
14:51:00<imer>you're probably fine on one table + proper indexes, yes
14:51:11<imer>unless you're expecting hundreds of millions of rows
14:58:19<Peroniko>No, I don't expect more than 1500 per day and that's around 2 years to reach million. I did modify it to be all in one table.
15:05:42le0n quits [Ping timeout: 265 seconds]
15:06:55toss (toss) joins
15:15:53etnguyen03 quits [Ping timeout: 252 seconds]
15:19:50<fireonlive>Plex to block all servers hosted at Hetnzer: https://links.plex.tv/e/evib?_t=3bef3c50f13f4320a9e31b8be79c6ad2&_m=df59a9eb59db44d2a0dbdbd0ebb61ee5&_e=xDXT7pYRisN-4z7uioydETDUiISVYQQUM0Y_a8MKNPZP6DN9yUpJaWCmlnGMyQQb https://news.ycombinator.com/item?id=37517216
15:23:24<@JAA>lol
15:27:19<hexa->arrrrrr
15:28:34<Peroniko>Time to switch to Jellyfin for them
15:28:55hitgrr8 joins
15:34:25<fireonlive>plex seems to have a bit of the 'gitlab' as well... too much new feature stuff and not enough core improvement 😅
15:40:21le0n (le0n) joins
15:40:39etnguyen03 (etnguyen03) joins
15:41:42<@HCross>JAA: I was just playing around with ZSTD on some HTML/IXRBL documents (financial data) - and I stuck it on 22 as a test. 1.63% ( 821 MiB => 13.4 MiB, 2919.22.tar.zst)
15:42:21<nicolas17>took forever to compress, and decompresses faster than your hard disk can read it?
15:42:43<@HCross>Took about 20 minutes to compress
15:43:00<@JAA>Yeah, the --ultra levels are ridiculously slow.
15:43:17<@JAA>But worth it for long-term storage compression.
15:43:23Mateon1 quits [Ping timeout: 252 seconds]
15:44:20<@JAA>I usually use 10 for most things. Nice balance between speed and compression ratio, in my opinion.
15:45:29<@HCross>10 gets down to 26MB
15:46:24<@HCross>Companies House in the UK will sort of just give you access to their S3 bucket-of-all-data if you give them an SSH key for their SFTP gateway
15:46:32<@HCross>so I've been playing with that
15:46:41<@JAA>Nice
15:46:59<@HCross>their data formatting is hideous
15:47:05Mateon1 joins
15:47:18<@JAA>It's a gov entity. Of course it is.
15:48:20<nicolas17>.img.xz from raspberrypi website: 819MB, decompresses in 1m02s
15:48:32<nicolas17>I extracted it and recompressed it with zstd -19, which took ages
15:48:39<nicolas17>.img.zst (zstd -19): 955MB, decompresses in 5s
15:48:45<@HCross>JAA: highlights include the fact they have a daily update XML, which has been corrupt each day for.. the past 2 years
15:48:54<@JAA>lol
15:49:07<@HCross>and the TSV file which randomly switches to space seperation
15:49:21<@JAA>Beautiful
15:50:05<fireonlive>oooooof
15:50:06<nicolas17>it's a bit annoying that I can download that 819MB file faster than I can extract it, but 819->955 is probably more growth than they would like
15:50:16<@HCross>there is also no real readme, to say what files are what
15:50:36<@HCross>the readme is.. "It would be good to have the specs file present, so people can read, the format of the file."
15:50:55<nicolas17>HCross: a few years ago, the city government of buenos aires started publishing open data
15:51:04<nicolas17>"under free licenses and open formats"
15:51:12<nicolas17>>look inside
15:51:21<@HCross>for context - https://find-and-update.company-information.service.gov.uk/company/00048839 this is everything here, plus a few more things
15:51:24<nicolas17>>.rar file with no actual license
15:52:03<nicolas17>they have since improved, though
16:03:04<fireonlive>wait you can just view the PDFs on their bucket
16:03:24<fireonlive>here they charge like $X/PDF if you wish to look up any company's documents -_-
16:04:03<fireonlive>like i'm curious who owns the new Y but not that curious :P
16:05:01DogsRNice joins
16:05:16<project10>https://en.wikipedia.org/wiki/Utah_Data_Center 5ZB... wonder if they can spare some
16:07:29<fireonlive>all that storage wasted for spying
16:08:17<fireonlive>its like literal r/DataHoarders: they have so much they can’t/don’t look at it all but line must go up
16:08:20<fireonlive>:P
16:08:59<DogsRNice>"we finally downloaded the entire internet!"
16:09:01<DogsRNice>"now what"
16:09:29toss quits [Client Quit]
16:09:36<@JAA><xkcd 792>
16:13:51etnguyen03 quits [Ping timeout: 265 seconds]
16:19:31<TheTechRobo>I like lzip for long-term compression because it's very good on a data recovery standpoint
16:19:48<TheTechRobo>on the other hand, zstd is MUCH faster (lzip is LZMA)
16:21:13<nicolas17>data recovery?
16:21:14<@JAA>Could you elaborate on the data recovery? How does it differ?
16:22:34<@JAA>I read a bit through the thread on the Plex forums. Only one official reply so far, and they're basically going 'I've altered the deal, pray I don't alter it any further'. https://forums.plex.tv/t/not-allowed-to-use-hetzner/853570
16:23:21<nicolas17>:|
16:29:03AmAnd0A quits [Read error: Connection reset by peer]
16:29:20AmAnd0A joins
16:37:50<fireonlive>how far you’ve fallen, plex
16:38:25<hexa->most corporate offerings fall eventually
16:42:18<hexa->fall short of our expectations*
16:42:42<fireonlive>yeah :(
16:59:06<@HCross>oh also JAA - they're flat out skipping days in some of the data
16:59:22<@HCross>in fact, FOUR MONTHS at one point
16:59:49<@HCross>I've also emailed them, as a pile of the mortgages dataset is missing
17:01:06<@JAA>Fun
17:15:08<Barto>https://media.discordapp.net/attachments/712424533377679430/1152282902332186725/f37e5b49db777015.png?width=695&height=458
17:15:10<Barto>lol
17:18:57magmaus3 (magmaus3) joins
17:19:03jacksonchen666 (jacksonchen666) joins
17:30:50<fireonlive>lmao
17:32:17etnguyen03 (etnguyen03) joins
17:49:42Dango360 (Dango360) joins
18:08:04<fireonlive>https://news.ycombinator.com/item?id=37526877 "Plex is in the right here. Hetzner is the sort company who doesn't want legitimate clients and actively caters to the underbelly."
18:08:08<fireonlive>🤨
18:08:10<fireonlive>oh really?
18:08:57<fireonlive>(a few people have thrown that sentiment around in a few places)
18:10:14<fireonlive>they seem to be the kind of people who cry when someone opens a TCP connection on port 22 though :D
18:20:38<imer>Cheap providers attract shady customers *shrug*
18:30:27<fireonlive>ah ye, basically what i thought
18:31:34<Frogging101>People paying for servers for "piracy" are not bad clients for a server company at all
18:31:59<Frogging101>They don't spam, they don't run wordpress exploit specials
18:32:11<Frogging101>they don't crypto mine
18:40:58<fireonlive>right? o_O
18:52:50Jake quits [Client Quit]
18:55:53Jake (Jake) joins
18:59:42Jake quits [Client Quit]
19:00:51jacksonchen666 quits [Ping timeout: 245 seconds]
19:19:55Jake (Jake) joins
19:30:36AmAnd0A quits [Read error: Connection reset by peer]
19:30:45AmAnd0A joins
20:13:50jacksonchen666 (jacksonchen666) joins
20:15:55Naruyoko5 joins
20:15:55Bleo quits [Quit: The Lounge - https://thelounge.chat]
20:18:23Naruyoko quits [Ping timeout: 252 seconds]
20:18:41Bleo joins
20:35:59AmAnd0A quits [Ping timeout: 252 seconds]
20:36:51AmAnd0A joins
20:40:09AmAnd0A quits [Read error: Connection reset by peer]
20:40:22AmAnd0A joins
21:01:55BearFortress quits [Ping timeout: 265 seconds]
21:16:30<@arkiver>i don't think it has anything to do with hetzner, just hetzner is the most used here and plex needs to make some gesture towards companies that might sue
21:22:32<imer>sue plex for not checking peoples library for pirated content? I don't quite understand how they're the target of any lawsuits here
21:23:12<fireonlive>people are filling up libraries with the latest pirated content then charging $x/mo to access them via plex's built in sharing feature
21:23:37<fireonlive>there's been a few subreddits for that where you can sell or look to buy access to a plex box
21:23:59<@JAA>There are so many ways that can be tackled that aren't 'let's ban an entire ISP lol' though.
21:24:59<@arkiver>JAA: sure but the technically savvy thinkers are usually not the managers
21:25:20<@JAA>Yeah, and they're apparently not very business-savvy either.
21:25:29<@arkiver>see Unity :P
21:25:39<@JAA>Yeah, I was going to say, I'm sensing a theme here this week.
21:25:47<@arkiver>we need just one more this weekend
21:26:14@arkiver is slowly turning an old man believing "the world is slowly going to shit"
21:26:31@arkiver will be talking of the good old days of the open internet
21:27:11<flashfire42>I REMEMBER WHEN YOU COULD BUY A PIZZA WITH WHOLE BITCOINS. "Alright grandpa time to get you back to the home"
21:27:11AmAnd0A quits [Read error: Connection reset by peer]
21:27:46AmAnd0A joins
21:27:57<@arkiver>yeah i'm still sad i didn't jump a little on that ship in the beginning
21:28:10<flashfire42>I REMEMBER WHEN YOU DIDNT HAVE TO GIVE A PERSONAL IDENTIFICATION CARD YOU COULD JUST TELL PEOPLE YOU WERE OVER 18 AND THEY BELIEVED YOU
21:28:38<fireonlive>i almoooooooooooost bought a bunch of bitcoin ~early on x3
21:28:45<fireonlive>rip 🙃
21:28:55<@arkiver>:P
21:29:06<flashfire42>If you do have tiktok I suggest wathcing 2000sGrandpa
21:29:18emberquill08 quits [Quit: The Lounge - https://thelounge.chat]
21:29:23<@arkiver>what is tiktok
21:29:25<fireonlive>flashfire42: is your tiktok just all thirst traps
21:29:37emberquill08 (emberquill) joins
21:29:42<flashfire42>2 kinds of people
21:30:40<flashfire42>fireonlive no its mostly absurdist comedy and weird learning channels. Despite having a disdain for organised religion I follow a fellow on there that is a biblical scholar who spends half his time debunking conspiracy theories about the bible
21:30:48<@JAA>Back in my day, we had one TV channel AND WE WERE HAPPY WITH IT!
21:31:04<fireonlive>flashfire42: ah :D
21:31:16<fireonlive>and cable tv had no ads!
21:31:28<fireonlive>i'm too young to have had cable TV without ads though
21:32:48<@JAA>'Cable'? The TV signal is transmitted over radio waves. That's why there's a large antenna on the top of the TV.
21:33:02<fireonlive>:P
21:33:33<fireonlive>i check my clocks are accurate by dialling a phone number!
21:33:50<DigitalDragons>Back in my day we had to walk five miles to school uphill both ways
21:34:17etnguyen03 quits [Ping timeout: 252 seconds]
21:34:26<flashfire42>What the fuck is a clock. Do you mean a sundial?
21:34:36<@JAA>And by 'dialling', I mean sticking my finger into the rotary dial.
21:34:37<nicolas17>fireonlive: there's a whole story about the woman who recorded that in argentina
21:34:56<fireonlive>ooh
21:34:58<nicolas17>she recorded the voice clips for the phone time service
21:35:10<fireonlive>jane barbie in the US i believe
21:35:34<nicolas17>there was some confusion at her daughter's kindergarden when they asked her what mom does for a job and she said "she gives the time"
21:36:30<fireonlive>:3
21:37:50<imer>https://www.speaking-clock.com/ "In the United Kingdom, the speaking clock can be reached by dialling 123 on a BT phone line; the number may vary on other networks" learned that today
21:39:32<imer>via https://youtu.be/JoTolTGiX4U?si=OrtR0XeqFZbv90oK&t=1097
21:40:29<fireonlive>https://cdn.discordapp.com/attachments/1140706606775025786/1152311056937529456/image.png
21:40:54<imer>thats sad, funny, but sad
21:41:08<Barto>back then you had a pre-paid card to use the telephone booth. remember that JAA ? :D
21:41:25<@JAA>Barto: Ooh yes, I probably still have some somewhere. lol
21:41:26<fireonlive>there's also ANAC telephone numbers https://en.wikipedia.org/wiki/Automatic_number_announcement_circuit
21:41:34<fireonlive>but it looks like wikipedia yeeted the listing of numbers
21:41:58<fireonlive>there was a little editing war about it too! https://en.wikipedia.org/w/index.php?title=Automatic_number_announcement_circuit&action=history
21:42:01<@JAA>I was collecting those for some time. Whenever I passed a booth, I'd check whether someone left an empty card inside. :-P
21:42:53<fireonlive> 16:38, 20 October 2022‎ Kbrose talk contribs‎ 8,182 bytes −19,443‎ WP:NOTDIRECTORY WP:NOTHOWTO WP:NOTDATABASE
21:43:21<fireonlive>but yeah anyways, numbers you'd call to tell you what number you were calling from
21:43:59<fireonlive>in the UK "*17070, Openreach Linetest Facilities" apparently
21:46:04<nicolas17>I think there's also a number that you dial, and then hang up, and seconds later it calls you back
21:47:30<fireonlive>ah yeah, ringback
21:47:53<fireonlive>https://en.wikipedia.org/wiki/Ringback_number
21:51:13AmAnd0A quits [Ping timeout: 265 seconds]
21:51:17AmAnd0A joins
21:52:51<project10>https://www.youtube.com/watch?v=jpMrTxMV6E4
22:07:41decky joins
22:10:04decky_e quits [Ping timeout: 265 seconds]
22:15:23AmAnd0A quits [Ping timeout: 265 seconds]
22:17:19Mateon2 joins
22:18:50Mateon1 quits [Ping timeout: 252 seconds]
22:18:50Mateon2 is now known as Mateon1
22:23:05emberquill08 quits [Client Quit]
22:23:49emberquill08 (emberquill) joins
22:24:33etnguyen03 (etnguyen03) joins
22:41:15<FireFly>https://merveilles.town/@neauoire/111070456834852211 *snicker*
22:42:29Suika_ quits [Ping timeout: 252 seconds]
22:44:27hitgrr8 quits [Client Quit]
22:44:42Suika joins
22:44:59<fireonlive>:3
22:52:56etnguyen03 quits [Ping timeout: 252 seconds]
22:58:44Jake quits [Client Quit]
22:59:03Jake (Jake) joins
23:33:09Arcorann (Arcorann) joins
23:46:43<fireonlive>https://mkx9delh5a.execute-api.ca-central-1.amazonaws.com/uploads/25fa8f49c85fee7f/image.png
23:46:54<fireonlive>infrastructure
23:48:23<imer>{"message":"Service Unavailable"}? weird png
23:48:52<fireonlive>o_O
23:49:10<fireonlive>does it load now lol
23:49:24<imer>nope, you broke aws - congrats :D
23:49:30<fireonlive>oh noooo
23:49:51<fireonlive>speaking of infrastructure lol
23:50:27<fireonlive>https://transfer.archivete.am/inline/14iiQ/IMG_5174.jpeg
23:50:31<fireonlive>there we go :D
23:50:47BlueMaxima joins
23:51:42<imer>mm, the generator is the finishing touch that needed
23:52:08<fireonlive>^_^
23:53:17<imer>oh, original link is working
23:53:27<@JAA>fireonlive: I also got that error on first attempt, but it worked on a reload. I've also seen it before on another one of your links, by the way.
23:53:59<@JAA>ArchiveBot seems to have succeeded the first time.
23:54:04<@JAA>¯\_(ツ)_/¯
23:54:28<fireonlive>ahh ok
23:54:38<fireonlive>maybe I’ll make that this weekend’s task to move away from that