HomeSearchPrevious dayNext day

00:04:09BlueMaxima quits [Client Quit]
00:08:53<pabs>re mastodon, here is a command-line client that requires no JS and dumps info to the terminal https://github.com/jwilk/zygolophodon
00:09:15<pabs>probably could take the guts of it to make an archiver for mastodon
00:15:51AlsoHP_Archivist quits [Client Quit]
00:16:12HP_Archivist (HP_Archivist) joins
00:22:00FalconK (FalconK) joins
00:40:01BigBrain_ quits [Ping timeout: 245 seconds]
00:42:48BigBrain_ (bigbrain) joins
00:55:29tertu quits [Ping timeout: 252 seconds]
00:55:53tertu (tertu) joins
01:38:56AmAnd0A quits [Ping timeout: 252 seconds]
01:39:29AmAnd0A joins
01:41:03null is now known as rawktucc
01:41:07rawktucc is now known as rktk
01:41:08rktk quits [Changing host]
01:41:08rktk (rktk) joins
01:42:01<rktk>"transgender phenomenon" it's not a phenomenon lmao
01:42:09<rktk>is this stuff that's being archived? I feel like why not let that content die?
01:42:21<SketchCow>Want to have that debate now? It is -bs
01:42:48<SketchCow>Have to warn you, though, no matter what you say, I'm doing it anyway.
01:43:28<rktk>debate on transgender being a phenomenon or archiving content like that
01:43:34<SketchCow>Archiving content.
01:43:48<flashfire42>I feel its important to have that stuff archived for future historians and the sort. But I personally will not be going out of my way to archive it. But Agree its important to do so.
01:44:56<rktk>Indeed, I didn't consider the historical research perspective
01:46:20<nstrom|m>those who forget history are doomed to repeat it 🤷
01:47:26<flashfire42>I am now just scared at the absolute fucking wall of text sketchcow must be typing
01:49:56etnguyen03 quits [Ping timeout: 252 seconds]
01:53:20<qyxojzh|m><nstrom|m> "those who forget history are..." <- It's about what _to_ do and what _not_ to do =P
01:53:26<qyxojzh|m>Gotta have both
02:05:01sec^nd quits [Ping timeout: 245 seconds]
02:05:34<rktk>thankfully i am going to bed but I am on znc so.
02:05:42<rktk>SketchCow, feel free to PM me if you want instead :P
02:11:01etnguyen03 (etnguyen03) joins
02:17:25Dango360_ (Dango360) joins
02:20:44Dango360 quits [Ping timeout: 252 seconds]
02:21:03_Dango360 (Dango360) joins
02:24:45kiryu quits [Changing host]
02:24:45kiryu (kiryu) joins
02:25:19Dango360_ quits [Ping timeout: 265 seconds]
02:44:04sec^nd (second) joins
02:44:13<@arkiver>we're not letting any content die
02:44:36BigBrain_ quits [Ping timeout: 245 seconds]
02:44:41<@arkiver>as with any site, if it is shutting down, and effort can be made in #archivebot or a custom project to archive that website
02:44:45<@arkiver>(or webpage/etc.)
03:07:51dumbgoy_ quits [Ping timeout: 265 seconds]
03:24:24Island quits [Read error: Connection reset by peer]
03:27:28<h2ibot>Yts98 edited Mobile Phone Applications (+186, Clean up dead links, add APKPure): https://wiki.archiveteam.org/?diff=50714&oldid=48489
03:28:30<flashfire42>Android subsystem for windows may come in handy for archival of android stuff
03:32:02decagon__ joins
03:33:29<h2ibot>Yts98 edited Mobile Phone Applications (+50): https://wiki.archiveteam.org/?diff=50715&oldid=50714
03:35:24krvme quits [Ping timeout: 265 seconds]
03:54:32<h2ibot>Yts98 edited BlackBerry World (+596, Update project status): https://wiki.archiveteam.org/?diff=50716&oldid=46619
03:56:49<fireonlive>RIP
04:01:30DogsRNice quits [Read error: Connection reset by peer]
04:07:26etnguyen03 quits [Ping timeout: 252 seconds]
04:11:24etnguyen03 (etnguyen03) joins
04:25:40BPCZ quits [Ping timeout: 265 seconds]
04:31:09etnguyen03 quits [Client Quit]
04:44:04<pabs>https://www.theverge.com/2023/9/1/23856029/gizmodo-shuts-down-spanish-language-site-ai-translations
04:44:11<pabs>"Gizmodo’s owner shuts down Spanish language site in favor of AI translations"
04:44:42<pabs>seems the site stays up but every article is Google-translated (poorly)
04:45:09<nicolas17>w t f
04:45:33<pabs>I should have said every *new* article
04:45:47<nicolas17>bad human translations are better because bad grammar can be *noticed*
04:47:03<nicolas17>the better the AI translation the harder it is to notice when it screws up :/
04:47:47pabs wonders whether to archive the site or not...
04:54:40<fireonlive>wat
04:55:09<fireonlive>pabs: might be worthy to grab the old articles i guess...
04:55:18<fireonlive>in case they just scrap the thing alltogether in the future
04:57:29BPCZ (BPCZ) joins
04:57:53Naruyoko quits [Read error: Connection reset by peer]
05:08:30<pabs>https://torrentfreak.com/tv-museum-will-die-in-48-hours-unless-sony-retracts-youtube-copyright-strikes-230904/
05:10:25<fireonlive>was thrown in DTT
05:10:32<fireonlive>website failed in AB due to how overloaded/slow it is
05:11:19<fireonlive>https://old.reddit.com/r/DataHoarder/comments/169q4cp/ claims 'multiple copies have been made' as well
05:11:41<nicolas17>4900 videos, seems most are not too long though
05:13:21<pabs>hmm, the site has a ton of subdomains
05:14:09<pabs>pretty broken in a browser
05:14:29<nicolas17>my yahoo videos indexing seems to be going well
05:14:40<fireonlive>pabs: wonder if it's relying on www.* for styles/js?
05:14:58<nicolas17>a .tar download from IA has been going for 26 continuous hours without getting interrupted, amazing
05:15:04<pabs>www. seems broken indeed
05:15:47<h2ibot>Yts98 edited Duelyst (+40, Clean up formatting): https://wiki.archiveteam.org/?diff=50717&oldid=46610
05:15:59<fireonlive>response times for things from there seem to take multiple seconds at times
05:16:27nicolas17 quits [Client Quit]
05:18:18<pabs>in AB I just got a 403 and then a timeout :(
05:21:29Naruyoko joins
05:24:34<pabs>hmm, in the browser all the subdomains are the same but different to the main site
05:40:33ave quits [Quit: Ping timeout (120 seconds)]
05:40:33lun4 quits [Quit: Ping timeout (120 seconds)]
05:40:53lun4 (lun4) joins
05:40:54ave (ave) joins
05:47:26<pabs>https://nitter.net/BIS_records/status/1698920897036374117?s=20 https://www.macrumors.com/2023/09/05/apple-acquires-bis-records/
05:48:11ave quits [Client Quit]
05:48:13lun4 quits [Client Quit]
05:48:28ave (ave) joins
05:48:31lun4 (lun4) joins
05:57:55<h2ibot>Yts98 edited URLTeam/Dead (-82, untiny.me (untiny.com) is an unshortner, not a…): https://wiki.archiveteam.org/?diff=50718&oldid=50695
06:05:38erkinalp joins
06:10:19jtagcat quits [Quit: Bye!]
06:11:08jtagcat (jtagcat) joins
06:43:05<h2ibot>Yts98 edited URLTeam (+597, Filter out dead table rows): https://wiki.archiveteam.org/?diff=50719&oldid=50694
06:48:02<fireonlive>yts98: nice work lately :)
06:50:36<yts98>;)
06:54:19<fireonlive>;o
06:56:23Minkafighter52531 quits [Quit: The Lounge - https://thelounge.chat]
06:56:53Minkafighter52531 joins
07:03:45railen63 quits [Remote host closed the connection]
07:04:01railen63 joins
07:07:03Unholy23613166180851 (Unholy2361) joins
07:10:25decky joins
07:11:56decky_e quits [Ping timeout: 265 seconds]
07:59:05BigBrain_ (bigbrain) joins
08:41:53nulldata quits [Ping timeout: 252 seconds]
08:45:04nulldata (nulldata) joins
08:58:16Naruyoko quits [Remote host closed the connection]
08:58:38Naruyoko joins
09:02:31<that_lurker>https://www.theguardian.com/world/2023/sep/05/bharat-g20-invitation-fuels-rumours-india-may-change-name
09:04:08@Fusl quits [Quit: K-Lined]
09:06:51Fusl (Fusl) joins
09:06:51@ChanServ sets mode: +o Fusl
09:10:01@Fusl quits [Client Quit]
09:10:13Fusl (Fusl) joins
09:10:13@ChanServ sets mode: +o Fusl
09:12:54@Fusl quits [Client Quit]
09:14:53Fusl (Fusl) joins
09:14:53@ChanServ sets mode: +o Fusl
09:16:03decky_e joins
09:18:11decky quits [Ping timeout: 252 seconds]
10:00:01railen63 quits [Remote host closed the connection]
10:01:58railen63 joins
10:29:30erkinalp quits [Remote host closed the connection]
10:49:12AmAnd0A quits [Remote host closed the connection]
10:49:24AmAnd0A joins
10:49:26abirkill quits [Ping timeout: 265 seconds]
11:10:34Exorcism (exorcism) joins
11:10:35yts98 leaves
11:10:43yts98 joins
11:29:17Exorcism_ (exorcism) joins
11:29:17yts98 leaves
11:29:26yts98 joins
11:31:36railen63 quits [Remote host closed the connection]
11:32:56Exorcism quits [Ping timeout: 245 seconds]
11:33:02Arcorann (Arcorann) joins
11:34:36Exorcism_ quits [Ping timeout: 245 seconds]
11:43:15decky_e quits [Read error: Connection reset by peer]
11:44:31decky_e joins
11:52:01Exorcism_ (exorcism) joins
12:42:58etnguyen03 (etnguyen03) joins
12:59:39MrRadar_ (MrRadar) joins
13:01:30xkey quits [Quit: WeeChat 3.8]
13:01:37xkey (xkey) joins
13:02:35MrRadar quits [Ping timeout: 252 seconds]
13:09:36AmAnd0A quits [Ping timeout: 265 seconds]
13:09:40AmAnd0A joins
13:27:00treora quits [Ping timeout: 265 seconds]
13:30:51treora joins
13:39:59etnguyen03 quits [Ping timeout: 252 seconds]
13:53:33railen63 joins
13:58:08Arcorann quits [Ping timeout: 252 seconds]
13:58:41Iki quits [Ping timeout: 252 seconds]
13:58:41<qwertyasdfuiopghjkl>I found this url shortener + pastebin site https://fars.ee/ that has a notice saying "All data may be erased without notifications". Maybe something that should be archived? IDs are 1 to 4 characters long, a-zA-Z0-9_- so might be possible to just !ao < a list of all possible combinations.
14:24:30Megame (Megame) joins
14:37:16_Dango360 quits [Client Quit]
14:37:34Dango360 (Dango360) joins
14:39:26DigitalDragon quits [*.net *.split]
14:39:26sonst-was|m quits [*.net *.split]
14:39:26yzqzss quits [*.net *.split]
14:39:26iCesenberk|m quits [*.net *.split]
14:39:26AntoninDelFabbro|m quits [*.net *.split]
14:39:27qyxojzh|m quits [*.net *.split]
14:39:27qq44|m quits [*.net *.split]
14:39:27alexshpilkin quits [*.net *.split]
14:39:27Misty|m quits [*.net *.split]
14:39:27nosamu|m quits [*.net *.split]
14:39:27username675f|m quits [*.net *.split]
14:39:27ram|m quits [*.net *.split]
14:39:27Peetz0r|m quits [*.net *.split]
14:39:27EmeraldSnorlax|m quits [*.net *.split]
14:39:27marius851000 quits [*.net *.split]
14:39:27kaz__|m quits [*.net *.split]
14:39:27Passiing|m quits [*.net *.split]
14:39:27noxious quits [*.net *.split]
14:39:27EvanBoehs|m quits [*.net *.split]
14:39:27trumad|m quits [*.net *.split]
14:39:27NickS|m quits [*.net *.split]
14:39:27haha-whered-it-go|m quits [*.net *.split]
14:39:27joepie91|m quits [*.net *.split]
14:39:27yetanotherarchiver|m quits [*.net *.split]
14:39:27lasdkfj|m quits [*.net *.split]
14:39:27superusercode quits [*.net *.split]
14:39:27noobirc|m quits [*.net *.split]
14:39:27GRBaset quits [*.net *.split]
14:39:27nyuuzyou quits [*.net *.split]
14:39:27Cydog|m quits [*.net *.split]
14:39:27will|m quits [*.net *.split]
14:39:27pannekoek11|m quits [*.net *.split]
14:39:27jwoglom|m quits [*.net *.split]
14:39:28akaibu|m quits [*.net *.split]
14:39:28Ruk8 quits [*.net *.split]
14:39:28dieserniko|m quits [*.net *.split]
14:39:28coro quits [*.net *.split]
14:39:28gwetchen|m quits [*.net *.split]
14:39:28x9fff00 quits [*.net *.split]
14:39:28hlgs|m quits [*.net *.split]
14:39:28thermospheric quits [*.net *.split]
14:39:28phaeton quits [*.net *.split]
14:39:28Video quits [*.net *.split]
14:39:28Max|m12 quits [*.net *.split]
14:39:28masterx244|m quits [*.net *.split]
14:39:28voltagex|m quits [*.net *.split]
14:39:28mikolaj|m quits [*.net *.split]
14:39:28madpro|m quits [*.net *.split]
14:39:28t3chler|m quits [*.net *.split]
14:39:28wrangle|m quits [*.net *.split]
14:39:28tech234a|m quits [*.net *.split]
14:39:28Roki_100|m quits [*.net *.split]
14:39:28M--mlv|m quits [*.net *.split]
14:39:29gungagungagunga|m quits [*.net *.split]
14:39:29finalti|m quits [*.net *.split]
14:39:29jackt1365|m quits [*.net *.split]
14:39:29saouroun|m quits [*.net *.split]
14:39:29moe-a-m|m quits [*.net *.split]
14:39:29schwarzkatz|m quits [*.net *.split]
14:39:29vexr quits [*.net *.split]
14:39:29Froxcey|m quits [*.net *.split]
14:39:29Tom|m1 quits [*.net *.split]
14:39:29flashfire42|m quits [*.net *.split]
14:39:29manu|m quits [*.net *.split]
14:39:29CrispyAlice2 quits [*.net *.split]
14:39:29s-crypt|m quits [*.net *.split]
14:39:29Fletcher quits [*.net *.split]
14:39:29ragu|m quits [*.net *.split]
14:39:29MinePlayersPEMyNey|m quits [*.net *.split]
14:39:29Thibaultmol quits [*.net *.split]
14:39:29nstrom|m quits [*.net *.split]
14:39:29Hans5958 quits [*.net *.split]
14:39:29theblazehen|m quits [*.net *.split]
14:39:29rewby|m quits [*.net *.split]
14:39:29mpeter|m quits [*.net *.split]
14:39:29tomodachi94 quits [*.net *.split]
14:39:30vokunal|m quits [*.net *.split]
14:39:30audrooku|m quits [*.net *.split]
14:39:30Maakuth|m quits [*.net *.split]
14:39:30xxia|m quits [*.net *.split]
14:39:30cmostracker|m quits [*.net *.split]
14:39:30britmob|m quits [*.net *.split]
14:39:30andrewvieyra|m quits [*.net *.split]
14:39:30mind_combatant quits [*.net *.split]
14:39:30@Sanqui|m quits [*.net *.split]
14:39:30Ajay quits [*.net *.split]
14:39:30igneousx quits [*.net *.split]
14:39:30Exorcism_ quits [*.net *.split]
14:39:30BigBrain_ quits [*.net *.split]
14:39:30sec^nd quits [*.net *.split]
14:39:30Megame quits [*.net *.split]
14:39:30railen63 quits [*.net *.split]
14:39:30treora quits [*.net *.split]
14:39:30AmAnd0A quits [*.net *.split]
14:39:30decky_e quits [*.net *.split]
14:39:30Minkafighter52531 quits [*.net *.split]
14:39:30jtagcat quits [*.net *.split]
14:39:30lun4 quits [*.net *.split]
14:39:30BPCZ quits [*.net *.split]
14:39:30decagon__ quits [*.net *.split]
14:39:30tertu quits [*.net *.split]
14:39:30HP_Archivist quits [*.net *.split]
14:39:30pseudorizer quits [*.net *.split]
14:39:30qwertyasdfuiopghjkl quits [*.net *.split]
14:39:30sfsefse quits [*.net *.split]
14:39:30VerifiedJ quits [*.net *.split]
14:39:30ThreeHM_ quits [*.net *.split]
14:39:30@OrIdow6 quits [*.net *.split]
14:39:30ArchivalEfforts quits [*.net *.split]
14:39:30Aoede quits [*.net *.split]
14:39:30JTL quits [*.net *.split]
14:39:30PredatorIWD quits [*.net *.split]
14:39:30datechnoman quits [*.net *.split]
14:39:30xarph quits [*.net *.split]
14:39:30nic quits [*.net *.split]
14:39:30shreyasminocha quits [*.net *.split]
14:39:30thehedgeh0g quits [*.net *.split]
14:39:30evan quits [*.net *.split]
14:39:30mindstrut1 quits [*.net *.split]
14:39:30nfriedly quits [*.net *.split]
14:39:30thuban quits [*.net *.split]
14:39:30gfhh quits [*.net *.split]
14:39:30wyatt8740 quits [*.net *.split]
14:39:30pie_ quits [*.net *.split]
14:39:30driib quits [*.net *.split]
14:39:30systwi quits [*.net *.split]
14:39:30Carnildo quits [*.net *.split]
14:39:30kiskaLogBot quits [*.net *.split]
14:39:30DLoader quits [*.net *.split]
14:39:30Bleo quits [*.net *.split]
14:39:30benjins quits [*.net *.split]
14:39:30appledash quits [*.net *.split]
14:39:31lennier1 quits [*.net *.split]
14:39:31@AlsoJAA quits [*.net *.split]
14:39:31FireFly quits [*.net *.split]
14:39:31sknebel quits [*.net *.split]
14:39:31ThetaDev quits [*.net *.split]
14:39:31Sluggs quits [*.net *.split]
14:39:31CraftByte quits [*.net *.split]
14:39:31Hecz quits [*.net *.split]
14:39:31fredgido quits [*.net *.split]
14:39:31Letur quits [*.net *.split]
14:39:31threedeeitguy3 quits [*.net *.split]
14:39:31MetaNova quits [*.net *.split]
14:39:31TheTechRobo quits [*.net *.split]
14:39:31siinus quits [*.net *.split]
14:39:31mcint quits [*.net *.split]
14:39:31Shampoo2140 quits [*.net *.split]
14:39:31rubberduckie quits [*.net *.split]
14:39:31plcp quits [*.net *.split]
14:39:31yasom1 quits [*.net *.split]
14:39:31le0n quits [*.net *.split]
14:39:31h3ndr1k quits [*.net *.split]
14:39:31CandidSparrow quits [*.net *.split]
14:39:31IDK_ quits [*.net *.split]
14:39:31mgrytbak quits [*.net *.split]
14:39:31aGerman quits [*.net *.split]
14:39:31Perk quits [*.net *.split]
14:39:31Barto quits [*.net *.split]
14:39:31itachi1706 quits [*.net *.split]
14:39:31project10 quits [*.net *.split]
14:39:31klg quits [*.net *.split]
14:39:31albertlarsan68 quits [*.net *.split]
14:39:31kiska quits [*.net *.split]
14:39:31s-crypt quits [*.net *.split]
14:39:31Ryz26 quits [*.net *.split]
14:39:31nickofnicks quits [*.net *.split]
14:39:31szczot3k quits [*.net *.split]
14:39:31@arkiver quits [*.net *.split]
14:39:31@rewby quits [*.net *.split]
14:39:31SF quits [*.net *.split]
14:39:31jasons quits [*.net *.split]
14:39:31murb quits [*.net *.split]
14:39:31coderobe quits [*.net *.split]
14:39:31cultpony quits [*.net *.split]
14:39:31rohvani quits [*.net *.split]
14:39:31DopefishJustin quits [*.net *.split]
14:39:31empress quits [*.net *.split]
14:39:31Exorcism|TheLounge quits [*.net *.split]
14:39:31razul quits [*.net *.split]
14:39:31JensRex quits [*.net *.split]
14:39:31adamus1red quits [*.net *.split]
14:39:31Gaelan quits [*.net *.split]
14:39:31DigitalDragons quits [*.net *.split]
14:39:31maxfan8_ quits [*.net *.split]
14:39:31nimaje quits [*.net *.split]
14:39:31Elizabeth quits [*.net *.split]
14:39:31justcool393 quits [*.net *.split]
14:39:31Irenes quits [*.net *.split]
14:39:31dan- quits [*.net *.split]
14:39:31seadog007 quits [*.net *.split]
14:39:31@rewby|backup quits [*.net *.split]
14:39:31todb quits [*.net *.split]
14:39:32dx quits [*.net *.split]
14:39:32murmur quits [*.net *.split]
14:39:32VonGuard quits [*.net *.split]
14:39:32JSharp quits [*.net *.split]
14:39:32jonty quits [*.net *.split]
14:39:32russss quits [*.net *.split]
14:39:32Ctrl-S quits [*.net *.split]
14:39:32ghuntley quits [*.net *.split]
14:39:32thejsa quits [*.net *.split]
14:39:32mgrandi quits [*.net *.split]
14:39:32qxtal quits [*.net *.split]
14:39:32zifnab06 quits [*.net *.split]
14:39:32devsnek quits [*.net *.split]
14:46:11Exorcism_ (exorcism) joins
14:46:11BigBrain_ (bigbrain) joins
14:46:11sec^nd (second) joins
14:57:07DogsRNice_ joins
14:57:07Island joins
14:57:07Megame (Megame) joins
14:57:07railen63 joins
14:57:07treora joins
14:57:07AmAnd0A joins
14:57:07decky_e joins
14:57:07Minkafighter52531 joins
14:57:07jtagcat (jtagcat) joins
14:57:07lun4 (lun4) joins
14:57:07BPCZ (BPCZ) joins
14:57:07decagon__ joins
14:57:07tertu (tertu) joins
14:57:07HP_Archivist (HP_Archivist) joins
14:57:07pseudorizer (pseudorizer) joins
14:57:07qwertyasdfuiopghjkl (qwertyasdfuiopghjkl) joins
14:57:07sfsefse joins
14:57:07VerifiedJ (VerifiedJ) joins
14:57:07ThreeHM_ (ThreeHeadedMonkey) joins
14:57:07OrIdow6 (OrIdow6) joins
14:57:07ArchivalEfforts joins
14:57:07Aoede (Aoede) joins
14:57:07JTL (jtl) joins
14:57:07PredatorIWD joins
14:57:07datechnoman (datechnoman) joins
14:57:07xarph joins
14:57:07nic (nic) joins
14:57:07thehedgeh0g (mrHedgehog0) joins
14:57:07shreyasminocha (shreyasminocha) joins
14:57:07evan joins
14:57:07mindstrut1 joins
14:57:07nfriedly joins
14:57:07thuban joins
14:57:07gfhh joins
14:57:07wyatt8740 joins
14:57:07pie_ joins
14:57:07driib (driib) joins
14:57:07systwi (systwi) joins
14:57:07Carnildo joins
14:57:07kiskaLogBot joins
14:57:07DLoader joins
14:57:07Bleo joins
14:57:07benjins (benjins) joins
14:57:07appledash joins
14:57:07AlsoJAA (JAA) joins
14:57:07ing.hackint.org sets mode: +oo OrIdow6 AlsoJAA
14:57:07lennier1 (lennier1) joins
14:57:07FireFly joins
14:57:07sknebel (sknebel) joins
14:57:07ThetaDev joins
14:57:07Sluggs joins
14:57:07CraftByte (DragonSec|CraftByte) joins
14:57:07Hecz (Hecz) joins
14:57:07fredgido (fredgido) joins
14:57:07Letur joins
14:57:07threedeeitguy3 (threedeeitguy) joins
14:57:07MetaNova (MetaNova) joins
14:57:07TheTechRobo (TheTechRobo) joins
14:57:07siinus (siinus) joins
14:57:07mcint joins
14:57:07Shampoo2140 joins
14:57:07itachi1706 (itachi1706) joins
14:57:07plcp joins
14:57:07yasom1 (yasomi) joins
14:57:07le0n (le0n) joins
14:57:07h3ndr1k (h3ndr1k) joins
14:57:07szczot3k (szczot3k) joins
14:57:07CandidSparrow joins
14:57:07IDK_ joins
14:57:07mgrytbak joins
14:57:07aGerman (aGerman) joins
14:57:07Perk joins
14:57:07Barto (Barto) joins
14:57:07project10 (project10) joins
14:57:07klg (klg) joins
14:57:07albertlarsan68 (AlbertLarsan68) joins
14:57:07kiska (kiska) joins
14:57:07s-crypt (s-crypt) joins
14:57:07Ryz26 (Ryz) joins
14:57:07nickofnicks (nickofnicks) joins
14:57:07arkiver (arkiver) joins
14:57:07rewby (rewby) joins
14:57:07SF joins
14:57:07jasons (jasons) joins
14:57:07murb (murb) joins
14:57:07coderobe (coderobe) joins
14:57:07cultpony (cultpony) joins
14:57:07rohvani joins
14:57:07DopefishJustin (DopefishJustin) joins
14:57:07empress (empress) joins
14:57:07Exorcism|TheLounge (exorcism) joins
14:57:07ing.hackint.org sets mode: +oo arkiver rewby
14:57:07razul joins
14:57:07JensRex (JensRex) joins
14:57:07adamus1red (adamus1red) joins
14:57:07Gaelan (Gaelan) joins
14:57:07DigitalDragons (DigitalDragons) joins
14:57:07maxfan8_ (maxfan8) joins
14:57:07nimaje joins
14:57:07Elizabeth (Elizabeth) joins
14:57:07jonty (jonty) joins
14:57:07justcool393 (justcool393) joins
14:57:07dx joins
14:57:07Irenes (ireneista) joins
14:57:07dan- (dan-) joins
14:57:07seadog007 (seadog007) joins
14:57:07rewby|backup (rewby) joins
14:57:07todb joins
14:57:07murmur joins
14:57:07VonGuard joins
14:57:07JSharp (JSharp) joins
14:57:07russss (russss) joins
14:57:07Ctrl-S joins
14:57:07ghuntley (ghuntley) joins
14:57:07thejsa joins
14:57:07mgrandi (mgrandi) joins
14:57:07qxtal (qxtal) joins
14:57:07zifnab06 joins
14:57:07devsnek (devsnek) joins
14:57:07ing.hackint.org sets mode: +o rewby|backup
14:57:08nulldata quits [Max SendQ exceeded]
14:57:37nulldata (nulldata) joins
14:58:47etnguyen03 (etnguyen03) joins
15:03:07DigitalDragon (DigitalDragon) joins
15:03:07sonst-was|m joins
15:03:07yzqzss (yzqzss) joins
15:03:07iCesenberk|m joins
15:03:07AntoninDelFabbro|m joins
15:03:07M--mlv|m joins
15:03:07qyxojzh|m joins
15:03:07qq44|m joins
15:03:07alexshpilkin joins
15:03:07Misty|m joins
15:03:07username675f|m joins
15:03:07nosamu|m joins
15:03:07ram|m joins
15:03:07Peetz0r|m joins
15:03:07EmeraldSnorlax|m joins
15:03:07marius851000 joins
15:03:07kaz__|m joins
15:03:07Passiing|m joins
15:03:07noxious joins
15:03:07EvanBoehs|m joins
15:03:07flashfire42|m joins
15:03:07coro joins
15:03:07phaeton (phaeton) joins
15:03:07Video joins
15:03:07yetanotherarchiver|m joins
15:03:07noobirc|m joins
15:03:07cmostracker|m joins
15:03:07gungagungagunga|m joins
15:03:07Tom|m1 joins
15:03:07trumad|m joins
15:03:07Roki_100|m joins
15:03:07Cydog|m joins
15:03:07s-crypt|m joins
15:03:07Max|m12 joins
15:03:07jwoglom|m joins
15:03:07superusercode (superusercode) joins
15:03:07nyuuzyou (nyuuzyou) joins
15:03:07vexr joins
15:03:07wrangle|m joins
15:03:07moe-a-m|m joins
15:03:07vokunal|m joins
15:03:07Hans5958 (Hans5958) joins
15:03:07will|m joins
15:03:07gwetchen|m joins
15:03:07CrispyAlice2 (CrispyAlice2) joins
15:03:07dieserniko|m joins
15:03:07voltagex|m joins
15:03:07Fletcher (Fletcher) joins
15:03:07tomodachi94 (tomodachi94) joins
15:03:07manu|m joins
15:03:07Thibaultmol joins
15:03:07finalti|m joins
15:03:07lasdkfj|m joins
15:03:07GRBaset (GRBaset) joins
15:03:07Froxcey|m joins
15:03:07masterx244|m joins
15:03:07akaibu|m joins
15:03:07NickS|m joins
15:03:07igneousx (igneousx) joins
15:03:07Ajay joins
15:03:07audrooku|m joins
15:03:07britmob|m joins
15:03:07ragu|m joins
15:03:07Maakuth|m joins
15:03:07madpro|m joins
15:03:07x9fff00 (x9fff00) joins
15:03:07jackt1365|m joins
15:03:07schwarzkatz|m joins
15:03:07t3chler|m joins
15:03:07haha-whered-it-go|m joins
15:03:07saouroun|m joins
15:03:07mind_combatant joins
15:03:07nstrom|m joins
15:03:07theblazehen|m joins
15:03:07andrewvieyra|m joins
15:03:07hlgs|m joins
15:03:07xxia|m joins
15:03:07mpeter|m joins
15:03:07thermospheric (Thermospheric) joins
15:03:07mikolaj|m joins
15:03:07Ruk8 (Ruk8) joins
15:03:07MinePlayersPEMyNey|m joins
15:03:07tech234a|m joins
15:03:07pannekoek11|m joins
15:03:07joepie91|m joins
15:03:07Sanqui|m (Sanqui) joins
15:03:07rewby|m joins
15:03:07ing.hackint.org sets mode: +o Sanqui|m
15:05:07HP_Archivist quits [Ping timeout: 265 seconds]
16:02:24DigitalDragon quits [*.net *.split]
16:02:24sonst-was|m quits [*.net *.split]
16:02:24yzqzss quits [*.net *.split]
16:02:24iCesenberk|m quits [*.net *.split]
16:02:25AntoninDelFabbro|m quits [*.net *.split]
16:02:25qyxojzh|m quits [*.net *.split]
16:02:25qq44|m quits [*.net *.split]
16:02:25alexshpilkin quits [*.net *.split]
16:02:25Misty|m quits [*.net *.split]
16:02:25nosamu|m quits [*.net *.split]
16:02:25username675f|m quits [*.net *.split]
16:02:25ram|m quits [*.net *.split]
16:02:25Peetz0r|m quits [*.net *.split]
16:02:25EmeraldSnorlax|m quits [*.net *.split]
16:02:25marius851000 quits [*.net *.split]
16:02:25kaz__|m quits [*.net *.split]
16:02:25Passiing|m quits [*.net *.split]
16:02:25noxious quits [*.net *.split]
16:02:25EvanBoehs|m quits [*.net *.split]
16:02:25trumad|m quits [*.net *.split]
16:02:25NickS|m quits [*.net *.split]
16:02:25haha-whered-it-go|m quits [*.net *.split]
16:02:25joepie91|m quits [*.net *.split]
16:02:25yetanotherarchiver|m quits [*.net *.split]
16:02:25lasdkfj|m quits [*.net *.split]
16:02:25superusercode quits [*.net *.split]
16:02:25noobirc|m quits [*.net *.split]
16:02:25GRBaset quits [*.net *.split]
16:02:25nyuuzyou quits [*.net *.split]
16:02:25Cydog|m quits [*.net *.split]
16:02:25will|m quits [*.net *.split]
16:02:25pannekoek11|m quits [*.net *.split]
16:02:25jwoglom|m quits [*.net *.split]
16:02:26akaibu|m quits [*.net *.split]
16:02:26Ruk8 quits [*.net *.split]
16:02:26dieserniko|m quits [*.net *.split]
16:02:26coro quits [*.net *.split]
16:02:26gwetchen|m quits [*.net *.split]
16:02:26x9fff00 quits [*.net *.split]
16:02:26hlgs|m quits [*.net *.split]
16:02:26thermospheric quits [*.net *.split]
16:02:26phaeton quits [*.net *.split]
16:02:26Video quits [*.net *.split]
16:02:26Max|m12 quits [*.net *.split]
16:02:26masterx244|m quits [*.net *.split]
16:02:26voltagex|m quits [*.net *.split]
16:02:26mikolaj|m quits [*.net *.split]
16:02:26madpro|m quits [*.net *.split]
16:02:26t3chler|m quits [*.net *.split]
16:02:26wrangle|m quits [*.net *.split]
16:02:26tech234a|m quits [*.net *.split]
16:02:26Roki_100|m quits [*.net *.split]
16:02:27M--mlv|m quits [*.net *.split]
16:02:27gungagungagunga|m quits [*.net *.split]
16:02:27finalti|m quits [*.net *.split]
16:02:27jackt1365|m quits [*.net *.split]
16:02:27saouroun|m quits [*.net *.split]
16:02:27moe-a-m|m quits [*.net *.split]
16:02:27schwarzkatz|m quits [*.net *.split]
16:02:27vexr quits [*.net *.split]
16:02:27Froxcey|m quits [*.net *.split]
16:02:27Tom|m1 quits [*.net *.split]
16:02:27flashfire42|m quits [*.net *.split]
16:02:27manu|m quits [*.net *.split]
16:02:27CrispyAlice2 quits [*.net *.split]
16:02:27s-crypt|m quits [*.net *.split]
16:02:28Fletcher quits [*.net *.split]
16:02:28ragu|m quits [*.net *.split]
16:02:28MinePlayersPEMyNey|m quits [*.net *.split]
16:02:28Thibaultmol quits [*.net *.split]
16:02:28nstrom|m quits [*.net *.split]
16:02:28Hans5958 quits [*.net *.split]
16:02:28theblazehen|m quits [*.net *.split]
16:02:28rewby|m quits [*.net *.split]
16:02:28mpeter|m quits [*.net *.split]
16:02:28tomodachi94 quits [*.net *.split]
16:02:28vokunal|m quits [*.net *.split]
16:02:28audrooku|m quits [*.net *.split]
16:02:28Maakuth|m quits [*.net *.split]
16:02:28xxia|m quits [*.net *.split]
16:02:28cmostracker|m quits [*.net *.split]
16:02:28britmob|m quits [*.net *.split]
16:02:28andrewvieyra|m quits [*.net *.split]
16:02:28mind_combatant quits [*.net *.split]
16:02:28@Sanqui|m quits [*.net *.split]
16:02:28Ajay quits [*.net *.split]
16:02:28igneousx quits [*.net *.split]
16:04:53HP_Archivist (HP_Archivist) joins
16:05:14rewby|m joins
16:05:14Sanqui|m (Sanqui) joins
16:05:14joepie91|m joins
16:05:14pannekoek11|m joins
16:05:14tech234a|m joins
16:05:14MinePlayersPEMyNey|m joins
16:05:14Ruk8 (Ruk8) joins
16:05:14mikolaj|m joins
16:05:14thermospheric (Thermospheric) joins
16:05:14mpeter|m joins
16:05:14xxia|m joins
16:05:14hlgs|m joins
16:05:14andrewvieyra|m joins
16:05:14theblazehen|m joins
16:05:14nstrom|m joins
16:05:14mind_combatant joins
16:05:14saouroun|m joins
16:05:14haha-whered-it-go|m joins
16:05:14t3chler|m joins
16:05:14schwarzkatz|m joins
16:05:14jackt1365|m joins
16:05:14x9fff00 (x9fff00) joins
16:05:14madpro|m joins
16:05:14Maakuth|m joins
16:05:14ragu|m joins
16:05:14britmob|m joins
16:05:14audrooku|m joins
16:05:14Ajay joins
16:05:14igneousx (igneousx) joins
16:05:14NickS|m joins
16:05:14akaibu|m joins
16:05:14masterx244|m joins
16:05:14Froxcey|m joins
16:05:14GRBaset (GRBaset) joins
16:05:14lasdkfj|m joins
16:05:14finalti|m joins
16:05:14Thibaultmol joins
16:05:14manu|m joins
16:05:14tomodachi94 (tomodachi94) joins
16:05:14Fletcher (Fletcher) joins
16:05:14voltagex|m joins
16:05:14dieserniko|m joins
16:05:14CrispyAlice2 (CrispyAlice2) joins
16:05:14gwetchen|m joins
16:05:14will|m joins
16:05:14ing.hackint.org sets mode: +o Sanqui|m
16:05:14Hans5958 (Hans5958) joins
16:05:14vokunal|m joins
16:05:15moe-a-m|m joins
16:05:15wrangle|m joins
16:05:15vexr joins
16:05:15nyuuzyou (nyuuzyou) joins
16:05:15superusercode (superusercode) joins
16:05:15jwoglom|m joins
16:05:15Max|m12 joins
16:05:15s-crypt|m joins
16:05:15Cydog|m joins
16:05:15Roki_100|m joins
16:05:15trumad|m joins
16:05:15Tom|m1 joins
16:05:15gungagungagunga|m joins
16:05:15cmostracker|m joins
16:05:15noobirc|m joins
16:05:15yetanotherarchiver|m joins
16:05:15Video joins
16:05:15phaeton (phaeton) joins
16:05:15coro joins
16:05:15flashfire42|m joins
16:05:15EvanBoehs|m joins
16:05:15noxious joins
16:05:15Passiing|m joins
16:05:15kaz__|m joins
16:05:15marius851000 joins
16:05:15EmeraldSnorlax|m joins
16:05:15Peetz0r|m joins
16:05:15ram|m joins
16:05:15nosamu|m joins
16:05:15username675f|m joins
16:05:15Misty|m joins
16:05:15alexshpilkin joins
16:05:15qq44|m joins
16:05:15qyxojzh|m joins
16:05:15M--mlv|m joins
16:05:15AntoninDelFabbro|m joins
16:05:15iCesenberk|m joins
16:05:15yzqzss (yzqzss) joins
16:05:15sonst-was|m joins
16:05:15DigitalDragon (DigitalDragon) joins
16:05:35dumbgoy_ joins
16:17:06DopefishJustin quits [Remote host closed the connection]
16:18:17nicolas17 joins
16:19:49<nicolas17>download interrupted for 46GiB .tar.bz2 from yahoo videos :( at least the others seem to be still going well
16:22:01<@arkiver>nicolas17: Wget allows resuming downloads
16:22:14<@arkiver>and IA allows download a range of bytes
16:22:31<@arkiver>downloading*
16:22:48<nicolas17>arkiver: I'm using "curl | tar tv", but I'll switch to wget which I *think* will auto-resume on errors even when outputting to stdout
16:23:21<@arkiver>right, within in the same Wget process it might
16:23:36<fireonlive>would be interesting to know
16:24:05<nicolas17>for this one I can't "wget -c" now because there's no file to resume from
16:24:56<nicolas17>I think I like the wget progress indicator better anyway :p
16:25:03<fireonlive>me toooooo
16:25:17<fireonlive>wish i could shove that into curl
16:27:04<nicolas17>there is "curl --progress-bar" to get a... bar, but it only shows % and no throughput or MiB or ETA
16:27:21<fireonlive>:(
16:32:36abirkill (abirkill) joins
16:33:12<nicolas17>Length: 484259014419 (451G) [application/octet-stream]
16:33:14<nicolas17>yikes
16:34:36<fireonlive>ooof lol
16:34:52<fireonlive>that’ll take a second
16:35:11<nicolas17>110.20M 907KB/s eta 6d 14h
16:35:34FireFly . o O ( if it takes a second that's some _very_ impressive downlink (and uplink) :p )
16:37:20<@arkiver>you could split it up in pieces and download concurrently using the bytes ranges
16:38:27<nicolas17>arkiver: that would require 451GB of disk space ;) I'm piping into tar -tv
16:38:28<fireonlive>FireFly: :P
16:52:27DopefishJustin joins
17:00:49HP_Archivist quits [Client Quit]
17:08:47icedice (icedice) joins
17:32:32DigitalDragon quits [*.net *.split]
17:32:32sonst-was|m quits [*.net *.split]
17:32:32yzqzss quits [*.net *.split]
17:32:32iCesenberk|m quits [*.net *.split]
17:32:33AntoninDelFabbro|m quits [*.net *.split]
17:32:33qyxojzh|m quits [*.net *.split]
17:32:33qq44|m quits [*.net *.split]
17:32:33alexshpilkin quits [*.net *.split]
17:32:33Misty|m quits [*.net *.split]
17:32:33nosamu|m quits [*.net *.split]
17:32:33username675f|m quits [*.net *.split]
17:32:33ram|m quits [*.net *.split]
17:32:33Peetz0r|m quits [*.net *.split]
17:32:33EmeraldSnorlax|m quits [*.net *.split]
17:32:33marius851000 quits [*.net *.split]
17:32:33kaz__|m quits [*.net *.split]
17:32:33Passiing|m quits [*.net *.split]
17:32:33noxious quits [*.net *.split]
17:32:33EvanBoehs|m quits [*.net *.split]
17:32:33trumad|m quits [*.net *.split]
17:32:33NickS|m quits [*.net *.split]
17:32:33haha-whered-it-go|m quits [*.net *.split]
17:32:33joepie91|m quits [*.net *.split]
17:32:33yetanotherarchiver|m quits [*.net *.split]
17:32:33lasdkfj|m quits [*.net *.split]
17:32:33superusercode quits [*.net *.split]
17:32:33noobirc|m quits [*.net *.split]
17:32:33GRBaset quits [*.net *.split]
17:32:33nyuuzyou quits [*.net *.split]
17:32:34Cydog|m quits [*.net *.split]
17:32:34will|m quits [*.net *.split]
17:32:34pannekoek11|m quits [*.net *.split]
17:32:34jwoglom|m quits [*.net *.split]
17:32:34akaibu|m quits [*.net *.split]
17:32:34Ruk8 quits [*.net *.split]
17:32:34dieserniko|m quits [*.net *.split]
17:32:34coro quits [*.net *.split]
17:32:34gwetchen|m quits [*.net *.split]
17:32:35x9fff00 quits [*.net *.split]
17:32:35hlgs|m quits [*.net *.split]
17:32:35thermospheric quits [*.net *.split]
17:32:35phaeton quits [*.net *.split]
17:32:35Video quits [*.net *.split]
17:32:35Max|m12 quits [*.net *.split]
17:32:35masterx244|m quits [*.net *.split]
17:32:35voltagex|m quits [*.net *.split]
17:32:35mikolaj|m quits [*.net *.split]
17:32:35madpro|m quits [*.net *.split]
17:32:35t3chler|m quits [*.net *.split]
17:32:35wrangle|m quits [*.net *.split]
17:32:35tech234a|m quits [*.net *.split]
17:32:35Roki_100|m quits [*.net *.split]
17:32:35M--mlv|m quits [*.net *.split]
17:32:35gungagungagunga|m quits [*.net *.split]
17:32:35finalti|m quits [*.net *.split]
17:32:35jackt1365|m quits [*.net *.split]
17:32:35saouroun|m quits [*.net *.split]
17:32:35moe-a-m|m quits [*.net *.split]
17:32:35schwarzkatz|m quits [*.net *.split]
17:32:36vexr quits [*.net *.split]
17:32:36Froxcey|m quits [*.net *.split]
17:32:36Tom|m1 quits [*.net *.split]
17:32:36flashfire42|m quits [*.net *.split]
17:32:36manu|m quits [*.net *.split]
17:32:36CrispyAlice2 quits [*.net *.split]
17:32:36s-crypt|m quits [*.net *.split]
17:32:36Fletcher quits [*.net *.split]
17:32:36ragu|m quits [*.net *.split]
17:32:36MinePlayersPEMyNey|m quits [*.net *.split]
17:32:36Thibaultmol quits [*.net *.split]
17:32:36nstrom|m quits [*.net *.split]
17:32:36Hans5958 quits [*.net *.split]
17:32:36theblazehen|m quits [*.net *.split]
17:32:36rewby|m quits [*.net *.split]
17:32:36mpeter|m quits [*.net *.split]
17:32:36tomodachi94 quits [*.net *.split]
17:32:36vokunal|m quits [*.net *.split]
17:32:36audrooku|m quits [*.net *.split]
17:32:36Maakuth|m quits [*.net *.split]
17:32:36xxia|m quits [*.net *.split]
17:32:36cmostracker|m quits [*.net *.split]
17:32:36britmob|m quits [*.net *.split]
17:32:36andrewvieyra|m quits [*.net *.split]
17:32:36mind_combatant quits [*.net *.split]
17:32:36@Sanqui|m quits [*.net *.split]
17:32:36Ajay quits [*.net *.split]
17:32:36igneousx quits [*.net *.split]
17:32:46DigitalDragon (DigitalDragon) joins
17:32:46sonst-was|m joins
17:32:46yzqzss (yzqzss) joins
17:32:46iCesenberk|m joins
17:32:46AntoninDelFabbro|m joins
17:32:46M--mlv|m joins
17:32:46qyxojzh|m joins
17:32:46qq44|m joins
17:32:46alexshpilkin joins
17:32:46Misty|m joins
17:32:46username675f|m joins
17:32:46nosamu|m joins
17:32:46ram|m joins
17:32:46Peetz0r|m joins
17:32:46EmeraldSnorlax|m joins
17:32:46marius851000 joins
17:32:46kaz__|m joins
17:32:46Passiing|m joins
17:32:46noxious joins
17:32:46EvanBoehs|m joins
17:32:46flashfire42|m joins
17:32:46coro joins
17:32:46phaeton (phaeton) joins
17:32:46Video joins
17:32:46yetanotherarchiver|m joins
17:32:46noobirc|m joins
17:32:46cmostracker|m joins
17:32:46gungagungagunga|m joins
17:32:46Tom|m1 joins
17:32:46trumad|m joins
17:32:46Roki_100|m joins
17:32:46Cydog|m joins
17:32:46s-crypt|m joins
17:32:46Max|m12 joins
17:32:46jwoglom|m joins
17:32:46superusercode (superusercode) joins
17:32:46nyuuzyou (nyuuzyou) joins
17:32:46vexr joins
17:32:46wrangle|m joins
17:32:46moe-a-m|m joins
17:32:46vokunal|m joins
17:32:46Hans5958 (Hans5958) joins
17:32:46will|m joins
17:32:46gwetchen|m joins
17:32:46CrispyAlice2 (CrispyAlice2) joins
17:32:46dieserniko|m joins
17:32:46voltagex|m joins
17:32:46Fletcher (Fletcher) joins
17:32:46tomodachi94 (tomodachi94) joins
17:32:46manu|m joins
17:32:46Thibaultmol joins
17:32:46finalti|m joins
17:32:46lasdkfj|m joins
17:32:46GRBaset (GRBaset) joins
17:32:46Froxcey|m joins
17:32:46masterx244|m joins
17:32:46akaibu|m joins
17:32:46NickS|m joins
17:32:46igneousx (igneousx) joins
17:32:46Ajay joins
17:32:46audrooku|m joins
17:32:46britmob|m joins
17:32:46ragu|m joins
17:32:46Maakuth|m joins
17:32:46madpro|m joins
17:32:46x9fff00 (x9fff00) joins
17:32:46jackt1365|m joins
17:32:46schwarzkatz|m joins
17:32:46t3chler|m joins
17:32:46haha-whered-it-go|m joins
17:32:46saouroun|m joins
17:32:46mind_combatant joins
17:32:46nstrom|m joins
17:32:46theblazehen|m joins
17:32:46andrewvieyra|m joins
17:32:46hlgs|m joins
17:32:46xxia|m joins
17:32:46mpeter|m joins
17:32:46thermospheric (Thermospheric) joins
17:32:46mikolaj|m joins
17:32:46Ruk8 (Ruk8) joins
17:32:46MinePlayersPEMyNey|m joins
17:32:46tech234a|m joins
17:32:46pannekoek11|m joins
17:32:46joepie91|m joins
17:32:46Sanqui|m (Sanqui) joins
17:32:46rewby|m joins
17:32:46ing.hackint.org sets mode: +o Sanqui|m
17:33:19Megame quits [Read error: Connection reset by peer]
17:40:56<nicolas17>it could be interesting to make a tool that does multithreaded downloads on smaller chunks and outputs them to stdout as they finish
17:44:16<FireFly>with some kind of container so they can be rearranged and reassembled afterward? (or synchronisation to make sure they're output in-order?)
17:44:36<nicolas17>yeah internal buffering and output in order
17:45:07<FireFly>yeah could be interesting
17:45:57<@JAA>Basically a reverse ia-upload-stream. It does exactly that, just in the other direction (reading from stdin, uploading in chunks in parallel in order).
17:46:24<nicolas17>JAA: you mentioned chunked uploads to IA have drawbacks, right?
17:46:41<@JAA>Yeah, the processing on IA's side is inefficient.
17:47:14<@JAA>It copies the chunks to the backup server, then assembles them in a separate task and copies the assembled file over again.
17:47:53<@JAA>And because that's always a separate task, snowballing doesn't work well for uploading multiple files to the same item.
17:48:10<@JAA>Neither of this should affect chunked downloads, of course.
17:51:49<nicolas17>hm
17:52:03<nicolas17>if I upload a file to an existing item, it goes to the same server as the other files, right?
17:52:39<@JAA>Yes
17:53:14<@JAA>An entire item is always on a single server (plus its mirror at the other facility). Even on a single disk in that server, I think.
17:53:21<@JAA>Or well, single FS at least.
17:53:34<nicolas17>what happens if I upload multiple files, in parallel, targeting the same non-existent item name? will they end up in the same server? when is the server "assigned" to an item?
17:53:35<@JAA>Maybe there's some RAID in place, no idea.
17:54:10<@JAA>You can't. All but one upload will fail with some weird error message IIRC.
17:54:18<nicolas17>well that's good to know
17:54:37<nicolas17>I have uploaded multiple files in parallel to get better speed
17:54:42<nicolas17>which worked great
17:54:51<nicolas17>good to know I shouldn't do that for the *first* file...
17:55:15<@JAA>Yeah, at least one upload has to be done individually, afterwards you can go parallel, even if the archive.php task for that first upload hasn't run yet I believe.
17:55:37<@JAA>But it's also worth mentioning that IA generally discourages parallel uploads to individual items.
17:57:04<nicolas17>why?
17:57:23<nicolas17>too much load on a single server?
17:59:20<@JAA>I believe it has to do with task limits. I.e. you're more likely to run into rate limiting errors.
17:59:41<nicolas17>ah
17:59:51<nicolas17>that may be more relevant if it was hundreds of files I guess?
18:00:21<nicolas17>I was uploading like, 5 files, each of them >1GB
18:01:14<@JAA>Yeah, or at least several dozen.
18:01:30<nicolas17>with IA's current ingestion problems I would probably upload one at a time and let it take as long as it wants tho... don't add to the problem ^^
18:01:44<@JAA>Agreed
18:01:58<nicolas17>even if I have 3Mbps upstream
18:11:08etnguyen03 quits [Ping timeout: 252 seconds]
18:17:58DogsRNice_ quits [Client Quit]
18:18:01DogsRNice_ joins
18:42:59<fireonlive>in theory, would it be possible to, say, take all (wiki)pages that have an infobox and pull attributes from them onto a page? e.g. 'every infobox's IRC channel'
18:43:29<@JAA>Anything is possible!
18:43:54<@JAA>Retrieving the page contents is easy enough. But then you have to parse MediaWiki syntax probably...
18:44:00<fireonlive>the eldritch horror of mediawiki :D
18:45:38<fireonlive>oh! i meant to ping you JAA - there's a page I can't quite edit: https://wiki.archiveteam.org/index.php?title=Main_Page&action=edit
18:45:48<fireonlive>"Monday, Nov. 09, 2009"
18:46:01<fireonlive>no rushy :3
18:47:28<@JAA>Yup, protected page.
18:47:42<fireonlive>ye, bad phrasing
18:47:53<fireonlive>could you please datetime-ify that for me =]
18:48:18<@JAA>Ah
18:48:23Typo joins
18:48:56Typo quits [Remote host closed the connection]
18:49:34<h2ibot>JustAnotherArchivist edited Main Page (+10, Datetimeify): https://wiki.archiveteam.org/?diff=50720&oldid=48497
18:49:50<fireonlive>:D thanks
19:08:40jacksonchen666 (jacksonchen666) joins
19:11:01Exorcism_ quits [Client Quit]
19:27:33AmAnd0A quits [Read error: Connection reset by peer]
19:27:46AmAnd0A joins
20:20:18erkinalp joins
20:25:58Jake quits [Quit: Ping timeout (120 seconds)]
20:26:06qwertyasdfuiopghjkl quits [Remote host closed the connection]
20:26:16qwertyasdfuiopghjkl (qwertyasdfuiopghjkl) joins
20:31:20Jake (Jake) joins
20:36:20Jake quits [Ping timeout: 252 seconds]
20:46:41jacksonchen666 quits [Ping timeout: 245 seconds]
20:49:01Jake (Jake) joins
21:06:16etnguyen03 (etnguyen03) joins
21:08:51sfsefse quits [Remote host closed the connection]
21:45:19yasom1 quits [Ping timeout: 265 seconds]
21:48:05BlueMaxima joins
22:16:08Jake quits [Client Quit]
22:36:40Jake (Jake) joins
22:42:04<nicolas17>sooo any news on IA ingestion?
22:42:37<@JAA>Frame 6 of 6
22:42:54<nicolas17>x_x I know what you're referencing
22:43:18<nicolas17>I guess temp storage already has its hat on fire too
22:44:00icedice quits [Client Quit]
22:46:03<flashfire42|m>Most likely
22:46:10<@arkiver>nicolas17: there is internal progress on resolving it. it's not resolved yet
22:46:14<flashfire42|m>This is archiveteam what else do you expect
22:46:16<@arkiver>i don't have an ETA
22:46:34<@arkiver>i'm hoping within a month... but i don't know, i'm not the one handling this
22:46:37<nicolas17>that's fine
22:47:17<nicolas17>I'm not like "what's taking so long?!", more like "by any chance did I miss news while I was offline?"
22:47:43<nicolas17>do we have a month worth of temp storage? x_x
22:48:38<@JAA>Depends on if any urgent projects come up, probably. Without, we're not far away with the throttled projects. But getting #shreddit up again would be good and would change the equation.
22:49:13<flashfire42|m>Looks like #zowch isn’t happening then…..
22:49:19<@arkiver>it is happening
22:49:44<@arkiver>#zowch ^
22:50:15<@arkiver>nicolas17: completely understood! i had no negative (or necessarily positive) reading of your question
22:50:20<@arkiver>just a question, i answered :P
22:50:45<@arkiver>(reading back - may have come off as annoyed/harsh? not my intention)
22:50:47<nicolas17>a few days ago I complained because people saw #telegrab was idle and started adding items "to keep things busy"
22:50:52<@JAA>flashfire42|m: ZOWA is small enough to not be an issue.
22:51:25<@arkiver>nicolas17: if you have large lists of channels, feel free to pass them to me
22:51:37<flashfire42|m>Yeah that was my fault partially and I apologise for that Nicolas17
22:51:40<@arkiver>best is in the formats of channel:CHANNELNAME lines in a file, then I can queue it directly
22:52:43<nicolas17>flashfire42|m: yeah don't worry, you already apologized at the time
22:53:46<nicolas17>I was also a bit unsure if it's *really* such a big deal to add large channels like that
22:53:58<nicolas17>like *how* conservative should we be adding items? are we in "emergency mode - low capacity - only archive if it's truly at risk", or is that too extreme? :p
22:54:19<@arkiver>the rules were much more relaxed
22:54:39<@arkiver>then a ton of big news channels were put in, we added like 50 TB of youtube to IA for a few days
22:54:42<@arkiver>i noticed too late
22:55:14<nicolas17>arkiver: oh I was talking about telegram, a few days ago
22:55:31<@arkiver>and we got in trouble at IA. we're known as a trusted responsible organisation, and dumping 100s of TBs of youtube into IA of content that will likely not be deleted any time soon does not fit the "responsible" flag we have
22:55:39<@arkiver>oh
22:55:42<@arkiver>uh
22:57:02<flashfire42>Telegram items are a lot smaller but there were people including myself throwing in "busywork" so to speak. Stuff that could be useful but like also probably not super important. A few million crypto faucet items
22:57:26<flashfire42>I think nicolas17 is trying to ask what limits should be in place for that with the limited storage
22:57:41etnguyen03 quits [Ping timeout: 252 seconds]
22:57:50<flashfire42>I wont be adding anymore except for the ones I scrape off the wiki because we are at like 40 million to do as of right now.
22:59:11<nicolas17>arkiver: I was like "is that channel actually important to archive? or are we adding stuff just to keep workers busy? I don't think we need to 'stay busy' while we have limited capacity"
22:59:20<nicolas17>but it's not really my place to judge that if I don't even know how much capacity we have or how long it will take for IA issues to resolve
22:59:36<@arkiver>i just need to do those checks for reddit and we can restart
23:00:03<nicolas17>also, if I ask "is that item actually important" it's probably a genuine question and not judging that it's not important, maybe it is :)
23:00:17<flashfire42>Because yeah when we have the free flow telegram is a free for all but is it needed to be more selective right now for that project
23:01:47<nicolas17>my stats on telegram say: avg item 1.7MB, success rate 50.1% (completed ÷ dequeued), estimated data remaining in queue 34TB
23:02:22<@arkiver>not bad
23:02:50<@JAA>We have around 180 TiB of remaining offload capacity currently.
23:02:58<nicolas17>it's very hard to give an "ETA for queue empty" because it seems we're hitting target "max connections (-1)" errors, so the speed goes up and down a lot
23:04:32<nicolas17>imgur has so many items failing that I estimate like 1TB left lol
23:08:21<fireonlive>rip the i.imgur.com refuge
23:13:25<nicolas17>I started a telegram worker using a ramdisk for data, and it's now on request 5357 with 104MB of data total /o\
23:18:18<fireonlive>active channels go brrrrrrrrrrrrr
23:18:21wyatt8740 quits [Remote host closed the connection]
23:22:44wyatt8740 joins
23:23:01wyatt8740 quits [Client Quit]
23:24:03wyatt8740 joins
23:43:11sfsefse joins
23:57:31JayEmbee (JayEmbee) joins

HomeSearchPrevious dayNext day