HomeSearchPrevious dayNext day

00:16:26Jake quits [Client Quit]
00:17:24Jake (Jake) joins
00:25:09Jake quits [Client Quit]
00:36:00<pabs>Peroniko: ArchiveBot doesn't use IA IPs, so might be feasible to save via that if the site isn't massive
00:36:21<pabs>although if they are blocking IA, they would probably just request removal of the site IA too
00:36:40<Peroniko>I would say it's at least 5 million links
00:37:09<pabs>probably doable, what about in GB?
00:37:14<Peroniko>because they add releases of published music, labels, artist...
00:38:20<Peroniko>I would say pictures would be largest part, they don't allow cover pictures above 10MB, other parts of the site are light, because site still has the spirit of 2005 with some modern tech
00:40:20<Peroniko>I think i undersold it, checking now and only releases are coming up to 10 million pages, so 20 million should be closer to the end number of pages
00:43:01<pabs>there are AB jobs running right now that got more requests than that, 47 million is the largest
00:43:29<TheTechRobo>page requisites might be a problem though?
00:43:41<TheTechRobo>assuming 20 million doesn't include them
00:47:47<Peroniko>no, but it seems that only third party one are googletagmanager and their image CDN. Some of their CSS links are on the same CDN and but they seem to use inline style, so that should reduce number of links.
00:50:33Jake (Jake) joins
00:53:45Arcorann (Arcorann) joins
01:08:05etnguyen03 quits [Ping timeout: 265 seconds]
01:11:30Jake quits [Client Quit]
01:15:06qwertyasdfuiopghjkl (qwertyasdfuiopghjkl) joins
01:16:57etnguyen03 (etnguyen03) joins
01:17:03Jake (Jake) joins
01:29:24icedice quits [Client Quit]
01:57:17etnguyen03 quits [Ping timeout: 252 seconds]
02:23:11BearFortress joins
02:29:39<nicolas17>fireonlive arkiver: I found two more, YV-003900000-003999999.tar YV-009900000-009999999.tar YV-003200000-003213887.tar are all friendster stuff rather than yahoo videos
02:44:12etnguyen03 (etnguyen03) joins
03:00:51<h2ibot>TheTechRobo edited Current Projects (-121, Remove Ownlog from upcoming projects as it is dead): https://wiki.archiveteam.org/?diff=50777&oldid=50759
03:11:49dumbgoy quits [Ping timeout: 265 seconds]
03:58:59Peroniko quits [Client Quit]
04:06:46<thuban>did we ever get anything for ownlog, or should the status be changed to "lost"?
04:17:02HP_Archivist quits [Read error: Connection reset by peer]
04:17:31HP_Archivist (HP_Archivist) joins
04:20:17DogsRNice quits [Read error: Connection reset by peer]
04:22:24gurshjbcdf joins
04:22:35gurshjbcdf quits [Remote host closed the connection]
04:38:09Island quits [Read error: Connection reset by peer]
04:42:50etnguyen03 quits [Ping timeout: 252 seconds]
04:43:56etnguyen03 (etnguyen03) joins
04:54:02BlueMaxima joins
05:09:15<h2ibot>VoynichCr edited Svalbard Global Seed Vault (+50): https://wiki.archiveteam.org/?diff=50778&oldid=47903
05:12:28etnguyen03 quits [Client Quit]
05:19:08magmaus3 quits [Ping timeout: 252 seconds]
05:57:26nicolas17 quits [Client Quit]
06:37:35Dango360 quits [Read error: Connection reset by peer]
07:05:02Unholy236131661808515 quits [Remote host closed the connection]
07:06:33Unholy236131661808515 (Unholy2361) joins
07:27:59parfait quits [Ping timeout: 265 seconds]
08:16:28BlueMaxima quits [Read error: Connection reset by peer]
08:21:31testo05 joins
08:21:52testo05 quits [Remote host closed the connection]
08:41:30railen64 joins
08:41:58railen63 quits [Read error: Connection reset by peer]
08:51:41Jake quits [Client Quit]
09:22:09Jake (Jake) joins
09:33:14szczot3k quits [Ping timeout: 252 seconds]
09:54:26efeafewa quits [Ping timeout: 265 seconds]
10:00:02railen64 quits [Remote host closed the connection]
10:02:10railen64 joins
10:12:08driib quits [Quit: The Lounge - https://thelounge.chat]
10:12:11<plcp>pokechu22: thanks
10:12:31driib (driib) joins
10:21:35nulldata quits [Client Quit]
10:21:59nulldata (nulldata) joins
10:30:15<flashfire42>OI SOMEONE GIVE THE GITHUB PROJECT A TARGET
10:30:53<flashfire42>Trying target rsync://optane9.targets.atinfra.net:8892/ateam-airsync/:downloader/.
10:30:53<flashfire42>Could not find a target.
10:30:53<flashfire42>Could not get rsync target.
10:30:53<flashfire42>Failed to upload, retrying...
11:20:45icedice (icedice) joins
11:33:02icedice quits [Client Quit]
11:42:36BigBrain_ quits [Remote host closed the connection]
11:43:06BigBrain_ (bigbrain) joins
11:43:22sec^nd quits [Remote host closed the connection]
11:45:18sec^nd (second) joins
11:53:53BigBrain_ quits [Remote host closed the connection]
11:54:20BigBrain_ (bigbrain) joins
11:55:27pie_ quits []
11:55:29pie_ joins
12:00:05pie_ quits [Ping timeout: 252 seconds]
12:20:54pie_ joins
12:27:59icedice (icedice) joins
12:28:02icedice quits [Remote host closed the connection]
12:28:20icedice (icedice) joins
12:58:56Peroniko joins
13:03:32superkuh quits [Remote host closed the connection]
13:03:32apache2_ quits [Remote host closed the connection]
13:03:32apache2 joins
13:03:47superkuh joins
13:05:16etnguyen03 (etnguyen03) joins
14:05:21icedice quits [Client Quit]
14:05:37icedice (icedice) joins
14:14:50Arcorann quits [Ping timeout: 252 seconds]
14:22:01Shjosan quits [Quit: Am sleepy (-, – )…zzzZZZ]
14:22:50Shjosan (Shjosan) joins
14:22:50Shjosan quits [Remote host closed the connection]
14:23:53Shjosan (Shjosan) joins
14:47:44nicolas17 joins
14:50:22parfait (kdqep) joins
15:05:42le0n quits [Ping timeout: 265 seconds]
15:06:55toss (toss) joins
15:15:53etnguyen03 quits [Ping timeout: 252 seconds]
15:21:16Island joins
15:28:55hitgrr8 joins
15:40:21le0n (le0n) joins
15:40:39etnguyen03 (etnguyen03) joins
15:43:23Mateon1 quits [Ping timeout: 252 seconds]
15:47:05Mateon1 joins
16:04:13dumbgoy joins
16:05:01DogsRNice joins
16:09:29toss quits [Client Quit]
16:13:37Island_ joins
16:13:51etnguyen03 quits [Ping timeout: 265 seconds]
16:29:03AmAnd0A quits [Read error: Connection reset by peer]
16:29:20AmAnd0A joins
16:31:21magmaus35 (magmaus3) joins
16:31:42magmaus35 quits [Client Quit]
16:31:57magmaus3 (magmaus3) joins
17:19:03jacksonchen666 (jacksonchen666) joins
17:32:17etnguyen03 (etnguyen03) joins
17:49:42Dango360 (Dango360) joins
18:28:02Unholy236131661808515 quits [Remote host closed the connection]
18:52:50Jake quits [Client Quit]
18:55:52Jake (Jake) joins
18:59:42Jake quits [Client Quit]
19:00:51jacksonchen666 quits [Ping timeout: 245 seconds]
19:03:25Unholy236131661808515 (Unholy2361) joins
19:19:54Jake (Jake) joins
19:30:36AmAnd0A quits [Read error: Connection reset by peer]
19:30:45AmAnd0A joins
20:00:45Rootliam joins
20:13:50jacksonchen666 (jacksonchen666) joins
20:15:55Naruyoko5 joins
20:15:55Bleo quits [Quit: The Lounge - https://thelounge.chat]
20:18:23Naruyoko quits [Ping timeout: 252 seconds]
20:18:39Bleo joins
20:22:45<Rootliam>nicolas17: Do you have any idea when all the file lists will be done and will you be uploading them to IA?
20:23:18<nicolas17>I finished all that I could do with the fast script that skips data
20:23:49<nicolas17>now I still have to do a few .tar.bz2, and one of the .tar that actually has friendster data
20:24:09<nicolas17>(the files inside are small so there's almost no benefit to doing range requests)
20:25:41<Rootliam>Alright, do any of them have videos from user id 375869?
20:27:25<nicolas17>not seeing any
20:27:50<nicolas17>but those friendster tars makes me think something got mixed up when uploading, and maybe the "correct" yahoo videos tar with that name still exists somewhere?
20:29:53<Rootliam>Who would be the person to ask about those though
20:35:59AmAnd0A quits [Ping timeout: 252 seconds]
20:36:51AmAnd0A joins
20:40:09AmAnd0A quits [Read error: Connection reset by peer]
20:40:22AmAnd0A joins
20:47:52<thuban>probably the people listed here, if you can track them down https://wiki.archiveteam.org/index.php/Yahoo!_Video_Warroom
21:00:58<@JAA>Have you checked whether there's perhaps something in the Friendster data?
21:01:17Unholy236131661808515 quits [Client Quit]
21:01:40Unholy236131661808515 (Unholy2361) joins
21:01:55BearFortress quits [Ping timeout: 265 seconds]
21:02:13<@arkiver>what do we know about FOIAonline? i see in the PDF that people need to contact the "Partners" to see where documents will be accessible
21:02:24<@arkiver>what do we know about that? is there a new central data repository?
21:03:32<Rootliam>JAA: My program didn't find a single video file in the one of those that I checked, idk about the other ones
21:27:11AmAnd0A quits [Read error: Connection reset by peer]
21:27:46AmAnd0A joins
21:29:18emberquill08 quits [Quit: The Lounge - https://thelounge.chat]
21:29:36emberquill08 (emberquill) joins
21:34:17etnguyen03 quits [Ping timeout: 252 seconds]
21:40:49<Rootliam>SketchCow: You're the one who packaged/uploaded the Yahoo Video archives right?
21:42:27erkinalp joins
21:46:01erkinalp quits [Remote host closed the connection]
21:47:24erkinalp joins
21:51:13AmAnd0A quits [Ping timeout: 265 seconds]
21:51:17AmAnd0A joins
22:07:41decky joins
22:10:04decky_e quits [Ping timeout: 265 seconds]
22:15:23AmAnd0A quits [Ping timeout: 265 seconds]
22:15:52erkinalp quits [Ping timeout: 265 seconds]
22:17:19Mateon2 joins
22:18:50Mateon1 quits [Ping timeout: 252 seconds]
22:18:50Mateon2 is now known as Mateon1
22:23:05emberquill08 quits [Client Quit]
22:23:48emberquill08 (emberquill) joins
22:24:33etnguyen03 (etnguyen03) joins
22:42:29Suika_ quits [Ping timeout: 252 seconds]
22:44:27hitgrr8 quits [Client Quit]
22:44:42Suika joins
22:52:56etnguyen03 quits [Ping timeout: 252 seconds]
22:58:44Jake quits [Client Quit]
22:59:02Jake (Jake) joins
23:33:09Arcorann (Arcorann) joins
23:50:47BlueMaxima joins

HomeSearchPrevious dayNext day