00:06:36Wohlstand quits [Quit: Wohlstand]
00:26:03meow quits [Ping timeout: 252 seconds]
00:56:19Webuser286969 quits [Quit: Ooops, wrong browser tab.]
01:00:03McAfee leaves [Disconnected: Hibernating too long]
01:00:54McAfee joins
01:13:39Pendonym quits [Read error: Connection reset by peer]
01:15:18Pendonym (Pendonym) joins
01:49:17pepsi2024 quits [Ping timeout: 252 seconds]
01:52:12medecau quits [Read error: Connection reset by peer]
01:52:41medecau (medecau) joins
01:55:18notarobot3455 joins
01:58:33notarobot345 quits [Ping timeout: 255 seconds]
02:07:53wyatt8740 quits [Remote host closed the connection]
02:11:38AlsoHP_Archivist (HP_Archivist) joins
02:11:48AlsoHP_Archivist quits [Remote host closed the connection]
02:12:04wyatt8740 joins
02:15:50etnguyen03 quits [Read error: Connection reset by peer]
02:16:02etnguyen03 (etnguyen03) joins
02:18:08medecau quits [Client Quit]
02:19:42wyatt8740 quits [Ping timeout: 268 seconds]
02:23:22wyatt8740 joins
02:24:29Umbire quits [Ping timeout: 252 seconds]
02:57:03grill quits [Ping timeout: 255 seconds]
02:57:46grill (grill) joins
03:00:08etnguyen03 quits [Remote host closed the connection]
03:11:27unknownsrc quits [Ping timeout: 255 seconds]
03:12:22Umbire joins
03:14:19unknownsrc (unknownsrc) joins
03:24:04thewinwin8704 joins
03:28:09thewinwin870 quits [Ping timeout: 268 seconds]
03:28:21thewinwin8704 is now known as thewinwin870
03:36:12Umbire quits [Ping timeout: 255 seconds]
03:48:18DogsRNice quits [Read error: Connection reset by peer]
03:49:49thewinwin8704 joins
03:52:29thewinwin870 quits [Ping timeout: 252 seconds]
03:55:03thewinwin8704 is now known as thewinwin870
03:56:52thewinwin8705 joins
03:59:27thewinwin870 quits [Ping timeout: 252 seconds]
03:59:37thewinwin8705 is now known as thewinwin870
04:09:17Island quits [Read error: Connection reset by peer]
04:33:32thewinwin8708 joins
04:37:13thewinwin870 quits [Ping timeout: 268 seconds]
04:37:19thewinwin8708 is now known as thewinwin870
04:49:33entrox quits [Ping timeout: 268 seconds]
04:49:41ThetaDev quits [Quit: https://quassel-irc.org - Chat comfortably. Anywhere.]
04:50:16ThetaDev joins
04:57:52cascode_ joins
04:57:52cascode quits [Read error: Connection reset by peer]
05:05:31cascode joins
05:05:31cascode_ quits [Read error: Connection reset by peer]
05:05:58cascode quits [Read error: Connection reset by peer]
05:06:12cascode joins
05:39:31lev (lev) joins
05:39:38lev quits [Remote host closed the connection]
05:39:56lev (lev) joins
05:40:46lev quits [Remote host closed the connection]
05:43:22nexussfan quits [Remote host closed the connection]
06:07:51unknownsrc quits [Ping timeout: 255 seconds]
06:08:02lsab101205 joins
06:11:03<lsab101205>Hi! I'm doing some preservation research on a lost 2007 GameTrailers video and I've traced it pretty deep into ArchiveTeam's 2016 GameTrailers crawl. I'm hoping someone familiar with that project/raw WARCs might be able to point me in the right direction.
06:11:03<lsab101205>The Internet Archive MegaWARC item I'm looking at is:
06:11:03<lsab101205>`archiveteam_gametrailers_2016062603290000`
06:11:03<lsab101205>It's currently access-restricted. The crawler batch I'm interested in is `10videos:1933`, and I believe the relevant individual file should be something like:
06:11:03<lsab101205>`gametrailers-10videos_1933-*.warc.gz`
06:11:03<lsab101205>The two GameTrailers IDs are `19338` and `19339`.
06:11:03<lsab101205>The original media filenames I'm specifically hunting are:
06:11:04<lsab101205>`t_xbox360_springupdate_im_int_gt_h264.wmv`
06:11:04<lsab101205>`t_xbox360_springupdate_im_int_gt_h264.mov`
06:11:05<lsab101205>`t_xbox360_springupdate_im_int_gt.wmv`
06:11:05<lsab101205>`t_xbox360_springupdate_im_int_gt.mov`
06:11:06<lsab101205>Does anyone know whether there's a way to search/index the contents of these old MegaWARCs, obtain the individual WARC rather than the full ~127 GB object, or whether any original/staging copies from the GameTrailers project still exist?
06:11:45unknownsrc (unknownsrc) joins
06:12:14<lsab101205>I've also contacted Internet Archive directly about access to the restricted MegaWARC, but figured someone here may remember how the GameTrailers crawl was packaged or whether individual WARCs still exist anywhere.
06:19:14BornOn420 quits [Remote host closed the connection]
06:20:19BornOn420 (BornOn420) joins
06:25:38BornOn420 quits [Remote host closed the connection]
06:26:43BornOn420 (BornOn420) joins
06:27:18<pokechu22>If that filename is already known, shouldn't you be able to find the relevant URL on web.archive.org?
06:27:26<pokechu22>not familiar with gametrailers at all
06:30:13thewinwin8700 joins
06:33:05thewinwin870 quits [Ping timeout: 252 seconds]
06:33:11thewinwin8700 is now known as thewinwin870
06:39:21n9nes quits [Ping timeout: 255 seconds]
06:39:52n9nes joins
06:44:33<lsab101205>Yeah, that was my first thought too. I’ve checked the known/likely original URLs directly in Wayback, including download.gametrailers.com/gt_vault/t_xbox360_springupdate_im_int_gt.mov and the WMV/H.264 variants, but none of them have captures.
06:44:33<lsab101205>The reason I’m looking at the raw ArchiveTeam crawl is that I’ve traced the relevant GameTrailers IDs to crawler batch 10videos:1933, so I’m trying to determine whether the file was captured under another URL/redirect or exists in the raw WARC even though the obvious URL isn’t exposed in Wayback.
07:04:13<pokechu22>Yeah, not listed on https://web.archive.org/cdx/search/cdx?url=download.gametrailers.com&collapse=urlkey&matchType=domain&fl=original&limit=100000&showResumeKey=true&resumeKey= at least
07:45:14Wohlstand (Wohlstand) joins
07:54:14Shard768 quits [Quit: Im doing something rq. Il brb]
07:55:52MrMcNuggets (MrMcNuggets) joins
07:56:30HP_Archivist quits [Read error: Connection reset by peer]
07:56:49HP_Archivist (HP_Archivist) joins
07:57:39thewinwin8704 joins
08:01:15thewinwin870 quits [Ping timeout: 255 seconds]
08:01:18h|ignition quits [Quit: WeeChat 4.10.0]
08:01:48thewinwin8704 is now known as thewinwin870
08:05:38h|ignition (h) joins
08:06:48h|ignition quits [Client Quit]
08:06:59h|ignition (h) joins
08:39:02lev (lev) joins
08:39:04cascode quits [Remote host closed the connection]
08:42:40lev quits [Remote host closed the connection]
08:47:32lev (lev) joins
08:47:51lev quits [Remote host closed the connection]
08:54:44amphitryon_ joins
08:57:11amphitryon quits [Ping timeout: 252 seconds]
09:00:23Bleo182600722719623455222011079 quits [Quit: The Lounge - https://thelounge.chat]
09:03:06Bleo182600722719623455222011079 joins
09:03:47MrMcNugg1 (MrMcNuggets) joins
09:05:09MrMcNuggets quits [Ping timeout: 255 seconds]
09:36:01<c3manu>currently manually going through web searches for www.inventati.org. a webuser ("ArchiveItNow") yesterday pointed me to https://www.inventati.org/archivio_ecn/, which wasn't discovered by #archivebot from what i can see in the WBM
09:36:15<c3manu>looks like there are a few more like that
09:36:57<c3manu>like this for example: https://www.inventati.org/cope/wp/
09:37:21<c3manu>a bit worrysome considering those all seem to be archives of dead websites themselves so fgar
09:37:23<c3manu>*far
09:39:55<c3manu>site:https://www.inventati.org/cafavale/Archivio/ gives some results which all point to 404s :/
10:00:30unknownsrc quits [Ping timeout: 255 seconds]
10:05:00nune quits [Remote host closed the connection]
10:05:01nune joins
10:05:40unknownsrc (unknownsrc) joins
10:26:24simon816 quits [Remote host closed the connection]
10:29:38<@arkiver>just so everyone knows, when we have an active project with a special channel, i plan on at least once posting a call for donations. i'm really hoping we can somehow increase incoming donations on opencollective.com/archiveteam with at least 200 euro/month, so we can handle long term recurring costs better.
10:30:26<@arkiver>everyone flowing out of opencollective.com/archiveteam is transparent, so everyone can also see that this is used for good purposes
10:30:32<skankhunt42>thrown my head in yesterday, not much but at least finally giving something
10:30:42simon816 (simon816) joins
10:31:08<@arkiver>so you might see these calls every now and then, announcing it here since i don't want it to sound greedy or anything, just so people know. and all is transparent as noted
10:31:53<@arkiver>skankhunt42: i saw yes, that monthly amount will almost offset an entire month per year of colo costs (without extra energy), so that is pretty significant
10:34:27<skankhunt42>just hope I can keep it up, might throw around some VPS costs / cancel some
10:36:27<@arkiver>skankhunt42: just know it is appreciated! if at some point it cannot continue, then that is also fine, no need to worry about that or feel bad about that
10:36:36<skankhunt42><3
10:36:45<c3manu>anarcat: you don't happen to have a list of archived websites in directories like https://www.inventati.org/khalas/, https://www.inventati.org/radiobandita/chisiamo.html, https://www.inventati.org/hcnonsicomanda/ etc. do you?
10:38:08<klea>There's even more than the ones listed on
10:38:12<klea>https://archive.inventati.org/?
10:38:54<@arkiver>i think we will also not proactively/explicitly thank people for donating, especially since i want to prevent any kind of "influence buying" and special privileges. just know that anything donated is put to very good use, and help keep all of this running (you can see that for yourself on opencollective).
10:39:36<c3manu>klea: that's a list of those that aren't, see https://inventati.org/bellalink/ for example
10:39:58<klea>ah.
10:40:02<klea>Annoying :(
10:40:34<c3manu>i'm just glad they exist in the first place. i've gone through 20 of those by now and i suspect there's more; don't want to miss anything if possible
10:42:19<c3manu>looks like some of those even get updated still...wow https://www.inventati.org/pravda/
10:50:53Umbire joins
10:51:08Umbire quits [Remote host closed the connection]
10:51:41Umbire joins
10:58:06pepsi2024 joins
11:09:42beastbg8 quits [Read error: Connection reset by peer]
11:10:04beastbg8 joins
11:10:21fuzzy80211 quits [Read error: Connection reset by peer]
11:10:38fuzzy80211 (fuzzy80211) joins
11:30:42cn joins
11:31:57Paw-chivist joins
11:32:11<Paw-chivist>Hi ! Shall we create a short-term project pour Zapytaj.onet.pl ?
11:32:35<klea>Paw-chivist: → #niepytaj
11:32:48<Paw-chivist>Perfect, thank you !
11:50:11Mateon1 quits [Remote host closed the connection]
11:50:22Mateon1 joins
12:26:09TunaLobster445 quits [Quit: So long and thanks for all the fish]
12:28:44TunaLobster445 joins
12:39:01Ikata joins
12:40:31d02 joins
13:17:01d02 quits [Client Quit]
13:18:45Paw-chivist quits [Client Quit]
13:20:47Ikata quits [Client Quit]
13:34:41<anarcat>pokechu22: b9nxh9izpv0sr5fd037ps7vlu seems stuck
13:34:46<anarcat>c3manu: i'll ask
13:53:47thewinwin8702 joins
13:57:39thewinwin870 quits [Ping timeout: 255 seconds]
13:57:42thewinwin8702 is now known as thewinwin870
14:07:08Ikata (Ikata) joins
14:09:00BornOn420 quits [Remote host closed the connection]
14:10:12BornOn420 (BornOn420) joins
14:16:25entrox joins
14:19:47Ikata quits [Client Quit]
14:22:26cn quits [Ping timeout: 268 seconds]
14:25:25thewinwin8709 joins
14:26:01BornOn420 quits [Remote host closed the connection]
14:27:07BornOn420 (BornOn420) joins
14:27:59thewinwin870 quits [Ping timeout: 268 seconds]
14:28:05thewinwin8709 is now known as thewinwin870
14:42:33HugsNotDrugs joins
14:42:47HugsNotDrugs` quits [Ping timeout: 268 seconds]
14:45:04<anarcat>i'm having trouble talking with archivebot
14:45:14<anarcat>i want to crawl the blogs in https://transfer.archivete.am/X0mgF/broken-noblogs.txt without outlinks
14:45:15<eggdrop>inline (for browser viewing): https://transfer.archivete.am/inline/X0mgF/broken-noblogs.txt
14:45:17McAfee leaves [Error from remote client]
14:45:29<anarcat>i tried !ao < foo and it's refusing
14:45:42<anarcat>those are blogs that were broken during the big crawl which A/I says should be recrawled
14:55:31<anarcat>pabs / JAA / pokechu22: could you please crawl https://transfer.archivete.am/X0mgF/broken-noblogs.txt? A/I said they should be recrawled as the sites were broken during the big crawl
14:55:31<eggdrop>inline (for browser viewing): https://transfer.archivete.am/inline/X0mgF/broken-noblogs.txt?
14:58:37Island joins
15:14:18<c3manu>anarcat: '!a <' jobs require operator permissions, but the bot gives no error message when a user without them attempts it. i just queued it
15:14:41<anarcat>thanks c3manu
15:14:55<anarcat>any idea what's up with b9nxh9izpv0sr5fd037ps7vlu ? it seems completely hung here
15:15:41<c3manu>anarcat: b9nxh9izpv0sr5fd037ps7vlu likely seemed stuck due to the ignores pokechu22 added recently. it was dismissing a large number of URLs (ignored URLs are not shown in the log by default) which made it look that way. b9nxh9izpv0sr5fd037ps7vlu seems to have finished in the meantime
15:15:54<anarcat>cool
15:16:31<anarcat>oh wow, that completed too, that's unexpected
15:22:44notarobot3455 quits [Quit: The Lounge - https://thelounge.chat]
15:22:48<anarcat>c3manu: https://transfer.archivete.am/hdHJR/ai-subsite-list.txt⏎
15:22:49<eggdrop>inline (for browser viewing): https://transfer.archivete.am/inline/hdHJR/ai-subsite-list.txt⏎
15:22:53<anarcat>c3manu: https://transfer.archivete.am/hdHJR/ai-subsite-list.txt
15:23:53<c3manu>anarcat: thanks for the list!
15:30:42nine quits [Quit: See ya!]
15:30:54nine joins
15:31:10<lsab101205>Thanks pokechu re: gametrailers on the archive, that's actually useful. I pulled the full result and confirmed none of the known Spring Update filenames, or even spring/dashboard/update, appear in the public CDX index for download.gametrailers.com. So I think the remaining question is specifically whether the 2016 ArchiveTeam raw WARC contains
15:31:10<lsab101205>records that aren't exposed in the public CDX index. I've never really done something like this before so I'm learning as I go.
15:33:27Umbire quits [Quit: [be back later]]
15:37:50Userfloor quits [Quit: Ooops, wrong browser tab.]
15:38:09McAfee joins
15:41:59camrod63629 quits [Quit: no-clipped reality]
15:42:15camrod63629 (camrod) joins
15:47:26notarobot3455 joins
15:49:47systwi (systwi) joins
15:57:17Umbire (Umbire) joins
16:12:14medecau (medecau) joins
16:23:47<h2ibot>KleaBot edited Main Page/Current Warrior Project (+265, Default projects are now weebly (weight…): https://wiki.archiveteam.org/?diff=63910&oldid=63905
16:25:20klea looks at arkiver's percentages after normalization, wonders how many warriors are using versions older than the multi project update.
16:25:44<@arkiver>klea: yeah those would be going to the urlteam2 project now
16:25:53<justauser>Why?
16:26:09<justauser>Last time I checked, URLTeam was already seriously overwarriored.
16:26:16<@arkiver>ah
16:26:17<@arkiver>hmm
16:26:34<@arkiver>i'll make them Telegram, but I'm going to stash the old stashes of Telegram away
16:26:36<@arkiver>for now
16:26:50<@arkiver>since space is really expensive, but we should keep up to date with the newly queue Telegram stuff
16:27:27<klea>AFAIK the URLTeam project had a item popping up rate equal to the rate of warriors getting items, but the touching the knobs needed to be done manually?
16:30:46<eggdrop>[remind] pokechu22: re-crawl https://keepitfree.ai/
16:43:47Doranwen quits [Remote host closed the connection]
16:44:12Doranwen (Doranwen) joins
16:47:45NeonGlitch quits [Quit: Textual IRC Client: www.textualapp.com]
16:51:35NeonGlitch (NeonGlitch) joins
16:55:42meow joins
17:02:11tallow-ghost joins
17:02:41tallow-ghost quits [Remote host closed the connection]
17:03:07tallow-ghost joins
17:04:26tallow-ghost quits [Client Quit]
17:12:34thewinwin8707 joins
17:13:57<c3manu>anarcat++
17:13:58<eggdrop>[karma] 'anarcat' now has 7 karma!
17:14:00<c3manu>there's so much in there
17:16:20thewinwin870 quits [Ping timeout: 268 seconds]
17:16:28thewinwin8707 is now known as thewinwin870
17:17:36<anarcat>yw
17:18:46<pokechu22>anarcat: b9nxh9izpv0sr5fd037ps7vlu crashed due to a malformed URL in an outlink and can't be resumed. It's redundant to 5l38c8aug4w989eodhz0wutyw which covers everything though
17:18:58<anarcat>got it
18:04:53scotrod2 quits [Quit: The Lounge - https://thelounge.chat]
18:14:27<justauser>arkiver: More cookie checks: https://forge.starlightnet.work/ https://forged.synth.download/ https://kitty.tel/ https://nixwiz.network/ .
18:18:29scotrod2 joins
18:30:00msfjarvis quits [Quit: Lurker 2.2.1 (the truth is out there) https://lurker.chat]
18:30:47msfjarvis joins
18:33:54scotrod2 quits [Client Quit]
18:41:41AccelArch (AccelArch) joins
18:48:29AccelArch quits [Client Quit]
19:01:59alkamaass joins
19:02:56<alkamaass>is downloading archived google videos a thing?
19:03:09<alkamaass>like i see on archive.org they are locked for download
19:04:12<klea>alkamaass: → #down-the-tube (And they can be accessed individually)
19:05:07<pokechu22>Is #down-the-tube for google video as well, or only youtube?
19:05:25<klea>oh, google videos != youtube, sorry.
19:05:40<pokechu22>https://wiki.archiveteam.org/index.php/Google_Video_(Archive) says -bs (there was a channel on efnet before)
19:06:35<klea>ah.
19:06:36<alkamaass>google videos and youtube both existing is so weird
19:06:50<alkamaass>yeah it seems like it says you can just put in url of video into archive.org
19:06:53<alkamaass>or rather the id
19:07:40<klea>I suppose you put the url.
19:09:36lsab101205 quits [Quit: Hi]
19:28:38<alkamaass>yeah but I'm trying to follow the instructions at https://archive.org/details/google_video and I can't figure out how to work it
19:29:12<klea>That collection is not ours, it's one made by IA.
19:29:37<klea>I suppose you can ask info@ if you can't get some specific video via the wayback machine.
19:31:28sludge joins
19:32:29sludge quits [Client Quit]
19:41:15medecau quits [Ping timeout: 268 seconds]
19:42:07medecau (medecau) joins
19:45:40Paw-chivist joins
20:01:54thewinwin8709 joins
20:05:55thewinwin870 quits [Ping timeout: 268 seconds]
20:06:07thewinwin8709 is now known as thewinwin870
20:06:53NeonGlitch quits [Quit: Textual IRC Client: www.textualapp.com]
20:16:15meow quits [Ping timeout: 252 seconds]
20:19:32leo60228 quits [Read error: Connection reset by peer]
20:19:36leo60228 (leo60228) joins
20:23:11Dalek quits [Ping timeout: 268 seconds]
20:26:29Suika joins
20:26:32Dalek (Dalek) joins
20:30:16scotrod2 joins
20:34:30DogsRNice joins
20:34:42kansei- quits [Quit: ZNC 1.10.3 - https://znc.in]
20:54:01pepsi2024 quits [Ping timeout: 268 seconds]
20:58:00Webuser731545 joins
21:08:44caglacigdem joins
21:11:35caglacigdem quits [Client Quit]
21:15:44websy joins
21:15:54<websy>does anyone still have the gitorious archive?
21:22:51lev (lev) joins
21:25:31Paw-chivist quits [Client Quit]
21:26:45lev quits [Remote host closed the connection]
21:52:59TheEnbyperor quits [Remote host closed the connection]
21:53:27TunaLobster445 quits [Quit: So long and thanks for all the fish]
21:53:40TunaLobster445 joins
21:58:00TheEnbyperor_ joins
22:05:14kansei (kansei) joins
22:10:38etnguyen03 (etnguyen03) joins
22:19:40meow joins
22:20:21guicale quits [Ping timeout: 268 seconds]
22:22:14Webuser731545 quits [Client Quit]
22:32:19Webuser405606 joins
22:32:31Webuser405606 quits [Client Quit]
22:35:31Hackerpcs quits [Remote host closed the connection]
22:36:30Hackerpcs (Hackerpcs) joins
22:37:30guicale (guicale) joins
22:38:55etnguyen03 quits [Client Quit]
22:46:19thewinwin8706 joins
22:50:00thewinwin870 quits [Ping timeout: 255 seconds]
22:50:08thewinwin8706 is now known as thewinwin870
22:50:41etnguyen03 (etnguyen03) joins
23:18:40nexussfan (nexussfan) joins
23:22:24Wohlstand quits [Ping timeout: 255 seconds]
23:37:31pepsi2024 joins
23:45:27etnguyen03 quits [Ping timeout: 268 seconds]
23:48:33medecau quits [Ping timeout: 252 seconds]
23:50:02medecau (medecau) joins