HomeSearchPrevious dayNext day

00:01:47systwi__ is now known as systwi
00:09:28<nicolas17>JAA: https://opencollective.com/archiveteam/expenses/32327 what's this about? was it paid, is it still needed, etc
00:10:45decky_e quits [Remote host closed the connection]
00:12:13<@JAA>nicolas17: I was just trying to find it because I remembered there being something. Thanks.
00:13:06<nicolas17>also, seems there's $3700 balance, can that already be used if (say) rewby needs money for a target?
00:14:13<@JAA>Some of it can be used, but the donations that came from those removed tiers have to wait until early July as explained in the update.
00:14:37<nicolas17>ah right, gotta wait 30d in case there's refunds
00:14:42<@JAA>Yeah
01:08:43Island joins
01:10:15decky_e (decky_e) joins
01:31:19icedice quits [Client Quit]
01:45:11icedice (icedice) joins
01:52:56<fireonlive>if i had a grab-site that finished and just wanted to sploosh somewhere, would i just shoot the whole directory to internet archive as-is? or are crtain files not needed
01:53:24<fireonlive>(full well knowing i'm not cool enough to shove them into wayback)
01:54:48icedice quits [Client Quit]
02:02:16<TheTechRobo>fireonlive: I'd just upload the whole folder, no reason not to
02:02:44<TheTechRobo>If they're big I suggest, zstd-compressing the wpull.db and wpull.log files
02:03:08<fireonlive>sounds good :)
02:03:12<fireonlive>tks
02:03:32<TheTechRobo>Also, if there are wpull.db-shm and wpull.db-wal files, try doing a `gs-dump-urls` to get rid of them. You can just extract the (now zero) todo urls.
02:03:35<TheTechRobo>But it doesn't really matter.
02:03:52icedice (icedice) joins
02:10:45decky_e quits [Remote host closed the connection]
02:14:35<fireonlive>ah! good tip
02:36:02tzt quits [Ping timeout: 265 seconds]
02:38:16tzt (tzt) joins
02:54:53AmAnd0A quits [Ping timeout: 252 seconds]
02:55:21AmAnd0A joins
03:19:32AmAnd0A quits [Ping timeout: 265 seconds]
03:19:54AmAnd0A joins
03:47:08AmAnd0A quits [Ping timeout: 252 seconds]
03:54:16AmAnd0A joins
04:06:58decky_e joins
04:09:28<fireonlive>oops; i accidentally my grab-sites by letting the disk run out of space.. is thee a way to resume them?
04:11:01<icedice>You mean you deleted them?
04:11:06<icedice>Try Recuva
04:11:33<icedice>If you meant to say corrupted them then I have no idea
04:12:09<icedice>But you probably meant that since running out of storage space doesn't delete files
04:12:17<icedice>I'm tired
04:12:25<icedice>I should go to sleep
04:14:21zhongfu quits [Client Quit]
04:15:24<fireonlive>ran out of space on the file system and the python/grab-site processes crashed
04:15:37<fireonlive>https://linustechtips.com/topic/202757-my-opinions-on-ssds/page/2/ ...
04:15:39<fireonlive>ERROR OSError: [Errno 28] No space left on device
04:24:09<fireonlive>accidentally ran something which was like sure let's preallocate space lol
04:27:31zhongfu (zhongfu) joins
04:34:54<fireonlive>uwu
04:37:18JackThompson3 joins
04:42:45BlueMaxima quits [Read error: Connection reset by peer]
04:50:11<andrew>oh dear, all my .ga domains stopped resolving
04:50:19<andrew>RIP
04:50:59<andrew>seems their registration has been transferred to the registry itself
04:56:05<andrew>if you're desperate to archive these sites you can try directing your DNS queries to ns01.freenom.com and maybe some other common DNS providers like bob.ns.cloudflare.com
05:01:27<andrew>huh, Freenom's nameservers for the .ga TLD are still active
05:01:49Island quits [Read error: Connection reset by peer]
05:02:01<andrew>185.21.168.49, 185.21.169.49, 185.21.170.49, 185.21.171.49 used to be {a,b,c,d}.ns.ga
05:02:13<andrew>they still respond to NS lookups
05:03:16<andrew>have fun archiving :D
05:05:14thuban quits [Ping timeout: 252 seconds]
05:05:33<fireonlive>some will come up again.. i think?
05:05:35<fireonlive>but not all
05:05:54<fireonlive>it's all quite confusing lol
05:06:49thuban joins
05:09:06icedice quits [Client Quit]
05:12:17icedice (icedice) joins
05:16:50ect0s joins
05:21:17<ect0s>Not sure if this is the correct place to ask, I'm looking for a bunch of files that were hosted on fileplanet, and I see the archived dump online - but I've come up short searching through the archived dumps.
05:22:18<ect0s>In case someone knows, or could lend a hand, basically the things I'm after were all hosted under http://dl.fileplanet.com/dl/dl.asp/
05:39:06hitgrr8 joins
05:44:07pokechu22 (pokechu22) joins
05:57:43railen63 quits [Remote host closed the connection]
05:58:13railen64 joins
05:58:35geezabiscuit quits [Ping timeout: 252 seconds]
06:24:34<SketchCow>Hey, folks, there is now an Unofficial, "Friends of the Internet Archive" discord server you are all invited to.
06:24:47<SketchCow>https://discord.gg/zjmVjNBa
06:25:05<SketchCow>It is not an archiveteam server, nor an official Internet Archive server. Meant to be a help setup between people.
06:30:35dumbgoy__ quits [Read error: Connection reset by peer]
06:32:05<fireonlive>i'm surprised the word discord isn't auto kickbanned here :p
06:32:23<fireonlive>thanks though jason :)
07:00:49Gereon6 (Gereon) joins
07:02:56Gereon quits [Ping timeout: 252 seconds]
07:02:56Gereon6 is now known as Gereon
07:57:10ect0s quits [Remote host closed the connection]
08:07:30lflare quits [Client Quit]
08:49:58decky_e quits [Read error: Connection reset by peer]
09:05:41c3manu (c3manu) joins
09:10:07<masterX244>main page warrior projects section needs a update. Reddit info is outdated there
09:18:47railen64 quits [Remote host closed the connection]
09:20:02<h2ibot>MasterX244 edited Reddit (+251, Updated the subreddit protest news into vital…): https://wiki.archiveteam.org/?diff=49875&oldid=49829
09:22:44railen63 joins
09:23:48railen63 quits [Remote host closed the connection]
09:24:03railen63 joins
09:33:00Miori joins
09:46:58Iki1 joins
09:47:04ell7 (ell) joins
09:47:05Gereon7 (Gereon) joins
09:47:07that_lurker quits [Client Quit]
09:47:07ell quits [Quit: Ping timeout (120 seconds)]
09:47:07chrismeller quits [Quit: Ping timeout (120 seconds)]
09:47:08ell7 is now known as ell
09:47:09Gereon quits [Client Quit]
09:47:09vukky quits [Quit: Ping timeout (120 seconds)]
09:47:09Craigle quits [Quit: Ping timeout (120 seconds)]
09:47:09sepro quits [Quit: Ping timeout (120 seconds)]
09:47:09franga2000 quits [Quit: Ping timeout (120 seconds)]
09:47:09threedeeitguy quits [Quit: Ping timeout (120 seconds)]
09:47:09Arachnophine quits [Quit: Ping timeout (120 seconds)]
09:47:09AnotherIki quits [Remote host closed the connection]
09:47:09tbc1887 quits [Remote host closed the connection]
09:47:09redbees quits [Quit: ZNC 1.7.5+deb4 - https://znc.in]
09:47:09Suika quits [Quit: Server is ded]
09:47:09Gereon7 is now known as Gereon
09:47:12sepro (sepro) joins
09:47:12chrismeller3 (chrismeller) joins
09:47:13franga2000 joins
09:47:14tbc1887_ joins
09:47:15Arachnophine (Arachnophine) joins
09:47:17vukky (vukky) joins
09:47:23that_lurker (that_lurker) joins
09:47:26Craigle1 (Craigle) joins
09:47:27threedeeitguy (threedeeitguy) joins
09:47:35Suika_ joins
09:48:21redbees joins
09:50:54<fullpwnmedia> JAA sorry for the long ass reply, they do. some updates have been removed. its not urgent but it should be done as soon as possible
10:00:19decky_e (decky_e) joins
10:01:54monoxane (monoxane) joins
10:09:23Ruthalas5 quits [Ping timeout: 252 seconds]
10:26:01CraftByte quits [Remote host closed the connection]
10:39:04Ruthalas5 (Ruthalas) joins
11:01:29decky_e quits [Remote host closed the connection]
11:24:54c3manu quits [Remote host closed the connection]
11:31:37c3manu (c3manu) joins
12:53:13kdy (kdy) joins
13:44:02duck joins
13:45:27nicolas17 quits [Ping timeout: 265 seconds]
13:46:12<duck>hi, how do I view the archived data? I got to here https://archive.org/details/archiveteam_reddit and I am totally lost
13:49:50nicolas17 joins
13:51:46zhongfu quits [Client Quit]
14:02:25duck quits [Remote host closed the connection]
14:03:36<@rewby|backup>So duck's left, but future reference: With a few days of delay the reddit stuff gets ingested into web.archive.org
14:03:37<TheTechRobo>duck, assuming you're reading logs: you can just browse the Wayback Machine
14:03:47<TheTechRobo>why do I keep getting ninja'd :P
14:03:58<@rewby|backup>So just take a link and chuck it in
14:03:58zhongfu (zhongfu) joins
14:04:26<@rewby|backup>TheTechRobo: Jinx
14:05:01<@rewby|backup>Also, please actually stay for more than a few minutes. People might take a few minutes to respond.
14:19:20zhongfu quits [Client Quit]
14:30:55zhongfu (zhongfu) joins
15:15:24icedice quits [Client Quit]
15:24:35balrog_ quits [Quit: Bye]
15:29:35icedice (icedice) joins
15:29:55balrog (balrog) joins
15:41:52cdreimanu (c3manu) joins
15:42:20cdreimanu quits [Remote host closed the connection]
15:45:16c3manu quits [Ping timeout: 252 seconds]
15:48:20c3manu (c3manu) joins
16:12:54railen63 quits [Remote host closed the connection]
16:13:08railen63 joins
16:25:22Island joins
16:44:36sonick quits [Client Quit]
17:01:53AmAnd0A quits [Ping timeout: 252 seconds]
17:02:04AmAnd0A joins
17:03:09AmAnd0A quits [Read error: Connection reset by peer]
17:03:39AmAnd0A joins
17:22:09HP_Archivist quits [Remote host closed the connection]
17:22:40HP_Archivist (HP_Archivist) joins
17:26:14decky_e (decky_e) joins
18:22:09pokechu22 quits [Client Quit]
18:35:19dumbgoy joins
19:33:41railen63 quits [Remote host closed the connection]
19:33:52skyrocket (skyrocket) joins
19:33:55railen63 joins
19:52:10<fireonlive>but i want immediate answers!
19:52:23<fireonlive>https://news.ycombinator.com/item?id=36186185
19:53:06<Ivan226>someone get these for me thanks https://transfer.archivete.am/iSxkC/honkaiwiki-newlinks.txt https://transfer.archivete.am/pYerZ/honkaiwiki-newfiles.txt
20:08:13<fireonlive>anyone know a way (or is it impossible)? to resume a dead grab-site?
20:09:36<fireonlive>or am i f-ed up the a
20:09:50<fireonlive>i had a little looks at docs but nothing stood out
20:09:54<fireonlive>or i'm blind
20:41:06geezabiscuit (geezabiscuit) joins
20:44:35dumbgoy quits [Read error: Connection reset by peer]
21:10:16c3manu quits [Client Quit]
21:10:28hitgrr8 quits [Client Quit]
21:26:38AmAnd0A quits [Ping timeout: 252 seconds]
21:27:16AmAnd0A joins
21:30:03dumbgoy joins
21:40:30IDK quits [Quit: Connection closed for inactivity]
21:43:31alexshpilkin (alexshpilkin) joins
21:45:52geezabiscuit quits [Read error: Connection reset by peer]
21:49:38<alexshpilkin>does anyone have a suggestion on how to track down the FTP data from csrd.uiuc.edu (U of Illinois now-defunct supercomputing group)?
21:50:59paper_cc joins
21:51:26paper_cc quits [Remote host closed the connection]
21:51:55paper_cc joins
21:52:09<alexshpilkin>it’s not on AT’s FTP crawl list, but it may have been already shut down at that time
21:52:18paper_cc quits [Remote host closed the connection]
21:53:47<alexshpilkin>it’s possible that it’s been mirrored on one of the sites that *were* archived, but there’s no searchable file index for those that I can see
21:53:58<alexshpilkin>(but I’m not hopeful)
21:55:37alexshpilkin prepares to be kicked to #effteepe but is not sure anybody’d actually respond there
21:58:22<alexshpilkin>(FWIW, I’m trying to track down a particular old piece of software that used to be hosted there, “Application executive” by Brian Bliss. unfortunately a file called at.tar.Z is not really findable with web search)
21:58:48<alexshpilkin>(if it’s even there)
21:59:11<icedice>I wonder if anyone uploaded it to VirusTotal
21:59:34<icedice>cc: joepie91|m
22:05:53<alexshpilkin>it was a library distributed in source form so doubt it
22:07:49<alexshpilkin>but I’m already preparing myself to contact the PR person behind the “contact webmaster” link on their current website so anything goes at this point
22:12:50<@JAA>I was going to say 'have you tried contacting Mr Bliss?', but it looks like he passed away two years ago.
22:14:36<@JAA>You're right that there's no index of our FTP data.
22:15:53<alexshpilkin>ah so that was him after all? I saw some articles like that but I wasn’t sure they were talking about the same person
22:16:50<@JAA>Well, the obituary I found mentions that 'he was currently employed as a Software Engineer for National Center for Super Computing Applications for the University of Illinois in Champaign'.
22:17:03<@JAA>https://www.h-p-w.com/obituary/MrBrian-Bliss
22:17:14<flashfire42>I did a lot of work on the FTP list years ago but I never coded anything so I was unable to do any grabs
22:17:25<alexshpilkin>oh. yeah, then that’s probably him
22:17:56<alexshpilkin>(I couldn’t track him down past his employment at Convex Computer Corp in the 2000s)
22:18:33<alexshpilkin>(and their ex-employees site is on its last legs)
22:20:57<alexshpilkin>JAA: I was just idly fantasizing about making such an index but I looked through the items on Archive.org and the format seems kinda cursed, also it would probably require downloading everything and I don’t currently have the disks for that even if I do surprisingly have the bandwidth
22:21:27<@JAA>Yeah, cursed sounds about right.
22:22:20<@JAA>Some of it is WARC, where it's relatively easy, but I think there's non-WARC stuff as well.
22:22:32<alexshpilkin>I mean no problem, crawls do tend to turn out like that, mine included :)
22:23:10<alexshpilkin>but it’s not exactly something I’m prepared to code up this evening
22:24:52<alexshpilkin>still if anyone has full copies and a good idea of what variations there are I could try to work on test cases and then throw executables at them
22:25:33<alexshpilkin>flashfire42: if that was intended for me I couldn’t really understand it, sorry
22:52:54sonick (sonick) joins
22:53:51railen63 quits [Remote host closed the connection]
22:56:25railen63 joins
22:57:52<imer>alexshpilkin: been down a rabbit hole, there is a mention of ftp://ftp.cs.uiuc.edu/pub/research-groups/csrd/oldftp/ but that is also gone
22:58:09<imer>also surprising its easier to find his ginger mead recipe https://github.com/opsxcq/mirror-textfiles.com/blob/1bd6eeb065083d430b61c0c9cb700bac4b1bbdfb/textfiles.com/drugs/mead2.cap#L276
23:01:24BlueMaxima joins
23:01:43<@JAA>Or, you know, http://textfiles.com/drugs/mead2.cap :-)
23:01:59<@JAA>But TIL people are mirroring Jason's site to GitHub.
23:01:59<imer>of course :) was searching github, cause you know, code
23:18:52<sonick>Did anyone mention the Ragtag Archive that is shutting down on July 24?
23:19:14<sonick>They seem to have a 1.38 PB Vtuber video collection.
23:19:25<sonick>https://archive.ragtag.moe/
23:19:32<sonick>https://archive.ragtag.moe/announcement.pdf
23:21:44<sonick>The collection includes videos of VTubers no longer in existence there, so it is worth archiving.
23:26:29AmAnd0A quits [Read error: Connection reset by peer]
23:26:48AmAnd0A joins
23:36:05AmAnd0A quits [Ping timeout: 265 seconds]
23:38:12AmAnd0A joins
23:43:33AmAnd0A quits [Read error: Connection reset by peer]
23:43:49AmAnd0A joins

HomeSearchPrevious dayNext day