00:06:37 | | JaffaCakes118 quits [Remote host closed the connection] |
00:09:47 | | JaffaCakes118 (JaffaCakes118) joins |
00:19:07 | <eightthree> | http://archivebot.com/finished - is there a will to make this work with https? It doesn't seem to work with it rn... |
00:20:44 | <eightthree> | Notrealname1234: nicolas17 https://github.com/search?q=mega.nz+api&ref=opensearch&type=repositories maybe these tools can help, at least for code inspiration for grabbers, if not done already? |
00:23:51 | <@JAA> | No, archivebot.com does not currently support HTTPS. |
00:35:52 | | Notrealname1234 (Notrealname1234) joins |
00:38:56 | <Notrealname1234> | Dang, i checked the logs, i misses it |
00:39:02 | <Notrealname1234> | Missed* |
00:39:35 | <Notrealname1234> | "They think that the download from MEGA is a simple API request. It's far more involved IIRC." JAA: what do you mean by that |
00:41:08 | <@JAA> | Read the next message. |
00:41:19 | <@JAA> | IIRC, it involves POST requests, too, which can't be done with SPN anyway. |
00:41:26 | <Notrealname1234> | Oh ok |
00:41:38 | <Notrealname1234> | I doubt ArchiveBot would too btw. |
00:42:08 | <@JAA> | AB can't download from MEGA either, no. |
00:42:58 | <Notrealname1234> | Oh ok |
00:45:18 | <@JAA> | Rule of thumb for AB: disable JS (and clear your cookies if necessary), visit a site. If it works fine, AB has a decent chance of working, too. |
00:51:30 | <Notrealname1234> | Oh ok |
01:00:59 | | cknow joins |
01:14:51 | <h2ibot> | Usernam edited List of websites excluded from the Wayback Machine (+22): https://wiki.archiveteam.org/?diff=52238&oldid=52220 |
01:14:53 | | Notrealname1234 quits [Client Quit] |
01:50:49 | | Island quits [Read error: Connection reset by peer] |
01:50:55 | | cknow quits [Client Quit] |
02:24:47 | | trenton13333 quits [Client Quit] |
02:37:36 | | Island joins |
02:45:39 | | kiryu joins |
02:45:39 | | kiryu is now authenticated as kiryu |
02:45:39 | | kiryu quits [Changing host] |
02:45:39 | | kiryu (kiryu) joins |
02:51:19 | | BlueMaxima quits [Read error: Connection reset by peer] |
03:09:22 | | kiryu quits [Read error: Connection reset by peer] |
03:14:35 | | sludge joins |
03:38:37 | | RealPerson joins |
03:57:59 | | kiryu joins |
03:57:59 | | kiryu is now authenticated as kiryu |
03:57:59 | | kiryu quits [Changing host] |
03:57:59 | | kiryu (kiryu) joins |
03:58:24 | | kiryu quits [Remote host closed the connection] |
03:58:36 | | kiryu joins |
03:58:36 | | kiryu is now authenticated as kiryu |
03:58:36 | | kiryu quits [Changing host] |
03:58:36 | | kiryu (kiryu) joins |
04:00:09 | | kiryu quits [Read error: Connection reset by peer] |
04:16:21 | | kiryu joins |
04:16:21 | | kiryu is now authenticated as kiryu |
04:16:21 | | kiryu quits [Changing host] |
04:16:21 | | kiryu (kiryu) joins |
04:16:54 | | kiryu quits [Remote host closed the connection] |
04:17:02 | | kiryu joins |
04:17:02 | | kiryu is now authenticated as kiryu |
04:17:02 | | kiryu quits [Changing host] |
04:17:02 | | kiryu (kiryu) joins |
04:22:46 | | kiryu quits [Remote host closed the connection] |
04:24:09 | | kiryu (kiryu) joins |
04:42:30 | | kiryu quits [Read error: Connection reset by peer] |
04:43:17 | | archivst joins |
04:43:28 | <archivst> | scoreexchange.com |
04:43:35 | <archivst> | https://scoreexchange.com |
04:43:50 | <archivst> | MP3s NOT saved by wayback |
04:43:53 | | kiryu (kiryu) joins |
04:44:11 | <archivst> | MP3s are in the form of scoreexchange.com/seview/mp3/[...] |
04:46:05 | <archivst> | These sites too: sheetmusicplus.com |
04:46:18 | <archivst> | sheetmusicdirect.com |
04:46:22 | | archivst quits [Client Quit] |
05:00:10 | | kiryu quits [Remote host closed the connection] |
05:01:18 | | kiryu joins |
05:01:18 | | kiryu is now authenticated as kiryu |
05:01:18 | | kiryu quits [Changing host] |
05:01:18 | | kiryu (kiryu) joins |
05:06:48 | | trenton13333 joins |
05:09:17 | | DogsRNice quits [Read error: Connection reset by peer] |
05:20:54 | | tzt quits [Remote host closed the connection] |
05:21:15 | | tzt (tzt) joins |
05:25:28 | | qwertyasdfuiopghjkl quits [Ping timeout: 265 seconds] |
05:29:26 | | qwertyasdfuiopghjkl (qwertyasdfuiopghjkl) joins |
05:43:54 | | Island quits [Read error: Connection reset by peer] |
06:07:22 | | etnguyen03 quits [Remote host closed the connection] |
06:08:18 | | adamus1red quits [Quit: SigTerm] |
06:12:18 | | adamus1red (adamus1red) joins |
07:09:31 | | Unholy2361924645 quits [Ping timeout: 255 seconds] |
07:37:42 | | trenton13333 quits [Client Quit] |
08:07:29 | <fireonlive> | for reasons, i'm unable to continue attempting to save the live steam at https://www.youtube.com/watch?v=2sv7SA2Ybgg at least for the next little while. capture of the footage ended several hours ago |
08:07:44 | <fireonlive> | while being days |
08:12:29 | <fireonlive> | if someone wants to run yt-dlp x2 (one for live chat, one for video + audio, don't forget to monitor the processes!) to be yeeted in to an IA item of your choosing do let the room know pls~ |
08:24:14 | | kiryu quits [Read error: Connection reset by peer] |
08:32:56 | | kiryu joins |
08:32:56 | | kiryu is now authenticated as kiryu |
08:32:57 | | kiryu quits [Changing host] |
08:32:57 | | kiryu (kiryu) joins |
08:33:32 | | kiryu quits [Read error: Connection reset by peer] |
08:40:37 | | grid joins |
08:49:13 | <h2ibot> | Usernam edited List of websites excluded from the Wayback Machine (+72): https://wiki.archiveteam.org/?diff=52239&oldid=52238 |
08:52:08 | | kiryu joins |
08:52:08 | | kiryu is now authenticated as kiryu |
08:52:08 | | kiryu quits [Changing host] |
08:52:08 | | kiryu (kiryu) joins |
09:00:02 | | Bleo18260072271 quits [Client Quit] |
09:01:23 | | Bleo18260072271 joins |
09:02:53 | | kdqep__ joins |
09:06:58 | | parfait_ quits [Ping timeout: 255 seconds] |
10:27:54 | | f_ (funderscore) joins |
10:46:09 | | kiryu quits [Remote host closed the connection] |
10:50:29 | | grid quits [Client Quit] |
10:51:43 | | kiryu (kiryu) joins |
10:53:38 | | kiryu quits [Read error: Connection reset by peer] |
10:54:33 | | kiryu joins |
10:54:33 | | kiryu is now authenticated as kiryu |
10:54:33 | | kiryu quits [Changing host] |
10:54:33 | | kiryu (kiryu) joins |
10:56:04 | | qwertyasdfuiopghjkl quits [Ping timeout: 265 seconds] |
11:01:57 | | qwertyasdfuiopghjkl (qwertyasdfuiopghjkl) joins |
11:25:33 | | qwertyasdfuiopghjkl quits [Ping timeout: 265 seconds] |
11:29:30 | | qwertyasdfuiopghjkl (qwertyasdfuiopghjkl) joins |
11:42:41 | | kiryu quits [Remote host closed the connection] |
11:43:57 | | kiryu joins |
11:43:57 | | kiryu is now authenticated as kiryu |
11:43:57 | | kiryu quits [Changing host] |
11:43:57 | | kiryu (kiryu) joins |
11:45:21 | | kiryu quits [Remote host closed the connection] |
11:46:23 | | kiryu joins |
11:46:23 | | kiryu is now authenticated as kiryu |
11:46:23 | | kiryu quits [Changing host] |
11:46:23 | | kiryu (kiryu) joins |
11:53:06 | | qwertyasdfuiopghjkl quits [Ping timeout: 265 seconds] |
12:05:36 | | qwertyasdfuiopghjkl (qwertyasdfuiopghjkl) joins |
12:10:26 | | linuxgemini9 (linuxgemini) joins |
12:11:57 | | linuxgemini quits [Ping timeout: 265 seconds] |
12:11:57 | | linuxgemini9 is now known as linuxgemini |
12:35:44 | | shgaqnyrjp_ is now known as shgaqnyrjp |
12:37:35 | <that_lurker|m> | fireonlive what commands do you use for that? I could maybe run it if no one else will. What type of monitoring does it need? |
13:07:34 | | etnguyen03 (etnguyen03) joins |
13:15:02 | | loug quits [Read error: Connection reset by peer] |
13:15:16 | | loug joins |
13:23:55 | | BearFortress quits [Ping timeout: 255 seconds] |
13:35:45 | | kiryu quits [Remote host closed the connection] |
14:21:49 | | Notrealname1234 (Notrealname1234) joins |
14:29:59 | <wickerz> | https://brewmasterscandinavia.dk/ <— bankrupt. Could someone AB? |
14:36:54 | <thuban> | wickerz: queued |
14:42:35 | | kiryu joins |
14:42:35 | | kiryu is now authenticated as kiryu |
14:42:35 | | kiryu quits [Changing host] |
14:42:35 | | kiryu (kiryu) joins |
14:42:40 | | zhongfu quits [Ping timeout: 255 seconds] |
14:52:13 | | zhongfu (zhongfu) joins |
14:56:55 | | jacksonchen666 quits [Client Quit] |
14:57:15 | | zhongfu quits [Ping timeout: 265 seconds] |
15:00:43 | | zhongfu (zhongfu) joins |
15:03:33 | | kiryu quits [Remote host closed the connection] |
15:04:47 | | kiryu joins |
15:04:47 | | kiryu is now authenticated as kiryu |
15:04:47 | | kiryu quits [Changing host] |
15:04:47 | | kiryu (kiryu) joins |
15:58:44 | | Notrealname1234 quits [Client Quit] |
15:58:49 | | Notrealname1234 (Notrealname1234) joins |
16:12:14 | | Notrealname1234 quits [Client Quit] |
16:24:02 | | Notrealname1234 (Notrealname1234) joins |
16:49:39 | | loug quits [Client Quit] |
16:50:57 | | loug joins |
17:12:21 | <wickerz> | ty thuban |
17:13:31 | | f_ is now known as funderscore |
17:14:44 | | funderscore is now known as f_ |
17:14:48 | | Notrealname1234 quits [Client Quit] |
17:14:56 | | Notrealname1234 (Notrealname1234) joins |
17:17:56 | | f_ quits [Client Quit] |
17:27:03 | | loug quits [Read error: Connection reset by peer] |
17:27:16 | | loug joins |
17:31:28 | | Notrealname1234 quits [Client Quit] |
18:05:37 | | sludge quits [Ping timeout: 255 seconds] |
18:12:09 | | BearFortress joins |
18:47:26 | <nicolas17> | mfw I didn't archive the thing because I didn't expect it to go down and now it went down |
18:47:39 | <nicolas17> | crossing fingers for WBM |
18:51:11 | <nicolas17> | first video was SPN'd, this is a good start |
18:52:01 | | Notrealname1234 (Notrealname1234) joins |
18:59:33 | | Notrealname1234 quits [Client Quit] |
19:02:58 | | that_lurker_ joins |
19:09:23 | | ArcticCircleSys joins |
19:09:34 | <ArcticCircleSys> | c3manu Alright, I'm here. |
19:09:52 | <c3manu> | awesome, thanks :) |
19:10:06 | <c3manu> | the oekaki.us job finished already :) |
19:10:12 | <ArcticCircleSys> | Thanks. |
19:10:28 | <c3manu> | thanks for pointing us to it! |
19:10:41 | <ArcticCircleSys> | No problem. I'm just glad I spotted it in time. |
19:10:57 | <ArcticCircleSys> | Actually, it'd probably be a good idea to go around archiving all remaining oekaki boards. |
19:11:25 | <ArcticCircleSys> | They're a dying breed, unfortunately. Even more so than forums and chanboards and stuff like that. Or Angelfire-type hosting sites. |
19:11:50 | <ArcticCircleSys> | You'd be hard-pressed to find one that's even remotely active, though there are a couple that do get people drawing on them from time to time. |
19:12:02 | <ArcticCircleSys> | I'm not sure how I'd go about doing that though. |
19:12:23 | <c3manu> | ArcticCircleSys: feel free to throw some URLs our way anytime |
19:12:37 | <c3manu> | maybe there's a way to discover them using search? |
19:13:11 | <ArcticCircleSys> | I'm sure there is, though I'll have to look further into it. |
19:13:40 | <ArcticCircleSys> | I'm guessing I just post the links in the archivebot channel or something? Or is there some program I should run to help out as well? |
19:14:42 | <c3manu> | the #archivebot channel is good for that |
19:15:02 | <ArcticCircleSys> | Alright cool. |
19:15:13 | <c3manu> | sometimes it can happen that such urls will go under in the archivebot spam, then posting them here is a good idea |
19:15:27 | | that_lurker_ quits [Remote host closed the connection] |
19:15:38 | <c3manu> | like, when people are adding lots of ignores or archiving lists from other channels |
19:16:02 | <nicolas17> | and some videos were archived by archivebot in 2021 |
19:16:04 | <nicolas17> | another archiveteam win |
19:16:29 | <ArcticCircleSys> | Sounds good. How do I check when a job is complete and find the resulting archives? |
19:16:30 | <nicolas17> | example: http://www3.emsec.rub.de/Vorlesung/VL_03.flv |
19:16:38 | <ArcticCircleSys> | nicolas17 Nice. |
19:17:20 | <nicolas17> | must have been a URL list, because I doubt archivebot could follow links from Javascript code setting the .flv URL on a Flash <object> :P |
19:19:54 | <c3manu> | ArcticCircleSys: for running jobs you can check http://archivebot.com/ |
19:20:07 | <c3manu> | finished jobs show up here: http://archivebot.com/finished? |
19:20:37 | <c3manu> | and with https://archive.fart.website/ you can check the logs after its finished, or check whether the domain has been archived already |
19:20:44 | <ArcticCircleSys> | Got it. |
19:20:45 | <nicolas17> | yay managed to track down the logs |
19:21:11 | <nicolas17> | Barto: thanks for getting crypto-textbook.com archived in 2021, dunno how that managed to actually grab the .flv's but it worked :P |
19:21:23 | <ArcticCircleSys> | Does the stuff from archivebot get put into the Wayback Machine? |
19:21:27 | <nicolas17> | yes |
19:21:29 | <fireonlive> | that_lurker|m (et al.) heres what i've been using for the stream: https://bpa.st/GIVOWN5YBADNOWWZ4X5456PHPA |
19:21:34 | <ArcticCircleSys> | Oh, well that makes that easier. |
19:21:37 | <fireonlive> | lmk if there's a better way cause i don't love mine lol |
19:21:47 | <fireonlive> | i also have some unmerged audio and video because yay |
19:22:15 | <ArcticCircleSys> | I'm guessing it takes a bit. |
19:22:52 | <that_lurker> | fireonlive: For chat https://github.com/xenova/chat-downloader might work better |
19:23:10 | <nicolas17> | ArcticCircleSys: I think archivebot only uploads to archive.org when it finishes with the entire job |
19:23:20 | <nicolas17> | and then wayback machine has to process the upload |
19:23:43 | <nicolas17> | expect it to take >24h end to end |
19:23:53 | <nicolas17> | the chain is kinda optimized for throughput, not latency :) |
19:24:31 | <ArcticCircleSys> | Makes sense. |
19:24:41 | <ArcticCircleSys> | I'm going to see if the oekaki.us archive works properly. |
19:25:15 | <ArcticCircleSys> | Not sure how well archivebot handles the way the site does pagination. |
19:26:02 | <nicolas17> | these cryptography videos are also available on youtube |
19:26:23 | <nicolas17> | with an *awful* attempt at motion stabilization that makes you seasick watching them |
19:27:16 | <ArcticCircleSys> | Gonna head out for a while. See y'all later. |
19:27:19 | | ArcticCircleSys quits [Client Quit] |
19:32:20 | | sludge joins |
19:32:35 | | Island joins |
19:35:38 | <Barto> | nicolas17: eh eh eh, looking at the logs, it was a request by a guy named gtgtgt :-) |
19:36:00 | <nicolas17> | https://crypto-textbook.com/movies.php |
19:36:14 | <nicolas17> | www3.emsec.rub.de is gone, every link is broken |
19:36:20 | <nicolas17> | it was already "broken" since nobody has Flash nowadays |
19:36:21 | <Barto> | muahaha |
19:36:31 | <nicolas17> | but at least I could get the flvs before, and now I can't |
19:36:36 | <nicolas17> | if it wasn't for the Internet Archive |
19:36:43 | <that_lurker> | fireonlive: I started a yt-dlp as well with https://bpa.st/5BNOVQDLB2YTZFAF5GK3CZRLVY |
19:37:38 | <that_lurker> | There is a lot of stuff there that are not needed, but oh well :-P |
19:44:01 | <fireonlive> | x3 |
19:44:04 | <fireonlive> | thanks! :) |
19:44:32 | <fireonlive> | i gotta retry the failed ffmpeg merges and trim off the dupe stuff |
19:47:05 | | shgaqnyrjp quits [Remote host closed the connection] |
19:47:39 | | shgaqnyrjp (shgaqnyrjp) joins |
19:48:00 | <fireonlive> | (merging video + audio channels) |
20:13:24 | | pseudorizer quits [Client Quit] |
20:15:29 | | pseudorizer (pseudorizer) joins |
20:16:29 | | loug quits [Client Quit] |
20:33:29 | | Notrealname1234 (Notrealname1234) joins |
20:39:15 | | archivst joins |
20:39:22 | <archivst> | https://scoreexchange.com |
20:39:35 | <archivst> | MP3s NOT saved by wayback |
20:39:45 | <archivst> | MP3s are in the form of scoreexchange.com/seview/mp3/[...] |
20:39:58 | <archivst> | These sites too: sheetmusicplus.com sheetmusicdirect.com |
20:40:07 | | archivst quits [Client Quit] |
21:05:24 | <h2ibot> | 0KepOnline edited VHS on YouTube (+69, /* Ukrainian */): https://wiki.archiveteam.org/?diff=52240&oldid=51104 |
21:07:37 | <Notrealname1234> | archivst: can you list me a list of MP3s? |
21:07:41 | <Notrealname1234> | he left |
21:13:09 | | Notrealname1234 quits [Client Quit] |
21:28:27 | | second (second) joins |
21:29:11 | | sec^nd quits [Ping timeout: 250 seconds] |
21:29:14 | | second is now known as sec^nd |
21:42:19 | <thuban> | tech234a: all the vmware directories you linked are done; lmk if you find any more |
21:44:37 | <nicolas17> | I'm thinking of reuploading these cryptography videos as an IA item |
21:44:44 | <tech234a> | thuban: thanks! |
21:44:47 | <nicolas17> | would IA transcode flv to something watchable? |
21:47:27 | <pokechu22> | Yeah, it does, or did for me at https://archive.org/details/agdq-2015-spanish-restream-raw a few years ago |
21:49:16 | <nicolas17> | that way I don't have to transcode it myself, I upload the files as-is and let IA take care of it |
21:51:10 | <pokechu22> | It did take like a week for it to transcode the files in that item, but it's also like a week of videos so that's sorta reasonable |
21:53:47 | <nicolas17> | this is probably 34 hours of video |
22:20:28 | | BlueMaxima joins |
22:36:28 | | SF quits [Remote host closed the connection] |
22:44:17 | | Webuser400 joins |
22:46:45 | | Webuser400 quits [Client Quit] |
23:00:34 | | Notrealname1234 (Notrealname1234) joins |
23:00:35 | | Notrealname1234 quits [Client Quit] |
23:00:42 | | Notrealname1234 (Notrealname1234) joins |
23:20:29 | | pedantic-darwin5 joins |
23:21:04 | | pedantic-darwin quits [Ping timeout: 255 seconds] |
23:21:04 | | pedantic-darwin5 is now known as pedantic-darwin |
23:38:26 | | Notrealname1234 quits [Client Quit] |