00:06:37JaffaCakes118 quits [Remote host closed the connection]
00:09:47JaffaCakes118 (JaffaCakes118) joins
00:19:07<eightthree>http://archivebot.com/finished - is there a will to make this work with https? It doesn't seem to work with it rn...
00:20:44<eightthree>Notrealname1234: nicolas17 https://github.com/search?q=mega.nz+api&ref=opensearch&type=repositories maybe these tools can help, at least for code inspiration for grabbers, if not done already?
00:23:51<@JAA>No, archivebot.com does not currently support HTTPS.
00:35:52Notrealname1234 (Notrealname1234) joins
00:38:56<Notrealname1234>Dang, i checked the logs, i misses it
00:39:02<Notrealname1234>Missed*
00:39:35<Notrealname1234>"They think that the download from MEGA is a simple API request. It's far more involved IIRC." JAA: what do you mean by that
00:41:08<@JAA>Read the next message.
00:41:19<@JAA>IIRC, it involves POST requests, too, which can't be done with SPN anyway.
00:41:26<Notrealname1234>Oh ok
00:41:38<Notrealname1234>I doubt ArchiveBot would too btw.
00:42:08<@JAA>AB can't download from MEGA either, no.
00:42:58<Notrealname1234>Oh ok
00:45:18<@JAA>Rule of thumb for AB: disable JS (and clear your cookies if necessary), visit a site. If it works fine, AB has a decent chance of working, too.
00:51:30<Notrealname1234>Oh ok
01:00:59cknow joins
01:14:51<h2ibot>Usernam edited List of websites excluded from the Wayback Machine (+22): https://wiki.archiveteam.org/?diff=52238&oldid=52220
01:14:53Notrealname1234 quits [Client Quit]
01:50:49Island quits [Read error: Connection reset by peer]
01:50:55cknow quits [Client Quit]
02:24:47trenton13333 quits [Client Quit]
02:37:36Island joins
02:45:39kiryu joins
02:45:39kiryu quits [Changing host]
02:45:39kiryu (kiryu) joins
02:51:19BlueMaxima quits [Read error: Connection reset by peer]
03:09:22kiryu quits [Read error: Connection reset by peer]
03:14:35sludge joins
03:38:37RealPerson joins
03:57:59kiryu joins
03:57:59kiryu quits [Changing host]
03:57:59kiryu (kiryu) joins
03:58:24kiryu quits [Remote host closed the connection]
03:58:36kiryu joins
03:58:36kiryu quits [Changing host]
03:58:36kiryu (kiryu) joins
04:00:09kiryu quits [Read error: Connection reset by peer]
04:16:21kiryu joins
04:16:21kiryu quits [Changing host]
04:16:21kiryu (kiryu) joins
04:16:54kiryu quits [Remote host closed the connection]
04:17:02kiryu joins
04:17:02kiryu quits [Changing host]
04:17:02kiryu (kiryu) joins
04:22:46kiryu quits [Remote host closed the connection]
04:24:09kiryu (kiryu) joins
04:42:30kiryu quits [Read error: Connection reset by peer]
04:43:17archivst joins
04:43:28<archivst>scoreexchange.com
04:43:35<archivst>https://scoreexchange.com
04:43:50<archivst>MP3s NOT saved by wayback
04:43:53kiryu (kiryu) joins
04:44:11<archivst>MP3s are in the form of scoreexchange.com/seview/mp3/[...]
04:46:05<archivst>These sites too: sheetmusicplus.com
04:46:18<archivst>sheetmusicdirect.com
04:46:22archivst quits [Client Quit]
05:00:10kiryu quits [Remote host closed the connection]
05:01:18kiryu joins
05:01:18kiryu quits [Changing host]
05:01:18kiryu (kiryu) joins
05:06:48trenton13333 joins
05:09:17DogsRNice quits [Read error: Connection reset by peer]
05:20:54tzt quits [Remote host closed the connection]
05:21:15tzt (tzt) joins
05:25:28qwertyasdfuiopghjkl quits [Ping timeout: 265 seconds]
05:29:26qwertyasdfuiopghjkl (qwertyasdfuiopghjkl) joins
05:43:54Island quits [Read error: Connection reset by peer]
06:07:22etnguyen03 quits [Remote host closed the connection]
06:08:18adamus1red quits [Quit: SigTerm]
06:12:18adamus1red (adamus1red) joins
07:09:31Unholy2361924645 quits [Ping timeout: 255 seconds]
07:37:42trenton13333 quits [Client Quit]
08:07:29<fireonlive>for reasons, i'm unable to continue attempting to save the live steam at https://www.youtube.com/watch?v=2sv7SA2Ybgg at least for the next little while. capture of the footage ended several hours ago
08:07:44<fireonlive>while being days
08:12:29<fireonlive>if someone wants to run yt-dlp x2 (one for live chat, one for video + audio, don't forget to monitor the processes!) to be yeeted in to an IA item of your choosing do let the room know pls~
08:24:14kiryu quits [Read error: Connection reset by peer]
08:32:56kiryu joins
08:32:57kiryu quits [Changing host]
08:32:57kiryu (kiryu) joins
08:33:32kiryu quits [Read error: Connection reset by peer]
08:40:37grid joins
08:49:13<h2ibot>Usernam edited List of websites excluded from the Wayback Machine (+72): https://wiki.archiveteam.org/?diff=52239&oldid=52238
08:52:08kiryu joins
08:52:08kiryu quits [Changing host]
08:52:08kiryu (kiryu) joins
09:00:02Bleo18260072271 quits [Client Quit]
09:01:23Bleo18260072271 joins
09:02:53kdqep__ joins
09:06:58parfait_ quits [Ping timeout: 255 seconds]
10:27:54f_ (funderscore) joins
10:46:09kiryu quits [Remote host closed the connection]
10:50:29grid quits [Client Quit]
10:51:43kiryu (kiryu) joins
10:53:38kiryu quits [Read error: Connection reset by peer]
10:54:33kiryu joins
10:54:33kiryu quits [Changing host]
10:54:33kiryu (kiryu) joins
10:56:04qwertyasdfuiopghjkl quits [Ping timeout: 265 seconds]
11:01:57qwertyasdfuiopghjkl (qwertyasdfuiopghjkl) joins
11:25:33qwertyasdfuiopghjkl quits [Ping timeout: 265 seconds]
11:29:30qwertyasdfuiopghjkl (qwertyasdfuiopghjkl) joins
11:42:41kiryu quits [Remote host closed the connection]
11:43:57kiryu joins
11:43:57kiryu quits [Changing host]
11:43:57kiryu (kiryu) joins
11:45:21kiryu quits [Remote host closed the connection]
11:46:23kiryu joins
11:46:23kiryu quits [Changing host]
11:46:23kiryu (kiryu) joins
11:53:06qwertyasdfuiopghjkl quits [Ping timeout: 265 seconds]
12:05:36qwertyasdfuiopghjkl (qwertyasdfuiopghjkl) joins
12:10:26linuxgemini9 (linuxgemini) joins
12:11:57linuxgemini quits [Ping timeout: 265 seconds]
12:11:57linuxgemini9 is now known as linuxgemini
12:35:44shgaqnyrjp_ is now known as shgaqnyrjp
12:37:35<that_lurker|m>fireonlive what commands do you use for that? I could maybe run it if no one else will. What type of monitoring does it need?
13:07:34etnguyen03 (etnguyen03) joins
13:15:02loug quits [Read error: Connection reset by peer]
13:15:16loug joins
13:23:55BearFortress quits [Ping timeout: 255 seconds]
13:35:45kiryu quits [Remote host closed the connection]
14:21:49Notrealname1234 (Notrealname1234) joins
14:29:59<wickerz>https://brewmasterscandinavia.dk/ <— bankrupt. Could someone AB?
14:36:54<thuban>wickerz: queued
14:42:35kiryu joins
14:42:35kiryu quits [Changing host]
14:42:35kiryu (kiryu) joins
14:42:40zhongfu quits [Ping timeout: 255 seconds]
14:52:13zhongfu (zhongfu) joins
14:56:55jacksonchen666 quits [Client Quit]
14:57:15zhongfu quits [Ping timeout: 265 seconds]
15:00:43zhongfu (zhongfu) joins
15:03:33kiryu quits [Remote host closed the connection]
15:04:47kiryu joins
15:04:47kiryu quits [Changing host]
15:04:47kiryu (kiryu) joins
15:58:44Notrealname1234 quits [Client Quit]
15:58:49Notrealname1234 (Notrealname1234) joins
16:12:14Notrealname1234 quits [Client Quit]
16:24:02Notrealname1234 (Notrealname1234) joins
16:49:39loug quits [Client Quit]
16:50:57loug joins
17:12:21<wickerz>ty thuban
17:13:31f_ is now known as funderscore
17:14:44funderscore is now known as f_
17:14:48Notrealname1234 quits [Client Quit]
17:14:56Notrealname1234 (Notrealname1234) joins
17:17:56f_ quits [Client Quit]
17:27:03loug quits [Read error: Connection reset by peer]
17:27:16loug joins
17:31:28Notrealname1234 quits [Client Quit]
18:05:37sludge quits [Ping timeout: 255 seconds]
18:12:09BearFortress joins
18:47:26<nicolas17>mfw I didn't archive the thing because I didn't expect it to go down and now it went down
18:47:39<nicolas17>crossing fingers for WBM
18:51:11<nicolas17>first video was SPN'd, this is a good start
18:52:01Notrealname1234 (Notrealname1234) joins
18:59:33Notrealname1234 quits [Client Quit]
19:02:58that_lurker_ joins
19:09:23ArcticCircleSys joins
19:09:34<ArcticCircleSys>c3manu Alright, I'm here.
19:09:52<c3manu>awesome, thanks :)
19:10:06<c3manu>the oekaki.us job finished already :)
19:10:12<ArcticCircleSys>Thanks.
19:10:28<c3manu>thanks for pointing us to it!
19:10:41<ArcticCircleSys>No problem. I'm just glad I spotted it in time.
19:10:57<ArcticCircleSys>Actually, it'd probably be a good idea to go around archiving all remaining oekaki boards.
19:11:25<ArcticCircleSys>They're a dying breed, unfortunately. Even more so than forums and chanboards and stuff like that. Or Angelfire-type hosting sites.
19:11:50<ArcticCircleSys>You'd be hard-pressed to find one that's even remotely active, though there are a couple that do get people drawing on them from time to time.
19:12:02<ArcticCircleSys>I'm not sure how I'd go about doing that though.
19:12:23<c3manu>ArcticCircleSys: feel free to throw some URLs our way anytime
19:12:37<c3manu>maybe there's a way to discover them using search?
19:13:11<ArcticCircleSys>I'm sure there is, though I'll have to look further into it.
19:13:40<ArcticCircleSys>I'm guessing I just post the links in the archivebot channel or something? Or is there some program I should run to help out as well?
19:14:42<c3manu>the #archivebot channel is good for that
19:15:02<ArcticCircleSys>Alright cool.
19:15:13<c3manu>sometimes it can happen that such urls will go under in the archivebot spam, then posting them here is a good idea
19:15:27that_lurker_ quits [Remote host closed the connection]
19:15:38<c3manu>like, when people are adding lots of ignores or archiving lists from other channels
19:16:02<nicolas17>and some videos were archived by archivebot in 2021
19:16:04<nicolas17>another archiveteam win
19:16:29<ArcticCircleSys>Sounds good. How do I check when a job is complete and find the resulting archives?
19:16:30<nicolas17>example: http://www3.emsec.rub.de/Vorlesung/VL_03.flv
19:16:38<ArcticCircleSys>nicolas17 Nice.
19:17:20<nicolas17>must have been a URL list, because I doubt archivebot could follow links from Javascript code setting the .flv URL on a Flash <object> :P
19:19:54<c3manu>ArcticCircleSys: for running jobs you can check http://archivebot.com/
19:20:07<c3manu>finished jobs show up here: http://archivebot.com/finished?
19:20:37<c3manu>and with https://archive.fart.website/ you can check the logs after its finished, or check whether the domain has been archived already
19:20:44<ArcticCircleSys>Got it.
19:20:45<nicolas17>yay managed to track down the logs
19:21:11<nicolas17>Barto: thanks for getting crypto-textbook.com archived in 2021, dunno how that managed to actually grab the .flv's but it worked :P
19:21:23<ArcticCircleSys>Does the stuff from archivebot get put into the Wayback Machine?
19:21:27<nicolas17>yes
19:21:29<fireonlive>that_lurker|m (et al.) heres what i've been using for the stream: https://bpa.st/GIVOWN5YBADNOWWZ4X5456PHPA
19:21:34<ArcticCircleSys>Oh, well that makes that easier.
19:21:37<fireonlive>lmk if there's a better way cause i don't love mine lol
19:21:47<fireonlive>i also have some unmerged audio and video because yay
19:22:15<ArcticCircleSys>I'm guessing it takes a bit.
19:22:52<that_lurker>fireonlive: For chat https://github.com/xenova/chat-downloader might work better
19:23:10<nicolas17>ArcticCircleSys: I think archivebot only uploads to archive.org when it finishes with the entire job
19:23:20<nicolas17>and then wayback machine has to process the upload
19:23:43<nicolas17>expect it to take >24h end to end
19:23:53<nicolas17>the chain is kinda optimized for throughput, not latency :)
19:24:31<ArcticCircleSys>Makes sense.
19:24:41<ArcticCircleSys>I'm going to see if the oekaki.us archive works properly.
19:25:15<ArcticCircleSys>Not sure how well archivebot handles the way the site does pagination.
19:26:02<nicolas17>these cryptography videos are also available on youtube
19:26:23<nicolas17>with an *awful* attempt at motion stabilization that makes you seasick watching them
19:27:16<ArcticCircleSys>Gonna head out for a while. See y'all later.
19:27:19ArcticCircleSys quits [Client Quit]
19:32:20sludge joins
19:32:35Island joins
19:35:38<Barto>nicolas17: eh eh eh, looking at the logs, it was a request by a guy named gtgtgt :-)
19:36:00<nicolas17>https://crypto-textbook.com/movies.php
19:36:14<nicolas17>www3.emsec.rub.de is gone, every link is broken
19:36:20<nicolas17>it was already "broken" since nobody has Flash nowadays
19:36:21<Barto>muahaha
19:36:31<nicolas17>but at least I could get the flvs before, and now I can't
19:36:36<nicolas17>if it wasn't for the Internet Archive
19:36:43<that_lurker>fireonlive: I started a yt-dlp as well with https://bpa.st/5BNOVQDLB2YTZFAF5GK3CZRLVY
19:37:38<that_lurker>There is a lot of stuff there that are not needed, but oh well :-P
19:44:01<fireonlive>x3
19:44:04<fireonlive>thanks! :)
19:44:32<fireonlive>i gotta retry the failed ffmpeg merges and trim off the dupe stuff
19:47:05shgaqnyrjp quits [Remote host closed the connection]
19:47:39shgaqnyrjp (shgaqnyrjp) joins
19:48:00<fireonlive>(merging video + audio channels)
20:13:24pseudorizer quits [Client Quit]
20:15:29pseudorizer (pseudorizer) joins
20:16:29loug quits [Client Quit]
20:33:29Notrealname1234 (Notrealname1234) joins
20:39:15archivst joins
20:39:22<archivst>https://scoreexchange.com
20:39:35<archivst>MP3s NOT saved by wayback
20:39:45<archivst>MP3s are in the form of scoreexchange.com/seview/mp3/[...]
20:39:58<archivst>These sites too: sheetmusicplus.com sheetmusicdirect.com
20:40:07archivst quits [Client Quit]
21:05:24<h2ibot>0KepOnline edited VHS on YouTube (+69, /* Ukrainian */): https://wiki.archiveteam.org/?diff=52240&oldid=51104
21:07:37<Notrealname1234>archivst: can you list me a list of MP3s?
21:07:41<Notrealname1234>he left
21:13:09Notrealname1234 quits [Client Quit]
21:28:27second (second) joins
21:29:11sec^nd quits [Ping timeout: 250 seconds]
21:29:14second is now known as sec^nd
21:42:19<thuban>tech234a: all the vmware directories you linked are done; lmk if you find any more
21:44:37<nicolas17>I'm thinking of reuploading these cryptography videos as an IA item
21:44:44<tech234a>thuban: thanks!
21:44:47<nicolas17>would IA transcode flv to something watchable?
21:47:27<pokechu22>Yeah, it does, or did for me at https://archive.org/details/agdq-2015-spanish-restream-raw a few years ago
21:49:16<nicolas17>that way I don't have to transcode it myself, I upload the files as-is and let IA take care of it
21:51:10<pokechu22>It did take like a week for it to transcode the files in that item, but it's also like a week of videos so that's sorta reasonable
21:53:47<nicolas17>this is probably 34 hours of video
22:20:28BlueMaxima joins
22:36:28SF quits [Remote host closed the connection]
22:44:17Webuser400 joins
22:46:45Webuser400 quits [Client Quit]
23:00:34Notrealname1234 (Notrealname1234) joins
23:00:35Notrealname1234 quits [Client Quit]
23:00:42Notrealname1234 (Notrealname1234) joins
23:20:29pedantic-darwin5 joins
23:21:04pedantic-darwin quits [Ping timeout: 255 seconds]
23:21:04pedantic-darwin5 is now known as pedantic-darwin
23:38:26Notrealname1234 quits [Client Quit]