HomeSearchPrevious dayNext day

00:01:13dm4v quits [Read error: Connection reset by peer]
00:01:38dm4v joins
00:01:40dm4v quits [Changing host]
00:01:40dm4v (dm4v) joins
00:19:50Ajay_m quits [Read error: Connection reset by peer]
00:42:06HP_Archivist (HP_Archivist) joins
00:45:30Arcorann (Arcorann) joins
00:56:03Ajay_m joins
00:59:54DogsRNice quits [Ping timeout: 258 seconds]
01:00:11DogsRNice (Webuser299) joins
01:10:14TheTechRobo joins
01:12:45<TheTechRobo>How do I download a large mediafire folder without coughing up a premium subscription?
01:12:55<TheTechRobo>I could manually select all he files but that would take ages...
01:13:29<TheTechRobo>It seems to use javascript, and doesn't load in netsurf, so I fed it into the wayback machine with outlinks enabled, since I'm pretty sure it runs javascript...
01:13:55<TheTechRobo>The individual pages were archived, but I don't believe the actual downloads were, since it saves outlinks at a level of 1
01:13:57<TheTechRobo>iirc
01:14:14<TheTechRobo>Is there a simple way to archive it?
01:16:01<@JAA>plowshare's plowlist + plowdown, perhaps? Also, #mediaonfire should gain folder support soonish, so then we can archive it properly through that.
01:22:59<TheTechRobo>Where are those on Apt?
01:23:25<TheTechRobo>Nvm - found it.
01:24:27<TheTechRobo>Huh?
01:24:43<TheTechRobo>"Skip: no module for URL (http://www.mediafire.com/)
01:25:26<TheTechRobo>That's... really confusing
01:25:49<@JAA>https://github.com/mcrapet/plowshare/blob/master/INSTALL
01:27:52<pabs>does the wayback machine archive bot really run JavaScript?
01:28:41<pabs>(if so it would be awesome if it could save the DOM at the end, so you can get a non-JS version of any web page, like you can with archive.is)
01:28:50<@JAA>SPN doesn't, SPN2 does. SPN is /save/URL, SPN2 is the form thingy.
01:29:20<pabs>is savepagenow@archive.org SPN or SPN2?
01:29:35<TheTechRobo>I'm still getting the issue
01:29:38<@JAA>I think that got introduced with SPN2, but not sure.
01:29:41<@OrIdow6>That's SPN2 IIRC
01:30:01<@JAA>(This is our nomenclature, by the way, not IA's.)
01:30:11<TheTechRobo>Sorry didn't mean to interrupt, didn't see the chat moving ^^"
01:30:21<TheTechRobo>I'm getting:
01:30:25<@OrIdow6>And the DOM thing is (I presume) on everyone's mind, but standards develop and change slowly
01:30:29<TheTechRobo>% $HOME/.local/bin/plowlist http://www.mediafire.com/\?bmqi2md844aycSkip: no module for URL (http://www.mediafire.com/)
01:31:25<@JAA>TheTechRobo: Try using the /folder/ID URL instead.
01:31:50<TheTechRobo>$HOME/.local/bin/plowlist http://www.mediafire.com/folder/bmqi2md844ayc results in
01:31:54<TheTechRobo>Skip: no module for URL (http://www.mediafire.com/)
01:32:01ddd quits [Remote host closed the connection]
01:32:10<@JAA>Then that sounds like you didn't install the modules correctly.
01:32:19<pabs>will /save/ get migrated to SPN2? (I mostly use that)
01:32:20<@JAA>It's been a while since I used plowshare though.
01:32:36ddd joins
01:33:03<@JAA>pabs: You mean /save/URL or plain /save/ ?
01:33:16<pabs>/save/URL
01:33:27<@JAA>Unlikely since that would break all sorts of things.
01:34:01<TheTechRobo>Ah, I missed that part of the section. I stopped reading at the "Advanced users" and "BSD" sections since I assumed from then on would only be things like troubleshooting
01:34:04<@JAA>When you load a snapshot and the browser tries to access an image that hasn't been archived before, that gets a redirect to /save/IMAGEURL to transparently archive it, for example.
01:34:31<TheTechRobo>Yep, it now works
01:34:45<TheTechRobo>JAA: Oh, that would explain why it sometimes takes ages to load
01:34:55<TheTechRobo>a low-popularity website
01:35:04<@JAA>Well, the WBM is also slow, but yeah, that can be a reason.
01:35:30<pabs>guess I need to switch to using /save/
01:35:56<TheTechRobo>They've been getting quite a lot of queries too it seems... I should really make a donation soon. Their servers keep returning "could not save target url due to system overload"
01:37:40<TheTechRobo>I can't seem to find the equivalent of the `-i` option... Where can I insert a filelist?
01:38:58<@JAA>Don't think there is one. Try xargs?
01:42:02<TheTechRobo>Now I'm getting this...
01:42:02<TheTechRobo>https://pastebin.com/ASGfrPpY
01:42:16<TheTechRobo>plowdown is both reading the ones with the hashtag
01:42:24<TheTechRobo>AND it's getting an error when actually downloading
01:45:00<@JAA>Actually, plowdown accepts a filename as an argument as well.
01:45:25<@JAA>But you need to invoke plowlist with some option to get plain links without filenames IIRC. Check its man page.
01:47:33<TheTechRobo>Still getting parse failed (sed): "/function[[:space:]]*_/ s/^.*"\(.\+\)";.*$/\1/p" (skip 1)
01:48:42<@JAA>Welp, looks like the MediaFire module has been broken for a while: https://github.com/mcrapet/plowshare-modules-legacy/issues/220
01:49:55<TheTechRobo>Dang it
01:50:04<TheTechRobo>Any alternatives to plowshare?
01:51:46<@JAA>JDownloader perhaps? It's been even longer since I've used that though.
01:54:16ddd quits [Client Quit]
01:54:44<@JAA>None of these tools will properly archive it (as WARC) though. Only our project would do that.
01:57:40hexa- quits [Quit: WeeChat 3.2]
01:58:59hexa- (hexa-) joins
01:59:20<TheTechRobo>Regarding properly archiving: Shoot, yeah I just realised that.
01:59:47<TheTechRobo>Leave a message on my talk page once the mediafire project is implemented with folder support
01:59:54<TheTechRobo>and i'd either submit it to the urls.ajay.app
02:00:08<TheTechRobo>or i'd "borrow" some code :P
02:00:09<@JAA>Just submit it now. I can guarantee nobody will notify you. lol
02:00:41<TheTechRobo>Oh, it's back up
02:00:45<Jake>I'll 'remember'
02:00:56<TheTechRobo>Nah it's fine now
02:00:59<TheTechRobo>I thought the site was still down
02:01:37<Ajay>yea, fixed it today
02:02:02<TheTechRobo>Nice website btw
02:02:22<TheTechRobo>Wish I could design like that
02:05:08TheTechRobo quits [Remote host closed the connection]
02:05:33TheTechRobo joins
02:07:01TheTechRobo quits [Remote host closed the connection]
02:07:19archiveteam-ot joins
02:07:30archiveteam-ot quits [Remote host closed the connection]
02:08:25TheTechRobo joins
02:12:12TheTechRobo quits [Remote host closed the connection]
03:12:06<h2ibot>Tech234a created Using Heroku (+3703, Create Heroku page): https://wiki.archiveteam.org/?title=Using%20Heroku
03:14:04HP_Archivist quits [Ping timeout: 258 seconds]
03:23:39qw3rty_ joins
03:27:29qw3rty__ quits [Ping timeout: 258 seconds]
03:53:40<jodizzle>Vimeo account including popular videos being deleted: https://twitter.com/fatalfarm/status/1416117865594249216. Might be good to grab.
03:55:46fdsdfs joins
03:55:51Iki1 quits [Ping timeout: 258 seconds]
04:06:07fdsdfs leaves
04:09:01<Ryz>Inb4 archiving Vimeo? s:
04:13:37<Ryz>This isn't the first time either: https://twitter.com/Maffewgregg/status/1251817769336745984
04:17:16DogsRNice quits [Read error: Connection reset by peer]
04:17:48HP_Archivist (HP_Archivist) joins
04:24:36<jodizzle>Oh, and here's a direct link to the account: https://vimeo.com/fatalfarm
05:04:02lennier1 quits [Client Quit]
05:08:39lennier1 (lennier1) joins
05:12:54Ajay_m quits [Ping timeout: 258 seconds]
05:14:52Ajay_m joins
05:33:45Ryz quits [Remote host closed the connection]
05:35:16Ryz (Ryz) joins
05:36:10Ryz quits [Remote host closed the connection]
05:39:09<wizards>is there any better way to archive an unmigrated gamepedia wiki besides 'wget -r'?
05:43:16vela quits [Quit: Ping timeout (120 seconds)]
05:43:36vela (vela) joins
05:43:52Ryz (Ryz) joins
05:49:36<wizards>ah, nevermind. "WikiTeam" has tools available for it, and it happens they've already archived the specific wiki i was looking to back up
05:49:47flashmeow quits [Quit: ZNC 1.8.2 - https://znc.in]
05:50:17flashmeow (flashmeow) joins
05:50:28HackMii quits [Ping timeout: 258 seconds]
05:51:52igloo22225 quits [Quit: Ping timeout (120 seconds)]
05:52:07vela quits [Client Quit]
05:52:19ave quits [Quit: Ping timeout (120 seconds)]
05:52:28Doran quits [Read error: Connection reset by peer]
05:52:34<h2ibot>Tech234a edited Using Heroku (+4, /* Required files for web deployability of…): https://wiki.archiveteam.org/?diff=46989&oldid=46988
05:52:39HackMii (hacktheplanet) joins
05:52:40ave (ave) joins
05:54:08lun4 quits [Quit: Ping timeout (120 seconds)]
05:54:26lun4 (lun4) joins
05:56:13Jonboy345 quits [Ping timeout: 258 seconds]
05:57:31ave quits [Client Quit]
05:58:09ave (ave) joins
06:07:07Doran (Doranwen) joins
06:12:12Doran is now known as Doranwen
06:15:34lunik1 quits [Client Quit]
06:19:46lunik1 joins
06:19:58lunik1 quits [Client Quit]
06:21:31lunik1 joins
06:30:39<h2ibot>Tech234a edited Using Heroku (+2708, Add 30 second warning, example repo,…): https://wiki.archiveteam.org/?diff=46990&oldid=46989
06:57:44<h2ibot>Tech234a edited Using Heroku (+350, Additional suggestions): https://wiki.archiveteam.org/?diff=46991&oldid=46990
07:26:39spirit joins
07:29:00BlueMaxima quits [Read error: Connection reset by peer]
08:35:50HP_Archivist quits [Ping timeout: 250 seconds]
12:39:59Mateon1 quits [Remote host closed the connection]
12:55:24dm4v quits [Read error: Connection reset by peer]
12:55:52dm4v joins
12:55:54dm4v quits [Changing host]
12:55:54dm4v (dm4v) joins
12:58:26dm4v quits [Read error: Connection reset by peer]
12:59:50dm4v joins
12:59:52dm4v quits [Changing host]
12:59:52dm4v (dm4v) joins
13:26:46Mateon1 joins
14:09:15Iki joins
14:30:39Ajay_m quits [Read error: Connection reset by peer]
14:30:56Ajay_m joins
15:44:15Arcorann quits [Ping timeout: 258 seconds]
15:49:53<ats>.4
16:08:45<@JAA>A Reddit thread just reminded me of the Supercell forums. They were discussed here in early May, but I forgot about them. They're read-only since 30 June and will go down in August. Will set up a qwarc grab now.
16:10:17<h2ibot>JustAnotherArchivist edited Deathwatch (+369, /* 2021 */ Add Supercell forums): https://wiki.archiveteam.org/?diff=46992&oldid=46982
16:10:18<h2ibot>Thezt edited Hong Kong media (+286): https://wiki.archiveteam.org/?diff=46993&oldid=46985
16:33:54gazorpazorp quits [Quit: WeeChat 2.3]
16:43:17jtagcat quits [Ping timeout: 258 seconds]
16:52:54jtagcat (jtagcat) joins
16:59:23jtagcat quits [Ping timeout: 258 seconds]
17:01:43jtagcat (jtagcat) joins
17:38:11<Ryz>There may be another new layout on the YouTube video pages~ oo;
17:39:13<Ryz>I wish I can can share a screenshot but I tend to instinctively clear out the cookies to get back to the previous layout <#>;
18:14:07DogsRNice (Webuser299) joins
18:16:45DogsRNice quits [Remote host closed the connection]
18:17:16DogsRNice (Webuser299) joins
18:47:16HP_Archivist (HP_Archivist) joins
18:51:13user1 joins
18:51:27user1 is now known as gazorpazorp
19:00:56Jonboy345 joins
21:09:19Lord_Nightmare quits [Ping timeout: 258 seconds]
21:17:52ivan (ivan) joins
21:23:34Ajay_m quits [Read error: Connection reset by peer]
21:24:14Ajay_m joins
21:28:44Lord_Nightmare (Lord_Nightmare) joins
22:02:20spirit quits [Client Quit]
22:07:58Ajay_m quits [Read error: Connection reset by peer]
22:08:54Ajay_m joins
22:17:56Ajay_m quits [Read error: Connection reset by peer]
22:24:27HP_Archivist quits [Ping timeout: 258 seconds]
22:31:50driib9 (driib) joins
22:32:44Ajay_m joins
22:35:34driib quits [Ping timeout: 258 seconds]
22:35:34driib9 is now known as driib
22:41:07Ajay_m quits [Read error: Connection reset by peer]
22:41:09Ajay_m joins
23:10:37Megame (Megame) joins
23:11:48HP_Archivist (HP_Archivist) joins
23:36:32lunik1 quits [Client Quit]
23:39:46Ajay_m quits [Read error: Connection reset by peer]
23:40:40Ajay_m joins
23:49:41lunik1 joins
23:57:42balrog quits [Quit: Bye]

HomeSearchPrevious dayNext day