00:28:10Mikesky quits [Client Quit]
00:44:00hooway quits [Client Quit]
00:54:19kozet joins
00:55:16<mgrandi>I assume snscrape doesn't know how to handle videos from "dlive" ?
00:56:14<mgrandi>Regardless, https://mobile.twitter.com/CULTUREWARCRMNL probably should be thrown in archive bot, 96 tweets, see https://www.vice.com/en/article/qjpjk7/mysterious-monolith-update-racists-destroy-california-monolith-proclaim-christs-superiority-to-space-aliens
00:56:47flirora quits [Ping timeout: 252 seconds]
00:56:52uruwi joins
00:57:52<benjins>mgrandi: youtube-dl can handle dlive streams
00:58:11<mgrandi>I keep forgetting youtube-dl is a jack of all trades
00:58:20<@JAA>I was going to ask whether you mixed up snscrape and youtube-dl there. snscrape most definitely does not.
00:58:58<mgrandi>I thought one of them would try and download videos if they were linked
00:59:04kozet quits [Ping timeout: 240 seconds]
00:59:18<mgrandi>Is that only if they are natively attached (aka a twitter video?)
00:59:42<@JAA>snscrape extracts the information for videos on Twitter but doesn't download anything.
01:01:34<mgrandi>I'll see if I can at least dl those manually,
01:05:40VADemon quits [Read error: Connection reset by peer]
01:14:49kozet joins
01:17:04uruwi quits [Ping timeout: 240 seconds]
01:21:04marked1957 quits [Ping timeout: 240 seconds]
01:34:15marked1957 joins
01:43:54uruwi joins
01:46:04kozet quits [Ping timeout: 240 seconds]
02:00:01Dallas quits [Client Quit]
02:03:44Dallas (Dallas) joins
02:17:56guesst1 quits [Remote host closed the connection]
02:30:16<uruwi>well that's an interesting topic
02:30:21uruwi is now known as flirora
02:31:09lukash quits [Quit: WeeChat 2.9]
02:34:40lukash (lukash) joins
02:43:16thuban joins
02:43:59<thuban>what's the appropriate way to request a metadata correction on ia?
03:14:44lennier2 joins
03:17:24lennier1 quits [Ping timeout: 240 seconds]
03:17:25lennier2 is now known as lennier1
04:31:04qw3rty_ joins
04:32:10Arcorann (Arcorann) joins
04:34:24qw3rty__ quits [Ping timeout: 240 seconds]
04:53:18<purplebot>ArchiveTeam Warrior edited by Tech234a (+505, Add notice that the Warrior is …) just now -- https://www.archiveteam.org/?diff=45859&oldid=45716
05:00:18<purplebot>腾讯微博 edited by Tech234a (-4, Project is done) just now -- https://www.archiveteam.org/?diff=45860&oldid=45503
05:05:18<purplebot>Current Projects edited by Tech234a (+6, Move Tencent Weibo to Recently …) just now -- https://www.archiveteam.org/?diff=45861&oldid=45811
05:09:19<purplebot>Google Sites edited by Tech234a (+0, Project is in progress) just now -- https://www.archiveteam.org/?diff=45862&oldid=45736
05:11:18<purplebot>GitHub edited by Tech234a (+131, Project is in progress, add source …) just now -- https://www.archiveteam.org/?diff=45863&oldid=45459
07:18:25<OrIdow6>From that announcement on Reddit: "Access to FRESH LIVE will be suspended on Friday, December 18"
07:42:21kozet joins
07:44:52flirora quits [Ping timeout: 252 seconds]
07:45:01VADemon joins
09:02:12hooway joins
10:05:38<endrift>oh, hey, I tried to ask Jason this on twitter a few days ago but I'm not sure he saw it
10:05:55<endrift>I have a huge collection of old video game manuals that was distributed online a few years back
10:06:12<endrift>not sure if it's made it onto IA yet and I wasn't sure how to check or how to get it to them if it hasn't
10:06:30<endrift>yes I know this isn't the IA channel but I figured people who would know where to direct me might be in this channel
10:35:49<jodizzle>endrift: This channel probably works, but you might have better luck on #internetarchive
11:21:54uruwi joins
11:24:30kozet quits [Ping timeout: 252 seconds]
11:26:18<purplebot>Webzdarma edited by Sanqui (+25, add page 14) just now -- https://www.archiveteam.org/?diff=45864&oldid=45821
11:26:44uruwi quits [Ping timeout: 240 seconds]
11:29:16ragu__ (ragu) joins
11:31:39<Sanqui>ragu__: do you know if the m3u8 files are linked as https://movie.freshlive.tv//playlist/1473.m3u8 or https://movie.freshlive.tv/playlist/1473.m3u8
11:31:44<Sanqui> // or /
11:32:53<ragu__>I was sending a message to a different channel, please let me resend it.
11:33:00<ragu__>Japanese video site FreshLive (https://freshlive.tv/) ended in November. The video archive will be deleted soon.
11:33:04<ragu__>I got the list of m3u8, but it's a lot.
11:33:09<ragu__> https://38.gigafile.nu/download.php?file=0202-dc03f055e923e3aff840fdd3b7fae7886
11:34:09<Sanqui>I got your list
11:34:43<ragu__>Actually it seems that you can download either, but when playing on the official page is /
11:35:07<Sanqui>good, that means / is the canonical URL so I will replace
11:35:26<Sanqui>is this all the videos?
11:37:18<purplebot>FreshLive created by Sanqui (+401, start page) just now -- https://www.archiveteam.org/?diff=45865&oldid=0
11:37:48<Sanqui>(I have started a project page on the wiki)
11:39:28<ragu__>I have not been able to get all of them. I'm trying all downloads now.
11:39:40<ragu__>There are some videos only for members.
11:40:24<Sanqui>understood. I can put the list of URLs into ArchiveBot, so they will get archived and injected into the Wayback Machine
11:40:39<Sanqui>should I put your current list in, or should I wait if you can get more?
11:45:05<ragu__>I think you should put my current list in.
11:45:07<ragu__>Get all the lists, remove duplicates from the previous list, and then resend the list here.
11:45:54<Sanqui>alright
11:46:21<OrIdow6>endrift: If you have no idea what the metadata on corresponding IA items would look like, you could use the full-text search (over many samples, the OCR still isn't perfect) to try to check
11:46:58<OrIdow6>Honestly, you are less likely to get replies in #internetarchive , but most of the people who will reply are there already, and it makes it easier to search through logs
11:48:00<Sanqui>ragu__: archivebot jobs in progress
11:48:31<Sanqui>endrift: there's also the Internet Archive discord
11:49:04<Sanqui>https://discord.gg/sMdZSvDY
11:50:08<OrIdow6>Wow, those are big m3u8s
11:50:37<OrIdow6>(Though maybe that's common, not an area I'm very familiar with)
12:10:18<purplebot>FreshLive edited by Sanqui (+118, website job) 22 minutes ago -- https://www.archiveteam.org/?diff=45866&oldid=45865
12:36:18<ragu__>https://16.gigafile.nu/download.php?file=0202-d31395549840fa32bb37f0547d91651c1
12:36:19<ragu__>This is almost all files.
12:36:19<ragu__>Some videos may have already been deleted or may not be available for download due to members only.
12:52:23<OrIdow6>Mirror: https://transfer.notkiska.pw/WgF6X/gigafile_0202-d31395549840fa32bb37f0547d91651c1.txt
13:00:29ragu_ joins
13:03:30ragu__ quits [Ping timeout: 252 seconds]
13:08:20<VADemon>Sanqui: dont put the m3u8 in the archivebot its useless as well as his list
13:09:09<VADemon>I dont know how much video is available here, a couple hundred thousands existed judging by IDs, but most of it was probably temporary
13:12:39<VADemon>Also I fucking hope that the edits to the Freshlive page on the wiki didnt overwrite my yesterdays write up that's hanging in moderation queue
13:30:30<OrIdow6>Well, it's done now
13:31:45<OrIdow6>Neither of the grabs that have been run so far have extracted the actual video links, I think because it's not a mimetype that wpull will do extraction on
13:33:02<OrIdow6>I remember someone saying something in the last few days about how merge conflicts with the moderation thing need to be manually resolved
13:37:57<VADemon>nice to hear
14:16:29Arcorann quits [Ping timeout: 252 seconds]
14:29:39cadence quits [Remote host closed the connection]
15:07:04<Sanqui>VADemon: why are the m3u8s useless?
15:08:16<Sanqui>also, can we PLEASE get rid of the wiki moderation thing, we already have the registration barrier... it's really annoying and pointless... jrwr please
15:09:34<@jrwr>@Sanqui Um, No. You can request for approval to bypass the moderation, It does catch a far bit of spam
15:10:19<Sanqui>jrwr: is the spam being submitted by accounts which registered with the secret word? that tells me the word needs to be rotated
15:10:43<@jrwr>There is no secret work registration anymore
15:10:46<Sanqui>oh, I see
15:10:49<@jrwr>its Self Service now
15:11:15<Sanqui>ok, how about approving people as soon as soon as it's clear their first edits were constructive?
15:11:40<Sanqui>most people won't realize they need to request, nor who to even pester about it, they'll just be frustrated
15:12:10<@jrwr>There is currently no automated process for approval
15:13:24<Sanqui>I understand it's not automated, but somebody is approving edits, correct?
15:13:51<@jrwr>Correct, there is a whole team of people who review the edits, even a IRC channel showing pending edits to be approved
15:14:38<Sanqui>I'm proposing that maybe people who have made constructive edits should be pro-actively added to bypass the moderation queue
15:15:04<Sanqui>because it's really unlikely to have contributors-turned-spammers
15:15:07<@jrwr>The team decides who that is and is added into the role that allows the bypass
15:15:14<@jrwr>We have had... a few go bad
15:16:59<Sanqui>okay
15:17:36<Sanqui>so alternatively, I'm nominating myself to join that team as an active wiki editor since 2014
15:18:17<Sanqui>thanks for your consideration!
15:24:55<@JAA>Worth mentioning that while there are several of us who can moderate edits, only three people can add users to the whitelist, and they're not always easy to reach.
15:26:25<@jrwr>I mean JAA you are on that list, so its really four
15:27:32<@jrwr>https://usercontent.irccloud-cdn.com/file/sT4KFHhc/image.png
15:27:34<@jrwr>Yep
15:27:42<@JAA>Yeah, since a minute, cheers. :-)
15:27:47<@jrwr>heheh
15:27:56@jrwr goes back to hacking things
15:28:19<phuzion>Mind if I get automoderated too?
15:29:49<@JAA>Anyone who wants to get automoderated, ping me with your wiki username, and I'll take a look later.
15:38:28<@jrwr>The joys of delegation
15:41:24<@JAA>:-)
15:52:09<@JAA>SketchTheCow: Did the uploads break on teamarchive1? No disk space decrease in 2 days and in particular none today despite no further incoming data.
15:54:27<thuban>hm... i don't remember ever asking to be automodded, but i don't think my edits have ever been held for moderation. did we not probate people when we were doing secret-word signups?
15:58:14<phuzion>thuban: what's your username on wiki?
15:58:26<@JAA>thuban: There was no moderation thing when the secret word was still a thing.
15:58:26<thuban>phuzion: switchnode
15:58:32<phuzion>I don't believe we automodded users who signed up with the secret word
15:58:32<thuban>aha
15:58:52<@JAA>Nobody was automatically automodded, only people who asked for it.
15:58:53<phuzion>And yeah, you're only in Autoconfirmed users, which is effectively useless as a group now with moderation
16:01:18<purplebot>Deathwatch edited by VADemon (+132, /* 2020 */ Add Freshllive) just now -- https://www.archiveteam.org/?diff=45867&oldid=45838
16:02:18<purplebot>Discourse edited by Themadprogramer (+128) just now -- https://www.archiveteam.org/?diff=45868&oldid=45828
16:02:18<purplebot>Move Archiveteam to Hackint edited by Nemo bis (+383, /* In Favor of Staying at EFNet …) just now -- https://www.archiveteam.org/?diff=45869&oldid=45552
16:03:13<@JAA>VADemon: You're automodded now.
16:04:05<@JAA>thuban: ^
16:04:22<thuban>JAA: thanks!
16:04:42<@JAA>VADemon: Also, your edit does not conflict with the other ones because you used a different page title. Someone will have to merge those two pages.
16:05:18<purplebot>FreshLive edited by Ragu (+159) just now -- https://www.archiveteam.org/?diff=45871&oldid=45866
16:05:44VADemon quits [Ping timeout: 252 seconds]
16:06:19<purplebot>Freshlive created by VADemon (+3579, Create) just now -- https://www.archiveteam.org/?diff=45872&oldid=0
16:06:22<@JAA>^ These two.
16:07:18<@JAA>phuzion: You're also automodded now.
16:07:23<phuzion>Thanks!
16:20:41<katocala>!d 7lkbx97o7yvu064yam9ccbe37 1000 2000
17:28:29cadence (cadence) joins
17:51:20thuban quits [Ping timeout: 252 seconds]
18:13:44mutantmonkey quits [Ping timeout: 240 seconds]
18:15:28mutantmonkey (mutantmonkey) joins
18:29:32Wayward (wayward) joins
18:42:51mutantmonkey quits [Remote host closed the connection]
18:43:10mutantmonkey (mutantmonkey) joins
18:45:47Craigle quits [Ping timeout: 244 seconds]
18:45:52mutantmonkey quits [Remote host closed the connection]
18:46:09mutantmonkey (mutantmonkey) joins
18:49:09<Ryz>Thoughts on proactively archiving Imgur? It appears it's getting to the end of the lifecycle of a image hosting website as when you upload an image, the uploading won't start until you finish watching a 30 second video ad
18:49:30<Ryz>https://i.imgur.com/BzR89uX.png
18:52:50<EggplantN_>im sure its planned im #imgone i think?
18:54:20Craigle (Craigle) joins
18:58:52<@JAA>Yep, channel exists and some discussion happened when they stopped hotlink support, but nothing is planned specifically (yet).
19:00:12<grawity>in relation to https://twitter.com/HoffmanLabs/status/1334194416727289856, is anyone interested in archiving that 26GB of zip files, and is there any place I could dump them (that doesn't involve a web-based uploader)?
19:05:56VADemon joins
19:10:46<@JAA>grawity: You could upload it to the Internet Archive (with the `ia` CLI from the Python package internetarchive).
19:11:07<@JAA>It's not available anymore if I'm reading those tweets correctly?
19:12:34<Sanqui>I've been archiving various forums and a major motivator for that has been external images hosted on imgur
19:12:53<grawity>the site is technically available, but the main index page is gone, so the files are only accessible by known URL
19:13:32<grawity>but I think the *other* sites (i.e. the main product website of openvms) are already gone though
19:13:38<grawity>this is just the docs
19:14:22<@JAA>Right
19:14:32<@JAA>We could throw those URLs into ArchiveBot if you have them.
19:16:49<@JAA>Then they'd end up in the Wayback Machine in a couple days or so.
19:17:47<grawity>index https://paste.rs/Yut, the directly web-accessible docs https://paste.rs/Tp9, and the archived ZIP files (containing some Windows-only Bookreader thing) https://paste.rs/5Nb
19:32:33<@JAA>Perfect, thanks, I'll get that into ArchiveBot shortly.
19:34:49<grawity>ahh I just understood, some of those other sites that are gone now (changelogs, patches) were also under the same domain, it's just /odl (docs) that mysteriously remains
20:02:45<endrift>OrIdow6: I did try that already and found at least one manual that I had that seemed to be missing, but they did have the game itself--with a slightly different name. I tried that too, and no luck. I was on my phone so I stopped there. A more in-depth
20:02:57<endrift>search would be needed maybe
20:25:07<@JAA>grawity: All added to ArchiveBot. I found two more docs in the index that weren't in your list: http://h30266.www3.hpe.com/odl/vsilp/ http://h30266.www3.hpe.com/odl/vsios/
22:03:07Mikesky_ joins
22:04:28Mikesky_ quits [Client Quit]
22:07:31Mikesky_ (Mikesky) joins
22:08:18<purplebot>File:Freshlivetv-official-57266-20201204.webp uploaded by VADemon (+0, https://freshlive.tv/official/57266) just now -- https://www.archiveteam.org/?diff=45873&oldid=0
22:08:19Mikesky_ quits [Client Quit]
22:08:37Mikesky (Mikesky) joins
22:08:51<VADemon>Big error time: it's a .webp and is allowed for upload - "Error creating thumbnail: convert: no decode delegate for this image format"
22:10:18<purplebot>File:Freshlive-logo.svg.png uploaded by VADemon (+0, Since PNGs are not allowed for …) just now -- https://www.archiveteam.org/?diff=45874&oldid=0
22:13:19<purplebot>File:Freshlivetv-official-57266-20201204.png uploaded by VADemon (+0, https://freshlive.tv/official/57266) just now -- https://www.archiveteam.org/?diff=45875&oldid=0
22:14:17<purplebot>Freshlive edited by VADemon (+97, Add images) just now -- https://www.archiveteam.org/?diff=45876&oldid=45872
22:15:18<purplebot>File:Cnet-forums 2020-12-02.png uploaded by VADemon (+0) just now -- https://www.archiveteam.org/?diff=45877&oldid=0
22:17:18<purplebot>File:Cnet-redball-logo.svg.png uploaded by VADemon (+0, Since the upload of SVG is disabled, …) 1 minute ago -- https://www.archiveteam.org/?diff=45878&oldid=0
22:17:18<purplebot>CNET Forums edited by VADemon (+51, Add images) just now -- https://www.archiveteam.org/?diff=45879&oldid=45837
22:19:55<tech234a>Wiki signup page text needs an update: “If you need help, Join the efnet.org/#archiveteam IRC Channel”
22:27:32<@JAA>Hmm, yeah, no idea where that needs to be changed.
22:27:34<@JAA>jrwr: ^
22:27:47<@JAA>Also, I feel it should point to -bs.
22:28:45<@jrwr>It should point to BS, also you're going to want to look in the templates namespace or in the translation table I'm currently indisposed or I would update it myself
22:31:03<@JAA>Couldn't find it through the search or Special:AllMessages.
22:39:44<@JAA>Might be part of the captcha thingy?
23:29:41Arcorann (Arcorann) joins