HomeSearchPrevious dayNext day

00:08:06<OrIdow6>Good
00:11:47hooway quits [Client Quit]
00:41:17HP_Archivist (HP_Archivist) joins
00:47:13daalekz joins
00:52:44Merzius quits [Ping timeout: 244 seconds]
00:54:05Merzius joins
00:58:39britm0b joins
01:02:04britmob quits [Ping timeout: 240 seconds]
01:06:38Merzius leaves
01:16:17godane2 joins
01:17:06godane1 quits [Read error: Connection reset by peer]
01:18:58godane2 quits [Client Quit]
01:22:23godane joins
02:26:59<purplebot>So-net U-Page+ edited by JustAnotherArchivist (-3, Fix IRC channel) just now -- https://www.archiveteam.org/?diff=46245&oldid=46237
03:02:49jonboy3452 joins
03:05:44Jonboy3451 quits [Ping timeout: 240 seconds]
04:05:35DogsRNice quits [Read error: Connection reset by peer]
04:15:51qw3rty_ joins
04:19:38qw3rty quits [Ping timeout: 265 seconds]
04:22:29<Arcorann>Has anyone discussed plans for Storyfire yet?
04:23:11crispyalice2 (crispyalice2) joins
04:23:22<Arcorann>https://teddit.net/r/DataHoarder/comments/l5ixas/storyfire_a_youtube_competitor_is_shutting_down/ <-- apparently they're opening export tools for the site's last week
04:25:26<Ajay>the comments say that it's all hosted on vimeo
04:29:44<@JAA>Yep, I noticed the same thing earlier.
04:30:03<@JAA>'YouTube competitor' that hosts all the data on another competitor. lol
04:30:30<Ajay>I don't think it is actually just vimeo videos though, seems to be just using their infrastructure
04:31:52<Ajay>I copied the "vimeoExternalURL" and got a valid m3u8 file with audio only. I couldn't get it into a vimeo website url though
04:54:16<OrIdow6>https://github.com/StoryFire/vimeo-upload-privacy - fork of a Node.JS/JS vimeo uploader for "custom privacy settings", whose changes I don't understand
04:55:09godane1 joins
04:56:43<Jake>I'm pretty sure you can make it so videos can only be embedded and not visible on vimeos website.
04:57:12<OrIdow6>That's what I'd guess, just from the name
04:57:32<OrIdow6>Anyone see a way to go through the whole site yet?
04:57:37godane quits [Ping timeout: 252 seconds]
04:57:50<OrIdow6>If not I might write something to go through the subscribers/subscribee graph to try to make a list
05:02:04<OrIdow6>Also, assuming that the Vimeo-hosted videos are going to go down/become inaccessible once it shuts down, how to save it? Tubeup-style or in warcs? (This is almost certainly not going to play back; so far I've seen expiration timestamps, random parameters, and websocket)
05:04:44<@JAA>I thought Vimeo worked reasonably well. At least it did last time I checked an AB grab that came across Vimeo. Maybe not in this embed-style thing though.
05:08:05<@JAA>As far as I can see, the .m3u8 URL is directly embedded in (a JS object in) the HTML page for a video. The timestamps, session parameter, and OAuth token shouldn't matter, although it would mean we can't delay the video retrieval.
05:08:24<@JAA>No JS mangling of that URL either.
05:13:13<OrIdow6>Oh, you're right
05:18:33etnguyen03 quits [Client Quit]
05:50:22ivan (ivan) joins
05:50:55<ivan>does anyone have a mirror of libgen or scimag or arxiv that they could ripgrep for youtube links?
06:03:55<ivan>well this is somewhat helpful http://search.arxiv.org:8081/?query=%22youtu.be%22
06:32:04godane1 quits [Ping timeout: 265 seconds]
06:40:42Ryz quits [Remote host closed the connection]
06:41:24aphitex quits [Ping timeout: 240 seconds]
06:42:01Ryz (Ryz) joins
06:43:43aphitex (aphitex) joins
06:43:53<OrIdow6>My list of StoryFire is up to 250k, by the way - most don't have videos
06:44:03<OrIdow6>250k users
07:02:24mutantmonkey quits [Remote host closed the connection]
07:02:41mutantmonkey (mutantmonkey) joins
07:51:06<Sanqui>[00:21:34] <OrIdow6^2> Sanqui: Are you saying that you think deletion of inactive accounts is accelerating?
07:51:33<Sanqui>Yeah. I also think they have some failed disks, because there's a fraction of pages across websites that look correct but 502
07:53:18<Sanqui>also when I started the project they claimed to be hosting 151 331 websites and now it's 98 431 lol
07:53:37<OrIdow6>Sounds like that would be simple enough - it's nearly identical to So-Net
07:53:47<OrIdow6>As a warrior project, I mean
07:53:52BlueMaxima quits [Client Quit]
07:54:07godane (godane) joins
07:54:25<Sanqui>To be fair, the no-offsites job I've run overnight has gone through so fast, I can blast through the rest just with archivebot
07:54:55<Sanqui>the Warrior project wouldn't grab offsite links either
07:55:23<OrIdow6>It's flexible; So-Net is set up to do so
07:55:41<Sanqui>hmm
07:55:58<Sanqui>ok, but honestly these jobs need quite a bit of monitoring for ignores
07:56:04<Sanqui>there's a lot of php junk
07:56:12<OrIdow6>But if the AB solution works for you, there's no harm in using it
07:56:12<Sanqui>calendars and unbounded pagination
07:56:26<OrIdow6>Ah, I see, it's dynamic
07:56:34<Sanqui>yep
07:56:37<Sanqui>it's like geocities with php
07:57:12<Sanqui>anyway I gotta run atm, thanks for the talk and I'll try to connect to hackint on my bouncer from my phone in circa 10 mins lol
07:57:26<OrIdow6>Ok
08:40:43hooway joins
08:50:38godane1 joins
08:53:12godane quits [Ping timeout: 265 seconds]
08:55:40godane2 joins
08:57:58godane1 quits [Ping timeout: 252 seconds]
08:59:08godane1 joins
09:00:18britmob2 quits [Client Quit]
09:01:24godane2 quits [Ping timeout: 240 seconds]
09:09:15Mossaab joins
09:10:22<Mossaab>Hi! First timer here. Any idea where I can find Twitter stream of the months Oct-Dec 2019? They seem to be missing from https://archive.org/details/twitterstream.
09:12:40godane2 joins
09:15:01godane1 quits [Ping timeout: 252 seconds]
09:27:44taka quits [Remote host closed the connection]
09:29:28Taka joins
09:38:23pilgrim (pilgrim) joins
09:46:04mutantmonkey quits [Ping timeout: 240 seconds]
09:46:45mutantmonkey (mutantmonkey) joins
11:20:24Barto quits [Ping timeout: 240 seconds]
11:57:21<OrIdow6>https://blog.google/threat-analysis-group/new-campaign-targeting-security-researchers/ - Twitter accounts and websites covertly run by North Korea - can someone put these into AB?
12:08:00Barto (Barto) joins
12:27:12jeff-kao-propublica-org quits [Quit: My MacBook has gone to sleep. ZZZzzz…]
12:50:59<purplebot>Webzdarma edited by Sanqui (+38, webzdarma_subdomainfinder_06) just now -- https://www.archiveteam.org/?diff=46246&oldid=46244
13:09:44daalekz quits [Ping timeout: 240 seconds]
13:14:06jonboy3452 quits [Client Quit]
13:14:31jonboy3452 joins
13:49:31britmob2 joins
14:32:59betamax quits [Ping timeout: 265 seconds]
14:33:07betamax (betamax) joins
14:37:04Arcorann quits [Ping timeout: 240 seconds]
14:46:55dela joins
15:04:46jeff-kao-propublica-org joins
15:26:39LeGoupil joins
15:32:15Merzius joins
15:53:27dela quits [Read error: Connection reset by peer]
16:02:25dela joins
16:13:19dela quits [Read error: Connection reset by peer]
16:38:12tech234a quits [Read error: Connection reset by peer]
16:38:12revi quits [Read error: Connection reset by peer]
16:38:12ThisAsYou quits [Read error: Connection reset by peer]
16:38:12brad quits [Read error: Network is unreachable]
16:38:12themadpro quits [Read error: Network is unreachable]
16:38:12Dallas quits [Read error: Connection reset by peer]
16:38:13rolll quits [Read error: Network is unreachable]
16:38:14@HCross quits [Read error: Connection reset by peer]
16:39:35ThisAsYou joins
16:39:37ftl_ joins
16:39:39Ctrl-S_ joins
16:39:39VonGuard_ joins
16:39:41space_ (space) joins
16:39:41mgrandi_ (mgrandi) joins
16:39:43devsnek_ (devsnek) joins
16:39:53jrwr_ (jrwr) joins
16:39:53@ChanServ sets mode: +o jrwr_
16:39:59HCross (HCross) joins
16:39:59@ChanServ sets mode: +o HCross
16:40:09Kaz___ joins
16:40:10tech234a (tech234a) joins
16:40:28spirit joins
16:40:34hook54321_ (hook54321) joins
16:40:35@ChanServ sets mode: +o hook54321_
16:40:45deni_ (deni) joins
16:40:50rolll joins
16:40:53Dallas (Dallas) joins
16:40:57justcool393_ (justcool393) joins
16:40:57JSharp_ (JSharp) joins
16:41:00revi (revi) joins
16:41:00themadpro (themadpro) joins
16:41:10EggplantN_ joins
16:41:24mgrandi quits [Ping timeout: 600 seconds]
16:41:24devsnek quits [Ping timeout: 600 seconds]
16:41:24@jrwr quits [Ping timeout: 600 seconds]
16:41:24Ctrl-S quits [Ping timeout: 600 seconds]
16:41:24justcool393 quits [Ping timeout: 600 seconds]
16:41:24justcool393_ is now known as justcool393
16:41:24devsnek_ is now known as devsnek
16:41:24Ctrl-S_ is now known as Ctrl-S
16:41:24mgrandi_ is now known as mgrandi
16:41:24@jrwr_ is now known as @jrwr
16:41:44Kaz__ quits [Ping timeout: 600 seconds]
16:41:44EggplantN quits [Ping timeout: 600 seconds]
16:41:44Kaz___ is now known as Kaz__
16:41:44EggplantN_ is now known as EggplantN
16:42:10yawkat quits [Ping timeout: 252 seconds]
16:42:24brad joins
16:42:35dela joins
16:43:04VonGuard quits [Ping timeout: 600 seconds]
16:43:04space quits [Ping timeout: 600 seconds]
16:43:04VonGuard_ is now known as VonGuard
16:43:04space_ is now known as space
16:44:04@hook54321 quits [Ping timeout: 600 seconds]
16:44:04@hook54321_ is now known as @hook54321
16:44:44ftl quits [Ping timeout: 600 seconds]
16:44:44JSharp quits [Ping timeout: 600 seconds]
16:44:44ftl_ is now known as ftl
16:44:44JSharp_ is now known as JSharp
16:45:24deni quits [Ping timeout: 600 seconds]
16:45:24deni_ is now known as deni
16:45:28Mossaab quits [Ping timeout: 244 seconds]
16:46:20EggplantN quits [Changing host]
16:46:20EggplantN (EggplantN) joins
16:47:19yawkat (yawkat) joins
16:59:02<@ChanServ>EggplantN now has flags +cv in the group !archiveteam-core which communally has +AFORSVefiorstv on #archiveteam-bs.
17:16:08dela quits [Read error: Connection reset by peer]
17:21:47@HCross quits [Read error: Connection reset by peer]
17:27:18HCross (HCross) joins
17:27:18@ChanServ sets mode: +o HCross
17:31:25Merzius leaves
17:54:33spirit quits [Client Quit]
18:00:25deni quits [Read error: Connection reset by peer]
18:00:27Ctrl-S quits [Read error: Connection reset by peer]
18:00:35justcool393 quits [Read error: Connection reset by peer]
18:00:36deni (deni) joins
18:00:37Ctrl-S joins
18:00:51justcool393 (justcool393) joins
18:04:04mgrandi quits [Read error: Connection reset by peer]
18:04:15mgrandi (mgrandi) joins
18:04:25space quits [Read error: Connection reset by peer]
18:04:31space (space) joins
18:09:26Stiletto quits [Remote host closed the connection]
18:13:29Ctrl-S quits [Read error: Connection reset by peer]
18:13:29justcool393 quits [Read error: Connection reset by peer]
18:16:24space quits [Ping timeout: 600 seconds]
18:16:38Ctrl-S joins
18:16:52JSharp quits [Read error: Connection reset by peer]
18:16:52EggplantN quits [Read error: Connection reset by peer]
18:16:52revi quits [Read error: Connection reset by peer]
18:17:00devsnek quits [Read error: Connection reset by peer]
18:17:04mgrandi quits [Ping timeout: 600 seconds]
18:17:04deni quits [Ping timeout: 600 seconds]
18:17:12space (space) joins
18:18:17deni (deni) joins
18:18:29devsnek (devsnek) joins
18:18:32revi (revi) joins
18:19:06JSharp (JSharp) joins
18:19:20EggplantN joins
18:19:49justcool393 (justcool393) joins
18:19:49mgrandi (mgrandi) joins
18:25:12JSharp quits [Read error: Connection reset by peer]
18:25:22deni quits [Read error: Connection reset by peer]
18:25:24justcool393 quits [Read error: Connection reset by peer]
18:25:24mgrandi quits [Read error: Connection reset by peer]
18:26:48deni (deni) joins
18:26:52justcool393 (justcool393) joins
18:28:42mgrandi (mgrandi) joins
18:31:46JSharp (JSharp) joins
18:37:42marked19573 joins
18:39:24marked1957 quits [Ping timeout: 240 seconds]
18:39:24marked19573 is now known as marked1957
18:50:49test joins
18:53:49ivan leaves
18:54:52EggplantN quits [Read error: Connection reset by peer]
18:59:04JSharp quits [Ping timeout: 600 seconds]
18:59:47Stiletto joins
19:02:11JSharp (JSharp) joins
19:02:24EggplantN joins
19:04:30etnguyen03 (etnguyen03) joins
19:05:35godane2 quits [Ping timeout: 265 seconds]
19:10:19EggplantN quits [Changing host]
19:10:19EggplantN (EggplantN) joins
19:10:19@ChanServ sets mode: +o EggplantN
19:22:28Stiletto quits [Remote host closed the connection]
19:29:59godane joins
19:31:41godane1 joins
19:32:31Stiletto joins
19:34:35godane quits [Ping timeout: 265 seconds]
19:41:17jonboy3452 quits [Client Quit]
19:42:15jonboy3452 joins
19:43:17astri (astri) joins
19:55:35DogsRNice (Webuser299) joins
20:05:09systwi_ (systwi) joins
20:06:44systwi quits [Ping timeout: 240 seconds]
20:26:05Ryz quits [Remote host closed the connection]
20:26:51Ryz (Ryz) joins
20:27:28LeighR joins
20:29:15sliccricc (sliccricc) joins
20:38:27benjinsmith joins
20:38:52Jake9 (Jake) joins
20:39:39Jake quits [Read error: Connection reset by peer]
20:39:39Jake9 is now known as Jake
20:40:19benjins quits [Ping timeout: 252 seconds]
20:40:19tzt quits [Ping timeout: 265 seconds]
20:40:44tzt joins
20:42:15balrog quits [Ping timeout: 265 seconds]
20:42:47balrog joins
20:58:39test quits [Remote host closed the connection]
21:25:16LeighR leaves
21:39:02daalekz joins
21:41:57Taka leaves
21:42:23taka joins
21:44:16benjinsmith is now known as benjins
21:46:04LeGoupil quits [Client Quit]
22:39:48hooway quits [Client Quit]
22:41:58astri quits [Ping timeout: 244 seconds]
22:49:01godane1 quits [Ping timeout: 252 seconds]
22:49:08godane joins
22:50:39godane1 joins
22:53:24godane quits [Ping timeout: 240 seconds]
23:00:36astri (astri) joins
23:04:07BlueMaxima joins
23:10:10Arcorann (Arcorann) joins
23:43:27icedice joins
23:46:25<icedice>JAA: Oh, that went fast. It was up just a few minutes ago. Did anyone grab any of it?
23:47:56<@JAA>We grabbed it with AB a couple times in the last few days. One job is currently running (and now paused). #shreddit probably also got a bunch of it.
23:51:44godane2 joins
23:54:28godane1 quits [Ping timeout: 252 seconds]
23:55:56<etnguyen03>I am (or was) grabbing WSB; I have posts through May 2015 (from Pushshift) and comments through January 2014 - if/when it opens back up I'll continue grabbing comments, posts can still be grabbed through Pushshift (and I'll still be)
23:58:20<Ryz>Oh wow, r/WallStreetBets went private because they can't ban bad people or bad actors fast enough: https://twitter.com/ladyinsanity/status/1354576719802290178
23:58:36godane1 joins

HomeSearchPrevious dayNext day