| 00:07:04 | | Barto quits [Ping timeout: 240 seconds] |
| 00:29:00 | <Ryz> | JAA, for the logs, I suppose URLs only filter could be interesting for quickly finding stuff even faster; I rarely use it but some people might use it~ |
| 00:36:30 | | Barto (Barto) joins |
| 00:49:11 | <lennier1> | tech234a: Cool site. Does crxcavator.io have a public list of all the apps/extensions/themes? |
| 00:57:56 | <tech234a> | lennier1: I'm not sure if they have a public list, but perhaps they could be asked for a list? |
| 01:00:08 | <tech234a> | https://api.crxcavator.io/v1/scans lists a few of the most recently scanned extension updates |
| 01:02:11 | <@JAA> | Yeah, I was just playing around with that endpoint. Can't find a pagination parameter though. |
| 01:02:36 | <@JAA> | The other endpoints require an extension ID. |
| 01:05:01 | <tech234a> | https://rss.crxcavator.io/ looks kind of S3-like |
| 01:05:08 | <@JAA> | Well, there's a search endpoint, but it only returns 5 results. |
| 01:05:16 | <tech234a> | Sample RSS: https://rss.crxcavator.io/hdokiejnpimakedhajhdlcegeplioahd.xml |
| 01:05:29 | <tech234a> | RSS for extension versions |
| 01:05:41 | <tech234a> | If it is an S3 bucket could it be listed? |
| 01:06:20 | <tech234a> | They also list an email address: support@crxcavator.io |
| 01:07:01 | <@JAA> | Looks like they locked it down. Unless we can find the underlying bucket and that is misconfigured, unlikely. |
| 01:07:58 | <tech234a> | Alright |
| 01:09:43 | <@arkiver> | JAA: any context on crxcavator? |
| 01:11:12 | <@arkiver> | also ping tech234a ^ |
| 01:11:31 | <@JAA> | arkiver: Google nuking paid extensions in the Chrome Web Store. crxcavator.io is an index and archive of extensions or something like that. |
| 01:12:21 | <@JAA> | Oh yeah, also nuking Chrome apps after that. |
| 01:12:22 | <@arkiver> | ah for december 1st |
| 01:12:40 | <@JAA> | Yeah and next year. |
| 01:12:41 | <@arkiver> | June 2022 right |
| 01:13:23 | <@arkiver> | I'll look into getting a project up for it |
| 01:13:25 | <lennier1> | June 2021 apps on Mac/Windows/Linux. June 2022 apps on Chrome OS. |
| 01:13:37 | <@arkiver> | they did give us plenty of time |
| 01:14:35 | <@arkiver> | so |
| 01:14:39 | <@arkiver> | coming up are the other .ee sites |
| 01:14:47 | <@JAA> | This is the S3 bucket that has the actual data, but also locked: https://extensions.crxcavator.io/ |
| 01:14:52 | <mgrandi> | http://My2020Census.gov is probably changing on the 15th, probably has been picked up by way back machine a bunch but maybe do a archive bot run of it |
| 01:15:20 | <@arkiver> | looks pretty quite for the rest of the year |
| 01:15:24 | <@arkiver> | also reddit is still up |
| 01:16:01 | <@JAA> | Docker Hub and Twitch Sings |
| 01:16:08 | <lennier1> | Might be some extensions with free trials or in-app purchases going away as soon as Demember 1. (And fully paid apps, which you could at least get metadata for.) |
| 01:16:57 | <@arkiver> | yeah I'm not completely sure what we'll do on docker hub |
| 01:17:13 | <@arkiver> | they're deleting PBs of data iirc |
| 01:17:32 | <lennier1> | There must be some process that these sites are using to scan the Chrome store, maybe an API for it? |
| 01:17:49 | <@JAA> | Yes, 4.5 PB according to their FAQ. |
| 01:18:00 | <mgrandi> | Maybe start with the docker files first? |
| 01:18:06 | <@arkiver> | yeah IA won't store that |
| 01:18:21 | <@arkiver> | we can get metadata at least |
| 01:18:27 | <@arkiver> | yeah and dockerfiles |
| 01:18:30 | <mgrandi> | Since those are the instructions to build said containers |
| 01:18:36 | <@arkiver> | yep |
| 01:18:37 | <@arkiver> | maybe |
| 01:18:38 | <mgrandi> | And you can reverse engineer after that |
| 01:18:49 | <@arkiver> | maybe this is a good chance to get a copy of all docker metadata :) |
| 01:19:02 | <mgrandi> | Do we need 4PB of alpine linux |
| 01:19:21 | <@JAA> | Maybe also the actual layers for official images and some other popular ones, though I'm not sure if those are affected at all. |
| 01:19:24 | <@arkiver> | let's set up a channel |
| 01:19:26 | <@JAA> | It'd be good to archive those regardless. |
| 01:19:38 | <@arkiver> | any ideas? |
| 01:19:41 | <mgrandi> | Also, for twitch sings, should I look into archiving comments? |
| 01:20:13 | <mgrandi> | I don't know if there is a CLI way to get twitch vods and clips yet, there is a GUI program at least, but nothing for comments exists anywhere |
| 01:20:29 | <mgrandi> | Failwhale? Lol |
| 01:20:41 | <mgrandi> | A twitter-ism but docker is a whale |
| 01:22:38 | <@arkiver> | :P failwhale sounds ok |
| 01:22:47 | <lennier1> | You have to set up a free Twitch developer account to use it, but there's this: https://github.com/PetterKraabol/Twitch-Chat-Downloader |
| 01:23:11 | <@arkiver> | JAA: did twitch use websockets for comments? |
| 01:23:26 | <@JAA> | On live chat, yes. IRC through WebSockets. |
| 01:23:46 | <@arkiver> | not archived that? |
| 01:24:01 | <@JAA> | Not sure how it works on VOD. |
| 01:24:02 | <@arkiver> | mgrandi: you have a twitch sings example? |
| 01:24:20 | <mgrandi> | Archived chat is JSON, not sure if it's web sockets or just long polling or what |
| 01:24:24 | <mgrandi> | https://success.mirantis.com/api/images/.%2Ferror-a-firewall-is-blocking-file-sharing-between-windows-and-the-containers%2Fimages%2Fimage.png |
| 01:24:32 | <mgrandi> | Docker even has a failwhale icon just for us |
| 01:24:57 | <@arkiver> | nice |
| 01:25:14 | <mgrandi> | I can get one later |
| 01:25:18 | | lennier1 is now authenticated as lennier1 |
| 01:25:25 | <mgrandi> | But twitch sings are just normal vods and clips I think |
| 01:32:45 | <@JAA> | #dick ? |
| 01:33:42 | <@arkiver> | uh :P |
| 01:33:48 | <@arkiver> | for twitch? |
| 01:33:53 | <@arkiver> | of docker |
| 01:33:55 | <@arkiver> | or |
| 01:34:07 | <@JAA> | Well, apparently it's not obvious enough, so I guess not. :-P |
| 01:34:13 | <@JAA> | I meant for Docker, via Moby Dick. |
| 01:34:42 | <lennier1> | Is there enough interest for a Chrome Web Store channel? #chromeweblore ? |
| 01:35:17 | <lennier1> | Surprised #dick wasn't already taken, lol. |
| 01:35:33 | <@arkiver> | ah lol |
| 01:35:46 | <@arkiver> | kinda liked failwhale |
| 01:37:14 | <@JAA> | Sure, although yeah, it's usually associated with Twitter. |
| 01:38:16 | <@JAA> | Not sure what happened with that purge of inactive accounts that was planned for late last year and then abandoned after Jason raised a shitstorm over the accounts of dead people that would be lost. |
| 01:49:18 | <purplebot> | Deathwatch edited by JustAnotherArchivist (-31, Sandboxie website to dead) just now -- https://www.archiveteam.org/?diff=45666&oldid=45664 |
| 01:50:40 | <benjins> | mgandi: Twitch VOD chat is accessible through "api.twitch.tv/v5/videos/{VIDEO_ID}/comments?content_offset_seconds={SECONDS_SINCE_START}" but requires setting the Client-ID header to "kimne78kx3ncx6brgo4mv6wki5h1ko" which is what web clients use (it's not secret) |
| 01:52:40 | <benjins> | I just check the chat messages returned, take the highest offset, and use that to compute the next seconds offset to request. Not sure if there's some other way of getting all messages |
| 01:53:15 | <benjins> | mgrandi: ^ |
| 01:57:16 | <mgrandi> | Cool, thanks |
| 01:57:34 | <mgrandi> | @JAA: they decided against it and haven't done anything further |
| 01:57:57 | <mgrandi> | Honestly it wouldn't be that hard to do what tumblr does and just rename the accounts and maybe keep a reference to the old username |
| 01:58:23 | <mgrandi> | But they gotta keep up the stereotype that they don't actually think about the stuff they are implementing lol |
| 02:00:32 | <mgrandi> | @benjins: is that their new api, I want to say it's called hydra or something? |
| 02:01:21 | <benjins> | No clue, I just poke at stuff in the network inspector until it works |
| 02:01:37 | <benjins> | There may have been some changes, but it's worked more or less the same way for a couple years |
| 02:02:38 | | @Fusl quits [Ping timeout: 252 seconds] |
| 02:08:59 | <mgrandi> | Ah, they are switching to a new api and apparently it's like no where near feature compatible with the old one, dunno how much that had changed |
| 02:21:12 | <@Fusl_> | is there a channel for fotoalbum.ee? |
| 02:21:18 | <@Fusl_> | the project doesnt have a wiki page |
| 02:22:24 | | EggplantTest] quits [Ping timeout: 240 seconds] |
| 02:22:25 | <tech234a> | #lookatthisfotograph |
| 02:22:36 | | EggplantN2 joins |
| 02:27:12 | | EggplantN2 quits [Ping timeout: 252 seconds] |
| 02:39:57 | | Fusl (Fusl) joins |
| 02:39:57 | | @ChanServ sets mode: +o Fusl |
| 02:54:55 | | EggplantN2 joins |
| 03:05:03 | | Dallas quits [Client Quit] |
| 03:08:10 | | Dallas (Dallas) joins |
| 03:18:14 | | HP_Archivist (HP_Archivist) joins |
| 03:19:09 | | qw3rty__ joins |
| 03:23:08 | | qw3rty_ quits [Ping timeout: 252 seconds] |
| 03:45:22 | | katocala quits [Remote host closed the connection] |
| 03:49:55 | | katocala joins |
| 03:56:03 | | EggplantN2 quits [Read error: Connection reset by peer] |
| 04:24:28 | | godane is now authenticated as godane |
| 04:25:05 | | godane quits [Client Quit] |
| 04:27:31 | | DopefishJustin quits [Remote host closed the connection] |
| 04:31:07 | | DopefishJustin joins |
| 04:31:07 | | DopefishJustin is now authenticated as DopefishJustin |
| 04:41:56 | | nerdguy1138 quits [Client Quit] |
| 04:44:18 | | nerdguy1138 (nerdguy1138) joins |
| 04:48:57 | | nerdguy1138 quits [Client Quit] |
| 04:49:12 | | lennier2 joins |
| 04:50:12 | | nerdguy1138 (nerdguy1138) joins |
| 04:51:44 | | lennier1 quits [Ping timeout: 240 seconds] |
| 04:51:53 | | lennier2 is now known as lennier1 |
| 04:53:36 | | lennier2 joins |
| 04:56:26 | | lennier1 quits [Ping timeout: 252 seconds] |
| 04:56:27 | | lennier2 is now known as lennier1 |
| 05:01:02 | | lennier1 quits [Ping timeout: 252 seconds] |
| 05:01:29 | | lennier1 joins |
| 05:26:14 | | godane (godane) joins |
| 05:40:38 | | lennier1 is now authenticated as lennier1 |
| 05:41:40 | | Atom-- joins |
| 05:45:44 | | Atom__ quits [Ping timeout: 240 seconds] |
| 05:46:34 | | rsn quits [Ping timeout: 244 seconds] |
| 05:53:04 | | Atom-- quits [Ping timeout: 240 seconds] |
| 06:34:01 | | HP_Archivist quits [Client Quit] |
| 07:17:17 | | HP_Archivist (HP_Archivist) joins |
| 09:37:57 | | VerifiedJ (VerifiedJ) joins |
| 13:09:40 | <@JAA> | mgrandi: Last I heard was 'we won't be doing this until there is a way to memorialise accounts' or something like that, not that they abandoned it entirely. |
| 13:21:11 | | Atom joins |
| 13:22:04 | | katocala leaves |
| 13:44:22 | | katocala joins |
| 13:45:55 | | katocala is now authenticated as katocala |
| 13:51:20 | | katocala quits [Remote host closed the connection] |
| 13:51:46 | | katocala joins |
| 13:55:42 | | katocala quits [Remote host closed the connection] |
| 13:56:05 | | katocala joins |
| 14:01:22 | | katocala is now authenticated as katocala |
| 14:19:40 | | rsn joins |
| 14:26:38 | | odemgi_ quits [Remote host closed the connection] |
| 14:27:00 | | odemgi_ joins |
| 14:28:18 | <purplebot> | List of websites excluded from the Wayback Machine edited by Nikchemny (+52, Added this website) just now -- https://www.archiveteam.org/?diff=45667&oldid=45658 |
| 14:40:14 | | Arcorann quits [Read error: Connection reset by peer] |
| 14:58:39 | | DLoader quits [Read error: Connection reset by peer] |
| 14:58:57 | | DLoader_ joins |
| 14:58:57 | | DLoader_ is now known as DLoader |
| 14:59:05 | | odemgi_ quits [Remote host closed the connection] |
| 14:59:19 | | odemgi_ joins |
| 15:07:56 | | fionera quits [*.net *.split] |
| 15:14:47 | | fionera (Fionera) joins |
| 16:28:14 | | atphoenix is now authenticated as atphoenix |
| 17:27:38 | | Ryz quits [Remote host closed the connection] |
| 17:28:11 | | Ryz joins |
| 18:00:20 | | Ryz quits [Client Quit] |
| 18:00:40 | | Ryz (Ryz) joins |
| 18:36:17 | | neb joins |
| 19:20:04 | | neb quits [Remote host closed the connection] |
| 19:55:00 | <wessel1512> | how long dus it takes to get the conformation email form hackint |
| 19:55:31 | <@JAA> | Just a minute or two on the registrations I've done. |
| 19:55:49 | <wessel1512> | and thet it is |
| 19:56:01 | | wessel1512 is now authenticated as wessel1512 |
| 19:56:58 | <wessel1512> | im registered JAA |
| 20:16:14 | | Lord_Nightmare quits [Quit: ZNC - http://znc.in] |
| 20:22:13 | | Lord_Nightmare (Lord_Nightmare) joins |
| 20:43:32 | | VerifiedJ quits [Client Quit] |
| 20:52:18 | <purplebot> | Coronavirus edited by Wessel1512 (+575, /* Information */) just now -- https://www.archiveteam.org/?diff=45672&oldid=45514 |
| 20:55:50 | | godane1 joins |
| 20:58:04 | | godane quits [Ping timeout: 240 seconds] |
| 22:37:24 | | @Fusl quits [Ping timeout: 240 seconds] |
| 22:41:22 | | Fusl (Fusl) joins |
| 22:41:22 | | @ChanServ sets mode: +o Fusl |
| 22:56:59 | | Arcorann (Arcorann) joins |
| 23:30:00 | | lunik1 quits [Read error: Connection reset by peer] |
| 23:30:15 | | lunik1 joins |
| 23:37:38 | | Smiley (Smiley) joins |
| 23:39:44 | | SmileyG quits [Ping timeout: 252 seconds] |