00:43:14BlueMaxima quits [Read error: Connection reset by peer]
01:30:34<@JAA>Probably too late, but I looked a bit into Keybase again and am listing the users now.
01:35:29<pabs>https://news.slashdot.org/story/23/03/01/2051203/free-weebly-legacy-plans-with-custom-domains-are-being-discontinued-now-pay-up
01:35:38<pabs>^weebly dropping gratis custom domains
01:35:47<pabs>March 28, 2023
01:36:36<pabs>[without payment] your site will be unpublished on March 28, 2023 and will no longer be visible to visitors or connected to your custom domain. You will need to republish your site on a free Weebly subdomain to make it publicly visible again (ex: my-name.weebly.com).
01:37:07<pabs>hmm, wonder how to find out which custom domains use weebly...
01:39:23<joepie91|m>nameservers, probably
01:40:57<joepie91|m>censys does not seem to index nameservers unfortunately
01:42:54<@JAA>Either that or setting the A record, according to https://www.weebly.com/app/help/us/en/topics/how-to-use-a-domain-you-purchased-elsewhere (assuming that also applies to those legacy plans).
01:43:26<pabs>I guess most of the custom domains will be paid ones though, would be hard to differentiate between paid/unpaid
01:43:34<@JAA>Yeah
01:43:50sec^nd quits [Ping timeout: 276 seconds]
01:44:22<pabs>I note in some cases foo.weebly.com redirects to foo.com, for eg http://dhltaiwan.weebly.com -> https://www.dhltaiwanconnects.com
01:46:48sec^nd (second) joins
02:23:29sec^nd quits [Ping timeout: 276 seconds]
02:25:31systwi (systwi) joins
02:25:39sec^nd (second) joins
02:39:34upintheairsheep joins
02:42:39<upintheairsheep>With the possible TikTok ban in the US getting closer and closer, with the vote happening tommorow, I think it's definately time to build a TikTok-Grab tool, supporting everything: the videos themselves, metadata of the videos, users, sounds, hashtags, answers, locations, and playlist as well as their listings, sound files and metadata, and the
02:42:39<upintheairsheep>thumbnails and the comments.
02:43:15<upintheairsheep>We will need a lot of work, but let's base our work on the current yt-dlp extractor for now.
02:44:09<pokechu22>Looks like there's the start of some tools at https://wiki.archiveteam.org/index.php/TikTok
02:45:27<upintheairsheep>Both TikTokTake and TikUp are dead and deleted, luckily both backed up on the software heritage website, and yt-dlp has a lot of missing functionality for now
02:46:00<@JAA>Several people here have tried before. The attempts all died within weeks at most.
02:46:22<@JAA>It would require a highly motivated individual, I guess.
02:47:28<upintheairsheep>Yep, we need to attempt to find some individuals that have the dedication, it will all be worth it if it starts to die.
02:48:41<upintheairsheep>We could probably find some hobby developers that are experts at the API or something, ChatGPT might also speed up the process of programming, we overall need lots of dedicated workers.
02:49:39tzt quits [Ping timeout: 265 seconds]
02:49:45<@JAA>Code produced by ChatGPT would be suitable for printing on toilet paper, and that's about it.
02:50:51<upintheairsheep>For me, I added TikTok comments support in yt-dlp myself, however as I immaturely spammed issues for the smallest missing functionalities in the past, I was permanently banned from contributing.
02:50:54<upintheairsheep>https://github.com/upintheairsheep/ytdl-sheep/pull/6
02:52:13<upintheairsheep>This is the framework needed to extract comments from TikTok, sorry if the code is horrible (it is lol), it is my first attempt at stuff this complicated.
02:53:55<@JAA>Why does that not surprise me?
03:00:21upintheairsheep quits [Remote host closed the connection]
03:45:29xkey quits [Quit: xkey]
04:01:38tzt (tzt) joins
04:27:24<@JAA>List of 481082 Keybase users found by traversing followers/following starting from https://keybase.io/chris : https://transfer.archivete.am/Xq9cY/keybase-users-from-chris-followers-recursion.zst
04:28:57<@JAA>keybase.pub is very slow currently, so archiving any meaningful amount of data from there might not be possible.
04:30:46<@JAA>I'm also traversing the entire current merkle tree now. That should discover all users, although the above is probably already pretty close.
04:31:22<@JAA>As a side effect, this traversal will effectively create a copy of all current user information, including account and device links etc.
04:31:47<@JAA>It does not include the Keybase Filesystem though. I still don't know how that works.
04:47:26<datechnoman>Im struggling to navigate through a tree and open files. Sooooooo slow :/
04:50:32<h2ibot>Bear edited List of websites excluded from the Wayback Machine (+77, web sites operated by Mike Kuketz): https://wiki.archiveteam.org/?diff=49517&oldid=49513
04:50:33<h2ibot>Bear created GSM Arena (+1552, Created page with "{{Infobox project | title =…): https://wiki.archiveteam.org/?title=GSM%20Arena
04:59:52xkey (xkey) joins
05:00:34<h2ibot>JAABot edited List of websites excluded from the Wayback Machine (+0): https://wiki.archiveteam.org/?diff=49519&oldid=49517
05:13:59Matthww1 quits [Quit: Ping timeout (120 seconds)]
05:14:15Matthww1 joins
05:22:37<@JAA>Woops, turns out there are way more users, apparently. My merkle tree traversal is only at 16% and already found over 900k.
05:22:58<@JAA>Although I saw earlier that many of those user objects in the tree are actually empty. Not sure what that means.
05:24:07<@JAA>It'll take several more hours to traverse the blocks, then it'll begin retrieving the user info. So that'll be a while.
05:24:19<@JAA>But since keybase.pub's unusable anyway, I guess it doesn't matter.
06:21:04Arcorann (Arcorann) joins
06:59:07fishingforsoup__ joins
07:02:38fishingforsoup_ quits [Ping timeout: 252 seconds]
07:05:29hitgrr8 joins
07:11:38Island quits [Read error: Connection reset by peer]
08:10:55eroc1990 quits [Client Quit]
08:17:56eroc1990 (eroc1990) joins
08:18:38hitgrr8 quits [Client Quit]
08:24:34knecht420 quits [Read error: Connection reset by peer]
08:24:36thuban quits [Ping timeout: 265 seconds]
08:24:37knecht4204 (knecht420) joins
08:27:27knecht4204 quits [Client Quit]
08:27:49knecht4204 (knecht420) joins
08:29:16thuban joins
08:40:29sec^nd quits [Ping timeout: 276 seconds]
08:45:25sec^nd (second) joins
09:11:12lennier1 quits [Client Quit]
09:11:33lennier1 (lennier1) joins
09:24:57hitgrr8 joins
10:05:01user_ quits [Remote host closed the connection]
10:05:16user_ joins
10:23:36hitgrr8 quits [Client Quit]
10:30:26hitgrr8 joins
10:37:22hitgrr8 quits [Client Quit]
12:23:08HackMii quits [Remote host closed the connection]
12:23:47HackMii (hacktheplanet) joins
12:25:38user_ quits [Remote host closed the connection]
12:34:29umgr036 joins
12:35:47HackMii quits [Ping timeout: 276 seconds]
12:36:18HackMii (hacktheplanet) joins
12:36:26sec^nd quits [Ping timeout: 276 seconds]
12:37:06sec^nd (second) joins
12:48:54<@arkiver>JAA: yeah nothing done on my side yet for keybase.pub
12:48:58<@arkiver>can look into it now
12:49:04<@arkiver>thank you for looking into user discovery!
13:10:15treora quits [Ping timeout: 265 seconds]
13:10:22treora joins
13:12:47HackMii quits [Remote host closed the connection]
13:13:06HackMii (hacktheplanet) joins
13:33:22sec^nd quits [Remote host closed the connection]
13:33:52sec^nd (second) joins
13:34:15sec^nd quits [Remote host closed the connection]
13:36:02Ketchup901 quits [Remote host closed the connection]
13:38:16sec^nd (second) joins
13:45:11Ketchup901 (Ketchup901) joins
14:24:28Arcorann quits [Ping timeout: 252 seconds]
14:46:22fl0w_ joins
14:49:46fl0w quits [Ping timeout: 252 seconds]
16:29:07Island joins
16:39:32sec^nd quits [Ping timeout: 276 seconds]
16:44:58dan_a quits [Quit: leaving]
16:44:59Island quits [Remote host closed the connection]
16:45:17Island joins
16:45:24sec^nd (second) joins
16:45:50dan_a (dan_a) joins
17:18:47thuban quits [Client Quit]
17:47:14fl0w joins
17:49:33Ketchup901 quits [Client Quit]
17:50:10fl0w_ quits [Ping timeout: 252 seconds]
17:51:32Ketchup901 (Ketchup901) joins
18:55:28umgr036 quits [Remote host closed the connection]
19:01:01umgr036 joins
19:10:35<@JAA>My Keybase merkle tree traversal found over 9 million nodes. 1.2 million are blocks, the rest are user IDs, but most of those don't actually resolve to anything on user lookup (not sure what that means).
19:12:56hitgrr8 joins
19:41:25lennier1 quits [Client Quit]
19:42:18lennier1 (lennier1) joins
19:44:06knecht4204 quits [Client Quit]
19:44:28knecht4204 (knecht420) joins
19:56:29HackMii quits [Ping timeout: 276 seconds]
19:57:16HackMii (hacktheplanet) joins
20:15:44<Jake>deleted users? spam?
20:39:29<@arkiver>JAA: what exactly is still online for keybase.pub to archive?
20:41:47Nulo_ joins
20:42:10njha1 quits [Ping timeout: 265 seconds]
20:43:41njha1 joins
20:44:16Nulo__ joins
20:46:02Nulo quits [Ping timeout: 265 seconds]
20:46:03Nulo__ is now known as Nulo
20:46:31Nulo_ quits [Ping timeout: 265 seconds]
20:47:03upintheairsheep joins
20:48:32<upintheairsheep>Please archive this wiki with wikitools and archivebot if not already - https://phobia.fandom.com/ as it is going to be shut down due to medical advice issues or at least there will be a crackdown on non-officially recognised phobias, https://phobia.fandom.com/wiki/Message_Wall:Kayvon2008?threadId=4400000000000048621
20:49:11upintheairsheep quits [Remote host closed the connection]
20:53:47<pokechu22>upintheairsheep: https://archive.org/details/wiki-phobiafandomcom and https://archive.fart.website/archivebot/viewer/job/e9lvl - both done a few days ago. Unfortunately your name isn't registered so I can't send this via MemoServ - hopefully you check the logs
20:54:36<@JAA>arkiver: Yeah, looks like keybase.pub is gone now. Keybase itself is still there but isn't currently known to shut down (although I'd be surprised at this point if it didn't within the next couple years).
20:55:22<@JAA>keybase.pub was just a web frontend for the Keybase Filesystem's 'public' data.
20:56:16<@JAA>It had some Markdown rendering (details in some GitHub issue, I believe), but otherwise it was basically just proxying to that. The code isn't open-source.
21:01:26thuban joins
21:27:01<TheTechRobo>pokechu22: TIL about MemoServ
21:29:03<pokechu22>It's quite convenient except that some of the people where it would be most useful are those who drop in once and never register (but the registration aspect does make sense; you wouldn't want the memos to be readable by random users). Most servers seem to have it (Freenode (before), Libera, Esper, Spigot all have it) too
21:42:45lunik17 quits [Remote host closed the connection]
21:43:59Arcorann (Arcorann) joins
21:46:54fl0w_ joins
21:49:50lunik17 joins
21:50:31fl0w quits [Ping timeout: 252 seconds]
22:24:09hitgrr8 quits [Client Quit]
23:53:23sec^nd quits [Remote host closed the connection]