| 00:02:03 | | michaelblob7641341083630592 joins |
| 00:06:18 | | Lord_Nightmare (Lord_Nightmare) joins |
| 00:18:21 | | AntiLiberal joins |
| 00:21:22 | | etnguyen03 (etnguyen03) joins |
| 00:29:06 | | IDK233 quits [Client Quit] |
| 00:34:35 | | IDK233 (IDK233) joins |
| 00:34:35 | | IDK233 quits [K-Lined] |
| 00:36:30 | | cascode quits [Read error: Connection reset by peer] |
| 00:36:53 | | cascode joins |
| 00:39:46 | | Webuser509473 quits [Client Quit] |
| 00:52:13 | | lossless quits [Read error: Connection reset by peer] |
| 00:52:26 | | lossless (lossless) joins |
| 00:56:51 | | Island quits [Read error: Connection reset by peer] |
| 01:00:54 | | Island joins |
| 01:03:36 | | notarobot345598 quits [Quit: The Lounge - https://thelounge.chat] |
| 01:05:12 | | notarobot345598 joins |
| 01:10:32 | <klea> | arkiver: Haven't seen this on the wild, but it's related to your interest. https://github.com/insanai/sibuna |
| 01:10:59 | <klea> | arkiver: And this, although it'll probably be obsolete in 2 hours. https://github.com/chris124567/cfsolve |
| 01:15:08 | | pepsi2024 quits [Ping timeout: 250 seconds] |
| 01:32:30 | | cmlow9 joins |
| 01:32:33 | | cmlow quits [Read error: Connection reset by peer] |
| 01:32:33 | | cmlow9 is now known as cmlow |
| 01:33:50 | | tertu quits [Remote host closed the connection] |
| 01:33:59 | | tertu (tertu) joins |
| 01:51:23 | <klea> | arkiver: More regarding fingerprinting stuff: https://nullpt.rs/fingerprinting-bioweapons https://fingerprint.garden/ |
| 01:53:49 | | Goofybally joins |
| 01:57:30 | | michaelblob7641341083630592 quits [Read error: Connection reset by peer] |
| 01:57:57 | | michaelblob7641341083630592 joins |
| 01:58:19 | | IDK233 (IDK233) joins |
| 02:10:48 | | benjins3__ joins |
| 02:11:12 | | michaelblob7641341083630592 quits [Read error: Connection reset by peer] |
| 02:11:47 | | michaelblob7641341083630592 joins |
| 02:13:52 | | lukash984 quits [Quit: The Lounge - https://thelounge.chat] |
| 02:14:04 | | benjins3_ quits [Ping timeout: 250 seconds] |
| 02:22:35 | <h2ibot> | Jodizzle uploaded File:Comic Genesis logo.png: https://wiki.archiveteam.org/?title=File%3AComic%20Genesis%20logo.png |
| 02:27:19 | | michaelblob7641341083630592 quits [Read error: Connection reset by peer] |
| 02:27:39 | | michaelblob7641341083630592 joins |
| 02:28:34 | <h2ibot> | Jodizzle created Comic Genesis (+283, Initialize page): https://wiki.archiveteam.org/?oldid=64354 |
| 02:29:57 | <jodizzle> | !lastseen Webarchomsav |
| 02:30:59 | <nicolas17> | !seen Webarchomsav |
| 02:30:59 | <eggdrop> | [seen] Webarchomsav (~webuser@105.69.42.43) was last seen quitting from #archiveteam 1 hour 34 minutes 25 seconds ago (2026-10-31T00:56:34Z), stating "Client Quit" |
| 02:31:00 | <klea> | jodizzle: The command is: |
| 02:31:04 | <klea> | nicolas17++ |
| 02:31:04 | <eggdrop> | [karma] 'nicolas17' now has 32 karma! |
| 02:31:07 | <klea> | nicolas17 beat me to it. |
| 02:31:15 | <jodizzle> | Thanks |
| 02:33:03 | <jodizzle> | Could someone help me setup a page like https://wiki.archiveteam.org/index.php/ArchiveBot/Astronomy, but for Comic Genesis? |
| 02:33:14 | <jodizzle> | I have a URL list but I'm confused by what's auto-generated and what's not |
| 02:33:48 | <@JAA> | That bot isn't active anymore. |
| 02:34:12 | <jodizzle> | Ah, okay. |
| 02:36:05 | <klea> | Well, it's discouraged to make new pages, the code hasn't broken too much yet, so if you really wanted you could make ArchiveBot/Comic_Genesis/list, although I'd rather you use the viewer directly. |
| 02:37:49 | <jodizzle> | By "use the viewer directly", do you just mean referencing https://archive.fart.website/archivebot/viewer/? |
| 02:38:25 | <klea> | Checking that page directly, yes. |
| 02:39:29 | <@JAA> | What would the list contain? The subdomains? |
| 02:40:47 | <jodizzle> | Yeah. Or those are the most relevant kinds of links I've found so far, digging into the site. Organization seems to be 1 comic per subdomain. |
| 02:41:04 | <jodizzle> | I just thought having a wiki page would be nice for general tracking and reference. But I'm personally fine using the viewer. |
| 02:47:05 | <klea> | If you really want to make it, [[ArchiveBot/Comic_Genesis/list]] should have a newline separated list of URLs, and you need to boop at me everytime you change either the URL list or the status of the URLs (ie, ran stuff on AB, and it was indexed by the viewer). |
| 02:47:37 | <klea> | Although the ArchiveBot/thing pages are kind of a ugly hack that we're trying to remove, IIRC. |
| 03:00:18 | <jodizzle> | Hmm. If you have to manually trigger the bot, and if those pages will be dropped anyway, then it's probably not worth it. I don't want to interfere. |
| 03:00:40 | <jodizzle> | I like the look of them, though. It seems like nice visibility. |
| 03:06:56 | | grill quits [Ping timeout: 265 seconds] |
| 03:07:36 | | grill (grill) joins |
| 03:11:00 | | michaelblob7641341083630592 quits [Read error: Connection reset by peer] |
| 03:11:00 | <@JAA> | The longer-term idea is to have lists on the wiki and integrate the parsing and presentation into the/a viewer so it doesn't need to be kept up-to-date by a bot. |
| 03:11:30 | | DopefishJustin quits [Remote host closed the connection] |
| 03:11:31 | <@JAA> | I had a proof of concept at one point but never followed up on it. |
| 03:11:40 | | michaelblob7641341083630592 joins |
| 03:18:07 | | BlankEclair quits [Remote host closed the connection] |
| 03:18:56 | | BlankEclair (BlankEclair) joins |
| 03:22:19 | | cascode_ joins |
| 03:23:38 | <h2ibot> | Jodizzle edited Alive... OR ARE THEY (+300, /* Endangered */ Add Comic Genesis): https://wiki.archiveteam.org/?diff=64355&oldid=64293 |
| 03:23:39 | <h2ibot> | Jodizzle edited Comic Genesis (+267, Add list of subdomains): https://wiki.archiveteam.org/?diff=64356&oldid=64354 |
| 03:25:44 | | cascode quits [Ping timeout: 256 seconds] |
| 03:26:00 | <jodizzle> | Yeah, something like that would be really cool |
| 03:41:36 | | lukash984 joins |
| 03:44:14 | | etnguyen03 quits [Remote host closed the connection] |
| 03:53:53 | | Island quits [Read error: Connection reset by peer] |
| 03:54:40 | | kwack_ joins |
| 03:55:02 | | kwack quits [Ping timeout: 250 seconds] |
| 04:00:17 | | lukash984 quits [Client Quit] |
| 04:02:28 | | harut joins |
| 04:03:07 | | lukash984 joins |
| 04:27:03 | | NoNamo (NoNamo) joins |
| 04:39:32 | <Dango360> | https://archive.org/details/archiveteam-geocities-midi-collection-2009 this is no longer available to download. not even the torrent is accessible |
| 04:40:43 | <pokechu22> | arkiver: ^ probably shouldn't be restricted |
| 04:42:32 | | nine quits [Quit: See ya!] |
| 04:42:44 | | nine joins |
| 04:58:06 | | NoNamo quits [Read error: Connection reset by peer] |
| 04:58:39 | | NoNamo (NoNamo) joins |
| 05:10:03 | | Marty joins |
| 05:11:56 | | michaelblob7641341083630592 quits [Read error: Connection reset by peer] |
| 05:12:19 | <Marty> | Hi there, if any volunteers could please help. I am wondering if there's any data available for the following YouTube channel? |
| 05:12:19 | <Marty> | https://www.youtube.com/channel/UCG8jISJSqLGsquY1BNkpsKw |
| 05:12:19 | <Marty> | Thank you. |
| 05:12:30 | | michaelblob7641341083630592 joins |
| 05:15:50 | <pokechu22> | Marty: try asking in #down-the-tube |
| 05:16:06 | <Marty> | Apologies, thank you. |
| 05:27:20 | | nexussfan quits [Remote host closed the connection] |
| 05:32:06 | | NoNamo quits [Ping timeout: 250 seconds] |
| 05:34:11 | | NoNamo (NoNamo) joins |
| 05:35:39 | | NoNamo2 (NoNamo) joins |
| 05:37:12 | | kwack_ quits [Ping timeout: 256 seconds] |
| 05:39:07 | | DogsRNice_ quits [Read error: Connection reset by peer] |
| 05:39:11 | | NoNamo quits [Ping timeout: 265 seconds] |
| 05:43:03 | | michaelblob7641341083630592 quits [Read error: Connection reset by peer] |
| 05:43:24 | | michaelblob7641341083630592 joins |
| 05:47:21 | | Marty quits [Client Quit] |
| 05:57:18 | | Kabaya quits [Quit: Ping timeout (120 seconds)] |
| 05:57:27 | | Kabaya joins |
| 06:01:31 | | d02 joins |
| 06:20:51 | <h2ibot> | KleaBot edited Main Page/Current Warrior Project (+135, Default projects are now metaadlibrary (weight…): https://wiki.archiveteam.org/?diff=64357&oldid=64246 |
| 06:28:58 | | h|ca2 quits [Quit: WeeChat 4.10.1] |
| 06:28:59 | | amphitryon_ joins |
| 06:29:14 | | amphitryon quits [Remote host closed the connection] |
| 06:30:16 | | h|ca2 (h) joins |
| 06:35:52 | <h2ibot> | KleaBot edited Main Page/Current Warrior Project (+0, Default projects are now metaadlibrary (weight…): https://wiki.archiveteam.org/?diff=64358&oldid=64357 |
| 06:36:24 | | BornOn420 quits [Remote host closed the connection] |
| 06:46:45 | | BornOn420 (BornOn420) joins |
| 06:55:29 | | cascode joins |
| 06:57:06 | | cascode_ quits [Ping timeout: 256 seconds] |
| 07:08:27 | | Cupping1285 quits [Quit: ZNC 1.10.3 - https://znc.in] |
| 07:09:05 | | BornOn420 quits [Remote host closed the connection] |
| 07:09:28 | | Cupping1285 joins |
| 07:18:56 | | BornOn420 (BornOn420) joins |
| 07:25:39 | | cascode_ joins |
| 07:29:23 | | NoNamo2 quits [Ping timeout: 265 seconds] |
| 07:29:58 | | cascode quits [Ping timeout: 256 seconds] |
| 07:30:50 | | tbc1887837265597 quits [Ping timeout: 250 seconds] |
| 07:47:32 | | harut quits [Ping timeout: 256 seconds] |
| 07:58:21 | | lev (lev) joins |
| 07:59:09 | | lev quits [Remote host closed the connection] |
| 08:03:06 | | michaelblob7641341083630592 quits [Read error: Connection reset by peer] |
| 08:03:28 | | michaelblob7641341083630592 joins |
| 08:05:50 | | Boppen_ joins |
| 08:09:30 | | Boppen quits [Ping timeout: 265 seconds] |
| 08:29:29 | <@JAA> | transfer's having a rough couple weeks. If your uploads fail, that's known. |
| 08:32:22 | | harut joins |
| 08:32:22 | | gosc joins |
| 08:55:17 | | thelounge7803 joins |
| 08:57:48 | | thelounge780 quits [Ping timeout: 256 seconds] |
| 08:57:48 | | thelounge7803 is now known as thelounge780 |
| 09:00:31 | | Bleo182600722719623455222011079 quits [Quit: The Lounge - https://thelounge.chat] |
| 09:03:15 | | Bleo182600722719623455222011079 joins |
| 09:11:08 | | pepsi2024 joins |
| 09:15:53 | <pabs> | arkiver: Cloudflare solver https://github.com/chris124567/cfsolve |
| 09:16:03 | <pabs> | thread https://news.ycombinator.com/item?id=50277379 |
| 09:47:07 | | BearFortress quits [] |
| 09:47:51 | | DopefishJustin (DopefishJustin) joins |
| 09:58:21 | | Umbire quits [Quit: Umbire zaps a wand of digging!] |
| 09:58:45 | | Webuser820091 quits [Quit: Ooops, wrong browser tab.] |
| 10:05:00 | | nune quits [Remote host closed the connection] |
| 10:05:04 | | nune (nune) joins |
| 10:06:21 | | michaelblob76413410836305926 joins |
| 10:07:26 | | michaelblob7641341083630592 quits [Ping timeout: 265 seconds] |
| 10:07:26 | | michaelblob76413410836305926 is now known as michaelblob7641341083630592 |
| 10:31:48 | | michaelblob7641341083630592 quits [Read error: Connection reset by peer] |
| 10:32:08 | | michaelblob7641341083630592 joins |
| 10:49:51 | | HP_Archivist quits [Quit: Leaving] |
| 11:01:26 | | harut quits [Ping timeout: 250 seconds] |
| 11:08:26 | | yano quits [Quit: WeeChat, https://weechat.org/] |
| 11:10:28 | | yano (yano) joins |
| 11:10:28 | | BearFortress joins |
| 11:19:42 | | VerifiedJ quits [Quit: The Lounge - https://thelounge.chat] |
| 11:20:08 | | VerifiedJ (VerifiedJ) joins |
| 11:20:08 | | michaelblob7641341083630592 quits [Read error: Connection reset by peer] |
| 11:20:56 | | michaelblob7641341083630592 joins |
| 11:24:00 | <c3manu> | arkiver: https://novayagazeta.ru/ (independent Russian newspaper) will shut down its servers on November 9th, see https://www.aljazeera.com/news/2026/10/30/russia-forces-closure-of-investigative-newspaper-novaya-gazeta and https://novayagazeta.ru/articles/2026/10/30/we-have-been-killed |
| 11:24:39 | <c3manu> | i'm gonna queue it in #archivebot, but from the last run in 2024 it's a bit on the chonkier side. there also seem to be subdomains: https://archive.fart.website/archivebot/viewer/?q=https%3A%2F%2Fnovayagazeta.ru%2F |
| 11:25:00 | <c3manu> | i'm not sure whether https://novayagazeta.eu/ is related to it or not |
| 11:25:25 | <c3manu> | arkiver: you think it would be possible to spin up a short-term project for that, or queue it in #Y ? |
| 11:30:06 | <c3manu> | funnily enough, it looks like the main page finished in just 2 days last time? |
| 11:36:42 | <IDK> | 500 on transfer again, if this is not known |
| 11:44:55 | <c3manu> | https://transfer.notkiska.pw/ is a 502 :/ |
| 11:51:42 | <@arkiver> | huh that is a pretty major one i think c3manu |
| 11:52:43 | <c3manu> | https://novaya.no/ is related |
| 11:53:20 | <c3manu> | if it's really able to run that fast again (queued it with --no-offsite) the #archivebot job will finish in time |
| 11:54:06 | <c3manu> | https://novayagazeta.eu/ was run in 2025-10 and is quite large https://archive.fart.website/archivebot/viewer/job/20251019142908a9x44 |
| 11:54:25 | <@arkiver> | c3manu: i think we can do both |
| 11:55:43 | <c3manu> | i would download the meta-warc from last time to see if it logged any subdomains i didn't find yet, if it were accessible on IA :) |
| 11:58:10 | <c3manu> | https://novayagazeta.info/ is related |
| 12:04:17 | <c3manu> | https://novaya.media/ |
| 12:05:51 | | IDK233 quits [Ping timeout: 265 seconds] |
| 12:17:40 | <c3manu> | https://www.novgaz.com/ |
| 12:19:03 | <klea> | novayagazeta.eu antiwar-art.novayagazeta.eu babushka.novayagazeta.eu bubble.novayagazeta.eu www.bubble.novayagazeta.eu data-db.novayagazeta.eu dev-shop.novayagazeta.eu diaspora.novayagazeta.eu www.diaspora.novayagazeta.eu elections.novayagazeta.eu img.novayagazeta.eu |
| 12:19:08 | <klea> | (from a subdomain finder) |
| 12:19:32 | | Dango360 quits [Ping timeout: 256 seconds] |
| 12:19:40 | <klea> | oh, there's two pages, nvm. https://ip.thc.org/#/result?type=SUBD&value=novayagazeta.eu was shared here already IIRC? |
| 12:19:57 | <klea> | polk.novayagazeta.eu propaganda.novayagazeta.eu regiment.novayagazeta.eu riviera.novayagazeta.eu files.s3.novayagazeta.eu static.s3.novayagazeta.eu shop.novayagazeta.eu www.novayagazeta.eu |
| 12:21:15 | <klea> | (I'm assuming www.[bought-domains] are being ran, or at least checked already) https://no.novaya.media/ |
| 12:27:04 | <@arkiver> | novaya.no |
| 12:27:26 | | Barto quits [Quit: WeeChat 4.10.1] |
| 12:27:38 | | Barto (Barto) joins |
| 12:29:56 | <@arkiver> | let's move to #Y |
| 12:32:21 | <klea> | ack. |
| 12:34:02 | <c3manu> | klea: c99 is usually what i'm going through |
| 12:34:09 | <katia> | c99.php |
| 12:34:09 | | michaelblob7641341083630592 quits [Read error: Connection reset by peer] |
| 12:34:26 | <klea> | c3manu: Yeah, that's fine too, and probably better. |
| 12:34:47 | <klea> | (I don't like the having to remove the serviceworker crap thingy to make it not annoyed at me, tho.) |
| 12:34:50 | | michaelblob7641341083630592 joins |
| 12:43:37 | | michaelblob7641341083630592 quits [Read error: Connection reset by peer] |
| 12:44:07 | | michaelblob7641341083630592 joins |
| 12:49:30 | | harut joins |
| 12:50:20 | | IDK233 (IDK233) joins |
| 12:50:58 | | IDK233 quits [Client Quit] |
| 12:51:12 | | IDK233 (IDK233) joins |
| 12:56:10 | | netbub_ (netbub) joins |
| 12:57:46 | | Dango360 (Dango360) joins |
| 12:58:42 | | netbub quits [Ping timeout: 240 seconds] |
| 12:58:42 | | netbub_ is now known as netbub |
| 13:03:55 | | Webuser304987 joins |
| 13:05:22 | <Webuser304987> | Hi everyone. I'm looking for a specific ASKfm profile from the archive: https://ask.fm/wuen2013Is there a URL index or CDX file for the ASKfm grabs that I can search, so I can find out which WARC file contains this profile? I'd really appreciate any help locating it. Thanks! |
| 13:08:48 | <klea> | Webuser304987: AT's stuff normally goes into the WBM, so if it doesn't appear in the wayback machine, you're likely out of luck, and specifically for ASKfm the wiki says the archival was partial, so it likely isn't available. |
| 13:09:51 | | Takeoff37808 quits [Quit: The Lounge - https://thelounge.chat] |
| 13:13:45 | <Webuser304987> | Thanks a lot, klea! That's really helpful to know. Just to be 100% sure — is there any index or URL list for the ASKfm grabs that I could check myself, or would downloading and replaying the WARCs be the only way to rule it out completely? Thanks again! |
| 13:14:20 | <klea> | There's a CDX endpoint at https://web.archive.org/cdx/search/cdx?url= |
| 13:14:21 | <h2ibot> | Manu edited Webring (+34, Found https://webring.blackpiratex.com/): https://wiki.archiveteam.org/?diff=64359&oldid=64212 |
| 13:15:43 | <klea> | You can't download the WARCs. |
| 13:16:58 | <klea> | IFTTT seems to be renaming themselves to ifttt.ai rather than ifttt.com |
| 13:18:51 | <Webuser304987> | Thanks, klea! Really appreciate you taking the time to help me figure this out. |
| 13:22:00 | | Takeoff37808 (Takeoff37808) joins |
| 13:22:28 | <gosc> | ah right I forgot to ask, I think it would be cool if a release for wget-at was made, I would really like to use it on windows but I probably can't compile it myself |
| 13:27:15 | | Webuser304987 quits [Client Quit] |
| 13:28:04 | <Hans5958> | I really want to add/use https://en.wikipedia.org/wiki/Template:Clickable_button so we don't have to do boring links |
| 13:28:11 | <Hans5958> | For CTA's |
| 13:29:22 | <h2ibot> | Hans5958 edited 搜狗问问 (-28, Links are unnecessart): https://wiki.archiveteam.org/?diff=64360&oldid=64323 |
| 13:36:40 | | etnguyen03 (etnguyen03) joins |
| 13:39:13 | <klea> | Hans5958: I don't think we can since it is a Lua module. |
| 13:39:32 | <Hans5958> | Yeah, have to do manual work using wikitext and such |
| 13:40:20 | <klea> | I guess we can copy the output, if we wanted it, but not entirely sure how good of a idea it'd be. |
| 13:41:10 | | d02 quits [Quit: Leaving] |
| 13:41:29 | <Hans5958> | Also mw-ui-button doesn't exist? Have to use oo-ui stuff? |
| 13:42:00 | <klea> | It works~ |
| 13:44:05 | <klea> | https://wiki.archiveteam.org/index.php/User:Klea/sandbox |
| 13:45:00 | | kwack_ joins |
| 13:45:00 | | michaelblob7641341083630592 quits [Read error: Connection reset by peer] |
| 13:45:45 | | michaelblob7641341083630592 joins |
| 13:48:24 | <triplecamera|m> | klea is right, Lua is not mandatory, but Lua is much easier to write than wikitext. |
| 13:49:51 | | gosc quits [Quit: Leaving] |
| 13:52:06 | <Hans5958> | Oh, there is mw-ui on pages? I was looking on preferences pages... |
| 13:54:16 | <klea> | I tested it on the "render wikitext page", https://wiki.archiveteam.org/index.php/Special:ExpandTemplates |
| 13:54:24 | <h2ibot> | KleaBot edited Main Page/Current Warrior Project (+0, Default projects are now metaadlibrary (weight…): https://wiki.archiveteam.org/?diff=64364&oldid=64358 |
| 13:54:26 | <triplecamera|m> | Hans5958: MediaWiki UI is an auto-loaded CSS module. |
| 13:55:58 | <Hans5958> | Thought AT wiki is too old for mw-ui |
| 13:56:30 | | nexussfan (nexussfan) joins |
| 13:56:35 | <triplecamera|m> | https://www.mediawiki.org/wiki/MediaWiki_UI |
| 14:10:31 | | etnguyen03 quits [Client Quit] |
| 14:11:31 | | harut quits [Ping timeout: 265 seconds] |
| 14:11:57 | | gosc joins |
| 14:12:14 | <gosc> | just realized there's a few oshi-tabi promotions due today, working on that right now |
| 14:12:28 | | IDK233 quits [Remote host closed the connection] |
| 14:12:31 | <gosc> | man I really have a hard time keeping up with that site because there's so many of these at the same time |
| 14:14:49 | | etnguyen03 (etnguyen03) joins |
| 14:35:31 | | libering joins |
| 14:36:23 | <libering> | Hi all — I built a prototype CLI that archives public X/Twitter content without |
| 14:36:23 | <libering> | login, via the FxEmbed API: for a tweet/user it outputs JSON metadata, orig-res |
| 14:36:23 | <libering> | images, a video URL list, and an ArchiveBot-feedable URL list (!ao < file). |
| 14:36:23 | <libering> | Login-free path is verified against the live API; code + docs: |
| 14:36:23 | <libering> | https://github.com/libering/x-archiver — feedback welcome. |
| 14:43:16 | <klea> | libering: It doesn't archive x.com, but api.fxtwitter.com, so I'd say it's not actually archiving things that'd play back at WBM well. |
| 14:47:17 | | etnguyen03 quits [Ping timeout: 265 seconds] |
| 14:52:25 | | etnguyen03 (etnguyen03) joins |
| 14:53:32 | <libering> | yeah, fair — it's not producing WARC and won't play back at WBM. The |
| 14:53:32 | <libering> | problem it targets is upstream of that: on X you can't even get the content |
| 14:53:32 | <libering> | unauthenticated, so a normal crawler/SPN hits the login wall before there's |
| 14:53:32 | <libering> | anything to archive. |
| 14:54:10 | | gosc quits [Client Quit] |
| 14:54:13 | <libering> | so I'd reframe it as a content-discovery/resolver layer, not an archiving layer — |
| 14:54:13 | <libering> | it turns "invisible" tweets into concrete URLs + data that something WARC-capable |
| 14:54:13 | <libering> | could then grab. happy to hear if that's useful or not in AT's flow. |
| 14:57:08 | <klea> | hmm. |
| 14:59:48 | | z00nx joins |
| 15:00:23 | <@arkiver> | x does show the content to be me in a browser when not logged in, so it's available without explicit authentication |
| 15:03:14 | <klea> | Yeah, I've seen that too. |
| 15:11:07 | | michaelblob7641341083630592 quits [Read error: Connection reset by peer] |
| 15:11:38 | | michaelblob7641341083630592 joins |
| 15:14:04 | | AntiLiberal quits [Ping timeout: 256 seconds] |
| 15:14:56 | <libering> | you're right, and I should be precise: a plain no-JS fetch of a single post URL |
| 15:14:56 | <libering> | or a profile does return content (I've seen the twitterapi.io 2026 numbers — |
| 15:14:56 | <libering> | 30/30 posts, 10/10 profiles, ~5 original tweets each, no reposts). so single |
| 15:14:56 | <libering> | items are reachable unauthenticated, agreed. where it still falls down for a crawler: replies/media/search tabs 307 to login, |
| 15:14:56 | <libering> | no full thread, no reposts, no timeline. the syndication endpoint |
| 15:14:57 | <libering> | (cdn.syndication.twimg.com) covers single tweets but is a fragile fallback, and |
| 15:14:57 | <libering> | bare guest-token scraping has been dead for a while. so what the tool really |
| 15:14:58 | <libering> | buys isn't "seeing a tweet" — it's packaging those scattered/fragile unauth |
| 15:14:58 | <libering> | paths into one structured result + an ArchiveBot URL list. if you're already |
| 15:14:59 | <libering> | hitting a cleaner direct path for a crawler, I'd genuinely like to know. |
| 15:17:06 | | fionera quits [Ping timeout: 250 seconds] |
| 15:18:36 | | IDK233 (IDK233) joins |
| 15:19:00 | | IDK233 quits [Remote host closed the connection] |
| 15:19:13 | | IDK233 (IDK233) joins |
| 15:21:43 | <klea> | libering: Could you talk by yourself, rather than having a LLM talk? |
| 15:23:40 | <katia> | that's load bearing |
| 15:23:59 | <@arkiver> | huh |
| 15:24:03 | <@arkiver> | haha yeah |
| 15:24:08 | <@arkiver> | "yeah, fair ----" |
| 15:24:15 | <@arkiver> | "you're right, blabla" |
| 15:24:19 | <katia> | ——— |
| 15:24:25 | <katia> | pass the em dash |
| 15:24:38 | <@arkiver> | i guess the software is also just pure LLM |
| 15:25:07 | <@arkiver> | and with their copying of literal LLM text into IRC, i guess that code is not checked much |
| 15:27:10 | <libering> | i have checked and tested it with different website |
| 15:30:17 | <justauser> | Yes, very believable that a single-purpose program was tested with different websites. |
| 15:37:53 | <libering> | i admit the earlier text was AI translated since i want to express quickly. but i wrote and tested the code myself, it shown 190 tests pass. the login-free part i ran with the real fxembed/x api, i actually crawled jack status/20 and the obama photo tweet and downloaded the full image.the result is only the 1 skipped tested in the login mode, i |
| 15:37:53 | <libering> | don't use any burner account to test it, those test result are all in the readme. |
| 15:41:54 | | etnguyen03 quits [Ping timeout: 265 seconds] |
| 15:42:01 | <katia> | 190 tests? |
| 15:43:11 | <libering> | yes |
| 15:46:44 | <libering> | unit + integration tests, those things are in the repo. you can clone and run pytest by yourself and don't need to trust me. all the things are test the data models, the fxembed response codes (e.g. private/deleted), the output files, and against real captured tweets. |
| 15:53:43 | | libering quits [Client Quit] |
| 15:54:33 | <h2ibot> | KleaBot edited Main Page/Current Warrior Project (+0, Default projects are now metaadlibrary (weight…): https://wiki.archiveteam.org/?diff=64365&oldid=64364 |
| 15:59:08 | | Mateon1 quits [Remote host closed the connection] |
| 15:59:19 | | Mateon1 joins |
| 15:59:52 | | fionera (Fionera) joins |
| 16:01:32 | | yzl-relay joins |
| 16:12:52 | | michaelblob7641341083630592 quits [Read error: Connection reset by peer] |
| 16:13:35 | | michaelblob7641341083630592 joins |
| 16:13:48 | | IDK233 quits [Ping timeout: 265 seconds] |
| 16:17:02 | | IDK233 (IDK233) joins |
| 16:33:42 | | michaelblob7641341083630592 quits [Read error: Connection reset by peer] |
| 16:34:13 | | michaelblob7641341083630592 joins |
| 16:42:53 | | Nekroschizofrenetyk joins |
| 16:48:57 | | night quits [Quit: No Ping reply in 180 seconds.] |
| 16:50:06 | | night joins |
| 16:54:46 | | Nekroschizofrenetyk quits [Client Quit] |
| 16:55:53 | | entrox9 joins |
| 16:57:12 | | entrox quits [Ping timeout: 250 seconds] |
| 16:57:12 | | entrox9 is now known as entrox |
| 17:08:10 | | nine quits [Quit: See ya!] |
| 17:08:22 | | nine joins |
| 17:12:27 | | cascode_ quits [Remote host closed the connection] |
| 17:12:58 | | yzl-relay quits [Remote host closed the connection] |
| 17:13:13 | | yzl-relay joins |
| 17:15:53 | | yasomi quits [Ping timeout: 256 seconds] |
| 17:17:01 | | pabs quits [Ping timeout: 256 seconds] |
| 17:18:43 | | DogsRNice joins |
| 17:19:31 | | Island joins |
| 17:25:35 | | michaelblob7641341083630592 quits [Read error: Connection reset by peer] |
| 17:25:57 | | michaelblob7641341083630592 joins |
| 17:32:14 | | pabs (pabs) joins |
| 17:47:13 | | etnguyen03 (etnguyen03) joins |
| 18:01:08 | | scotrod24 quits [Quit: The Lounge - https://thelounge.chat] |
| 18:02:16 | | scotrod246 joins |
| 18:07:41 | | michaelblob7641341083630592 quits [Read error: Connection reset by peer] |
| 18:08:20 | | michaelblob7641341083630592 joins |
| 18:13:16 | | Umbire (Umbire) joins |
| 18:16:48 | <justauser> | arkiver: https://git.btxx.org/ uses Halt! , POST+cookie check. |
| 18:30:00 | | msfjarvis quits [Quit: Lurker 2.6.1 https://lurker.chat] |
| 18:32:14 | | msfjarvis joins |
| 18:45:33 | | kwack_ quits [Ping timeout: 265 seconds] |
| 18:45:46 | <h2ibot> | Nekroschizofrenetyk edited Deathwatch (+322, /* 2026-11 */ novayagazeta.ru): https://wiki.archiveteam.org/?diff=64366&oldid=64351 |
| 18:46:20 | | Nekroschizofrenetyk joins |
| 18:51:12 | <Nekroschizofrenetyk> | Hi, https://novayagazeta.ru/ is forced to close in 10 days. Along with some sub-domains, it's been captured in the past but last capture seems to have been in 2024. Would it be a job for AB or -bs? |
| 18:51:23 | | midou quits [Remote host closed the connection] |
| 18:51:27 | | midou joins |
| 18:54:27 | <pokechu22> | I believe we're doing stuff in both AB and #Y, but i haven't looked into the details |
| 18:58:45 | | d02 joins |
| 19:04:18 | <justauser> | Already reported in #archiveteam yesterday, a bunch of AB jobs are running and a #Y job is being prepared. |
| 19:11:44 | | etnguyen03 quits [Client Quit] |
| 19:13:53 | <Nekroschizofrenetyk> | Yeah, should have checked running AB jobs, sorry |
| 19:13:55 | | yasomi (yasomi) joins |
| 19:19:54 | | yasomi quits [Client Quit] |
| 19:26:13 | | yasomi (yasomi) joins |
| 19:31:57 | | NoNamo (NoNamo) joins |
| 19:32:20 | | Nekroschizofrenetyk quits [Client Quit] |
| 19:35:40 | | yasomi quits [Client Quit] |
| 19:43:58 | | kwack_ joins |
| 19:45:29 | | yasomi (yasomi) joins |
| 19:54:23 | | d02 quits [Client Quit] |
| 19:54:27 | | simon816 quits [Remote host closed the connection] |
| 20:00:44 | | simon816 (simon816) joins |
| 20:15:41 | <Dango360> | katia: who needs the em dash when you can have the three-em dash ⸻ it's perfectly practical! |
| 20:30:20 | | etnguyen03 (etnguyen03) joins |
| 20:30:37 | | asie quits [Quit: WeeChat 4.6.3] |
| 20:32:22 | | NoNamo2 (NoNamo) joins |
| 20:35:45 | | NoNamo quits [Ping timeout: 265 seconds] |
| 20:46:29 | | NoNamo2 quits [Client Quit] |
| 20:46:40 | | NoNamo2 (NoNamo) joins |
| 20:46:48 | | NoNamo2 is now known as NoNamo |
| 21:09:06 | | @rewby quits [Ping timeout: 265 seconds] |
| 21:12:45 | | Xesxen_ quits [Ping timeout: 256 seconds] |
| 21:13:38 | | Xesxen (Xesxen) joins |
| 21:26:55 | | michaelblob7641341083630592 quits [Read error: Connection reset by peer] |
| 21:27:28 | | michaelblob7641341083630592 joins |
| 21:47:53 | | etnguyen03 quits [Ping timeout: 256 seconds] |
| 22:07:34 | | Umbire quits [Remote host closed the connection] |
| 22:08:06 | | Umbire joins |
| 22:09:33 | | Umbire quits [Remote host closed the connection] |
| 22:10:40 | | Umbire (Umbire) joins |
| 22:14:24 | | rewby (rewby) joins |
| 22:14:24 | | @ChanServ sets mode: +o rewby |
| 22:19:34 | | Umbire quits [Client Quit] |
| 22:30:17 | | magmaus3 quits [Remote host closed the connection] |
| 22:30:23 | | kwack_ quits [Ping timeout: 256 seconds] |
| 22:32:08 | | yasomimi (yasomi) joins |
| 22:32:14 | | yasomi quits [Ping timeout: 265 seconds] |
| 22:32:32 | | magmaus3 (magmaus3) joins |
| 22:32:59 | | yasomimi is now known as yasomi |
| 22:53:45 | | nstrom|m quits [*.net *.split] |
| 22:53:45 | | jmcdowan17384|m quits [*.net *.split] |
| 22:53:45 | | HeroCC|m quits [*.net *.split] |
| 22:53:45 | | nano412510 quits [*.net *.split] |
| 22:53:45 | | Claire|m quits [*.net *.split] |
| 22:53:45 | | Alee|m quits [*.net *.split] |
| 22:53:45 | | Fijxu|m quits [*.net *.split] |
| 22:53:45 | | osiride|m quits [*.net *.split] |
| 22:53:45 | | mind_combatant quits [*.net *.split] |
| 22:53:45 | | pebbles|m quits [*.net *.split] |
| 22:53:45 | | DoctorAnomaly quits [*.net *.split] |
| 22:53:45 | | exorcism|matrix quits [*.net *.split] |
| 22:53:45 | | phaeton quits [*.net *.split] |
| 22:53:45 | | triplecamera|m quits [*.net *.split] |
| 22:53:45 | | yzqzss quits [*.net *.split] |
| 22:53:45 | | cruller quits [*.net *.split] |
| 22:53:45 | | mistablizzard|m quits [*.net *.split] |
| 22:53:45 | | katia|m quits [*.net *.split] |
| 22:53:45 | | devnoname120 quits [*.net *.split] |
| 22:53:45 | | Ruk8 quits [*.net *.split] |
| 22:53:45 | | mrblizzard|m quits [*.net *.split] |
| 22:53:45 | | anon00001|m quits [*.net *.split] |
| 22:53:45 | | tech234a quits [*.net *.split] |
| 22:53:45 | | Hans5958 quits [*.net *.split] |
| 22:53:45 | | masterx244|m quits [*.net *.split] |
| 22:53:45 | | flashfire42|m quits [*.net *.split] |
| 22:53:45 | | th3z0l4|m quits [*.net *.split] |
| 22:53:45 | | starg2|m quits [*.net *.split] |
| 22:53:45 | | Allemn|m quits [*.net *.split] |
| 22:53:45 | | exorcism|m quits [*.net *.split] |
| 22:53:45 | | M3oq3slzqpf|m quits [*.net *.split] |
| 22:53:45 | | schwarzkatz|m quits [*.net *.split] |
| 23:03:43 | | yzqzss (yzqzss) joins |
| 23:03:45 | | Woodie (Woodie) joins |
| 23:06:19 | | DoctorAnomaly (DoctorAnomaly) joins |
| 23:06:19 | | Allemn|m joins |
| 23:06:19 | | Ruk8 (Ruk8) joins |
| 23:06:19 | | triplecamera|m (triplecamera|m) joins |
| 23:06:19 | | HeroCC|m joins |
| 23:06:19 | | pebbles|m (pebbles|m) joins |
| 23:06:19 | | nano412510 (nano412510) joins |
| 23:06:19 | | masterx244|m (masterx244|m) joins |
| 23:06:19 | | tech234a (tech234a) joins |
| 23:06:19 | | schwarzkatz|m joins |
| 23:06:19 | | nstrom|m (nstrom|m) joins |
| 23:06:19 | | Hans5958 (Hans5958) joins |
| 23:06:19 | | exorcism|matrix (exorcism) joins |
| 23:06:19 | | M3oq3slzqpf|m joins |
| 23:06:19 | | flashfire42|m (flashfire42) joins |
| 23:06:19 | | anon00001|m joins |
| 23:06:19 | | exorcism|m (exorcism) joins |
| 23:06:19 | | mrblizzard|m joins |
| 23:06:19 | | phaeton (phaeton) joins |
| 23:06:19 | | cruller (cruller) joins |
| 23:07:30 | | osiride|m joins |
| 23:07:30 | | jmcdowan17384|m joins |
| 23:07:30 | | katia|m joins |
| 23:07:30 | | th3z0l4|m joins |
| 23:07:30 | | starg2|m joins |
| 23:07:30 | | Fijxu|m joins |
| 23:07:30 | | mind_combatant (mind_combatant) joins |
| 23:07:31 | | Claire|m joins |
| 23:07:32 | | Alee|m joins |
| 23:07:32 | | mistablizzard|m joins |
| 23:07:33 | | devnoname120 (devnoname120) joins |
| 23:27:25 | | Umbire (Umbire) joins |
| 23:49:00 | | etnguyen03 (etnguyen03) joins |
| 23:56:23 | | tzt quits [Remote host closed the connection] |
| 23:56:42 | | tzt (tzt) joins |
| 23:58:25 | | DogsRNice quits [Read error: Connection reset by peer] |