HomeSearchPrevious dayNext day

00:03:37Shard76801 (Shard) joins
00:04:26Shard7680 quits [Ping timeout: 268 seconds]
00:04:27Shard76801 is now known as Shard7680
00:55:16Umbire quits [Killed (zoidberg.hackint.org (Nickname regained by services))]
00:55:22Umbire (Umbire) joins
01:21:12thewinwin870494630 joins
01:25:13thewinwin87049463 quits [Ping timeout: 268 seconds]
01:25:19thewinwin870494630 is now known as thewinwin87049463
01:27:20etnguyen03 quits [Client Quit]
01:33:38etnguyen03 (etnguyen03) joins
01:35:36<pokechu22>http://www.pgsa.ir/ seems to be using a new captcha system again, either recaptcha or hcaptcha, and the captcha token seems to be properly tied to IP and user-agent and applies to static .pdf files and wp-json. I was unable to save it with the SPN2 api. It would be kinda nice to get a capture of http://www.pgsa.ir/non-compliance-list/ but that seems difficult.
01:36:47<pokechu22>arkiver: I think that might be https://mizbancloud.com/'s WAF but I'm not 100% sure
01:37:59<pokechu22>oh, good, the captcha page is also saved as a 307 without a Location header, so AB won't record it and I don't think the WBM replays it
01:59:29poinsettia joins
02:01:49etnguyen03 quits [Remote host closed the connection]
02:07:09Lolo quits [Ping timeout: 268 seconds]
02:12:07Umbire quits [Ping timeout: 252 seconds]
02:15:05<cruller>Re 21STYLE, I did some more scraping: https://transfer.archivete.am/1vLPF/21style_scrape.tar
02:16:13Lolo (Lolo) joins
02:16:52<cruller>But... I found some more domains from archive.is — http://21style.jp/ http://number7.jp/ http://play21.jp/
02:19:10<cruller>I'll scrape bing more thoroughly and also scrape those domains.
02:20:15<cruller>(To be precise, I use Yahoo because Bing has some unclear restrictions)
02:22:13thewinwin870494631 joins
02:26:16thewinwin87049463 quits [Ping timeout: 268 seconds]
02:26:21thewinwin870494631 is now known as thewinwin87049463
02:27:54<pokechu22>Might be worth trying duckduckgo which also uses bing data
02:28:04<pokechu22>Oh, though yahoo is generally better for japan IIRC
02:53:33Umbire joins
03:10:28khaoohs quits [Read error: Connection reset by peer]
03:10:42PredatorIWD80 joins
03:10:57khaoohs joins
03:10:58MrMcNugg1 (MrMcNuggets) joins
03:11:50<pokechu22>cruller: I think I've kinda lost track of everything with 21STYLE. I thought that http://www.style-21.com/support/userslink/userlink.cgi had a list of user blogs but I don't think it actually does, and it's just the very limited stuff at http://www.style-21.com/wwwup.html ?
03:11:50Juesto (Juest) joins
03:13:42MrMcNuggets quits [Ping timeout: 255 seconds]
03:14:09PredatorIWD8 quits [Ping timeout: 255 seconds]
03:14:09Juest quits [Ping timeout: 255 seconds]
03:14:09PredatorIWD80 is now known as PredatorIWD8
03:14:10Juesto is now known as Juest
03:16:56h|ignition quits [Ping timeout: 272 seconds]
03:17:32h|ignition (h) joins
03:36:49<pokechu22>cruller: re https://irclogs.archivete.am/archiveteam-bs/2026-09-12#lf3413e67 I guess just `zstdcat file.zst | grep -Fia -e 21styles.jp -e number21.jp` etc if you know what domains you're looking for
03:47:03meiam1 quits [Quit: Leaving.]
03:47:14meiam joins
03:49:11<cruller>pokechu22: I tried DDG as well, but it returned different results for the same request for me.
03:50:33<cruller>http://www.style-21.com/wwwup.html lists only entries from 21style's paid diary section that were recently updated and marked as public. I already scraped that > https://irclogs.archivete.am/archiveteam-bs/2026-09-26#l039214c5
03:51:21chunkynutz601816946652 joins
03:53:50chunkynutz60181694665 quits [Ping timeout: 268 seconds]
03:53:51chunkynutz601816946652 is now known as chunkynutz60181694665
03:55:10<cruller>pokechu22: I'm not entirely sure what http://www.style-21.com/support/userslink/userlink.cgi is, but it looks like a page where users can share links to other websites they own, similar to an Instagram profile URL.
03:58:12Pendonym quits [Quit: Pendonym]
03:59:34<cruller>pokechu22: Re https://irclogs.archivete.am/archiveteam-bs/2026-09-12#lf3413e67 That sounds good. If I ever get the chance, I'd like to try extracting the remaining URLs, though.
04:02:18<cruller>PSA: My forumscraper job grabbed 6616 viewtopic.php URLs.
04:02:32<cruller>(WIP)
04:14:11<cruller>https://www.google.com/search?q=%22%E3%83%AC%E3%83%B3%E3%82%BF%E3%83%ABBBS-21style%22+-site:21styles.com+-site:style-21.com+-site:number21.jp+-site:plays.jp+-site:21styles.jp+-site:style-21.jp+-site:th21.jp+-site:21style.jp+-site:number7.jp+-site:play21.jp&filter=0 indicates that there are no other 21STYLE domains.
04:36:33abirkill quits [Quit: Let us prepare to grapple with the ineffable itself, and see if we may not eff it after all.]
04:37:18abirkill (abirkill) joins
05:11:31Pendonym (Pendonym) joins
05:28:30<pokechu22>cruller: I think what I want to do is come up with a list users, from id= parameters and /diary/ etc, and then generate http://www.21style.jp/bbs/USER/ http://www.21style.jp/diary/USER/ etc and run that
05:28:43<pokechu22>I don't think we need to rerun all of the now-dead form URLs
05:33:24<pokechu22>I think I'm also going to combine the users across all domains
05:42:40lev (lev) joins
05:46:27lev quits [Remote host closed the connection]
06:01:15meiam quits [Client Quit]
06:01:28meiam joins
06:03:31nexussfan quits [Remote host closed the connection]
06:12:35TheEnbyperor_ quits [Ping timeout: 268 seconds]
06:12:48TheEnbyperor quits [Ping timeout: 255 seconds]
06:13:29TheEnbyperor joins
06:14:39TheEnbyperor quits [Remote host closed the connection]
06:18:06<cruller>pokechu22: Yes, I think it would be sufficient to include only the homepage for each user in the seed, but since I don't yet know the exact URL format, I'm sharing the raw URL list for now.
06:19:47TheEnbyperor joins
06:20:05<cruller>I only remove duplicates within each file; I don't perform any other processing such as fragment removal.
06:22:11Umbire quits [Ping timeout: 252 seconds]
06:22:24<cruller>Now I'm clustering known URL prefixes to enable more in-depth searches.
06:36:30lev (lev) joins
06:41:34lev quits [Remote host closed the connection]
06:49:17meiam quits [Client Quit]
06:49:29meiam joins
06:49:53<cruller>For now, I will try searching for (21styles.com|style-21.com|number21.jp|plays.jp|21styles.jp|style-21.jp|th21.jp|21style.jp|number7.jp|play21.jp)/(abc|bbs|board|diary|mybbs|mydiary|web) . This should list almost all existing homepages. Even if there are other users, it will be enough to deal with them later.
06:50:19Umbire joins
06:56:33lev (lev) joins
06:56:56lev quits [Remote host closed the connection]
07:10:45<pokechu22>Sounds good. Getting a list of valid patterns would also be useful for generating a list. I can probably come up with something from CDX afterwards
07:59:00TheEnbyperor quits [Ping timeout: 255 seconds]
08:02:57<cruller>s#board#board/bbs#
08:06:29thewinwin870494638 joins
08:09:07TheEnbyperor joins
08:10:22thewinwin87049463 quits [Ping timeout: 268 seconds]
08:10:45thewinwin870494638 is now known as thewinwin87049463
08:13:40lev (lev) joins
08:13:57lev quits [Remote host closed the connection]
08:16:06unknownsrc quits [Ping timeout: 255 seconds]
08:25:29unknownsrc (unknownsrc) joins
08:34:42d02 joins
08:40:55d02 quits [Client Quit]
08:51:12TheEnbyperor quits [Ping timeout: 255 seconds]
08:54:36msfjarvis quits [Quit: Lurker 2.3.1 (the truth is out there) https://lurker.chat]
08:55:02msfjarvis joins
08:55:37TheEnbyperor joins
08:55:41TheEnbyperor_ (TheEnbyperor) joins
08:58:15TheEnbyperor quits [Remote host closed the connection]
08:58:15TheEnbyperor_ quits [Remote host closed the connection]
09:00:27Bleo182600722719623455222011079 quits [Quit: The Lounge - https://thelounge.chat]
09:03:16Bleo182600722719623455222011079 joins
09:08:20TheEnbyperor joins
09:15:31skankhunt42 quits [Quit: Ping timeout (120 seconds)]
09:16:17skankhunt42 (skankhunt42) joins
09:26:11<klea>arkiver: https://limbuscompany.wiki.gg/wiki/Special:Stats wiki.gg seems to have a customized CF antibot.
09:37:12<@arkiver>justauser: pokechu22: klea: thank you!
09:37:20Mateon1 quits [Quit: Mateon1]
10:05:00nune quits [Remote host closed the connection]
10:05:02nune joins
10:09:30skankhunt42 quits [Ping timeout: 255 seconds]
10:20:29andrew quits [Ping timeout: 268 seconds]
10:20:50d02 joins
10:43:04skankhunt42 (skankhunt42) joins
10:46:50Pendonym quits [Quit: Pendonym]
10:57:09Wohlstand (Wohlstand) joins
11:33:18d02 quits [Client Quit]
11:39:34meiam quits [Quit: Leaving.]
11:39:46meiam joins
11:52:55Umbire quits [Ping timeout: 252 seconds]
11:59:30meiam quits [Read error: Connection reset by peer]
11:59:34meiam1 joins
12:03:04lev (lev) joins
12:03:39lev quits [Remote host closed the connection]
12:10:08lev (lev) joins
12:10:25lev quits [Remote host closed the connection]
12:15:17pepsi2024 quits [Ping timeout: 252 seconds]
12:15:20pepsi2024 joins
12:36:28xkey quits [Quit: WeeChat 4.10.1]
12:45:47xkey (xkey) joins
12:51:30Mateon1 joins
12:58:00d02 joins
12:58:24lev (lev) joins
12:59:14lev quits [Remote host closed the connection]
13:04:33hexagonwin quits [Ping timeout: 255 seconds]
13:04:47hexagonwin (hexagonwin) joins
13:06:21TheEnbyperor quits [Ping timeout: 255 seconds]
13:07:00Shard7680 quits [Quit: Im doing something rq. Il brb]
13:08:25TheEnbyperor joins
13:08:38TheEnbyperor_ (TheEnbyperor) joins
13:28:34TheEnbyperor_ quits [Ping timeout: 268 seconds]
13:48:45<skankhunt42>arkiver: not sure where to ping you since it affects more than one project. what is the current status on these? #navermore seems paused, #dweebly has some DNS errors which lead to RAM usage and slow progress and #photodeleto shows project code out of date (but it looks like there is no newer image?)
14:13:37nexussfan (nexussfan) joins
14:31:05skyrock3t quits [Read error: Connection reset by peer]
14:32:06skyrocket joins
14:34:25d02 quits [Client Quit]
14:52:37Umbire joins
15:16:29Umbire quits [Ping timeout: 268 seconds]
15:24:45meiam1 quits [Quit: Leaving.]
15:24:49<@arkiver>skankhunt42: yep, all work in progress
15:24:56meiam joins
15:29:16meiam quits [Client Quit]
15:29:29meiam joins
15:35:35meiam quits [Read error: Connection reset by peer]
15:35:47meiam joins
15:37:23saveallthejunk joins
15:38:49meiam quits [Client Quit]
15:38:56saveallthejunk quits [Client Quit]
15:39:00meiam joins
15:41:33saveallthejunk joins
15:45:43saveallthejunk quits [Client Quit]
15:45:57saveallthejunk (saveallthejunk) joins
15:47:08saveallthejunk quits [Client Quit]
15:47:31saveallthejunk (saveallthejunk) joins
15:50:22Wohlstand quits [Quit: Wohlstand]
15:56:36BornOn420 quits [Remote host closed the connection]
16:06:45BornOn420 (BornOn420) joins
16:10:08Pendonym (Pendonym) joins
17:25:43Umbire joins
17:26:53<cruller>pokechu22: I've compiled a list of known homepages in 21style_known_homepages.txt. It includes 1606 diaries and 1263 BBSs. https://transfer.archivete.am/OL4EW/21style_scrape.tar
17:29:58<cruller>I also compiled a list of prefixes for URLs including user_id. Searching for these yields too many results, so it doesn't work well. https://transfer.archivete.am/jwQOM/Prefix%20for%20urls%20including%20user_id.tsv
17:29:59<eggdrop>inline (for browser viewing): https://transfer.archivete.am/inline/jwQOM/Prefix%20for%20urls%20including%20user_id.tsv
17:40:43<cruller>Ah, a method without an upper limit on the number of results would work, but I haven't tried it.
17:42:17meiam quits [Read error: Connection reset by peer]
17:42:23meiam1 joins
18:14:19thewinwin870494633 joins
18:18:24thewinwin87049463 quits [Ping timeout: 268 seconds]
18:18:29thewinwin870494633 is now known as thewinwin87049463
18:26:05BornOn420 quits [Remote host closed the connection]
18:30:00msfjarvis quits [Quit: Lurker 2.3.2 (the truth is out there) https://lurker.chat]
18:31:02msfjarvis joins
18:36:18BornOn420 (BornOn420) joins
18:43:33<ScenarioPlanet>https://www.youtube.com/watch?v=UkJhnJegVUY a recent video highlighting AT jobs on Spore
18:50:03Zachava (Zachava) joins
18:53:14ruchypeja quits [Quit: Leaving]
18:59:36agtsmith quits [Ping timeout: 255 seconds]
19:03:13agtsmith joins
19:41:22Webuser231879 joins
19:41:39Webuser231879 quits [Client Quit]
20:13:24TheEnbyperor quits [Ping timeout: 255 seconds]
20:15:08TheEnbyperor_ joins
20:35:44pepsi2024 quits [Quit: pepsi2024]
20:46:51thewinwin870494632 joins
20:50:43thewinwin87049463 quits [Ping timeout: 268 seconds]
20:50:52thewinwin870494632 is now known as thewinwin87049463
21:07:22skankhunt42 quits [Ping timeout: 268 seconds]
21:08:34MrMcNugg1 quits [Quit: WeeChat 4.9.2]
21:09:21pepsi2024 joins
21:20:16skankhunt42 (skankhunt42) joins
21:21:41lev (lev) joins
21:24:57TheEnbyperor_ quits [Ping timeout: 255 seconds]
21:25:44TheEnbyperor_ joins
21:26:14lev quits [Remote host closed the connection]
21:33:57TheEnbyperor_ quits [Ping timeout: 255 seconds]
21:50:39TheEnbyperor joins
21:51:54TheEnbyperor_ (TheEnbyperor) joins
21:54:59doskel_ (doskel) joins
21:56:05doskel quits [Ping timeout: 268 seconds]
21:56:06doskel_ is now known as doskel
22:01:48michaelblob764134108363059 quits [Quit: yoop]
22:02:14michaelblob764134108363059 joins
22:14:44Pendonym quits [Quit: Pendonym]
22:16:42wickedplayer494 quits [Remote host closed the connection]
22:19:02jspiros quits []
22:34:11wickedplayer494 (wickedplayer494) joins
22:40:43Webuser448673 joins
22:41:16Webuser448673 quits [Client Quit]
22:58:03thewinwin870494638 joins
23:01:43thewinwin87049463 quits [Ping timeout: 252 seconds]
23:01:47thewinwin870494638 is now known as thewinwin87049463
23:02:54HP_Archivist quits [Quit: Leaving]
23:50:10zex quits [Ping timeout: 268 seconds]

HomeSearchPrevious dayNext day