00:01:45<Hans5958>Random idea: Add all tracker sub-projects on the wiki (e.g. telegram has telegram-groups-temp, telegram-channels, and telegram-manycomments)
00:02:27<klea>They usually are, see [[Roblox]] or [[YouTube]] for a few examples?
00:04:25etnguyen03 quits [Client Quit]
00:04:52<Hans5958>Hmm, you misunderstood, YouTube has youtube-stash, youtube-limitedcomments, youtube-limited1080p, youtube-errors, youtube-error-age-restricted, youtube-error-private, youtube-error-removed-tos, and youtube-error-unavailable (https://github.com/ArchiveTeam/youtube-grab/blob/767e393e6c0e44dd9b448400c6be1ad198d52058/youtube.lua#L1859-L1868)
00:05:13<Hans5958>Wasn't talking about sub-projects in that sense
00:05:45<klea>Those aren't sub projects, those are the different places where things go.
00:05:55<klea>(normally either stashes or directly queues)
00:06:05<Hans5958>Some are available to access https://tracker.archiveteam.org/youtube-stash/
00:06:16<Hans5958>Yeah kinda hard to explain, but they are tracker stuff also
00:06:18<klea>Yes, but it's not a guarantee that they are on the tracker.
00:06:30<klea>(available using a guessable URL)
00:06:46<klea>So I'd personally think it's better not to point people there.
00:08:04nine quits [Ping timeout: 265 seconds]
00:09:19NoNamo (NoNamo) joins
00:12:47<h2ibot>Hans5958 edited Who We Are (+71): https://wiki.archiveteam.org/?diff=64444&oldid=58425
00:18:46TheTechRobo (TheTechRobo) joins
00:20:50MPThLee quits [Quit: bye]
00:21:34MPThLee (MPThLee) joins
00:22:12<Hans5958>Anyone had a modern version of https://wiki.archiveteam.org/index.php/File:Usagej.png ? 258 GB seems pennies at this time of day
00:22:51pepsi2024 quits [Ping timeout: 265 seconds]
00:22:59<Hans5958>Okay, "pennies" was a hyperbole, but still, kinda old
00:27:48<h2ibot>Hans5958 uploaded File:Warrior-web-screenshot.png (2026 update): https://wiki.archiveteam.org/?title=File%3AWarrior-web-screenshot.png
00:32:31nexussfan (nexussfan) joins
00:40:11nexussfan quits [Client Quit]
00:40:27HP_Archivist (HP_Archivist) joins
00:59:11etnguyen03 (etnguyen03) joins
01:10:19katia_ quits [Remote host closed the connection]
01:10:22katia_ joins
01:19:49^ quits [Remote host closed the connection]
01:19:54^ (^) joins
01:20:23Webuser085677 joins
01:20:52<Webuser085677>Old site with a lot of posts. ~0.5% of members are still active. Consider for archiving? https://forums.animesuki.com/
01:21:13Webuser085677 quits [Client Quit]
01:23:31datechnoman quits [Quit: The Lounge - https://thelounge.chat]
01:23:41<pokechu22>It looks like all threads require an account to access
01:35:53datechnoman (datechnoman) joins
01:50:23cascode joins
01:53:48cascode_ quits [Ping timeout: 256 seconds]
02:06:31cascode quits [Read error: Connection reset by peer]
02:06:46cascode joins
02:24:52BornOn420 quits [Remote host closed the connection]
02:34:56BornOn420 (BornOn420) joins
02:35:48h2ibot quits [Quit: Bye]
02:36:28astrinaut is now known as astrid
02:43:36h2ibot (h2ibot) joins
02:55:06@rewby quits [Ping timeout: 265 seconds]
02:55:30<Dango360>roblox-assets slipped through the wiki cracks, if anyone's interested
02:57:04rewby (rewby) joins
02:57:04@ChanServ sets mode: +o rewby
02:58:06Hackerpcs quits [Remote host closed the connection]
02:59:00Hackerpcs (Hackerpcs) joins
03:21:41admin quits [Ping timeout: 265 seconds]
03:32:47Cupping1285 joins
03:38:07Cupping1285 quits [Ping timeout: 265 seconds]
03:39:36Cupping1285 joins
03:45:31etnguyen03 quits [Client Quit]
03:46:26etnguyen03 (etnguyen03) joins
03:47:42Cupping1285 quits [Ping timeout: 256 seconds]
03:52:49etnguyen03 quits [Remote host closed the connection]
03:52:56Cupping1285 joins
03:55:54RedCat joins
03:57:39Cupping1285 quits [Ping timeout: 265 seconds]
03:58:55glassy9 joins
04:01:02glassy quits [Ping timeout: 265 seconds]
04:01:02glassy9 is now known as glassy
04:01:29BennyOtt quits [Quit: Bye]
04:01:53BennyOtt (BennyOtt) joins
04:03:16DogsRNice quits [Read error: Connection reset by peer]
04:03:19Cupping1285 joins
04:38:39tzt quits [Remote host closed the connection]
04:38:58tzt (tzt) joins
04:42:23RedCat quits [Client Quit]
04:42:39RedCat joins
04:44:03Umbire quits [Ping timeout: 265 seconds]
04:46:24Webuser552793 joins
04:46:44Webuser552793 quits [Client Quit]
04:48:20Webuser716913 joins
04:53:33nexussfan (nexussfan) joins
04:58:59Island quits [Read error: Connection reset by peer]
05:02:57Umbire (Umbire) joins
05:05:10<Webuser716913>JAA: Important update from my arocalypse.com request, its going down early. ~00:30 UTC Nov 6 logged in users get 503 errors but guests get still normal pages, most of them succeed. i assume its cache. i have 36,819 public urls from my crawler: https://pixeldrain.com/api/file/wFMckZo8 if anyone has archivebot privileges please queue it
05:05:24Webuser716913 quits [Client Quit]
05:15:17<pokechu22>!w 5ljo1ykyleez47zrqlp8w39o1
05:19:58<pokechu22>Archivebot hit cloudflare unfortunately :/
05:20:09<pokechu22>and that file doesn't seem to work either
05:21:14BornOn420 quits [Remote host closed the connection]
05:21:49<RedCat>That file, when I looked at it, gave an XML that complained about hotlinking... and I don't know enough about pixeldrain to know if that's fixable (by, say, having an account)
05:24:02<pokechu22>I'm seeing JSON complaining about hotlinking but yeah. I tried messing with referers and that didn't work either
05:28:01<Hans5958>Is there a list of dashboards of grafana.at.imer.dev? Last Grafana that has the settings open to the public letting us control the graphs and stuff, but it seems it's now just different public-dashboard links to scour upon
05:28:36<DigitalDragons>after some googling around, the web display url that works is https://pixeldrain.com/u/wFMckZo8 -> https://irc.digitaldragon.dev/uploads/7e41353e3cb96ed5/arocalypse-urls-all.txt (would upload to transfer, but got 403)
05:30:00<pokechu22>Looks like there is some pagination stuff in there. Invision also has https://www.arocalypse.com/sitemap.php (linked via robots.txt) but that doesn't help with cloudflare
05:31:11BornOn420 (BornOn420) joins
05:37:39<RedCat>Anything profile-related hits a "we're offline" notice for me; some of the forum links that are "topic" are like that, too, but most worked. Cloudflare flares up occasionally :/
05:44:32nexussfan quits [Remote host closed the connection]
05:45:04d02 joins
06:06:22BornOn420 quits [Remote host closed the connection]
06:14:58BornOn420 (BornOn420) joins
06:15:38Webuser192740 joins
06:15:41barry quits [Ping timeout: 265 seconds]
06:16:54<Webuser192740>sorry my wifi kept going off and on, didnt come through. the link works here: https://pixeldrain.com/u/wFMckZo8 u jsut have to use a captcha to download it
06:17:47<Webuser192740>if you hit a 503 then clearing cache and cookies for the site usually works for me
06:22:12Webuser192740 quits [Client Quit]
06:42:42Padishah quits [Quit: Ooops, wrong browser tab.]
06:47:53luckcolors quits [Read error: Connection reset by peer]
06:48:12<RedCat>Oh, regarding Novaya Gazeta. Apparently, the folks at Russian Independent Media Archive, https://t.me/s/svobodasnova or https://rima.media have been doing a lot of archival of their work. And they say https://rima.media/sources/novaya--holding is the archive. Alas, their anti-bot system hates me and I can't check this out :/ But it's pretty cool to hear of other archival efforts!
06:49:24luckcolors (luckcolors) joins
06:54:23<RedCat>Also, somebody's been making a tool for getting their data in Markdown format, at https://github.com/novaya-gazeta-ru/archive , but that doesn't get images/videos. So I'm doubly interested to know if the RIMA version has the multimedia stuff in it.
07:04:18d02 quits [Client Quit]
07:44:04tzt quits [Quit: WeeChat 3.0]
07:44:15tzt (tzt) joins
07:48:12NoNamo quits [Ping timeout: 265 seconds]
08:26:30goecho (goecho) joins
08:58:27<cruller>Ueno Bank, used by 63% of adults in Paraguay, has gone bankrupt: https://en.wikipedia.org/wiki/2026_Paraguay_banking_crisis
09:06:47<cruller>It appears that umanle, the owner of namuwiki and arcalive, is also a customer of the bank: https://www.dogdrip.net/733395676
09:14:48RedCat quits [Remote host closed the connection]
09:15:04RedCat joins
09:20:20RedCat quits [Ping timeout: 256 seconds]
09:36:00datechnoman quits [Quit: The Lounge - https://thelounge.chat]
09:36:35datechnoman (datechnoman) joins
09:43:26Umbire quits [Quit: Umbire zaps a wand of digging!]
10:00:26Bleo182600722719623455222011079 quits [Quit: The Lounge - https://thelounge.chat]
10:00:29<@imer>Hans5958: kiska's grafana is still a thing: https://grafana3.kiska.pw/d/000000/archiveteam-tracker-stats and no list at the moment
10:03:10Bleo182600722719623455222011079 joins
10:32:32chrismrtn quits [Quit: leaving]
10:37:17chrismrtn (chrismrtn) joins
10:45:46z00nx quits [Quit: The Lounge - https://thelounge.chat]
10:54:46tzt quits [Ping timeout: 265 seconds]
10:56:36z00nx joins
11:01:36tzt (tzt) joins
11:04:55nune quits [Remote host closed the connection]
11:04:58nune (nune) joins
11:09:24d02 joins
11:10:30<hexagonwin>namuwiki is a hassle to backup :( i hope we don't have to do an emergency archival project on it..
11:10:59<hexagonwin>i basically couldn't find a way other than using bunch of automated browsers with captcha solver
11:11:20<katia>https://en.namu.wiki/ ?
11:11:56<hexagonwin>yes that's the site
11:12:03<hexagonwin>the en. is auto translated, namu.wiki is the original
11:12:08<katia>ok
11:12:19<hexagonwin>i've written a (short) wiki page about that website before
11:12:42<hexagonwin>https://wiki.archiveteam.org/index.php/Namuwiki
11:22:06<@arkiver>hexagonwin: we could run #Y on it
11:22:19<@arkiver>what makes it problematic to archive?
11:23:02<hexagonwin>arkiver: the site needs javascript to render. and it's a wiki site, you need to pass captcha to access the 'raw' wiki markup
11:23:13<hexagonwin>there's just hell lotta captchas basically
11:23:47fuzzy80211 quits [Killed (NickServ (GHOST command used by fuzzy8021))]
11:23:53fuzzy80211 (fuzzy80211) joins
11:25:38<hexagonwin>the method I used to successfully scrape raw wiki markup from the site early this year was using bunch of chromium browsers automated using pydoll and using nopecha for solving hcaptcha/turnstile
11:28:40Webuser103263 joins
11:29:06Webuser103263 quits [Client Quit]
11:35:31goecho quits [Quit: đź‘‹]
11:35:59goecho (goecho) joins
11:36:18goecho quits [Client Quit]
11:36:39goecho (goecho) joins
11:37:50pepsi2024 joins
12:29:35kedihacker quits [Remote host closed the connection]
12:33:26kedihacker (kedihacker) joins
12:49:55<exorcism|matrix>https://x.com/Office2007_Word/status/2118267116080017526
12:49:56<eggdrop>nitter: https://nitter.miningtcup.me/Office2007_Word/status/2118267116080017526
13:00:19<tta2>nice https://git.miningtcup.me/MiningTcup/dogwaf
13:02:41<klea>arkiver: https://git.miningtcup.me/MiningTcup/dogwaf You'll find it pretty intuitive how it works.
13:04:57<klea>oh rip, I triggered the block mechanism by hitting /llms.txt to see what they'd lure me to.
13:05:09<klea>I hope that's temporary because now I can't contact them :P
13:09:06RedCat joins
13:20:24Webuser0392797 joins
13:21:12BornOn420 quits [Remote host closed the connection]
13:22:30Webuser0392797 quits [Client Quit]
13:25:47leprachaun joins
13:26:10<leprachaun>Hi how can I get in touch with a senior at ArchiveTeam? I got a few Twitter datasets to share :)
13:31:18BornOn420 (BornOn420) joins
13:40:20<@imer>leprachaun: either via email archiveteam@archiveteam.org or wait around here :)
14:01:47nathang218438 quits [Quit: The Lounge - https://thelounge.chat]
14:03:09icedice (icedice) joins
14:13:40nathang218438 joins
14:18:41MrMcNuggets (MrMcNuggets) joins
14:25:35thelounge266 joins
14:26:20thelounge26 quits [Ping timeout: 256 seconds]
14:26:20thelounge266 is now known as thelounge26
14:51:11Webuser431871 joins
14:51:15Webuser431871 leaves
14:59:07MrMcNugg1 (MrMcNuggets) joins
15:02:14MrMcNuggets quits [Ping timeout: 265 seconds]
15:56:16Webuser153629 joins
15:59:41<@arkiver>klea: thank you! i will have a look at that one soon
16:00:00<klea>You're welcome, and thank tta2 for sharing it.
16:00:11<@arkiver>thank you tta2 :)
16:05:29Island joins
16:06:17<tta2>thank you miningtcup nitter link for nerd-sniping me :))
16:06:57<klea>So thanking steering for running eggdrop and nerd-snipping tta2. :-P
16:10:43<@arkiver>thank you steering :)
16:11:09<@arkiver>now we need to go all the way up the chain
16:11:17<@arkiver>who introduced steering here? :P
16:12:49<netbub>@klea if you have issues I can forward them to the guy who runs the miningtcup nitter to get the block resolved if it's not temporary
16:13:23<klea>Understood~
16:13:34<klea>arkiver: fireonlive
16:13:40<klea>fireonlive++++
16:13:41<eggdrop>[karma] 'fireonlive++' now has 19 karma!
16:16:10leprachaun quits [Remote host closed the connection]
16:16:28leprachaun joins
16:23:23notarobot345598 quits [Quit: The Lounge - https://thelounge.chat]
16:24:31notarobot345598 joins
16:30:52<tta2>mmh that makes me think
16:31:06<tta2>I've downloaded for work https://info.arxiv.org/help/bulk_data_s3.html and now have 5.6TB pdfs + 6.5TB src on a disk at home
16:32:21<tta2>(if it is of interest to anyone here)
16:37:25Umbire (Umbire) joins
16:40:27Umbire quits [Remote host closed the connection]
16:40:55Umbire joins
16:42:27JayEmbee quits [Quit: WeeChat 4.1.1]
16:59:58MrMcNugg1 quits [Ping timeout: 265 seconds]
17:08:31<tta2>fwiw https://archive.org/details/arxiv-bulk?sort=-title&tab=about exists
17:14:11leprachaun quits [Ping timeout: 265 seconds]
17:16:43Webuser744409 joins
17:23:44barry joins
17:25:16<Webuser744409>attempting to download (previously known-working) archiveteam dumps results in 401 on archive.org. transient/load issue or modern modus operandi of an "archive" ?
17:48:42Webuser187123 joins
17:48:53Webuser187123 quits [Client Quit]
17:50:18<masterx244|m>warcs had to be locked down due to the AI fuckturds abusing the AT collection as a scraper bypass
17:50:26<masterx244|m>Webuser744409:
17:52:33<Webuser744409>i see, thanks for the answer.
17:56:28<TheTechRobo>Note that the content is still available in the Wayback Machine, just not in bulk
18:04:38<Webuser744409>not applicable; site is exempt
18:06:52<klea>Just wait a hundred years or two, and it will probably™ be available there. *hides*
18:10:23MrMcNuggets (MrMcNuggets) joins
18:11:06Incrediblez7_ joins
18:11:45Incrediblez7_ quits [Client Quit]
18:12:05Incrediblez7 joins
18:16:57Incrediblez7 quits [Read error: Connection reset by peer]
18:17:07Incrediblez7 joins
18:23:30MrMcNuggets quits [Read error: Connection reset by peer]
18:29:54msfjarvis quits [Quit: Lurker 2.6.3 https://lurker.chat]
18:30:48msfjarvis joins
18:30:50MrMcNuggets (MrMcNuggets) joins
18:32:22MrMcNugg1 (MrMcNuggets) joins
18:32:30leprachaun joins
18:36:13MrMcNuggets quits [Ping timeout: 256 seconds]
18:38:30leprachaunxd joins
18:39:14myuar (myuar) joins
18:39:28<Webuser744409>sad to see that the internet archive voids its own purpose. for my usecase ive found another source of untampered data of said website by now; still thanks for the help.
18:42:09leprachaun quits [Ping timeout: 265 seconds]
18:42:53sg72 quits [Remote host closed the connection]
18:44:29sg72 joins
18:45:25sg72 quits [Remote host closed the connection]
18:48:25MrMcNugg1 quits [Read error: Connection reset by peer]
19:03:53<masterx244|m>the issue is that archive.org gets locked out from sites, too when they can be abused as a AI crawl proxy
19:04:58<masterx244|m>and raw WARCs are a bypass against the wayback machine ratelimiting since a WARC file can contain a serious amount of pages for one download
19:19:27sg72 joins
19:51:01pepsi2024 quits [Ping timeout: 256 seconds]
19:56:49pepsi2024 joins
20:04:29d02 quits [Quit: Leaving]
20:06:28sludgegunkman quits [Quit: Farewell!]
20:06:50sludge joins
20:15:57pepsi2024 quits [Ping timeout: 256 seconds]
20:32:44cascode_ joins
20:33:29cascode_ quits [Read error: Connection reset by peer]
20:33:37cascode_ joins
20:36:55cascode quits [Ping timeout: 256 seconds]
21:08:50APOLLO03a joins
21:10:20APOLLO03 quits [Ping timeout: 265 seconds]
21:36:15aninternettroll quits [Remote host closed the connection]
21:38:04aninternettroll (aninternettroll) joins
21:41:37NoNamo (NoNamo) joins
21:50:00NoNamo quits [Remote host closed the connection]
21:50:28NoNamo (NoNamo) joins
21:50:46NoNamo quits [Read error: Connection reset by peer]
21:51:17NoNamo (NoNamo) joins
22:00:57NoNamo quits [Read error: Connection reset by peer]
22:02:09parallaxstellar quits [Remote host closed the connection]
22:02:20parallaxstellar (parallaxstellar) joins
22:03:13TunaLobster445 quits [Quit: So long and thanks for all the fish]
22:03:25TunaLobster445 joins
22:03:44JayEmbee joins
22:05:27parallaxstellar quits [Remote host closed the connection]
22:05:38parallaxstellar (parallaxstellar) joins
22:11:06cascode joins
22:11:34nexussfan (nexussfan) joins
22:14:23cascode_ quits [Ping timeout: 256 seconds]
22:24:06<klea>I've noticed https://wiki.archiveteam.org/index.php/Yahoo! has a big warning to people about us not considering Yahoo! as a safe place for the data, is it still accurate?
22:31:57skankhunt42 quits [Ping timeout: 256 seconds]
22:34:25leprachaunxd quits [Remote host closed the connection]
22:47:02NoNamo (NoNamo) joins
22:56:49cascode quits [Read error: Connection reset by peer]
22:57:05cascode joins
22:59:33Umbire quits [Ping timeout: 265 seconds]
23:01:03Umbire (Umbire) joins
23:10:46etnguyen03 (etnguyen03) joins
23:11:09myuar quits [Ping timeout: 265 seconds]
23:11:32notSokar quits [Quit: Leaving]
23:18:23amphitryon_ joins
23:21:15amphitryon quits [Ping timeout: 256 seconds]
23:28:42skankhunt42 (skankhunt42) joins
23:31:12cascode_ joins
23:35:25cascode quits [Ping timeout: 256 seconds]
23:41:08<Webuser744409>layla tov
23:41:11Webuser744409 quits [Quit: Ooops, wrong browser tab.]