HomeSearchPrevious dayNext day

00:29:33ArchivalEfforts joins
00:29:42ArchivalEfforts_ quits [Ping timeout: 276 seconds]
00:42:27TheTechRobo quits [Read error: Connection reset by peer]
00:43:03TheTechRobo (TheTechRobo) joins
01:51:06Atom quits [Read error: Connection reset by peer]
01:59:24<@JAA>Atom package pages are done except for a handful of seemingly broken packages (over 200 requests all failed). No images to be retrieved there since they're all already broken.
01:59:39<@JAA>This site has clearly been under- or unmaintained for a while.
02:47:30Hackerpcs quits [Quit: Hackerpcs]
02:49:48Hackerpcs (Hackerpcs) joins
03:11:33Wingy quits [Ping timeout: 276 seconds]
03:36:41BlueMaxima quits [Read error: Connection reset by peer]
04:07:36Wingy (Wingy) joins
04:45:46AnotherIki quits [Read error: Connection reset by peer]
05:45:44<h2ibot>JustAnotherArchivist edited Deathwatch (+222, /* 2023 */ Add Revue): https://wiki.archiveteam.org/?diff=49242&oldid=49223
05:52:57<@JAA>Revue has an API which might help with discovery, but it requires auth, and registration is no longer possible.
05:53:45<@JAA>Docs for it are here: https://www.getrevue.co/api
05:54:04benjins quits [Read error: Connection reset by peer]
06:04:38hackbug quits [Ping timeout: 268 seconds]
06:16:21<@OrIdow6>Amazing, they've removed everything on the support site except the shutdown notice
06:16:56<@JAA>Not exactly, looks like the articles are still there, they're just not listed anywhere anymore.
06:17:10<@JAA>But yeah...
06:18:17<@OrIdow6>Oh
06:34:13<@OrIdow6>May have found an enumeration method
06:37:14<@OrIdow6>But I'm not sure where it's used in the live site
06:43:17V84 joins
06:43:35V84 quits [Remote host closed the connection]
06:44:55eroc19901 (eroc1990) joins
06:45:20eroc1990 quits [Ping timeout: 268 seconds]
06:47:10<@JAA>You can get rid of the slug in the issue URLs with https://www.getrevue.co/profile/00/archive/384543
06:47:39<@JAA>Still requires the username though.
06:47:55<tech234a>Ironically they made the announcement that Revue is shutting down less than a day after Jack Dorsey started using the service
06:50:48<@JAA>Heh
06:51:05<@JAA>Although apparently the news about it getting shut down have been known for a bit already: https://www.platformer.news/p/inside-twitters-product-roadmap-under?post_id=82372028
06:52:04Arcorann (Arcorann) joins
07:08:03Island quits [Read error: Connection reset by peer]
07:10:58<h2ibot>JustAnotherArchivist edited The WARC Ecosystem (+2, /* Information */ Fix link): https://wiki.archiveteam.org/?diff=49243&oldid=46405
07:16:59<h2ibot>JustAnotherArchivist edited Template:Url (+80, Add category to pages with broken URLs (usually…): https://wiki.archiveteam.org/?diff=49244&oldid=45771
07:19:59<h2ibot>JustAnotherArchivist edited Reddit (+4, Fix broken URLs): https://wiki.archiveteam.org/?diff=49245&oldid=48498
07:20:00<h2ibot>JustAnotherArchivist edited Sketch (+2, Fix broken URL): https://wiki.archiveteam.org/?diff=49246&oldid=47562
07:20:59<h2ibot>JustAnotherArchivist edited List of lost online videos/list (+2, Fix broken URL): https://wiki.archiveteam.org/?diff=49247&oldid=48234
07:26:45<@JAA>Revue has a link shortener at rev.vu, but that seems to be used for outlinks from newsletters.
07:27:11<@JAA>Also, not all things are under the getrevue.co domain: https://newsletter.mgsiegler.com/
07:50:33sec^nd quits [Remote host closed the connection]
07:51:07sec^nd (second) joins
08:21:30atirclog (atirclog) joins
08:21:30Topic: Lengthy ArchiveTeam-related discussions, questions here | Offtopic: #archiveteam-ot | https://twitter.com/textfiles/status/1069715869994020867
08:21:30Topic set by JAA at 2021-11-02 03:43:57Z
08:21:41Current users: atirclog (atirclog), Church_ (Church), thuban, @Fusl (Fusl), wickedplayer494, katocala, @AlsoJAA (JAA), AK (AK), Arcorann_, VerifiedJ (VerifiedJ), marked1 (marked1), DiscantX_, ThreeHM_ (ThreeHeadedMonkey), bleb, klg_ (klg), Dalek_ (Dalek), jodizzle (jodizzle), ats_ (ats), le0n_ (le0n), daxxy_ (daxxy), sepro (sepro), Doran (Doranwen), RKenshin, Czechball, JackThompson3, ell4 (ell), Shjosan (Shjosan), @chfoo_ (chfoo), Mateon1, wyatt8740, kiska (kiska), Soul_, Lord_Nightmare (Lord_Nightmare), hitgrr8, fuzzy8021 (fuzzy8021), [42] (N4Y), nyany_ (nyany), thelounge27, nico_32 (nico), Wingy (Wingy), lun4 (lun4), driib (driib), monika (boom), flashfire42 (flashfire42), Craigle (Craigle), Matthww1, leo60228- (leo60228), Chris5010 (Chris5010), simon816 (simon816), Aoede_ (Aoede), s-crypt2 (s-crypt), Ryz2 (Ryz), schwarzkatz, birdjj, systwi_ (systwi), superkuh__, atphoenix_ (atphoenix), fishingforsoup_, michaelblob_ (michaelblob), Pichu0102 (Pichu0102), sec^nd (second), eroc19901 (eroc1990), Hackerpcs (Hackerpcs), TheTechRobo (TheTechRobo), ArchivalEfforts, omglolbah, HackMii (hacktheplanet), mut4ntm0nkey (mutantmonkey), programmerq (programmerq), T31M (T31M), jtagcat (jtagcat), @rewby (rewby), shoghicp (shoghicp), sonick (sonick), igloo22225 (igloo22225), Stiletto, qw3rty, Ketchup902 (Ketchup901), jacksonchen666 (jacksonchen666), JTL (jtl), rewby|m, Sanqui|m, tech234a|m, Ruk8, theblazehen|m, xxia|m, andrewvieyra|m, mind_combatant, saouroun|m, nyuuzyou, schwarzkatz|m, ragu|m, Maakuth|m, DigitalDragon, britmob|m, igneousx, audrooku|m, Ajay, mpeter|m, NickS|m, Passiing|m, joepie91|m, kaz__|m, noxious, marius851000, thermospheric, EmeraldSnorlax|m, haha-whered-it-go|m, Peetz0r|m, madpro|m, x9fff00, will1|m, DLoader, Jonimus, tzt (tzt), adamus1red (adamus1red), @Sanqui (Sanqui), lunik17, girst (girst), adia4 (adia), geezabiscuit (geezabiscuit), datechnoman (datechnoman), xkey (xkey), yawkat (yawkat), knecht420 (knecht420), pabs (pabs), Minkafighter7, ave (ave), nepeat (nepeat), IDK (IDK), gazorpazorp (gazorpazorp), Doomaholic, kiskaLogBot, Ruthalas (Ruthalas), hexa- (hexa-), Pingerfowder (Pingerfowder), ghuntley (ghuntley), h3ndr1k (h3ndr1k), FalconK (FalconK), Sluggs, fangfufu_, Larsenv (Larsenv), celestial, erenrich, nimaje, Terbium, Jake (Jake), endrift, cronfox (Cronfox), asie, fionera (Fionera), summerisle_ (summerisle), Frogging101, jamesp (jamesp), evan, thehedgeh0g (mrHedgehog0), mikael, Barto (Barto), mrfooooo, @OrIdow6 (OrIdow6), SketchCow, colona (colona), dunger (dunger), @JAA (JAA), JensRex (JensRex), njha, pie_, Arachnophine3 (Arachnophine), Nulo, BPCZ (BPCZ), DopefishJustin (DopefishJustin), sembiance (sembiance), mwfc (mwfc), thejsa, pcr (pcr), Hecz (Hecz), balrog (balrog), HotSwap (HotSwap), TappyToes, Suika_, coderobe (coderobe), Kinille_ (Kinille), _kallsyms, Deewiant (Deewiant), maxfan8 (maxfan8), f0x2, pekster` (pekster), betamax (betamax), masterX244_ (masterX244), MrRadar_ (MrRadar), luckcolors_ (luckcolors), @hook54321 (hook54321), Dj-Wawa, yano (yano), justcool393 (justcool393), @HCross (HCross), phuzion (phuzion), CraftByte (DragonSec|CraftByte), russss (russss), notbasetwo, @kaz (Kaz), NotEggplant, mgrandi (mgrandi), @arkiver (arkiver), HugsNotDrugs`, murmur, JSharp (JSharp), cptcobalt, qxtal (qxtal), Ctrl-S, omni_, abirkill (abirkill), jmtd, @dxrt (dxrt), Ryz (Ryz), sknebel (sknebel), Somebody2, kpcyrd (kpcyrd), aismallard, Gaelan (Gaelan), apache2, sloop, marto_8, shreyasminocha (shreyasminocha), zifnab06, @jrwr (jrwr), devsnek (devsnek), tech234a (tech234a), Dallas (Dallas), @ChanServ
08:26:47Retrofan joins
08:26:55<Retrofan>Hi
08:27:55h2ibot (h2ibot) joins
08:32:45<Retrofan>I was wondering about whether FOS uses rsync over ssh or normal rsync?
08:33:21<@JAA>Why?
08:35:52<Retrofan>JAA: only a question...
08:36:44<@JAA>Well, FOS isn't even used anymore here. So, neither?
08:38:44<Retrofan>from my experience, it uses verification without password...
08:39:11duce1337 joins
08:39:18<@JAA>Are you uploading data there?
08:39:44benjins joins
08:41:03<Retrofan>for example, I tried yesterday to pick any nickname from the pipeline list (only to try), and it uploaded my test file (sorry) to user's rsync files even without asking for a password...
08:41:32<Retrofan>JAA: no, I only uploaded one file to test
08:41:36<@JAA>So you did.
08:41:39<@JAA>Stop it.
08:41:59<@JAA>I told you this weeks ago when you tried to mess with ArchiveBot 'just to test'.
08:42:08<@JAA>Stop testing shit against our prod systems.
08:42:28<@JAA>SketchCow: ^ Someone uploaded random shit to FOS.
08:42:29<Retrofan>sorry, the name of file is (sorry)
08:45:17benjins quits [Read error: Connection reset by peer]
08:46:09<Retrofan>JAA: Why not use SSH for authentication? I mean, as you can see, anyone can upload shit to your servers...
08:46:47<@JAA>SketchCow: I'll send you an email with details instead.
08:48:34benjins joins
08:55:26<Retrofan>JAA: the nickname of pipeline is (jap-kakapo-e), and sorry again.
08:56:29<@JAA>lol
08:56:36<@JAA>At least come up with your own names. :-)
08:56:54<@JAA>That part doesn't matter, you can't connect to the AB control node anyway (fortunately).
09:04:00<Retrofan>you mean that FOS is using a single rsync secret file with nicknames for authentication, and not every pipeline has a separate user account on FOS with its own rsync..?
09:06:17<@JAA>FOS dates back to the dark ages, and its configuration is ... suboptimal. As I said, we don't use it anymore.
09:06:49<@JAA>We should've just deactivated the target when we moved away from it, but that never happened for $reasons.
09:14:19<@JAA>That's been fixed now.
09:14:34<@JAA>And now stop messing with our systems.
09:16:30<monika>surprise pentest
09:18:20sonick quits [Client Quit]
09:21:58geezabiscuit quits [Ping timeout: 268 seconds]
09:24:18geezabiscuit (geezabiscuit) joins
10:16:44<Retrofan>good to know... but, I am still can't understand how are you running a rsync server without password or even ssh?
10:19:37Xesxen (Xesxen) joins
10:20:09Muad-Dib joins
10:20:30nothere joins
10:39:34<monika>rsync has a daemon mode that can just accept connections unauthenticated
10:40:09<monika>this is how archiveteam warriors submit their jobs to the targets
10:47:17<Retrofan>monika: but why, when I try to connect to FOS without a username, it returns "Connection refused"?
10:47:43<monika>i don't know, maybe you shouldn't be poking around FOS???
11:15:26Ruthalas quits [Quit: Ping timeout (120 seconds)]
11:15:44Ruthalas (Ruthalas) joins
12:51:52katocala quits [Remote host closed the connection]
12:53:29Arcorann_ quits [Ping timeout: 268 seconds]
12:57:31hackbug (hackbug) joins
12:58:27Megame (Megame) joins
13:13:05eroc19901 is now known as eroc1990
13:16:29user_ (gazorpazorp) joins
13:16:59gazorpazorp quits [Read error: Connection reset by peer]
13:27:14Iki joins
14:27:07RisenRubix joins
14:27:26RisenRubix quits [Remote host closed the connection]
14:32:45HackMii quits [Client Quit]
14:34:50HackMii (hacktheplanet) joins
14:46:09Megame quits [Client Quit]
15:09:59Retrofan quits [Remote host closed the connection]
15:16:27DLoader_ joins
15:18:46DLoader quits [Ping timeout: 265 seconds]
15:18:48DLoader_ is now known as DLoader
15:47:51anarcat (anarcat) joins
15:48:07<anarcat>https://aegirproject.org/ is likely going to EOL and completely shut down, unsure what will happen with the assets
15:48:12<anarcat>https://tenyears.aegirproject.org/
15:49:35<anarcat>The repo and tenyears sites could be moved to gitlab pages to keep them
15:49:35<anarcat>online as an archive.
15:49:54<anarcat>https://debian.aegirproject.org/ is the debian repository
15:50:14<anarcat>the rest is likely part of the normal drupal.org infrastructure and unlikely threatened
16:38:32Island joins
17:54:17phuzion quits [Quit: https://quassel-irc.org - Chat comfortably. Anywhere.]
17:54:37phuzion (phuzion) joins
18:17:03lennier1 (lennier1) joins
18:19:52phuzion quits [Client Quit]
18:20:14phuzion (phuzion) joins
18:26:28phuzion quits [Client Quit]
18:26:48phuzion (phuzion) joins
19:54:52phuzion quits [Client Quit]
19:55:13phuzion (phuzion) joins
19:58:11phuzion quits [Client Quit]
19:58:25TheTechRobo quits [Remote host closed the connection]
19:58:29phuzion (phuzion) joins
19:59:21TheTechRobo (TheTechRobo) joins
20:09:21phuzion quits [Client Quit]
20:09:27TheTechRobo quits [Read error: Connection reset by peer]
20:09:40phuzion (phuzion) joins
20:09:58TheTechRobo (TheTechRobo) joins
20:13:23phuzion quits [Client Quit]
20:13:41phuzion (phuzion) joins
20:16:51<@JAA>Retrofan: It refuses the connection now because the issue has been fixed by taking rsync down. Which we should've done a long while ago.
20:18:54<@JAA>anarcat: https://aegirproject.org/ returns an Apache page for me now (with an invalid certificate, too). :-|
20:19:13<anarcat>that's a great start
20:19:55<@JAA>Ah, broken server config, HTTP redirects to the www subdomain, which works.
20:20:54<anarcat>good catch
20:22:27TheTechRobo quits [Remote host closed the connection]
20:23:00TheTechRobo (TheTechRobo) joins
20:25:02<jacksonchen666>found clara.io on the deathwatch list, says it will shutdown at 2022-12-31 and it also seems to be not yet saved. has there been progress on it?
20:27:30<@JAA>anarcat: Everything I could find is in AB now.
20:28:13<anarcat>amazing, thanks
20:30:04godane (godane) joins
20:38:29phuzion quits [Client Quit]
20:47:13phuzion (phuzion) joins
20:55:42phuzion quits [Client Quit]
21:03:46<@OrIdow6>jacksonchen666: A bit on it from me, hope to have something written by Monday
21:14:13Jonimus quits [Ping timeout: 268 seconds]
21:31:29fishingforsoup_ quits [Ping timeout: 268 seconds]
21:35:13fishingforsoup joins
21:35:31Retrofan joins
21:35:37CompArison joins
21:37:13<CompArison>I'm trying to get all the metadata of the games on the wii shop channel. I'm seeing a section of the wiki page that talks about that but I can't get either of them to work. Everything downloaded with the first method is a 404 and I have no idea how I'm supposed to do the second one. Any tips?
21:39:24<@JAA>Well yeah, those URLs are dead now since the site was shut down. The data is linked in the box on the wiki page, but I don't know anything about the details.
21:41:13<CompArison>I'm pretty sure the metadata still exists somewhere. You can still access the website through the method explained in the wiki page, and you can still download games you already own.
21:41:33sonick (sonick) joins
21:44:54<TheTechRobo>CompArison: I thought the Wii Shop is still down
21:45:44CompArison9 joins
21:46:23<TheTechRobo>Nevermind, it went back up awhile ago. Missed that.
21:47:17<CompArison9>Yeah. Maybe it has something to do with the certificate it had me install? the command it had me paste doesn't have anything like that so maybe that's why its only seeing 404s
21:48:05Matthww1 quits [Client Quit]
21:48:09<@JAA>Larsenv: ^
21:48:20CompArison quits [Ping timeout: 265 seconds]
21:48:20Matthww1 joins
21:48:46<CompArison9>i think i lost internet a bit ago so now i got a 9 for some reason
21:49:11<TheTechRobo>Do you mean the Commands section on https://wiki.archiveteam.org/index.php/Wii_Shop_Channel ?
21:49:21Jonimus joins
21:49:21<CompArison9>yeah
22:04:56<Retrofan>JAA: anyways... I recommend using ssh for authentication on whatever rsync server you are using for uploading warcs.
22:06:00<@JAA>Retrofan: If you understood how we use rsync targets, you'd know why that doesn't work.
22:07:00<Retrofan>you mean using SSH for authentication?
22:07:16<@JAA>But yes, for AB specifically, this has been known for a while. One of the reasons why we no longer use FOS, albeit only a minor one.
22:07:21<@JAA>Yes
22:09:50<Retrofan>so... you see that it is impossible to use rsync over ssh to transfer finished warcs?
22:11:43<@JAA>If you control both ends, you absolutely can.
22:12:42<Retrofan>that will be a good point for my archive system
22:12:42BlueMaxima joins
22:26:28<@JAA>The Atom packages API was shut down sometime between 15:30 and 16:20 today, redirecting to broken github.blog URLs instead. By now, it presents an invalid certificate and an HTTP 400. Great engineering, much wow.
22:27:32<@JAA>More accurately, I saw the first such redirects at 15:30 and the last successful requests at 16:24.
22:31:04<@JAA>The trigram bruteforce found 266k packages or so. 10k I had already retrieved before and were skipped. No clue currently how many of the others were retrieved successfully. The vast, vast majority of them were spam anyway though. As you can tell from the size, too: the oldest 500 pages of packages produced 35 GiB of WARCs, this run only 800 MiB.
22:46:06<Retrofan>It looks like running a public archiving system is so hard... got over 100k attempts to login to root in the last hour, and my main archivebot VM had been hacked a few days ago, and the hacker added his ssh key to authorized_keys. fortunately, I realised that early and deleted his entry and secured the VM's root ssh login, before he did anything.
22:48:21Retrofan quits [Remote host closed the connection]
22:49:43fishingforsoup quits [Read error: Connection reset by peer]
22:55:38fishingforsoup joins
22:58:41<Larsenv>CompArison, JAA, TheTechRobo, I've done that before
22:58:58<Larsenv>fun fact, you can grab metadata even using the dsi shop
22:59:03<Larsenv>you can rquery stuff with the switch endpoint
22:59:14<Larsenv>https://archive.org/details/WiiShopChannelBackup
22:59:28<Larsenv>https://archive.org/details/NintendoDSiShopBackup
22:59:37<Larsenv>I think they're in here?
22:59:49<Larsenv>the hard drive containing my work stopped functioning
22:59:50<Larsenv>it crashed...
23:06:34Arcorann_ joins
23:09:03lennier1 quits [Client Quit]
23:10:03lennier1 (lennier1) joins
23:12:57phuzion (phuzion) joins
23:13:49fishingforsoup quits [Read error: Connection reset by peer]
23:14:40hitgrr8 quits [Client Quit]
23:26:35phuzion quits [Client Quit]
23:36:58phuzion (phuzion) joins
23:44:20klg_ quits [Ping timeout: 265 seconds]

HomeSearchPrevious dayNext day