00:01:56jtagcat quits [Quit: Bye!]
00:02:28jtagcat (jtagcat) joins
00:16:23etnguyen03 quits [Ping timeout: 252 seconds]
00:20:14wyatt8740 quits [Client Quit]
00:21:45wyatt8740 joins
01:26:35<xarph_>ah yes the wayback machine the thing that google doesn't link to in search results
02:01:08xarph joins
02:02:50yts98 leaves
02:03:29xarph_ quits [Ping timeout: 258 seconds]
02:05:17yts98 joins
02:12:45<nicolas17>how to archive a github repo?
02:13:09railen63 joins
02:13:25<thuban>nicolas17: ask in #gitgud
02:16:49etnguyen03 (etnguyen03) joins
03:23:27<pabs>nicolas17: and save it to Software Heritage using their Save Code Now form, or API
03:24:38<nicolas17>seems SH has it and it's up to date
03:27:03dumbgoy_ quits [Ping timeout: 258 seconds]
03:27:31<pabs>curl -D /dev/tty -X POST "https://archive.softwareheritage.org/api/1/origin/save/git/url/$url/" | jq
03:28:08<pabs>ah good, they auto-update all of GitHub and other things on https://archive.softwareheritage.org/coverage/
03:41:27ehmry quits [Client Quit]
03:43:33ehmry joins
03:45:02DogsRNice quits [Read error: Connection reset by peer]
04:02:06jacksonchen666 quits [Ping timeout: 245 seconds]
04:16:06Icyelut (Icyelut) joins
04:31:27BPCZ quits [Ping timeout: 258 seconds]
04:31:38Icyelut|2 (Icyelut) joins
04:35:02Icyelut quits [Ping timeout: 265 seconds]
04:42:16Island quits [Read error: Connection reset by peer]
04:44:13TastyWiener95 quits [Quit: So long, farewell, auf wiedersehen, good night]
04:44:24etnguyen03 quits [Client Quit]
04:46:14Dango360 quits [Read error: Connection reset by peer]
04:49:48Dango360 (Dango360) joins
04:58:54BPCZ (BPCZ) joins
04:59:40balrog quits [Quit: Bye]
05:02:24balrog (balrog) joins
05:04:31kiryu quits [Ping timeout: 265 seconds]
05:13:10xarph_ joins
05:16:36xarph quits [Ping timeout: 265 seconds]
05:28:39xarph joins
05:31:58Dango360_ (Dango360) joins
05:32:04xarph_ quits [Ping timeout: 265 seconds]
05:33:13xarph_ joins
05:33:42DogsRNice joins
05:35:28xarph quits [Ping timeout: 258 seconds]
05:35:56Dango360 quits [Ping timeout: 252 seconds]
05:43:10TastyWiener95 (TastyWiener95) joins
05:54:24T31M quits [Client Quit]
05:55:42T31M joins
05:57:57DogsRNice quits [Read error: Connection reset by peer]
06:11:24xarph joins
06:13:33Megame quits [Client Quit]
06:14:34xarph_ quits [Ping timeout: 258 seconds]
06:26:00xarph_ joins
06:27:27nicolas17 quits [Client Quit]
06:28:20xarph__ joins
06:29:31xarph quits [Ping timeout: 258 seconds]
06:30:40xarph_ quits [Ping timeout: 258 seconds]
06:31:13xarph joins
06:34:53xarph__ quits [Ping timeout: 258 seconds]
06:59:27Naruyoko quits [Remote host closed the connection]
06:59:50Naruyoko joins
07:06:28Unholy2361316618 (Unholy2361) joins
07:09:26Unholy236131661 quits [Ping timeout: 252 seconds]
07:09:26Unholy2361316618 is now known as Unholy236131661
07:19:45railen63 quits [Remote host closed the connection]
07:20:01railen63 joins
07:20:52railen63 quits [Remote host closed the connection]
07:38:09treora quits [Remote host closed the connection]
07:38:11treora joins
07:55:48Arcorann (Arcorann) joins
08:03:00Carnildo quits [Remote host closed the connection]
08:12:15Girish joins
08:14:36<Girish>Hi archiveteam, I trying to decompress warc.zst file which I have downloaded to my local. May I know where can I find the DICT for it? Thanks
08:15:01<kpcyrd>I wish softwareheritage had a version of snapshot.debian.org that actually works
08:17:21<pabs>they imported all of snapshot.debian.org already
08:18:39<kpcyrd>how do I access it? see eg https://lists.debian.org/debian-devel/2023/08/msg00014.html
08:20:49<thuban>Girish: it's in a skippable frame at the beginning of the file http://iipc.github.io/warc-specifications/specifications/warc-zstd/
08:21:15<thuban>you will probably find https://gitea.arpa.li/JustAnotherArchivist/little-things/src/branch/master/zstdwarccat helpful
08:25:07<pabs>kpcyrd: I think via the usual archive.softwareheritage.org site
08:25:33<pabs>it of course doesn't contain any binary packages
08:27:11<Girish>Thank thuban I tried the zstdwarccat. It does stdout. I was looking for organized folders of each url ...
08:28:35<Girish>The actual archive file is a megawarc.warc.zst
08:30:03<thuban>the output of zstdwarccat is the uncompressed warc file. you can then use another tool to extract the contents
08:32:28<thuban>(https://wiki.archiveteam.org/index.php/The_WARC_Ecosystem)
08:38:02<Girish>thuban: Does zstdwarccat create any warc files or is it just stdout?
08:39:34<thuban>it's just stdout, so you can use a shell redirect: `zstdwarccat input.warc.zst > output.warc`
08:46:18BlueMaxima quits [Read error: Connection reset by peer]
08:51:41sec^nd quits [Ping timeout: 245 seconds]
08:53:17sec^nd (second) joins
09:00:32Earendil7 quits [Ping timeout: 252 seconds]
09:03:27AK quits [Quit: AK]
09:22:17Earendil7 (Earendil7) joins
09:26:14xarph_ joins
09:29:52xarph quits [Ping timeout: 265 seconds]
09:30:47Earendil7 quits [Ping timeout: 252 seconds]
09:33:30Earendil7 (Earendil7) joins
09:43:20<kpcyrd>pabs: idk, seems incomplete 🤷 https://archive.softwareheritage.org/browse/search/?q=gcc_12.2.0-3_amd64.deb&with_visit=true&with_content=true&search_metadata=true
09:43:45<pabs><pabs> it of course doesn't contain any binary packages
09:44:08<kpcyrd>what did they import then?
09:44:19<pabs>source packages
09:49:01<kpcyrd>not a snapshot.debian.org replacement then. There's also https://snapshot-cloudflare.debian.org/ but unless you're lucky enough to get a cache hit you're still stuck with the 504 prone snapshot service
09:49:36<kpcyrd>essentially if you can't pull the file from snapshot.debian.org yourself, cloudflare won't be able to either
09:57:27<pabs>right
10:05:30<pabs>IIRC the service needs these:
10:05:35<pabs>1) people to care about improving it instead of working around its current limitations
10:05:41<pabs>2) the Debian sysadmins to have time to complete the in-progress migration of the primary replica to newer hardware
10:05:46<pabs>3) a Debian team for the service, so the Debian sysadmins can just do hardware/OS
10:05:51<pabs>4) more replicas (152TB + growth) to meet the demand on the service
10:05:53<pabs>5) probably architecture and hardware upgrades
10:07:21kiryu joins
10:10:13kiryu quits [Read error: Connection reset by peer]
10:11:10<pabs>oh, and 6) the Debian sysadmins need to fix the failing proprietary backup system the primary replica uses
10:14:08kiryu joins
10:31:58AK (AK) joins
10:53:43<h2ibot>Yts98 edited Xuite (+524, Add smallpaint): https://wiki.archiveteam.org/?diff=50452&oldid=50431
10:56:22railen63 joins
11:03:09jacksonchen666 (jacksonchen666) joins
11:05:07W7RFa6AbNFz quits [Read error: Connection reset by peer]
11:05:30W7RFa6AbNFz joins
11:07:31jacksonchen666 quits [Ping timeout: 245 seconds]
11:21:05sec^nd quits [*.net *.split]
11:21:05BigBrain_ quits [*.net *.split]
11:21:05Ketchup901 quits [*.net *.split]
11:21:05thenes quits [*.net *.split]
11:22:16sec^nd (second) joins
11:22:16BigBrain_ (bigbrain) joins
11:22:16Ketchup901 (Ketchup901) joins
11:22:16thenes (thenes) joins
11:39:19jacksonchen666 (jacksonchen666) joins
11:55:41BigBrain (bigbrain) joins
11:57:56BigBrain_ quits [Ping timeout: 245 seconds]
12:30:56awefea quits [Remote host closed the connection]
12:31:50eafaefaew joins
12:37:01qwertyasdfuiopghjkl quits [Remote host closed the connection]
12:39:17Hackerpcs quits [Quit: Hackerpcs]
12:41:21Hackerpcs (Hackerpcs) joins
12:41:28tertu (tertu) joins
12:41:35<pabs>"The Future of the Vim Project" https://groups.google.com/g/vim_dev/c/dq9Wu5jqVTw https://news.ycombinator.com/item?id=37074452
12:45:09etnguyen03 (etnguyen03) joins
12:51:34qwertyasdfuiopghjkl (qwertyasdfuiopghjkl) joins
13:04:06<Barto>+1 for transparency
13:39:38Dango360_ quits [Client Quit]
13:45:51thenes quits [Ping timeout: 245 seconds]
13:46:13thenes (thenes) joins
13:47:12Dango360 (Dango360) joins
13:50:14Dango360_ (Dango360) joins
13:51:00Ketchup901 quits [Remote host closed the connection]
13:51:36Ketchup901 (Ketchup901) joins
13:53:17Girish quits [Ping timeout: 265 seconds]
13:54:14Dango360 quits [Ping timeout: 252 seconds]
14:09:54treora quits [Ping timeout: 258 seconds]
14:17:55treora joins
15:20:57kiryu quits [Remote host closed the connection]
15:21:23kiryu joins
15:25:44_Dango360 (Dango360) joins
15:29:23Dango360_ quits [Ping timeout: 252 seconds]
16:12:00_Dango360 quits [Client Quit]
16:19:26treora quits [Remote host closed the connection]
16:19:26Arcorann quits [Ping timeout: 252 seconds]
16:19:27treora joins
16:28:47etnguyen03 quits [Ping timeout: 252 seconds]
16:33:18dumbgoy_ joins
16:34:53etnguyen03 (etnguyen03) joins
16:37:33<that_lurker>Could maybe be a good idea to grab all the vim mail lists if possible.
16:44:39<that_lurker>https://www.vim.org/maillist.php
16:46:09<pabs>already done
16:46:17<pabs>the google based ones at least
16:46:21<that_lurker>well thats awesome
17:01:47railen63 quits [Ping timeout: 265 seconds]
17:47:32DogsRNice joins
18:00:21<@arkiver>rewby: since I only see rewby|backup in #deadcat i'll post this here
18:00:26<@arkiver>can we please have a target for gfycat?
18:00:33<@arkiver>this would be
18:00:37<@arkiver>archiveteam_gfycat_
18:00:40<@arkiver>gfycat_
18:00:45<@arkiver>Archive Team Gfycat:
18:04:09Carnildo joins
18:24:02nicolas17 joins
18:50:32Shjosan quits [Quit: Am sleepy (-, – )…zzzZZZ]
18:52:11Shjosan (Shjosan) joins
19:36:23<h2ibot>TheTechRobo edited Periscope (-3, There are still items, but "Tracker rate…): https://wiki.archiveteam.org/?diff=50453&oldid=50291
19:37:26AmAnd0A quits [Ping timeout: 252 seconds]
19:37:52AmAnd0A joins
19:44:24<h2ibot>TheTechRobo edited ArchiveTeam Warrior (-130, /* Warrior architecture and alternatives */…): https://wiki.archiveteam.org/?diff=50454&oldid=50367
19:45:25<h2ibot>TheTechRobo edited ArchiveTeam Warrior (-591, /* Can I use whatever internet access for the…): https://wiki.archiveteam.org/?diff=50455&oldid=50454
19:45:42fireonlive edits the TheTechRobo
19:46:28<TheTechRobo>maybe we should also note that if your ISP blocks custom DNS, the projects won't work, but I'm not sure what the error message is so idk what to add to FAQ
19:46:57<fireonlive>in my fuzzy memory it isn't to descript
19:47:07<fireonlive>too*
20:11:45AmAnd0A quits [Read error: Connection reset by peer]
20:12:23AmAnd0A joins
21:43:29W7RFa6AbNFz quits [Read error: Connection reset by peer]
21:43:58W7RFa6AbNFz joins
23:52:17<flashfire42>any chance of a warrior project for Webs? or is there too many stuff for a warrior project for that atm
23:53:08<TheTechRobo>flashfire42: https://wiki.archiveteam.org/index.php/Webs
23:53:11<TheTechRobo>we already did a bunch
23:53:14<TheTechRobo>i'm not sure how much
23:53:35<flashfire42>I mean its definite again
23:55:36AlsoHP_Archivist joins
23:59:14HP_Archivist quits [Ping timeout: 252 seconds]