HomeSearchPrevious dayNext day

00:03:22IDK quits [Quit: Connection closed for inactivity]
00:17:42nexussfan quits [Quit: Konversation terminated!]
00:22:55chrismeller3 (chrismeller) joins
00:28:26<TheTechRobo>It should, since IIRC they are using warcprox
00:30:56<klea>Time to test it :P
00:40:22LddPotato quits [Read error: Connection reset by peer]
00:42:28LddPotato (LddPotato) joins
00:59:36LddPotato quits [Read error: Connection reset by peer]
01:01:32LddPotato (LddPotato) joins
01:21:36LddPotato quits [Read error: Connection reset by peer]
01:24:11LddPotato (LddPotato) joins
01:31:17LddPotato quits [Remote host closed the connection]
01:32:40LddPotato (LddPotato) joins
01:36:20polypept1 (polypeptide) joins
01:39:44polypeptide quits [Ping timeout: 245 seconds]
01:40:43ivan_ is now known as ivan
01:44:14systwi_ joins
02:12:26dabs quits [Read error: Connection reset by peer]
03:02:11etnguyen03 quits [Remote host closed the connection]
03:30:00@rewby quits [Ping timeout: 268 seconds]
03:33:55rewby (rewby) joins
03:33:55@ChanServ sets mode: +o rewby
03:38:38@rewby quits [Ping timeout: 268 seconds]
03:39:13nexussfan (nexussfan) joins
03:47:36Webuser147699 joins
03:48:32rewby (rewby) joins
03:48:32@ChanServ sets mode: +o rewby
03:50:07Webuser147699 quits [Client Quit]
03:51:24DogsRNice quits [Read error: Connection reset by peer]
03:58:48Webuser097082 joins
03:58:48Webuser097082 quits [Client Quit]
04:04:32n9nes quits [Ping timeout: 268 seconds]
04:06:20n9nes joins
04:36:21nicolas17 quits [Remote host closed the connection]
04:36:29TastyWiener95 quits [Quit: So long, farewell, auf wiedersehen, good night]
04:37:39nicolas17 (nicolas17) joins
04:43:50TastyWiener95 (TastyWiener95) joins
04:45:07TastyWiener95 quits [Client Quit]
04:53:52szczot3k quits [Ping timeout: 268 seconds]
04:54:12szczot3k (szczot3k) joins
05:00:24scotrod2 quits [Quit: The Lounge - https://thelounge.chat]
05:00:53scotrod2 joins
05:00:55scotrod2 quits [Client Quit]
05:02:21TastyWiener95 (TastyWiener95) joins
05:02:53TastyWiener95 quits [Client Quit]
05:04:49scotrod2 joins
05:06:20nexussfan quits [Client Quit]
05:11:13TastyWiener95 (TastyWiener95) joins
05:11:42TastyWiener95 quits [Client Quit]
05:12:00whimsysciences quits [Quit: Lost terminal]
05:16:40atphoenix_ (atphoenix) joins
05:19:40TastyWiener95 (TastyWiener95) joins
05:19:46atphoenix__ quits [Ping timeout: 268 seconds]
05:57:56<@arkiver>klea: did it?
05:59:51ducky quits [Ping timeout: 268 seconds]
06:11:55ducky (ducky) joins
06:39:06SootBector quits [Remote host closed the connection]
06:40:15SootBector (SootBector) joins
06:45:58IDK (IDK) joins
06:58:26rohvani quits [Ping timeout: 268 seconds]
07:08:09nine quits [Quit: See ya!]
07:08:22nine joins
07:08:22nine quits [Changing host]
07:08:22nine (nine) joins
07:35:53<klea>I didn't test it (yet)
07:35:56<klea>procrastination++
07:35:57<eggdrop>[karma] 'procrastination' now has 104 karma!
07:46:05<klea>Depends, sometimes it calls out to zeno apparently.
07:46:46<klea>but idk if zeno supports http/2.
07:51:16<klea>Mozilla/5.0 (compatible; archive.org_bot +http://archive.org/details/archive.org_bot) Zeno/0344175 warc/v0.8.97
07:51:16<klea>Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/142.0.0.0 Safari/537.36
07:51:16<klea>python-urllib3/2.2.3
07:52:44<klea>I've seen those UAs, but I haven't made my server http2, even tho it supports http2.
09:02:23h|ca2 quits [Ping timeout: 268 seconds]
09:03:00fireatseaparks quits [Ping timeout: 268 seconds]
09:04:03fireatseaparks (fireatseaparks) joins
09:04:39h|ca2 (h) joins
09:21:03croissant_ joins
09:24:40croissant` quits [Ping timeout: 268 seconds]
09:44:03Jake3 (Jake) joins
09:46:15Jake quits [Ping timeout: 268 seconds]
09:46:16Jake3 is now known as Jake
10:23:10969AACSW2 quits [Ping timeout: 268 seconds]
10:24:09Boppen quits [Read error: Connection reset by peer]
10:27:02Boppen (Boppen) joins
11:00:01Bleo182600722719623455222011 quits [Quit: The Lounge - https://thelounge.chat]
11:02:43Bleo182600722719623455222011 joins
11:06:45simon816 quits [Quit: ZNC 1.10.1 - https://znc.in]
11:10:42simon816 (simon816) joins
11:14:58IDK quits [Quit: Connection closed for inactivity]
11:24:19yano quits [Quit: WeeChat, https://weechat.org/]
11:26:14yano (yano) joins
11:30:13IDK (IDK) joins
12:18:49Webuser571280 joins
12:19:15Webuser571280 quits [Client Quit]
12:28:42ducky_ (ducky) joins
12:29:40ducky quits [Ping timeout: 268 seconds]
12:29:41ducky_ is now known as ducky
12:40:34kansei quits [Quit: ZNC 1.10.1 - https://znc.in]
12:43:09kansei (kansei) joins
12:52:44FiTheArchiver joins
12:53:43Arcorann_ quits [Ping timeout: 268 seconds]
12:55:43FiTheArchiver quits [Client Quit]
13:32:29monoxane quits [Ping timeout: 268 seconds]
13:35:38monoxane (monoxane) joins
14:27:38ducky_ (ducky) joins
14:28:04ducky quits [Ping timeout: 268 seconds]
14:28:15ducky_ is now known as ducky
14:34:52Matthww quits [Read error: Connection reset by peer]
14:35:46Matthww joins
15:50:05cm quits [Ping timeout: 268 seconds]
15:50:45cm joins
16:06:47jspiros quits [Read error: Connection reset by peer]
16:06:57Grzesiek11 (Grzesiek11) joins
16:08:01jspiros (jspiros) joins
16:09:06<Grzesiek11>hi, why does my IA upload using the S3 backend of rclone apparently have to be completed "twice"? apparently there's an "archive" task running now that it's doing it the second time, which I assume might be relevant.
16:09:46<klea>→ #internetarchive for IA stuff, and note we are not affiliated with the Internet Archive.
16:11:45Mateon1 quits [Read error: Connection reset by peer]
16:11:51Mateon1 joins
16:29:48<Grzesiek11>yeah ik you aren't, I forgot that channel existed sorry
16:54:58IDK quits [Quit: Connection closed for inactivity]
17:16:24Webuser131669 joins
17:23:12ducky quits [Ping timeout: 268 seconds]
17:24:13ducky (ducky) joins
17:38:56IDK (IDK) joins
17:55:03Webuser297026 joins
17:57:20Webuser297026 quits [Client Quit]
18:20:59Wohlstand (Wohlstand) joins
18:37:38<klea>Don't appologize unecesarily.
19:02:43Snivy quits [Quit: Ping timeout (120 seconds)]
19:02:57Snivy (Snivy) joins
19:10:28Island_ quits [Read error: Connection reset by peer]
19:25:13betamax quits [Ping timeout: 268 seconds]
19:25:50fangfufu quits [Ping timeout: 268 seconds]
19:29:47fangfufu joins
19:31:36kline quits [Quit: *.banana *.split]
19:32:32kline (kline) joins
19:36:32Island joins
19:41:25betamax (betamax) joins
19:47:57IDK quits [Client Quit]
19:51:13ducky_ (ducky) joins
19:52:26ducky quits [Ping timeout: 268 seconds]
19:52:27ducky_ is now known as ducky
20:06:30<tzt>On 2026-03-31, NTT Docomo is shutting down it's 3G service, and associated phone internet service i-mode https://www.docomo.ne.jp/info/3g_closed/
20:08:37IDK (IDK) joins
20:28:42Webuser131669 quits [Quit: Ooops, wrong browser tab.]
21:00:41azalea_sh_ (azalea_sh_) joins
21:02:20<azalea_sh_>Hiya, wanted to know if AT is aware of the situation of vndb? it looks like they have it under control as of now but it might be something to keep an eye on in the future
21:03:11<azalea_sh_>(see https://vndb.org/t24837.11#last and https://vndb.org/t24789)
21:06:30Webuser240588 joins
21:06:37Webuser240588 quits [Client Quit]
21:06:41<pokechu22>Yes, there's an archivebot job currently running, although we can't save all of the site since they restrict access to some pages
21:12:53<Dango360>can't wait to see HTTP/3 support in 2036
21:24:28Webuser666196 joins
21:24:59Webuser666196 quits [Client Quit]
21:32:53<klea>nulldata, rewby|backup: Please rejoin #archivebot.
21:33:21<Barto>i've written them a privmsg too, sorry for my screwup
21:38:08<klea>I wonder, how hard is it to get a extension like https://www.mediawiki.org/wiki/Special:MyLanguage/Extension:OAuth installed in the ArchiveTeam wiki?
21:53:39keyboarder joins
22:01:53Wohlstand quits [Quit: Wohlstand]
22:05:02nexussfan (nexussfan) joins
22:05:30keyboarder quits [Client Quit]
22:17:57IDK quits [Client Quit]
22:20:05Wohlstand (Wohlstand) joins
22:20:09Wohlstand quits [Client Quit]
22:27:06etnguyen03 (etnguyen03) joins
22:48:22tdslll joins
22:53:18<tdslll>Heyo. I have a site www.onestopenglish.com that is about to go down. ArchiveBot didn't work because of rate-limits on anonymous browsing, so I made an account and did a crawl using those cookies and the archiveteam grab-site tools. Is there any way to get these WARCs into the internet archive? If not, is there another good place to make them
22:53:18<tdslll>publicly available?
22:53:55<klea>You can put them on IA yes, but they won't end up on the WBM.
22:54:24<klea>https://wiki.archiveteam.org/index.php/Frequently_Asked_Questions#I_uploaded_a_WARC_file_but_why_doesn't_it_show_up_in_Wayback_Machine?
22:54:27<pokechu22>Hmm, I thought that the archivebot job did work? I don't remember seeing rate-limits on there
22:55:19<pokechu22>At least, if they had rate-limiting, they didn't use an error status code e.g. https://developer.mozilla.org/en-US/docs/Web/HTTP/Reference/Status/429 for it; I don't see any onsite errors like that
22:55:26<tdslll>pokechu22: looking at the wayback machine it seems it hit a login-wall on most articles
22:55:32<pokechu22>ah :/
22:58:38<pokechu22>Hmm, Yeah, I only see ~73 https://www.onestopenglish.com/download urls from the archivebot job
22:59:18<pokechu22>I assume your crawl has more of those? I wonder if I could run those through archivebot or if they'd hit the same rate-limiting
22:59:36<klea>https://web.archive.org/web/20260327223937/https://www.onestopenglish.com/elementary-business-lessons/elementary-business-trees-for-sale/1000703.article sample login walled article.
23:00:58<tdslll>Yeah my crawl had a lot more of those urls.
23:01:02<pokechu22>(assuming grab-site behaves the same as archivebot, the job log should be in the meta-warc as gzipped text, which you can read with zless/zcat/zgrep)
23:04:46<klea>I believe it does, since both grab-site and ArchiveBot use wpull behind the scenes.
23:05:20<klea>Sample meta-warc from a random job I found on IA that was made using wpull, which I think was aided via grab-site. https://archive.org/download/agnesjongerius.nl_20190624/agnesjongerius.nl-2019-06-24-1ef9d363-meta.warc.gz
23:08:21Webuser383447 joins
23:08:33Webuser383447 quits [Client Quit]
23:10:33<tdslll>I can get a list of the download urls for archivebot.
23:11:39<tdslll>That's at least something :/ Maybe someday in the future IA will have an WARC-viewer so users can get the lesson pages that link to them too
23:13:15<klea>Suppsing they don't rate-limit those, which I suppose is very unlikely I guess?
23:14:16<pokechu22>Well, none of the ones archivebot found were rate-limited, and probably it hit other rate-limited pages before it started downloading files... but hard to know for sure
23:15:06<pokechu22>but the only way to know for sure is to run it
23:17:41ericgallager quits [Quit: This computer has gone to sleep]
23:18:56bilboed08 quits [Ping timeout: 268 seconds]
23:21:41bilboed08 joins
23:55:56Matthww quits [Ping timeout: 268 seconds]

HomeSearchPrevious dayNext day