HomeSearchPrevious dayNext day

00:00:55<pokechu22>That URL format's available in the share link
00:02:00<pokechu22>(and IIRC is the format you're supposed to use on Wikipedia)
00:11:56night quits [Quit: goodbye]
00:12:06night joins
00:18:12<steering>ah, ic
00:19:37etnguyen03 (etnguyen03) joins
00:38:53dabs joins
00:39:44dabs quits [Remote host closed the connection]
00:40:01dabs joins
00:40:21anarcat quits [Ping timeout: 258 seconds]
00:47:46dabs quits [Client Quit]
00:57:13etnguyen03 quits [Client Quit]
01:18:03<pabs>are Bing searches for "site:example.org -site:www.example.org" broken for anyone else? here they just return stuff from other domains
01:18:35<pokechu22>Seems broken, duckduckgo is fine though
01:19:12<pokechu22>(also note that on Google you can do site:*.example.org -site:www.example.org, but not on ddg)
01:35:00NatTheCat (NatTheCat) joins
01:50:24SootBector quits [Remote host closed the connection]
01:51:30SootBector (SootBector) joins
02:05:25<hexagonwin|m>Hi, can we have archivebot save http://www.kbdmania.net/xe/ ? An old korean keyboard forum, there isn't much activity nowadays.
02:06:23<hexagonwin|m>I don't think it's urgent, so having low concurrency and some delay might be good. (considering it's http only its highly likely to be running on a potato)
02:10:29TunaLobster quits [Read error: Connection reset by peer]
02:10:36<@JAA>hexagonwin|m: Started
02:10:45TunaLobster joins
02:10:52<@JAA>And yes, I can hear the potato screaming from halfway around the world.
02:10:52TunaLobster quits [Client Quit]
02:11:53<hexagonwin|m>Thanks :)
02:13:38<hexagonwin|m>seems like it shows 302 and 200 for each url for some reason
02:14:44TunaLobster joins
02:16:15<@JAA>Well yeah, they're redirects.
02:22:08anarcat (anarcat) joins
02:26:01Stagnant_ quits [Remote host closed the connection]
02:29:29<nicolas17>I think there's a glitch there where the 200 logs the source of the redirect rather than the destination?
02:29:59<@JAA>Yes
02:34:30<hexagonwin|m>(this is my third attempt, kinda feels spammy. sorry) can we run archivebot on lolinet? it provides stock firmware for lenovo/hmd phones. they announced they lost access to new firmwares back in july 10 and said "Existing firmware will continue to be stored until the end of the year." on their telegram channel t.me/lolinetnews
02:34:34<hexagonwin|m>these are the websites they run - https://mirrors.lolinet.com/ https://mirrors-hmd-1.lolinet.com/ https://mirrors-obs-1.lolinet.com/ https://mirrors-obs-2.lolinet.com/ (total about 50TB)
02:35:50<nicolas17>ugh mirrors
02:36:22<nicolas17>archivebot does not deduplicate so that could need some extra work
02:36:31<nicolas17>if we want to preserve all 4 URLs}
02:36:49<hexagonwin|m>it's not really 'mirrors' as in the traditional sense from what i see, the contents all differ
02:37:05<hexagonwin|m>..and for some reason https://mirrors-obs-2.lolinet.com/ throws errors right now,,
02:38:20<nicolas17>hm I see, files seem to be disjoint
02:39:30<hexagonwin|m>afaik they first put files on the main mirrors.lolinet.com site, then after a few years (when the device is 'obsolete') "remove" them (which seemed to be moving them to another domain for now?) i'm not really very familiar with this site so not sure
02:40:09<nicolas17>yeah seems so
02:42:52etnguyen03 (etnguyen03) joins
02:43:46TunaLobster quits [Client Quit]
02:43:54pedantic-darwin8 joins
02:43:57TunaLobster joins
02:43:58pedantic-darwin quits [Read error: Connection reset by peer]
02:43:58pedantic-darwin8 is now known as pedantic-darwin
02:56:18HP_Archivist (HP_Archivist) joins
02:57:12TheEnbyperor_ quits [Ping timeout: 258 seconds]
02:57:12@rewby quits [Ping timeout: 258 seconds]
02:57:29TheEnbyperor quits [Ping timeout: 260 seconds]
02:59:14rewby (rewby) joins
02:59:14@ChanServ sets mode: +o rewby
03:00:14TheEnbyperor joins
03:03:31Guest58 joins
03:08:27TheEnbyperor_ (TheEnbyperor) joins
03:09:57Guest58 quits [Client Quit]
03:20:56<nicolas17>there's some captures of the main page with savepagenow and they do not work
03:21:11<nicolas17>some JSON got captured instead of the webpage
03:24:20<nicolas17>https://web.archive.org/web/20250810071558if_/https://mirrors.lolinet.com/ this older capture has the HTML but it only works with JS disabled
03:24:25aiueo700 joins
03:26:42<nicolas17>oh the JS version involves a POST, so it's never gonna work
03:27:38Stagnant_ (Stagnant) joins
03:27:43<nicolas17>and that random JSON I saw archived by SPN looks like the POST response...
03:28:32<nicolas17>same URL, different responses for GET and POST, it ain't gonna replay properly, best we can do is getting the no-JS version to work
03:30:03<nicolas17>https://web.archive.org/web/*/https://mirrors.lolinet.com/* I see several files already archived
03:30:39<nicolas17>looking at one random .7z that is already archived, it was done by #//
03:34:41etnguyen03 quits [Client Quit]
03:38:11etnguyen03 (etnguyen03) joins
03:39:56aiueo700 quits [Client Quit]
03:45:37<nicolas17>...I just had a realization about iconfinder
03:45:51<nicolas17>after 100 requests in the same wget process I start getting redirected to the login page, and I said "same TCP connection", but maybe it's because of cookies... does wget keep a cookie jar in memory by default?
04:02:47<dendory>there doesn't seem to be a whole lot of files, but each file is pretty big. https://mirrors.lolinet.com/firmware/lenomola/2022/austin/ for example is 319 GB.
04:03:12<nicolas17>wow, ok that could be a problem
04:03:38<nicolas17>ah no that's a folder
04:04:08<nicolas17>files there seem to be 4 gig max?
04:04:37<dendory>And I didn't get that problem with iconfinder. I got over 20,000 icons with this script: https://transfer.archivete.am/KXgs/iconfinder.sh
04:04:38<eggdrop>inline (for browser viewing): https://transfer.archivete.am/inline/KXgs/iconfinder.sh
04:05:00<nicolas17>yes because you're doing 1 URL per wget instance
04:05:23<dendory>some files are 10 GB https://mirrors.lolinet.com/firmware/fcnt/2025/fuji/official/RETJP/
04:08:48<nicolas17>seems their IPv6 address doesn't work?
04:12:27etnguyen03 quits [Remote host closed the connection]
04:13:44<@JAA>Yeah, I did look at it on one of the previous mentions, and the size is a concern.
04:19:27<nicolas17>!remindme 14h lolinet file listing
04:19:28<eggdrop>[remind] ok, i'll remind you at 2025-10-12T18:19:27Z
04:20:28<hexagonwin|m>they're firmware files so pretty big usually. it's h5ai file listing, so i guess there would be no issue with non-js crawling (like archivebot/wget -r)?
04:20:38<nicolas17>correct
04:20:54<nicolas17>non-js crawling works
04:21:10<nicolas17>however it seems js-enabled replay won't work for the file lists
04:21:43<nicolas17>so you have to disable JS in your browser when loading https://web.archive.org/web/20250810071558/https://mirrors.lolinet.com/
04:23:14<@JAA>Ah yeah, I also found that their IPv6 is broken.
04:23:17<@JAA>IPv6 is hard++
04:23:17<eggdrop>[karma] 'IPv6 is hard' now has 32 karma!
04:23:41<hexagonwin|m>ah.. maybe excluding https://mirrors.lolinet.com/_h5ai/ could work but since its already saved i guess its inevitable
04:58:10SootBector quits [Remote host closed the connection]
04:58:10HackMii quits [Remote host closed the connection]
04:58:38HackMii (hacktheplanet) joins
04:59:20SootBector (SootBector) joins
05:15:36aiueo700 joins
05:30:55aiueo700 quits [Ping timeout: 258 seconds]
05:49:03Island quits [Read error: Connection reset by peer]
06:04:44balrog quits [Ping timeout: 260 seconds]
06:05:47balrog (balrog) joins
06:13:12ABSOLUTEDOOM joins
06:22:39ABSOLUTEDOOM quits [Client Quit]
06:34:49<h2ibot>Manu edited Discourse (+54, Active Discourses: Add discuss.privacyguides.net): https://wiki.archiveteam.org/?diff=57628&oldid=57611
06:36:49<h2ibot>Manu edited Discourse/archived (+92, Queued discuss.privacyguides.net): https://wiki.archiveteam.org/?diff=57629&oldid=57612
07:36:06HackMii quits [Remote host closed the connection]
07:36:36HackMii (hacktheplanet) joins
07:51:05<h2ibot>PaulWise edited Bugzilla (+156, mention the sitemap trick, move march-hare…): https://wiki.archiveteam.org/?diff=57630&oldid=54895
07:59:21HackMii quits [Remote host closed the connection]
07:59:36HackMii (hacktheplanet) joins
08:41:01alexa joins
08:41:09<alexa>hi
08:41:16<alexa>an abandoned forum
08:41:30<alexa>one of the flibusta contributors is worried it may disappear
08:41:32<alexa>https://libroom.net/
08:41:44alexa quits [Client Quit]
08:50:47beastbg8_ quits [Quit: Leaving]
08:51:04beastbg8 (beastbg8) joins
09:02:39beastbg8 quits [Client Quit]
09:02:56beastbg8 (beastbg8) joins
09:03:40ducky quits [Ping timeout: 258 seconds]
09:05:50ducky (ducky) joins
09:24:14<pabs>!tell alexa https://libroom.net/ queued in #archivebot
09:24:14<eggdrop>[tell] ok, I'll tell alexa when they join next
09:24:43bilboed0 joins
09:49:11HermanToothrot joins
10:22:15NatTheCat4 (NatTheCat) joins
10:24:19NatTheCat quits [Ping timeout: 260 seconds]
10:25:14NatTheCat (NatTheCat) joins
10:27:14NatTheCat4 quits [Ping timeout: 258 seconds]
11:00:03Bleo182600722719623455222 quits [Quit: The Lounge - https://thelounge.chat]
11:02:17NatTheCat quits [Client Quit]
11:02:39NatTheCat (NatTheCat) joins
11:02:48Bleo182600722719623455222 joins
11:25:06SootBector quits [Ping timeout: 255 seconds]
11:26:09<ichdasich>hrm, so... hypothetically speaking... if i wanted to host a target in .eu (ideally v6; Makes traffic engineering easier ;-))... would that be possible?
11:26:25<ichdasich>i.e. whom would i have to convince that it is a good idea? ;-)
11:27:39SootBector (SootBector) joins
12:04:40<h2ibot>Hans5958 edited SourceForge (+2, /* Developer Web removal (2025) */): https://wiki.archiveteam.org/?diff=57631&oldid=57602
12:32:25<@imer>ichdasich: adding targets has been on a "need" basis in the past and we've got plenty of capacity at the moment (that can change of course depending on projects, so will try to remember you offered)
12:38:31<ichdasich>imer: kk; ran about 3tb of optane dimms ;-)
12:56:34BearFortress quits [Ping timeout: 260 seconds]
13:11:44HermanToothrot quits [Ping timeout: 260 seconds]
13:23:59cipherrot quits [Ping timeout: 260 seconds]
13:25:21HermanToothrot joins
13:30:54danwellby quits [Quit: Watch out For sysops carrying carpet and quicklime]
13:39:09HermanToothrot quits [Ping timeout: 260 seconds]
13:44:16Hackerpcs quits [Ping timeout: 258 seconds]
13:44:27Hackerpcs_1 (Hackerpcs) joins
13:47:51petrichor (petrichor) joins
13:52:32HermanToothrot joins
13:57:14HermanToothrot quits [Ping timeout: 260 seconds]
14:00:38<nicolas17>ooh optane
14:10:07<dendory>Any idea why my warrior VM would randomly shut down every few weeks? I typically keep it running full time on my cluster but sometimes in the morning I notice it's offline. I just restart it and it seems to continue fine.
14:12:58<ichdasich>nicolas17: yeah ^^
14:13:13<TheTechRobo>dendory: Is it the docker container or the full VM?
14:13:31<dendory>it's the VM appliance.. running on Proxmox
14:14:10<TheTechRobo>The warrior does try to do a reboot every week. That might be what you're seeing. Does proxmox have a way to auto restart the VM?
14:16:13<dendory>That might be it.. It's set to start on boot but if the VM shuts itself down then it wont be automatically restarted. I guess I can look into scheduling a restart script.
14:17:41pabs quits [Read error: Connection reset by peer]
14:17:57pabs (pabs) joins
14:27:12HermanToothrot joins
14:36:39Guest58 joins
14:40:59HermanToothrot quits [Ping timeout: 260 seconds]
14:42:34HermanToothrot joins
14:43:54etnguyen03 (etnguyen03) joins
14:47:08HermanToothrot quits [Ping timeout: 258 seconds]
14:47:19HermanToothrot joins
14:52:04HermanToothrot quits [Ping timeout: 260 seconds]
15:00:23etnguyen03 quits [Client Quit]
15:08:15HermanToothrot joins
15:12:44Shard7 quits [Quit: Im doing something rq. Il brb]
15:13:04HermanToothrot quits [Ping timeout: 260 seconds]
15:15:19Shard7 (Shard) joins
15:23:10Shard7 quits [Client Quit]
15:28:49HermanToothrot joins
15:39:16HermanToothrot quits [Ping timeout: 258 seconds]
15:42:31etnguyen03 (etnguyen03) joins
15:49:27HermanToothrot joins
15:53:54HermanToothrot quits [Ping timeout: 260 seconds]
16:06:02HermanToothrot joins
16:10:34erkinalp quits [Quit: Ooops, wrong browser tab.]
16:13:44HermanToothrot quits [Ping timeout: 260 seconds]
16:25:51HermanToothrot joins
16:30:38HermanToothrot quits [Ping timeout: 258 seconds]
16:31:30Dada joins
16:37:21Wohlstand (Wohlstand) joins
16:45:50HermanToothrot joins
16:52:09shinon71 quits [Remote host closed the connection]
16:52:42shinon71 joins
16:58:39HermanToothrot quits [Ping timeout: 260 seconds]
17:09:21Hackerpcs_1 is now known as Hackerpcs
17:09:41HermanToothrot joins
17:16:38HermanToothrot quits [Ping timeout: 258 seconds]
17:21:26etnguyen03 quits [Client Quit]
17:22:27HermanToothrot joins
17:26:54SootBector quits [Ping timeout: 255 seconds]
17:29:39SootBector (SootBector) joins
17:30:09dave quits [Ping timeout: 260 seconds]
17:36:03Guest58 quits [Client Quit]
17:45:01etnguyen03 (etnguyen03) joins
17:45:19HermanToothrot quits [Ping timeout: 260 seconds]
17:55:39<h2ibot>Cooljeanius edited Giphy (+48, Use URL template): https://wiki.archiveteam.org/?diff=57632&oldid=57626
18:01:35HermanToothrot joins
18:06:19HermanToothrot quits [Ping timeout: 260 seconds]
18:08:15HermanToothrot joins
18:10:41<h2ibot>Cooljeanius edited Governments on YouTube (+92, /* Spain */ add channel from #down-the-tube on IRC): https://wiki.archiveteam.org/?diff=57633&oldid=57607
18:15:32etnguyen03 quits [Client Quit]
18:17:22Island joins
18:19:28<eggdrop>[remind] nicolas17: lolinet file listing
18:21:57<nicolas17>hm right -_-
18:22:47<nicolas17>though my eyes hurt and I'm struggling to focus on the screen
18:25:09<that_lurker>can always just procrastinate
18:26:43<nicolas17>and tomorrow find an ophthalmologist that doesn't need an appointment
18:49:32<that_lurker>that would be good with those symptoms
19:09:22DogsRNice joins
19:09:28danwellby joins
19:36:23BearFortress joins
19:43:28ATinySpaceMarine quits [Quit: https://quassel-irc.org - Chat comfortably. Anywhere.]
19:43:58ATinySpaceMarine joins
20:12:48notSokar joins
20:13:02ATinySpaceMarine quits [Client Quit]
20:13:23ATinySpaceMarine joins
20:15:16Sokar quits [Ping timeout: 258 seconds]
20:22:24Shard7 (Shard) joins
20:31:28notSokar quits [Client Quit]
20:31:37Sokar joins
20:58:02ATinySpaceMarine quits [Client Quit]
20:59:52ATinySpaceMarine joins
21:02:09nine quits [Quit: See ya!]
21:02:25nine joins
21:02:26nine quits [Changing host]
21:02:26nine (nine) joins
21:16:10ATinySpaceMarine quits [Client Quit]
21:30:27ATinySpaceMarine joins
21:31:12etnguyen03 (etnguyen03) joins
21:49:12Gadelhas56287378443 quits [Quit: Ping timeout (120 seconds)]
21:49:24Gadelhas56287378443 joins
22:46:43Wohlstand quits [Quit: Wohlstand]
22:48:31etnguyen03 quits [Client Quit]
23:00:26nicolas17 quits [Quit: Konversation terminated!]
23:01:41nicolas17 joins
23:31:45Dada quits [Remote host closed the connection]
23:35:53etnguyen03 (etnguyen03) joins
23:39:43Guest quits [Quit: Guest]
23:40:04Guest joins
23:42:49datechnoman quits [Quit: Ping timeout (120 seconds)]
23:43:07datechnoman (datechnoman) joins

HomeSearchPrevious dayNext day