HomeSearchPrevious dayNext day

00:34:51rocketdive quits [Ping timeout: 250 seconds]
01:47:26Jonimus quits [Ping timeout: 264 seconds]
02:27:05Jonimus joins
03:00:49BlueMaxima quits [Client Quit]
03:10:06sec^nd quits [Ping timeout: 245 seconds]
03:10:49sec^nd (second) joins
03:15:06sec^nd quits [Ping timeout: 245 seconds]
03:24:46sec^nd (second) joins
05:37:59sepro quits [Quit: Bye!]
05:43:45sepro (sepro) joins
06:27:33Matthww1 quits [Read error: Connection reset by peer]
06:27:59Matthww1 joins
07:14:45<h2ibot>Mentalist edited Deathwatch (+134, /* 2022 */ Tweakblogs.net): https://wiki.archiveteam.org/?diff=49320&oldid=49319
07:58:28<jodizzle>(from #archiveteam) it seems like the tweakblogs.net situation may have been handled back in October?
07:59:33<jodizzle>Though I can't quite tell from the logs.
08:01:35Mental joins
08:01:59<Mental>jodizzle, what'd I miss?
08:02:52<jodizzle>Just me mentioning that it seems like tweakblogs.net may have been handled back in October, but I'm not sure.
08:03:36<Jake>Looks like there may have been some sort of ratelimit as well
08:03:38<jodizzle>Logs indicate that there weren't actually that many blogs, or that many total posts
08:04:29<Mental>there is a ratelimit
08:04:48<Mental>if you go to fast you get a page saying "je gaat iets te snel"
08:04:58<Mental>*too
08:05:39<Mental>not sure about the http code for that though, httrack didn't detect it
08:06:28<Jake>yeah, I'm fairly sure we got it though. You'll likely have to wait for JAA or arkiver to come back.
08:08:24<Mental>https://tweakblogs.net/?allWeblogs=1 shows all blogs, about 945 blogs
08:10:03xkey quits [Quit: xkey]
08:13:18<Mental>where is it backed up? archive.org? or is there a complete dump from October?
08:14:52xkey (xkey) joins
08:47:34<@OrIdow6>rewby JAA: Did tweaksblogs get saved?
08:47:41<@OrIdow6>Apropos of above
08:47:56<@rewby>Don't remember
08:48:35<@rewby>I think JAA was doing a thing
08:48:35<@OrIdow6>Picking an arbitrary page, the only capture for 2022 is from SPN
08:48:42<@OrIdow6>In the WBM
08:55:45sonick quits [Client Quit]
09:08:16<@OrIdow6>https://www.washingtonpost.com/obituaries/2022/12/30/barbara-walters-tv-dies/
09:17:10hitgrr8 joins
09:19:33Island quits [Read error: Connection reset by peer]
09:34:27Wingy2 (Wingy) joins
09:35:35Wingy quits [Ping timeout: 250 seconds]
09:35:35Wingy2 is now known as Wingy
09:35:36fishingforsoup quits [Remote host closed the connection]
09:35:54fishingforsoup joins
09:53:20<@OrIdow6>https://www.reuters.com/world/former-pope-benedict-has-died-spokesman-2022-12-31/
10:48:36sonick (sonick) joins
11:43:56rocketdive joins
12:42:32Arcorann_ quits [Remote host closed the connection]
12:42:32fishingforsoup quits [Remote host closed the connection]
12:42:50fishingforsoup joins
12:44:32Megame (Megame) joins
12:48:32Arcorann_ joins
13:18:16Minkafighter7 quits [Quit: The Lounge - https://thelounge.chat]
13:20:14Minkafighter7 joins
13:22:13Megame quits [Client Quit]
13:25:05Minkafighter7 quits [Client Quit]
13:28:58Minkafighter7 joins
13:43:05Arcorann_ quits [Ping timeout: 250 seconds]
14:01:12CreaZyp154 joins
14:06:41Minkafighter7 quits [Client Quit]
14:06:59Minkafighter7 joins
14:07:57Minkafighter7 quits [Client Quit]
14:11:23<Mental>Orldow6, https://web.archive.org/web/20220000000000*/https://melek-taus.tweakblogs.net/blog/ was last captured in 2021 and https://zerfox.tweakblogs.net/blog/ wasn't captured at all
14:22:50leo60228 quits [Ping timeout: 264 seconds]
14:23:41leo60228 (leo60228) joins
14:28:20Minkafighter7 joins
14:48:04Aoede_ quits [Quit: ZNC - https://znc.in]
14:48:05lun4 quits [Write error: Connection reset by peer]
14:48:18lun4 (lun4) joins
14:48:18Aoede (Aoede) joins
15:00:10spirit quits [Client Quit]
15:04:46CreaZyp154 quits [Ping timeout: 265 seconds]
15:26:16leo60228- (leo60228) joins
15:26:26leo60228 quits [Ping timeout: 264 seconds]
15:27:44CreaZyp154 joins
15:42:33<Mental>I'm trying to save at least every /blog/ homepage from Tweakblogs manually (that hasn't been archived yet) using WBM but now it says "You have already reached the limit of active Save Page Now sessions. Please wait for a few minutes and then try again."
15:43:55<@arkiver>working on it
15:44:10<@arkiver>https://tweakblogs.net/?allWeblogs=1 has everything?
15:45:26<@arkiver>Mental: what status code fo they give upon a ban?
15:45:33<@arkiver>how long does the ban last>
15:45:34<@arkiver>?
15:51:31marto_8 quits [Client Quit]
15:51:31sepro quits [Client Quit]
15:51:31eroc1990 quits [Quit: Ping timeout (120 seconds)]
15:51:31TappyToes quits [Quit: ZNC - https://znc.in]
15:51:31Suika quits [Quit: Server is ded]
15:51:32AK quits [Quit: Ping timeout (120 seconds)]
15:51:32Pichu0202 quits [Remote host closed the connection]
15:51:32eroc19903 (eroc1990) joins
15:51:33sepro (sepro) joins
15:51:54AK9 (AK) joins
15:51:59Suika joins
15:52:03Pichu0102 joins
15:52:23TappyToes joins
16:27:13<@arkiver>tweakblogs.net is up at #Y or tracker.archiveteam.org/grab/
16:27:16<@arkiver>err
16:27:32<@arkiver>i mean https://tracker.archiveteam.org/grabtemp20221126/
16:28:37Mateon1 quits [Ping timeout: 250 seconds]
16:28:52Mateon1 joins
16:40:37<lukeman>I see a few ArchiveBot jobs for HipCast MP3 file lists (podcast host shutting down and cutting off downloads at some definition of midnight tonight), but it's slow-going and doesn't seem like it will grab much if they cut things off on time. I have all of the feeds + 100GB or so of enclosures fetched locally, but I think in total the media would add up to 1.4TB or so (estimated from crawling the feeds and adding up the
16:40:38<lukeman>listed enclosure content sizes).
16:42:54<lukeman>Not sure if anyone has suggestions to try and save that last minute. I'm more of a Warrior user, so not even sure my partial/naive `wget -xN` fetch of the media is in a form that's usable.
16:45:29<@arkiver>lukeman: can they handle high load?
16:45:34<@arkiver>or
16:45:53<@arkiver>Ryz: why do we have such a high delay (5-10 seconds) on the hipcast mp3s?
16:45:56<@arkiver>JAA: ^
16:46:14<@arkiver>if they can handle load I might push these mp3s to #// as well
16:47:25<lukeman>No clue on how resilient their servers might be at this point. I'm only running a few threads, but at least with that have not had any trouble.
16:48:52<lukeman>Someone on reddit messaged me that they were running a similar manual archive and were being throttled to 5MB/s
16:52:19<CreaZyp154>Why is everything closing at the same time ?!
16:52:53<CreaZyp154>Well actually I know why but that's annoying
16:56:49<lukeman>The invisible hand of link rot? Tax reporting periods
17:00:19<CreaZyp154>The day of the renewal of the web server subscription
17:14:42<lukeman>Switched my Warrior over to Grab at least. If HipCast ends up in that project I'll stop my manual archive.
17:32:28Megame (Megame) joins
17:41:38sonick quits [Client Quit]
17:43:35treora quits [Ping timeout: 250 seconds]
17:52:59anon15 joins
17:53:48<anon15>hi
17:54:23anon15 quits [Remote host closed the connection]
18:18:21<Mental>arkiver, if you hit the ratelimit the page says "je gaat iets te snel", not sure of status code. ratelimit resets after a few minutes
18:20:05<Mental>for Tweakblogs
18:40:47Megame quits [Ping timeout: 250 seconds]
18:56:03<Ryz>arkiiver, looks like throttling, then again, saying it as someone who didn't run those jobs related to Hipcast MP3s, but observing
19:00:42<h2ibot>JAABot edited CurrentWarriorProject (+4): https://wiki.archiveteam.org/?diff=49321&oldid=49258
19:21:20<lukeman>Looks like HipCast blocked my IP. I'd been running the same two threads for ~36 hours without issue. ¯\_(ツ)_/¯
19:32:53<@JAA>For the record: I was going to do something about Tweakblogs but didn't have the infrastructure required, and then it fell between the cracks (especially since it wasn't on Deathwatch for some reason).
19:49:17CreaZyp154 quits [Remote host closed the connection]
19:54:47michaelblob quits [Quit: Leaving]
20:00:41DLoader_ joins
20:01:53DLoader quits [Ping timeout: 257 seconds]
20:02:02DLoader_ is now known as DLoader
20:26:15<@JAA>https://www.anime-greek.com/ is shutting down shortly, apparently. Requires an account, registration's open. https://old.reddit.com/r/Archiveteam/comments/1001831/immediate_request/
20:27:23DLoader quits [Ping timeout: 250 seconds]
20:32:37DLoader joins
20:35:35<@OrIdow6>"Our newest member burner"
20:46:14<Mental>@JAA tweakblogs.net will *probably* remain up for at least sunday, possibly some days after (according to a Tweakers employee) (translated) "actual shutdown can only happen during working hours and IIRC no shutdown date has been decided upon yet" - he's a developer though, not a server admin so he might not know everything (he literally said
20:46:15<Mental>"IIRC")
20:47:15<Mental>https://gathering.tweakers.net/forum/list_message/73978264#73978264
20:57:48BlueMaxima joins
21:01:32@chfoo quits [Quit: _]
21:02:13chfoo (chfoo) joins
21:02:14@ChanServ sets mode: +o chfoo
22:09:02michaelblob (michaelblob) joins
22:19:08<Mental>correction: the Tweakers developer said "AFAIK" ("vziw"), not "IIRC"
22:28:51sec^nd quits [Ping timeout: 245 seconds]
22:33:53sec^nd (second) joins
22:38:48chrismeller (chrismeller) joins
22:50:42h3ndr1k_ (h3ndr1k) joins
22:52:06<tech234a>Chrome publishes a site popularity ranking collected using browser telemetry. A cached version of part of the dataset is on GitHub here: https://github.com/zakird/crux-top-lists
22:53:24<tech234a>The latest release of the full dataset contains 17,618,944 origins
22:53:46<tech234a>The GitHub has the top 1,000,000 origins
22:54:02h3ndr1k quits [Ping timeout: 264 seconds]
22:57:18Island joins
23:02:03<tech234a>Could be a good way to discover subdomains
23:03:19eroc19903 quits [Client Quit]
23:11:49leo60228- quits [Client Quit]
23:11:49BlueMaxima quits [Remote host closed the connection]
23:11:49eroc1990 (eroc1990) joins
23:11:49leo60228 (leo60228) joins
23:11:51BlueMaxima joins
23:14:28<h2ibot>TheTechRobo edited Geometry Dash (+560, Details): https://wiki.archiveteam.org/?diff=49322&oldid=48997
23:24:53Arcorann_ joins
23:28:14immibis_ (immibis) joins
23:31:50immibis quits [Ping timeout: 264 seconds]
23:34:58AK9 is now known as AK
23:45:25chrismeller quits [Ping timeout: 250 seconds]

HomeSearchPrevious dayNext day