HomeSearchPrevious dayNext day

00:19:21nepeat quits [Quit: ZNC - https://znc.in]
00:21:02nepeat (nepeat) joins
00:33:48Webuser499251 joins
00:35:20Webuser499251 leaves
00:55:28Umbire joins
01:38:05HP_Archivist quits [Quit: Leaving]
02:15:39Webuser373576 joins
02:15:44Webuser373576 quits [Client Quit]
02:29:53Erebus quits [Remote host closed the connection]
02:33:14Erebus (Erebus) joins
02:48:21Island joins
02:49:29cyanbox_ joins
02:53:36cyanbox quits [Ping timeout: 268 seconds]
02:55:15matthias1 joins
03:12:24Umbire quits [Client Quit]
03:22:19Umbire (Umbire) joins
03:39:04Island quits [Read error: Connection reset by peer]
03:59:17Umbire is now known as RJHacker37722
03:59:18Umbire (Umbire) joins
04:02:42RJHacker37722 quits [Ping timeout: 252 seconds]
04:05:54cyanbox_ quits [Client Quit]
04:06:14cyanbox joins
04:16:45Pendonym (Pendonym) joins
04:18:56DogsRNice quits [Read error: Connection reset by peer]
04:27:36michaelblob7641341 quits [Quit: yoop]
04:28:51michaelblob76413410 joins
04:30:43michaelblob76413410 quits [Client Quit]
04:31:25michaelblob76413410 joins
04:44:55michaelblob76413410 quits [Client Quit]
04:48:12michaelblob76413410 joins
05:16:45atphoenix_ (atphoenix) joins
05:19:08atphoenix__ quits [Ping timeout: 268 seconds]
05:19:35nexussfan quits [Quit: Konversation terminated!]
05:39:25h|ignition quits [Remote host closed the connection]
05:39:49h|ignition (h) joins
05:40:40<klea>arkiver: ^
06:13:07hexa- quits [Quit: Disconnected]
06:14:03hexa- (hexa-) joins
06:30:45ConstantK quits [Quit: Ping timeout (120 seconds)]
06:31:10ConstantK joins
06:47:28Wohlstand1 (Wohlstand) joins
06:49:51Wohlstand1 is now known as Wohlstand
07:02:30Wohlstand quits [Client Quit]
07:52:45<didyousayboop>pokechu22: thank you!
08:08:36pedantic-darwin quits [Quit: The Lounge - https://thelounge.chat]
08:09:34pedantic-darwin joins
08:12:25Zachava quits [Ping timeout: 268 seconds]
08:13:05Zachava (Zachava) joins
09:49:12Umbire quits [Ping timeout: 252 seconds]
09:49:36rewby (rewby) joins
09:49:37@ChanServ sets mode: +o rewby
11:00:26Bleo18260072271962345522201107 quits [Quit: The Lounge - https://thelounge.chat]
11:03:12Bleo18260072271962345522201107 joins
11:09:33<cruller|irc>I've created a list of URLs for nicotalk, which will be shutting down on July 31st. These URLs currently return 2xx: https://transfer.archivete.am/14NHsV/nicotalk.com_urls_2xx_now.txt
11:09:33<eggdrop>inline (for browser viewing): https://transfer.archivete.am/inline/14NHsV/nicotalk.com_urls_2xx_now.txt
11:09:57<cruller|irc>These URLs now return 4xx, but they used to return 2xx: https://transfer.archivete.am/MLQBA/nicotalk.com_urls_2xx_past.txt
11:09:58<eggdrop>inline (for browser viewing): https://transfer.archivete.am/inline/MLQBA/nicotalk.com_urls_2xx_past.txt
11:24:53Webuser108621 joins
11:41:00Umbire joins
12:00:55<cruller|irc>It’s a shame that quite a few of nicotalk’s older "sozai" have been lost.
12:01:10didyousayboop quits [Quit: The Lounge - https://thelounge.chat]
12:01:32didyousayboop (didyousayboop) joins
12:01:40<cruller|irc>Note: In Japanese, photographs, videos, music, sound effects, and other elements used as "raw materials" in creative work are called "素材(sozai)". I suppose the English equivalent would be "asset".
12:13:09McAfee leaves [Error from remote client]
12:19:25<cruller|irc>Assets are generally important because they are frequently referenced, but I don’t think they are adequately archived. This is because they are often hosted on external services, and file-hosting services generally dislike bots.
12:36:59<Ursidinoj>Yes, asset.
12:45:36ThreeHM quits [Ping timeout: 268 seconds]
12:47:49<cruller|irc>Oh, wait. I found another alias domain: http://vocatalk.web.fc2.com/
12:53:21ThreeHM (ThreeHeadedMonkey) joins
13:09:25McAfee joins
13:19:16<h2ibot>Cruller edited Deathwatch (+220, /* 2026-10 */ Add Supreme Prosecutors' Office…): https://wiki.archiveteam.org/?diff=63207&oldid=63174
13:35:10<cruller|irc>The "Network School" in Malaysia is likely to disappear: https://x.com/balajis/status/2078184375154618789
13:35:10<eggdrop>nitter: https://nitter.net/balajis/status/2078184375154618789
13:37:09<cruller|irc>https://ns.com/ Huh, its domain looks expensive.
13:56:38tertu quits [Quit: so long...]
13:56:59twiswist (twiswist) joins
14:04:04nexussfan (nexussfan) joins
14:04:36didyousayboop8 joins
14:06:04didyousayboop8 quits [Client Quit]
14:06:13didyousayboop8 joins
14:06:23didyousayboop8 quits [Client Quit]
14:30:26n9nes quits [Ping timeout: 268 seconds]
14:31:07n9nes joins
14:33:27nine quits [Quit: See ya!]
14:33:40nine joins
14:44:29<h2ibot>Exorcism edited Anubis/uncategorized (+44): https://wiki.archiveteam.org/?diff=63208&oldid=63204
15:15:55Webuser790153 joins
15:16:18Webuser790153 leaves
15:29:12Island joins
15:37:51fuzzy80211 quits [Killed (NickServ (GHOST command used by fuzzy8021))]
15:37:57fuzzy80211 (fuzzy80211) joins
15:43:58ichdasich joins
15:56:33pedantic-darwin quits [Quit: The Lounge - https://thelounge.chat]
16:06:20DogsRNice joins
16:09:08Webuser108621 quits [Quit: Ooops, wrong browser tab.]
16:10:47pedantic-darwin joins
16:57:06Pendonym quits [Ping timeout: 252 seconds]
17:03:22klea quits [Ping timeout: 268 seconds]
17:04:36alexlehm quits [Ping timeout: 268 seconds]
17:09:52<h2ibot>Brad edited Governments on YouTube (+449, US): https://wiki.archiveteam.org/?diff=63209&oldid=62415
17:11:52<h2ibot>Brad edited Governments on YouTube (+128, Adde U.S. Army and DNI title): https://wiki.archiveteam.org/?diff=63210&oldid=63209
17:12:22alexlehm (alexlehm) joins
17:12:27klea (klea) joins
17:24:54<h2ibot>Vitorio edited CBS News Radio (-454, Marked as saved per JAA): https://wiki.archiveteam.org/?diff=63211&oldid=61674
17:24:55<h2ibot>Powerkitten edited Deathwatch (+137, /* 2027 */): https://wiki.archiveteam.org/?diff=63212&oldid=63207
18:18:43McAfee leaves [Disconnected: Hibernating too long]
18:20:07garbanz joins
18:20:11<garbanz>Hi everyone. I have a worker up for archiving pastebin and I'm hoping to eventually do some research on the entire pastebin dataset. I'm looking for suggestions on the best way to access the data we have
18:27:26<@arkiver>garbanz: the records from the WARCs are available through the Wayback Machine, not for direct download as we don't want to let archived data become AI training data
18:27:35<@arkiver>so it may be difficult to pull data on a massive scale
18:30:00<justauser>Making a list from CDX API and pulling directly from Pastebin might work.
18:30:33<justauser>Last time I checked, the claim was that you can get banned for too much 404s, but the volume of 200s isn't limited much.
18:33:10ThreeHM quits [Ping timeout: 252 seconds]
18:33:49<garbanz>ah ok so it's going to be a bit tougher that I thought. So generally would you suggest something like check records that returned a 200 via Wayback and basically hope they are still returning a 200 from the time they were archived
18:35:06ThreeHM (ThreeHeadedMonkey) joins
18:40:11NeonGlitch (NeonGlitch) joins
18:40:11ThreeHM quits [Ping timeout: 268 seconds]
18:41:29ThreeHM (ThreeHeadedMonkey) joins
18:45:55<TheTechRobo>garbanz: You can scrape from the Wayback Machine if something isn't still available, but you will eventually run into ratelimits. (Not sure what the limits are these days.)
18:56:38unknownsrc quits [Ping timeout: 252 seconds]
19:03:16ice quits [Quit: WeeChat 4.9.0]
19:03:19ice joins
19:06:54unknownsrc (unknownsrc) joins
19:13:08Island quits [Ping timeout: 252 seconds]
19:13:49Island joins
19:15:19Island_ joins
19:18:58garbanz quits [Client Quit]
19:19:02Island quits [Ping timeout: 268 seconds]
19:35:45nine quits [Quit: See ya!]
19:35:59nine joins
19:40:38h|ignition quits [Ping timeout: 272 seconds]
19:41:20h|ignition (h) joins
19:48:38BornOn420 quits [Ping timeout: 268 seconds]
19:58:19McAfee joins
20:09:08Paw-chivist joins
20:41:23Paw-chivist quits [Client Quit]
21:48:20fuzzy80211 quits [Killed (NickServ (GHOST command used by fuzzy8021))]
21:48:26fuzzy80211 (fuzzy80211) joins
21:48:57fuzzy80211 quits [Excess Flood]
21:49:14fuzzy80211 (fuzzy80211) joins
21:49:47fuzzy80211 quits [Excess Flood]
21:50:09fuzzy80211 (fuzzy80211) joins
21:53:23Pendonym (Pendonym) joins
21:58:07nyakase5 quits [Remote host closed the connection]
21:58:45nyakase5 (nyakase) joins
21:59:33nyakase5 quits [Client Quit]
22:01:24fetcher joins
22:06:22fuzzy80211 quits [Killed (NickServ (GHOST command used by fuzzy8021))]
22:06:28fuzzy80211 (fuzzy80211) joins
22:35:43justauser quits [Remote host closed the connection]
22:41:35justauser (justauser) joins
22:55:46Webuser649499 joins
22:56:30Webuser649499 quits [Client Quit]
23:21:34Pendonym quits [Read error: Connection reset by peer]
23:36:02unknownsrc quits [Ping timeout: 252 seconds]
23:47:54unknownsrc (unknownsrc) joins

HomeSearchPrevious dayNext day