HomeSearchPrevious dayNext day

00:03:26etnguyen03 quits [Ping timeout: 252 seconds]
00:22:46guicale quits [Quit: ZNC 1.9.1+deb2+b3 - https://znc.in]
00:26:29guicale (guicale) joins
00:28:16fuzzy80211 (fuzzy80211) joins
00:36:06etnguyen03 (etnguyen03) joins
00:42:13<Doranwen>I have stared at this line of code for ages and I cannot figure out why it is not successfully stripping off the referer and replacing all the `%2F` with a slash (it only replaces the first one in each line, despite the 'g' flag): `cat links1.txt | sed 's~%3A~:~g' | sed 's~%2F~/~g' | sed 's~https://www\.livejournal\.com/away\?to=~~g' | sort -u > links2.txt`
00:43:13<Doranwen>`https://www.livejournal.com/away?to=http%3A%2F%2Fcastle-tv.dreamwidth.org%2F` is one of the urls in that file, and it comes out as `https://www.livejournal.com/away?to=http:/%2Fcastle-tv.dreamwidth.org%2F`
00:46:43<Doranwen>As a result, the links I've been dumping to the LJ project have had extras that shouldn't be there - and there are links that *should* be getting into #// and aren't.
00:47:43<klea>huh
00:47:57<klea>echo 'https://www.livejournal.com/away?to=http%3A%2F%2Fcastle-tv.dreamwidth.org%2F' | sed 's~%3A~:~g' | sed 's~%2F~/~g' | sed 's~https://www\.livejournal\.com/away\?to=~~g' gives me `https://www.livejournal.com/away?to=http://castle-tv.dreamwidth.org/` tho?
00:48:35<klea>As in, with it replaced.
00:49:35<klea>And echo 'https://www.livejournal.com/away?to=http%3A%2F%2Fcastle-tv.dreamwidth.org%2F' | sed 's~%3A~:~g' | sed 's~%2F~/~g' | sed 's~https://www.livejournal.com/away?to=~~g' gives me `http://castle-tv.dreamwidth.org/`, is it related to GNUisms?
00:56:40nine quits [Client Quit]
00:56:52nine joins
00:58:35<Doranwen>The bizarre thing is if I echo the link and then put my substitutions in like you said, I get this: `https://www.livejournal.com/away?to=http://castle-tv.dreamwidth.org/`
00:58:54<Doranwen>It doesn't strip the referer like it should but it does do all the substitutions.
01:00:27<Doranwen>But when I process the entire set of html files, where it pulls out every single link and dumps that into the links1.txt, and then runs the command I gave above where it does all the substitutions… along the way it pulls out all the links with livejournal in them, and I get that result I pasted earlier, where the colon was substituted correctly, but only the first %2F is swapped for the slash, and the referer is still there.
01:01:23<Doranwen>This is the full script I'm using: https://github.com/Doranwen/LJ-Processing-Scripts/blob/main/extractlinks.sh
01:02:44<Doranwen>If you want to test it on the same LJ I am, this is it: https://transfer.archivete.am/VHZXf/newbieguide.zip
01:03:07<Doranwen>(Note the instructions regarding the automatic dumping of text files into folders.)
01:03:31<Doranwen>I can't figure out why it behaves differently in the terminal vs. with the files - and why the referer won't get stripped no matter what I do.
01:05:22<klea>hmm
01:09:02Sidpatchy4 quits [Client Quit]
01:09:21Sidpatchy4 (Sidpatchy) joins
01:20:43fuzzy80211 quits [Killed (NickServ (GHOST command used by fuzzy8021))]
01:20:49fuzzy80211 (fuzzy80211) joins
01:36:39wickedplayer494 quits [Ping timeout: 252 seconds]
01:41:57wickedplayer494 (wickedplayer494) joins
01:46:28wickedplayer494 quits [Ping timeout: 252 seconds]
01:47:15wickedplayer494 (wickedplayer494) joins
01:52:04Matthww quits [Quit: Ping timeout (120 seconds)]
01:52:25Matthww joins
02:37:04grill quits [Ping timeout: 252 seconds]
02:37:55grill (grill) joins
02:47:36etnguyen03 quits [Remote host closed the connection]
04:00:07DogsRNice quits [Read error: Connection reset by peer]
04:52:05hexagonwin quits [Ping timeout: 252 seconds]
04:53:59hexagonwin (hexagonwin) joins
05:38:08nine quits [Quit: See ya!]
05:38:20nine joins
05:56:32hexagonwin quits [Ping timeout: 252 seconds]
05:58:29hexagonwin (hexagonwin) joins
06:07:59hexagonwin quits [Ping timeout: 252 seconds]
06:12:31hexagonwin (hexagonwin) joins
06:29:40BornOn420 quits [Quit: Textual IRC Client: www.textualapp.com]
06:40:24BornOn420 (BornOn420) joins
06:40:26BornOn420 quits [Client Quit]
07:20:14flotwig quits [Read error: Connection reset by peer]
07:20:31flotwig joins
07:59:19ThreeHM_ quits [Ping timeout: 268 seconds]
08:00:38ThreeHM (ThreeHeadedMonkey) joins
08:05:19ThreeHM quits [Ping timeout: 252 seconds]
08:06:58ThreeHM (ThreeHeadedMonkey) joins
09:10:43MrMcNugg1 (MrMcNuggets) joins
09:13:31MrMcNuggets quits [Ping timeout: 252 seconds]
09:42:12Goofybally quits [Killed (NickServ (GHOST command used by Goofybally8))]
09:42:18Goofybally joins
09:59:42HackMii quits [Ping timeout: 240 seconds]
10:00:40HackMii (hacktheplanet) joins
10:28:13_null quits [Quit: Connection closed]
10:28:33hexagonwin quits [Remote host closed the connection]
10:30:06_null (_null) joins
10:50:33systwo quits [Remote host closed the connection]
10:50:49systwo (systwi) joins
11:00:16Bleo182600722719623455222011079 quits [Quit: The Lounge - https://thelounge.chat]
11:02:59Bleo182600722719623455222011079 joins
11:13:05hexagonwin (hexagonwin) joins
12:00:41amphitryon joins
12:02:54amphitryon_ quits [Ping timeout: 268 seconds]
12:25:06Sidpatchy4 quits [Ping timeout: 268 seconds]
12:47:05MrMcNuggets (MrMcNuggets) joins
12:48:40MrMcNugg1 quits [Ping timeout: 252 seconds]
12:50:48MrMcNugg1 (MrMcNuggets) joins
12:54:05MrMcNuggets quits [Ping timeout: 268 seconds]
13:44:58systwo quits [Remote host closed the connection]
13:54:45MrMcNuggets (MrMcNuggets) joins
13:57:36MrMcNugg1 quits [Ping timeout: 268 seconds]
15:05:26^ quits [Ping timeout: 268 seconds]
15:05:52^ (^) joins
15:08:39Sidpatchy4 (Sidpatchy) joins
15:09:42Sidpatchy4 quits [Client Quit]
15:11:53Sidpatchy4 (Sidpatchy) joins
15:30:15Doran (Doranwen) joins
15:30:15Doranwen quits [Read error: Connection reset by peer]
15:36:16Doran quits [Ping timeout: 268 seconds]
16:01:33nicolas17 quits [Ping timeout: 268 seconds]
16:04:36nicolas17 (nicolas17) joins
16:15:28ThreeHM quits [Ping timeout: 252 seconds]
16:18:55ThreeHM (ThreeHeadedMonkey) joins
16:52:19BornOn420_ (BornOn420) joins
16:55:51BornOn420_ quits [Client Quit]
16:56:07BornOn420 (BornOn420) joins
17:38:47<hint>https://www.tomshardware.com/software/cloud-storage/nine-pbs-loses-access-to-70-years-of-data-after-contracted-cloud-storage-vendor-goes-defunct-public-tv-channel-sues-iron-mountain-data-center-which-hosts-archival-materials-to-ensure-preservation
17:38:59nine quits [Ping timeout: 268 seconds]
17:41:04nine joins
18:02:19DogsRNice joins
19:22:24<nulldata>Fiddler Classic has had its license rug pulled - now restricted to non-commercial use. https://textslashplain.com/2026/08/05/fiddler-in-2026/
19:51:26Doran (Doranwen) joins
19:51:27Doran is now known as Doranwen
19:54:05MrMcNugg1 (MrMcNuggets) joins
19:55:33MrMcNuggets quits [Ping timeout: 252 seconds]
20:13:17systwo (systwi) joins
20:21:13ThreeHM quits [Ping timeout: 252 seconds]
20:23:16ThreeHM (ThreeHeadedMonkey) joins
20:28:34ThreeHM quits [Ping timeout: 268 seconds]
20:29:36ThreeHM (ThreeHeadedMonkey) joins
20:33:12MrMcNugg1 quits [Client Quit]
21:28:43etnguyen03 (etnguyen03) joins
22:13:24jinn6 quits [Ping timeout: 268 seconds]
23:29:15etnguyen03 quits [Client Quit]
23:36:32BearFortress quits []

HomeSearchPrevious dayNext day