HomeSearchPrevious dayNext day

00:01:17dm4v quits [Read error: Connection reset by peer]
00:03:12dm4v joins
00:03:14dm4v quits [Changing host]
00:03:14dm4v (dm4v) joins
00:29:26onetruth joins
00:30:39atphoenix_ is now known as atphoenix
01:02:37dm4v quits [Client Quit]
01:03:46dm4v joins
01:03:49dm4v quits [Changing host]
01:03:49dm4v (dm4v) joins
01:25:51onetruth quits [Read error: Connection reset by peer]
02:59:49BlueMaxima joins
03:01:20qwertyasdfuiopghjkl quits [Remote host closed the connection]
03:20:29BlueMaxima_ joins
03:24:06BlueMaxima quits [Ping timeout: 258 seconds]
03:36:01qwertyasdfuiopghjkl joins
03:41:06jacobk quits [Ping timeout: 250 seconds]
03:46:45qw3rty__ joins
03:50:33qw3rty_ quits [Ping timeout: 258 seconds]
04:05:03Iki quits [Read error: Connection reset by peer]
04:45:14qwertyasdfuiopghjkl quits [Ping timeout: 244 seconds]
04:50:06jacobk joins
04:52:45qwertyasdfuiopghjkl joins
05:02:01pabs quits [Remote host closed the connection]
05:14:00pabs (pabs) joins
05:42:52rsn quits [Ping timeout: 258 seconds]
06:02:08vinia joins
06:50:24sec^nd quits [Remote host closed the connection]
06:58:18sec^nd (second) joins
07:17:01Arcorann (Arcorann) joins
07:39:47Arcorann quits [Ping timeout: 258 seconds]
08:01:57Arcorann (Arcorann) joins
08:19:19Megame (Megame) joins
08:42:06CottonProphecy joins
10:25:37BlueMaxima_ quits [Read error: Connection reset by peer]
10:55:46IDK quits [Quit: Connection closed for inactivity]
11:14:39dm4v_ joins
11:16:58dm4v quits [Ping timeout: 250 seconds]
11:16:58dm4v_ is now known as dm4v
11:16:58dm4v quits [Changing host]
11:16:58dm4v (dm4v) joins
11:30:49dm4v quits [Remote host closed the connection]
11:35:37dm4v joins
11:35:39dm4v quits [Changing host]
11:35:39dm4v (dm4v) joins
11:35:55dm4v quits [Remote host closed the connection]
11:37:04dm4v joins
11:37:06dm4v quits [Changing host]
11:37:06dm4v (dm4v) joins
11:37:36dm4v quits [Remote host closed the connection]
11:38:41dm4v joins
11:38:41dm4v quits [Changing host]
11:38:41dm4v (dm4v) joins
12:09:01qw3rty_ joins
12:09:06AlsoHP_Archivist joins
12:09:16Atom-- joins
12:09:17Arcorann_ joins
12:09:26benjinsmith joins
12:09:35atphoenix_ (atphoenix) joins
12:09:38fuzzy8021 quits [Killed (NickServ (GHOST command used by fuzzy802!~fuzzy8021@173-224-26-244.ptcnet.net))]
12:09:44apache2_ joins
12:09:44fuzzy8021 (fuzzy8021) joins
12:09:45Wayward- (wayward) joins
12:09:51Jonboy3451 joins
12:10:04Gereon6 (Gereon) joins
12:10:15SketchTh1Cow joins
12:10:21jmtd joins
12:10:25HugsNotDrugs` joins
12:10:29lukash71 joins
12:10:31AK1 (AK) joins
12:10:34britm0b joins
12:10:41Video_ joins
12:10:57VerifiedJ4 (VerifiedJ) joins
12:11:03Kaz2 (Kaz) joins
12:11:03@ChanServ sets mode: +o Kaz2
12:11:10britmob2568 joins
12:11:11Frogging- joins
12:11:18endrift|ZNC joins
12:11:19Fusl__ (Fusl) joins
12:11:19@ChanServ sets mode: +o Fusl__
12:11:20notbase2 joins
12:11:22Stiletto joins
12:11:24Sanqui_ joins
12:11:42RKenshin joins
12:11:44Doran (Doranwen) joins
12:11:46dm4v_ joins
12:11:57shogchips joins
12:12:09chfoo_ (chfoo) joins
12:12:09@ChanServ sets mode: +o chfoo_
12:12:10nothere_ joins
12:12:27driib9 (driib) joins
12:12:31jtagcat6 (jtagcat) joins
12:12:41revi_ (revi) joins
12:12:42cadence- (cadence) joins
12:12:43]42[ (N4Y) joins
12:12:44xit6 joins
12:12:46jacobk_ joins
12:12:51phillipsjk256 joins
12:12:56phiresky6 joins
12:13:04yawkat` (yawkat) joins
12:13:04benjins quits [Read error: Connection reset by peer]
12:13:04HP_Archivist quits [Read error: Connection reset by peer]
12:13:04atphoenix quits [Read error: Connection reset by peer]
12:13:04Wayward quits [Read error: Connection reset by peer]
12:13:04apache2 quits [Remote host closed the connection]
12:13:04Gereon quits [Quit: Ping timeout (120 seconds)]
12:13:04britmob quits [Remote host closed the connection]
12:13:04SketchTheCow quits [Read error: Connection reset by peer]
12:13:04Video quits [Remote host closed the connection]
12:13:04@Kaz quits [Quit: Ping timeout (120 seconds)]
12:13:04jtagcat quits [Quit: Ping timeout (120 seconds)]
12:13:04AK quits [Quit: Ping timeout (120 seconds)]
12:13:04lukash7 quits [Quit: Ping timeout (120 seconds)]
12:13:04britmob256 quits [Quit: Ping timeout (120 seconds)]
12:13:04monoxane quits [Quit: Ping timeout (120 seconds)]
12:13:04xit quits [Quit: Ping timeout (120 seconds)]
12:13:04mrfooooo quits [Quit: Ping timeout (120 seconds)]
12:13:04HugsNotDrugs quits [Quit: .]
12:13:04Jon quits [Quit: ZNC - http://znc.in]
12:13:04Stilett0 quits [Read error: Connection reset by peer]
12:13:04phiresky quits [Client Quit]
12:13:04phillipsjk quits [Remote host closed the connection]
12:13:04VerifiedJ quits [Quit: Ping timeout (120 seconds)]
12:13:04robbi5 quits [Quit: Ping timeout (120 seconds)]
12:13:04holbrooke quits [Ping timeout: 258 seconds]
12:13:04h2ibot quits [Ping timeout: 258 seconds]
12:13:04yanome quits [Client Quit]
12:13:04aphitex22 quits [Quit: Ping timeout (120 seconds)]
12:13:04Frogging101 quits [Remote host closed the connection]
12:13:05simon816 quits [Remote host closed the connection]
12:13:05cadence quits [Quit: ZNC 1.8.1 - https://znc.in]
12:13:05endrift quits [Remote host closed the connection]
12:13:05@arkiver quits [Quit: .]
12:13:05nothere quits [Quit: Leaving]
12:13:05Sanqui quits [Remote host closed the connection]
12:13:05jodizzle quits [Remote host closed the connection]
12:13:05notbasetwo quits [Quit: o/]
12:13:05@Fusl_ quits [Read error: Connection reset by peer]
12:13:05mutantmonkey quits [Ping timeout: 258 seconds]
12:13:05yawkat quits [Quit: No Ping reply in 180 seconds.]
12:13:05treora quits [Remote host closed the connection]
12:13:05Kenshin quits [Quit: ZNC - http://znc.in]
12:13:05HotSwap` quits [Ping timeout: 258 seconds]
12:13:05ArchivalEfforts quits [Remote host closed the connection]
12:13:05phuzion quits [Remote host closed the connection]
12:13:05shoghicp quits [Remote host closed the connection]
12:13:05Aoede quits [Quit: ZNC - https://znc.in]
12:13:05Ctrl-S quits [Read error: Connection reset by peer]
12:13:05summerisle quits [Remote host closed the connection]
12:13:05Larsenv quits [Quit: ZNC 1.8.2+deb1+focal2 - https://znc.in]
12:13:05pie_ quits [Remote host closed the connection]
12:13:05dm4v quits [Client Quit]
12:13:05BPCZ quits [Ping timeout: 258 seconds]
12:13:05luckcolors quits [Remote host closed the connection]
12:13:05sknebel quits [Remote host closed the connection]
12:13:05Soulflare quits [Ping timeout: 258 seconds]
12:13:05Arcorann quits [Ping timeout: 258 seconds]
12:13:05HackMii quits [Ping timeout: 258 seconds]
12:13:05JensRex quits [Ping timeout: 258 seconds]
12:13:05Doranwen quits [Ping timeout: 258 seconds]
12:13:05m0nika quits [Ping timeout: 258 seconds]
12:13:05Atom quits [Ping timeout: 258 seconds]
12:13:06programmerq quits [Ping timeout: 258 seconds]
12:13:06starship_8601 quits [Read error: Connection reset by peer]
12:13:06Gereon6 is now known as Gereon
12:13:06@Kaz2 is now known as @Kaz
12:13:06jtagcat6 is now known as jtagcat
12:13:06AK1 is now known as AK
12:13:06VerifiedJ4 is now known as VerifiedJ
12:13:06phiresky6 is now known as phiresky
12:13:06lukash71 is now known as lukash7
12:13:06britmob2568 is now known as britmob256
12:13:06xit6 is now known as xit
12:13:06Frogging- is now known as Frogging101
12:13:06@Fusl__ is now known as @Fusl_
12:13:06dm4v_ is now known as dm4v
12:13:06Ctrl-S joins
12:13:06djsrv quits [Read error: Connection reset by peer]
12:13:06h3ndr1k quits [Read error: Connection reset by peer]
12:13:06qw3rty__ quits [Ping timeout: 258 seconds]
12:13:06driib quits [Ping timeout: 258 seconds]
12:13:07FalconK quits [Ping timeout: 258 seconds]
12:13:07Somebody2 quits [Ping timeout: 258 seconds]
12:13:07kiskaLogBot quits [Ping timeout: 258 seconds]
12:13:07Viniter69 quits [Ping timeout: 258 seconds]
12:13:07tzt quits [Ping timeout: 258 seconds]
12:13:07[42] quits [Ping timeout: 258 seconds]
12:13:07driib9 is now known as driib
12:13:07]42[ is now known as [42]
12:13:07grawity quits [Ping timeout: 258 seconds]
12:13:07Ajay quits [Ping timeout: 258 seconds]
12:13:07taavi quits [Ping timeout: 258 seconds]
12:13:07@JAA quits [Ping timeout: 258 seconds]
12:13:07avoozl quits [Ping timeout: 258 seconds]
12:13:07dm4v quits [Changing host]
12:13:07dm4v (dm4v) joins
12:13:08ArchivalEfforts joins
12:13:08treora joins
12:13:09Soulflare joins
12:13:10taavi6 (taavi) joins
12:13:10robbi5 (robbi5) joins
12:13:10revi quits [Read error: Connection reset by peer]
12:13:11revi_ is now known as revi
12:13:11phuzion (phuzion) joins
12:13:13starship_8601 (starship_8601) joins
12:13:14monoxane (monoxane) joins
12:13:15mrfooooo joins
12:13:16summerisle (summerisle) joins
12:13:16m0nika (m0nika) joins
12:13:17BPCZ (BPCZ) joins
12:13:17Viniter69 (Viniter) joins
12:13:18JAA (JAA) joins
12:13:19aphitex22 joins
12:13:19@ChanServ sets mode: +o JAA
12:13:20masterX244_ (masterX244) joins
12:13:20luckcolors (luckcolors) joins
12:13:21djsrv_ (djsrv) joins
12:13:22kiskaLogBot joins
12:13:23arkiver (arkiver) joins
12:13:23@ChanServ sets mode: +o arkiver
12:13:25xkey quits [Remote host closed the connection]
12:13:29jacobk quits [Ping timeout: 258 seconds]
12:13:29Jonboy345 quits [Ping timeout: 258 seconds]
12:13:29atomicthumbs quits [Ping timeout: 258 seconds]
12:13:29@AlsoJAA quits [Ping timeout: 258 seconds]
12:13:29@chfoo quits [Ping timeout: 258 seconds]
12:13:29kpcyrd quits [Ping timeout: 258 seconds]
12:13:29maxfan8 quits [Ping timeout: 258 seconds]
12:13:29Mopman quits [Ping timeout: 258 seconds]
12:13:38atomicthumbs joins
12:13:41Somebody2 joins
12:13:44holbrooke joins
12:13:45yanome (yano) joins
12:13:47taavi6 is now known as taavi
12:13:48xkey (eyo) joins
12:13:50Ajay joins
12:13:52masterX244 quits [Ping timeout: 258 seconds]
12:13:53sknebel (sknebel) joins
12:13:56Aoede (Aoede) joins
12:14:01tzt joins
12:14:02c00k13_ joins
12:14:04pie_ joins
12:14:05AlsoJAA (JAA) joins
12:14:05@ChanServ sets mode: +o AlsoJAA
12:14:06avoozl joins
12:14:15asie quits [Ping timeout: 258 seconds]
12:14:15JensRex (JensRex) joins
12:14:15h3ndr1k (h3ndr1k) joins
12:14:18maxfan8 (maxfan8) joins
12:14:38c00k13 quits [Ping timeout: 258 seconds]
12:14:39HotSwap joins
12:14:44kpcyrd (kpcyrd) joins
12:14:45mutantmonkey (mutantmonkey) joins
12:14:54simon816 (simon816) joins
12:14:54HackMii (hacktheplanet) joins
12:15:01wickedplayer494 quits [Ping timeout: 258 seconds]
12:15:11asie joins
12:15:17programmerq (programmerq) joins
12:15:27jodizzle (jodizzle) joins
12:15:50wickedplayer494 joins
12:16:41Larsenv (Larsenv) joins
12:29:50Ryz quits [Remote host closed the connection]
12:31:27Ryz (Ryz) joins
12:31:37Ryz quits [Excess Flood]
12:31:56Ryz (Ryz) joins
12:39:47grawity (grawity) joins
12:39:56FalconK (FalconK) joins
12:39:59Mopman joins
12:47:33robbi5 quits [Client Quit]
12:47:33taavi quits [Client Quit]
12:47:35Viniter69 quits [Client Quit]
12:47:37monoxane quits [Client Quit]
12:47:40yanome quits [Client Quit]
12:47:42robbi5 (robbi5) joins
12:47:42taavi (taavi) joins
12:47:45m0nika quits [Client Quit]
12:47:50monoxane (monoxane) joins
12:47:52yanome (yano) joins
12:47:53Viniter69 (Viniter) joins
12:48:06m0nika (m0nika) joins
12:48:11JensRex quits [Client Quit]
12:49:24JensRex (JensRex) joins
12:49:39masterX244_ quits [Client Quit]
12:49:55masterX244 (masterX244) joins
13:14:04shogchips quits [Client Quit]
13:14:20shoghicp (shoghicp) joins
13:51:42benjinsmith is now known as benjins
14:04:58AntiLiberal joins
14:05:06gazorpazorp quits [Ping timeout: 250 seconds]
14:06:50Video_ quits [Ping timeout: 250 seconds]
14:12:28jacobk_ quits [Ping timeout: 250 seconds]
14:25:54AntiLiberal quits [Ping timeout: 250 seconds]
14:27:15Hackerpcs quits [Client Quit]
14:28:58Hackerpcs (Hackerpcs) joins
14:29:15gazorpazorp joins
14:32:24duce1337 quits [Ping timeout: 250 seconds]
14:34:29@chfoo_ is now known as @chfoo
14:46:23x9fff00 quits [Remote host closed the connection]
14:48:21x9fff00 (x9fff00) joins
15:10:32Arcorann_ quits [Ping timeout: 250 seconds]
15:42:33h2ibot (h2ibot) joins
15:49:32rsn joins
16:25:58jacobk joins
16:36:42pabs is now known as RJHacker33116
16:36:42RJHacker33116 quits [Killed (chaostal.hackint.org (Nickname regained by services))]
16:36:45pabs (pabs) joins
16:57:42duce1337 joins
17:13:07rsn_ joins
17:16:55rsn quits [Ping timeout: 252 seconds]
18:47:54tzt quits [Changing host]
18:47:54tzt (tzt) joins
18:54:11Stiletto quits [Remote host closed the connection]
19:07:26Stiletto joins
19:08:00duce1337 quits [Ping timeout: 250 seconds]
20:25:03CottonProphecy quits [Ping timeout: 244 seconds]
20:28:12IDK joins
20:40:33<thuban>hey rewby, do you still have that mass warc outlink scanning setup?
20:40:35<thuban>can it (a) be run on specific sets of warcs and (b) find specific url-like patterns outside of href/src markup?
20:40:55<rewby>Yes on all three
20:44:36<thuban>great! what's the best way to specify the warcs (ab job id? domain? list of files?), and are there any restrictions on the patterns?
20:45:32<rewby>List of http urls is best. It tries it's best to find anything url like based on a set of regexes
20:46:13<rewby>I have a script to turn ia collections into input for it
20:50:42Atom-- quits [Ping timeout: 250 seconds]
20:51:09<thuban>hmmm. i'd like to scan https://archive.fart.website/archivebot/viewer/job/9minf for the pattern '(file|image):\s*"([^"])",' (where the actual url of interest is in the second group; any urls found elsewhere in the source would be redundant).
20:51:58<thuban>is that possible, or would i have to match on internal url structure, rather than surrounding text, in order to do any filtering?
20:52:27<rewby>That should be easy to do
20:53:17<rewby>I'll look into it tomorrow
20:53:43<rewby>But should be an easy code patch to make it do what you want
20:55:56<thuban>ok, cool! let me know if you'd rather have a lookaround/reset-based pattern.
20:56:03qwertyasdfuiopghjkl quits [Ping timeout: 244 seconds]
20:56:15<rewby>Nah, I cant do lookaround
20:56:27<thuban>yeah, i suspected as much
20:56:41<rewby>It's basically hyperscan glued to a streaming warc parser
20:57:16<rewby>So it has the limits that come with that choice of engine
20:58:57<thuban>makes sense. anyway if you link the results here i will post-process and pass them back to archivebot :)
20:59:09<rewby>Sure thing
20:59:40<thuban>thanks very much
21:41:58vela quits [Remote host closed the connection]
21:43:08AlsoHP_Archivist quits [Ping timeout: 250 seconds]
21:51:58duce1337 joins
21:58:27vinia quits [Ping timeout: 258 seconds]
22:18:29Megame quits [Client Quit]
22:21:53Ruthalas quits [Quit: END OF LINE]
22:23:08Ruthalas (Ruthalas) joins
22:37:53IDK quits [Client Quit]
23:27:44Arcorann_ joins
23:35:19Arcorann_ quits [Ping timeout: 252 seconds]

HomeSearchPrevious dayNext day