HomeSearchPrevious dayNext day

00:21:04pabs quits [Remote host closed the connection]
00:24:03Island joins
00:31:10jasons (jasons) joins
00:52:05<@JAA>Holy response times on srad.jp submissions... 16 seconds is the *minimum* average over one-minute windows I'm seeing...
00:58:56<fireonlive>holy crap
01:12:10xarph joins
01:13:56pabs (pabs) joins
01:30:20jasons quits [Ping timeout: 240 seconds]
01:58:27datechnoman quits [Quit: The Lounge - https://thelounge.chat]
02:14:35datechnoman (datechnoman) joins
02:34:10jasons (jasons) joins
02:59:28superkuh quits [Read error: Connection reset by peer]
03:01:04abirkill (abirkill) joins
03:23:33superkuh joins
03:33:50prikaza quits [Ping timeout: 240 seconds]
03:34:41jasons quits [Ping timeout: 272 seconds]
03:35:23prikaza (prikaza) joins
04:31:06icedice quits [Client Quit]
04:37:41jasons (jasons) joins
05:34:23jasons quits [Ping timeout: 272 seconds]
05:37:44sonick (sonick) joins
05:51:05JohnnyJ quits [Quit: Ping timeout (120 seconds)]
06:37:17jasons (jasons) joins
07:08:21Gereon4 (Gereon) joins
07:10:39Gereon quits [Ping timeout: 272 seconds]
07:10:39Gereon4 is now known as Gereon
07:17:24BlueMaxima quits [Read error: Connection reset by peer]
07:32:49jasons quits [Ping timeout: 272 seconds]
08:35:41jasons (jasons) joins
09:03:23pabs quits [Ping timeout: 272 seconds]
09:06:33T31M quits [Client Quit]
09:06:51T31M joins
09:12:15lflare quits [Ping timeout: 272 seconds]
09:18:14lflare (lflare) joins
09:32:31jasons quits [Ping timeout: 272 seconds]
09:32:59pabs (pabs) joins
09:45:02pabs quits [Remote host closed the connection]
09:48:17pabs (pabs) joins
09:51:52emtee quits [Remote host closed the connection]
10:01:50prikaza quits [Ping timeout: 240 seconds]
10:06:29JohnnyJ joins
10:07:28JohnnyJ quits [Read error: Connection reset by peer]
10:09:08JohnnyJ joins
10:11:36JohnnyJ quits [Client Quit]
10:12:10JohnnyJ joins
10:15:11JohnnyJ quits [Client Quit]
10:18:18JohnnyJ joins
10:19:36Wohlstand (Wohlstand) joins
10:35:39jasons (jasons) joins
10:39:45Island quits [Read error: Connection reset by peer]
10:47:42prikaza (prikaza) joins
11:15:16Wohlstand quits [Client Quit]
11:32:20jasons quits [Ping timeout: 240 seconds]
11:34:26JohnnyJ quits [Read error: Connection reset by peer]
11:35:10JohnnyJ joins
11:36:43Shjosan quits [Client Quit]
11:37:31Shjosan (Shjosan) joins
12:03:48toss (toss) joins
12:04:03JohnnyJ quits [Read error: Connection reset by peer]
12:04:55JohnnyJ joins
12:25:55JohnnyJ quits [Read error: Connection reset by peer]
12:26:33JohnnyJ joins
12:29:51Arcorann quits [Ping timeout: 272 seconds]
12:30:31JohnnyJ quits [Read error: Connection reset by peer]
12:32:09JohnnyJ joins
12:36:16jasons (jasons) joins
12:41:30JohnnyJ quits [Read error: Connection reset by peer]
13:27:29BearFortress quits [Ping timeout: 272 seconds]
13:34:27jasons quits [Ping timeout: 272 seconds]
13:41:25DLoader quits [Ping timeout: 272 seconds]
13:42:38BearFortress joins
13:56:21DLoader (DLoader) joins
14:37:30jasons (jasons) joins
14:37:50kiryu quits [Ping timeout: 240 seconds]
14:41:29qwertyasdfuiopghjkl quits [Remote host closed the connection]
15:07:00Lord_Nightmare quits [Quit: ZNC - http://znc.in]
15:10:37Lord_Nightmare (Lord_Nightmare) joins
15:18:11pixel leaves [Disconnected: Replaced by new connection]
15:18:12pixel (pixel) joins
15:37:50jasons quits [Ping timeout: 240 seconds]
15:51:03emtee joins
15:58:23toss_ (toss) joins
16:02:01toss quits [Ping timeout: 272 seconds]
16:20:03toss_ quits [Client Quit]
16:22:20parfait_ joins
16:26:05parfait quits [Ping timeout: 272 seconds]
16:27:55icedice (icedice) joins
16:41:28jasons (jasons) joins
16:48:24lizardexile joins
16:51:20DLoader quits [Ping timeout: 240 seconds]
16:59:25Wohlstand (Wohlstand) joins
17:00:51DLoader (DLoader) joins
17:36:59LeGoupil joins
17:40:20jasons quits [Ping timeout: 240 seconds]
17:47:20DLoader quits [Ping timeout: 240 seconds]
17:51:04adamus1red quits [Quit: SigTerm]
17:53:14adamus1red (adamus1red) joins
17:58:21<Pedrosso>JAA: Why is it you cannot choose a list of domains for AB to recurse through (rather than individual grabs) (such as subdomains)? Is it a Wget thing?
18:00:55<@JAA>Pedrosso: Simple: because it isn't implemented.
18:01:18<@JAA>wpull supports it, AB doesn't expose that.
18:05:24<Pedrosso>Ah.
18:05:24<Pedrosso>Is it particularly difficult to implement?
18:08:50@dxrt quits [Ping timeout: 240 seconds]
18:18:53<@JAA>For a fixed list of subdomains, it shouldn't be too hard. But that's not *that* useful. 'Grab this and any subdomain encountered' is trickier.
18:19:22<@JAA>Only the former is supported by wpull, actually, at least directly.
18:20:15<pokechu22>The main case where a fixed list would be useful is sites that mix www and non-www links
18:21:22<@JAA>I'm not exactly sure how it'd interact with --no-offsite-links and crosslinks.
18:21:42<@JAA>So that'd need some testing.
18:22:22<thuban>JAA: iirc, last time i looked into this i concluded that '!a <' would be fine for that (as long as you wanted the entirety of each subdomain)
18:25:02<@JAA>My srad.jp qwarc for comments, submissions, and comment parents should finish in a few hours.
18:26:46<@JAA>The generic solution I've been thinking about was to allow for a regex that controls what's considered onsite.
18:27:40<@JAA>And then bypass wpull's filters entirely, basically.
18:29:09<thuban>... all of wpull's filters? that doesn't make sense to me
18:29:44Megame (Megame) joins
18:30:32<@JAA>Well, maybe almost all, but because wpull doesn't provide information which filter gave which verdict (IIRC), it's almost unavoidable.
18:31:18<@JAA>The scheme and tries filters is probably the only one we'd still need. And those are trivial.
18:31:24<thuban>https://github.com/ArchiveTeam/wpull/blob/cfa5bcc571e7ff2d5175d8299e90651955c72df5/wpull/urlfilter.py#L44-L54 ?_?
18:32:05<@JAA>Yeah, but I don't think that's passed to the hooks.
18:32:12<thuban>^ level as well, surely
18:32:21<@JAA>AB doesn't care about the level.
18:32:38<@JAA>Well, except for !ao jobs.
18:34:39<thuban>https://github.com/ArchiveTeam/wpull/blob/cfa5bcc571e7ff2d5175d8299e90651955c72df5/wpull/processor/rule.py#L125-L126
18:39:21DLoader (DLoader) joins
18:44:04jasons (jasons) joins
18:49:50<@JAA>Huh, indeed.
18:57:46<thuban>probably worth hashing out a spec (either for any potential plugin or for wpull itself--i don't think anybody's completely happy with wpull's current set of options/priorities) before writing a lot of code
19:29:39LeGoupil quits [Read error: Connection reset by peer]
19:29:52LeGoupil joins
19:42:25jasons quits [Ping timeout: 272 seconds]
19:52:36Wohlstand quits [Client Quit]
19:53:45Wohlstand (Wohlstand) joins
19:58:53Wohlstand quits [Ping timeout: 272 seconds]
20:08:14<Pedrosso>JAA: "The generic solution I've been thinking about was to allow for a regex that controls what's considered onsite." Is there any reason not to do so?
20:16:23BlueMaxima joins
20:17:05<@JAA>Pedrosso: Time
20:17:26Wohlstand (Wohlstand) joins
20:18:39<Pedrosso>Ah. Time.
20:18:45<Pedrosso>We speaking a day, a week?
20:29:57LeGoupil quits [Client Quit]
20:41:13Island joins
20:44:26<fireonlive>where's that arkiver meme
20:44:45jasons (jasons) joins
20:44:48<fireonlive>https://mkx9delh5a.execute-api.ca-central-1.amazonaws.com/uploads/c7743b41c33e6600/arkiver.png
20:44:55<fireonlive>but JAA's projects
20:45:33lizardexile quits [Client Quit]
20:48:02<@JAA>https://i.pinimg.com/originals/c9/59/d4/c959d48ae082f5ff152e226612674e7f.jpg
20:50:03<fireonlive>:D
20:52:14<@JAA>My (main) AT todo list officially reached 1000 uncompleted items the other day, by the way.
20:53:09<project10>oof
20:53:15<project10>is there a supplemental list? :)
20:53:52Wohlstand quits [Client Quit]
20:54:33Wohlstand (Wohlstand) joins
20:54:53Wohlstand quits [Client Quit]
20:59:41<@JAA>A couple, yeah. :-P
21:07:30<katia>where do you keep your todo list
21:11:35<@JAA>The primary one is in Taskwarrior. The others are text files in various places.
21:12:21emtee quits [Ping timeout: 272 seconds]
21:12:24emtee joins
21:15:09<thuban>i want to see the list, but i'm afraid that looking upon it might turn me to ash...
21:21:20emtee quits [Ping timeout: 240 seconds]
21:21:57emtee joins
21:33:57<fireonlive>☠️
21:43:50jasons quits [Ping timeout: 240 seconds]
22:39:58Ryz quits [Quit: Ping timeout (120 seconds)]
22:40:00kiska5 quits [Quit: Ping timeout (120 seconds)]
22:40:18kiska5 joins
22:40:43Ryz (Ryz) joins
22:47:22jasons (jasons) joins
22:47:37DLoader_ (DLoader) joins
22:50:50DLoader quits [Ping timeout: 240 seconds]
22:50:58DLoader_ is now known as DLoader
23:27:06<h2ibot>Vokunal edited Vbox7 (+83, added tracker and archiving type): https://wiki.archiveteam.org/?diff=51648&oldid=51644
23:29:47xarph quits [Ping timeout: 272 seconds]
23:45:20jasons quits [Ping timeout: 240 seconds]

HomeSearchPrevious dayNext day