00:02:38KiiwiiWasTooken joins
00:06:04KiiwiiIsTaken quits [Ping timeout: 240 seconds]
00:06:32pew joins
00:14:23atphoenix quits [Remote host closed the connection]
00:15:01atphoenix (atphoenix) joins
00:17:22<@JAA>Dallas: pywb
00:42:45ddd quits [Remote host closed the connection]
01:00:05LeighR joins
01:04:44LeighR quits [Ping timeout: 240 seconds]
01:13:01jut quits [Ping timeout: 252 seconds]
01:23:56<thuban>can we handle flickr? this fellow died recently https://www.flickr.com/photos/andreaskay/
01:25:11Wayward quits [Remote host closed the connection]
01:29:11jut (jut) joins
01:32:03pew leaves
01:40:30<@JAA>thuban: Yes, I'll throw it into AB.
01:40:46<thuban>cool, thanks!
01:41:00jut quits [Ping timeout: 265 seconds]
01:41:44jut (jut) joins
01:54:04TheLovinator quits [Ping timeout: 240 seconds]
01:55:19TheLovinator joins
02:30:39onetruth quits [Read error: Connection reset by peer]
02:31:47Jonboy345 quits [Read error: Connection reset by peer]
02:33:15onetruth joins
02:43:10Jonboy345 joins
02:46:37madmax joins
02:59:10LeighR joins
03:03:44LeighR quits [Ping timeout: 240 seconds]
03:48:35Mineroboter joins
03:48:47Mineroboter quits [Remote host closed the connection]
04:05:57sec^nd quits [Ping timeout: 240 seconds]
04:09:25sec^nd (second) joins
04:17:33qw3rty_ joins
04:21:07qw3rty quits [Ping timeout: 252 seconds]
04:53:41LeighR joins
04:55:36LeighR_ joins
04:58:24LeighR quits [Ping timeout: 240 seconds]
05:00:04LeighR_ quits [Ping timeout: 240 seconds]
05:27:51BurritoMan joins
06:06:21daalekz quits [Ping timeout: 265 seconds]
06:26:29<flashfire42>So the dutch government resigned we should porbably do some grabs about that
06:33:25divi_ joins
06:34:23divi quits [Ping timeout: 265 seconds]
06:34:57divi_ quits [Client Quit]
06:36:55divi (divi) joins
06:56:10LeighR joins
07:00:44LeighR quits [Ping timeout: 240 seconds]
07:01:22madmax quits [Client Quit]
07:07:50aphitex quits [Quit: Ping timeout (120 seconds)]
07:10:44aphitex (aphitex) joins
07:13:24Barto quits [Remote host closed the connection]
07:13:44Barto (Barto) joins
07:36:47lennier1 joins
07:54:41LeGoupil joins
07:58:44betamax quits [Ping timeout: 240 seconds]
07:59:37betamax (betamax) joins
08:22:24godane1 quits [Ping timeout: 240 seconds]
08:23:21godane (godane) joins
08:38:02hooway joins
08:56:49LeighR joins
09:01:24LeighR quits [Ping timeout: 240 seconds]
10:24:26LeighR joins
10:29:04LeighR quits [Ping timeout: 240 seconds]
10:36:28LeighR joins
10:58:08<Dallas>ty JAA :)
11:18:34BPCZ quits [Ping timeout: 252 seconds]
11:23:10LeGoupil quits [Client Quit]
11:23:18BPCZ joins
11:36:54<justcool393>JAA: gotcha
11:48:33jeff-kao-propublica-org quits [Ping timeout: 265 seconds]
11:59:37ragu_ joins
12:03:04ragu__ quits [Ping timeout: 240 seconds]
12:14:10<Dallas>idk If anyone pointed this out yet but looks like parler is starting to come back up, or at least they have some sort of host https://parler.com/
12:14:35<purplebot>Webzdarma edited by Sanqui (+192, /* ArchiveBot jobs */) just now -- https://www.archiveteam.org/?diff=46197&oldid=46178
12:41:08<Dallas>They're still on aws somehow .... https://subdomainfinder.c99.nl/scans/2021-01-11/https://parler.com/ https://subdomainfinder.c99.nl/geoip/13.224.227.89
12:57:34<purplebot>Webzdarma edited by Sanqui (+7, /* ArchiveBot jobs */) 20 minutes ago -- https://www.archiveteam.org/?diff=46198&oldid=46197
13:16:25Matthww joins
13:18:28monoxane quits [Ping timeout: 252 seconds]
13:24:35monoxane (monoxane) joins
13:26:18left-shark quits [Quit: Connection closed for inactivity]
13:26:34<purplebot>Site exploration edited by Sanqui (+447, Add subdomain enumeration) just now -- https://www.archiveteam.org/?diff=46200&oldid=30117
13:27:09qw3rty_ quits [Ping timeout: 265 seconds]
13:27:34<purplebot>Webzdarma edited by Sanqui (+787, subdomainfinder jobs) 23 minutes ago -- https://www.archiveteam.org/?diff=46199&oldid=46198
13:50:10qw3rty joins
14:01:54lunik1 quits [Client Quit]
14:07:53lunik1 joins
14:13:04Arcorann_ quits [Ping timeout: 265 seconds]
14:16:27nerdguy1138 quits [Ping timeout: 265 seconds]
14:26:40monoxane quits [Ping timeout: 252 seconds]
14:32:47nerdguy1138 (nerdguy1138) joins
14:38:30ddd joins
14:47:47monoxane (monoxane) joins
15:11:43ddd quits [Remote host closed the connection]
15:14:34<purplebot>Deathwatch edited by JustAnotherArchivist (+167, /* 2021 */ BugTraq not shutting …) just now -- https://www.archiveteam.org/?diff=46201&oldid=46180
15:16:34<purplebot>Alive... OR ARE THEY edited by Maner76 (+249, /* Watchlist */) just now -- https://www.archiveteam.org/?diff=46202&oldid=45963
15:16:35<purplebot>BBC News Social Media edited by Flashfire42 (+12, /* Twitter Accounts */) just now -- https://www.archiveteam.org/?diff=46203&oldid=45101
15:16:35<purplebot>X3.hu edited by Flashfire42 (+45) just now -- https://www.archiveteam.org/?diff=46204&oldid=45614
15:29:49lunik1 quits [Client Quit]
15:31:33lunik1 joins
15:32:34<purplebot>List of major MediaWiki wikis with the LinkSearch extension edited by Sanqui (+74, add cs, sk wikipedias) just now -- https://www.archiveteam.org/?diff=46205&oldid=28672
15:36:43lunik1 quits [Client Quit]
15:40:00<Sanqui>https://subdomainfinder.c99.nl/ is nifty btw
15:40:14lunik1 joins
15:40:53<Sanqui>and the fact that 50% of these domains 404 already is depressing https://etc.sanqui.net/archivebot_wzcz_404.png
15:44:09<@JAA>Sanqui: Have you looked at Project Sonar's lists?
15:44:38<Sanqui>I haven't
15:44:51<Sanqui>honestly this page needs more love https://archiveteam.org/index.php?title=Site_exploration
15:45:32<Sanqui>the very first link is dead...
15:45:42<Sanqui>mwlinkscrape actually still works tho
15:48:41ddd joins
15:51:47lunik1 quits [Client Quit]
15:53:18lunik1 joins
15:57:58jut quits [Ping timeout: 252 seconds]
15:58:38jut (jut) joins
16:10:34<purplebot>Webzdarma edited by Sanqui (+1185, add mwlinkscrape set) just now -- https://www.archiveteam.org/?diff=46206&oldid=46199
16:11:33lunik1 quits [Client Quit]
16:12:47ddd quits [Remote host closed the connection]
16:13:09lunik1 joins
16:16:04jut quits [Ping timeout: 240 seconds]
16:17:12jut (jut) joins
16:18:09<@kiska>What is being discovered? I have project sonar stuffs
16:19:38<Sanqui>kiska: these subdomains https://archiveteam.org/index.php?title=Webzdarma
16:20:13<Sanqui>I have a local master link that I'm working with and adding more from various sources as you can see
16:21:57<Sanqui>I built up a big backlog of jobs already though so... no stress I guess
16:26:24jut quits [Ping timeout: 240 seconds]
16:26:59lunik1 quits [Client Quit]
16:27:38jut (jut) joins
16:27:56lunik1 joins
16:32:42<@JAA>For visibility: BugTraq is not shutting down after all. Looks like they'll revive the mailing list as well, not just keep the archives up.
16:33:04<@JAA>I'll make sure everything's archived anyway.
16:33:26<@JAA>Specifically, every message under https://www.securityfocus.com/archive/1 and every advisory under https://www.securityfocus.com/bid/
16:34:40jut quits [Client Quit]
16:36:14jeff-kao-propublica-org joins
16:44:52ddd joins
16:47:24DogsRNice (Webuser299) joins
17:00:02ddd quits [Remote host closed the connection]
17:09:18jut (jut) joins
17:09:37lunik1 quits [Client Quit]
17:10:45lunik1 joins
17:11:35lunik1 quits [Client Quit]
17:11:55lunik1 joins
17:12:04Matthww quits [Ping timeout: 240 seconds]
17:15:00Matthww joins
18:28:54<AK>Finally worked out why docker exec -it <name> touch STOP never seemed to do anything. "restart: unless-stopped" I'm an idiot
18:29:28<EggplantN>ah yes
18:29:35<EggplantN>touch STOP causes run-pipeline3 to exist
18:29:44<EggplantN>which then will restart the CT
18:30:02<AK>Yeah it explains why when I look back they just seem to still be running
18:30:10<AK>Ahh well, time to change the compose files
18:35:48spirit joins
18:43:52LeighR quits [Remote host closed the connection]
18:49:12KiiwiiWasTooken quits [Remote host closed the connection]
18:49:44KiiwiiWasTooken joins
18:50:25Hackerpcs quits [Quit: Hackerpcs]
18:52:19Hackerpcs (Hackerpcs) joins
18:55:53t8c joins
19:00:10jut quits [Ping timeout: 265 seconds]
19:00:42jut (jut) joins
19:08:47Ruthalas quits [Quit: END OF LINE]
19:09:14Ruthalas (Ruthalas) joins
19:20:25LeighR joins
19:25:24LeighR quits [Ping timeout: 240 seconds]
20:03:51<avoozl>Sanqui: I've got around 8M posts loaded (takes half an hour from scratch) and search queries currently can take around 1 second, for a personal hosting that seems acceptable
20:04:34<Sanqui>definitely -- that'd be fine for public consumption too if you just limit to 1 search per ip per minute or something
20:05:00<avoozl>I think for public consumption another type of data store would be better suited, but that's for another day
20:05:45<avoozl>for example, searching for "magic penetration" "armor penetration" currently gives me posts (and their fragments) like this:
20:05:47<avoozl>Yes but I would expect Ryze to have much more <mark>magic</mark> <mark>penetration</mark> than <mark>armor</mark> <mark>penetration</mark> so the damage dealt will be lower.
20:06:41<avoozl>But there's some work to be done on the parser side now first
20:08:18<avoozl>I'm just adding a sanitized html output for my post overview, because otherwise I'm going to have some issues down the road with disallowed tags and other madness
20:08:55<avoozl>the lol forums download itself is still running, but I'll do a sizeable load overnight, see how well the index keeps up. This was just a single 5GB WARC
20:17:44prebala-publici quits [Read error: Connection reset by peer]
20:17:54prebala-publici joins
20:20:14LeGoupil joins
20:21:13LeGoupil quits [Client Quit]
20:23:28<avoozl>estimate is around an hour to load the entire forums.eune.leagueoflegends.com
21:06:29BlueMaxima joins
21:18:24Peetz1r quits [Ping timeout: 240 seconds]
21:19:19Peetz1r (Peetz0r) joins
21:21:56LeighR joins
21:26:24LeighR quits [Ping timeout: 240 seconds]
21:28:24LeighR joins
21:29:08t8c quits [Client Quit]
21:33:04LeighR quits [Ping timeout: 240 seconds]
21:37:44BlueMaxima quits [Ping timeout: 265 seconds]
21:40:23BlueMaxima joins
21:58:19BlueMaxima quits [Read error: Connection reset by peer]
22:40:34BlueMaxima joins
22:46:04Peetz1r quits [Ping timeout: 252 seconds]
23:21:15Peetz1r (Peetz0r) joins
23:22:44nertzy (nertzy) joins
23:24:26etnguyen03 (etnguyen03) joins
23:29:07LeighR joins
23:33:44LeighR quits [Ping timeout: 240 seconds]
23:36:08hooway quits [Client Quit]
23:37:31@Fusl quits [Excess Flood]
23:37:48Fusl (Fusl) joins
23:37:48@ChanServ sets mode: +o Fusl
23:48:43BlueMaxima quits [Ping timeout: 265 seconds]
23:50:58BlueMaxima joins
23:58:24BlueMaxima quits [Ping timeout: 240 seconds]