HomeSearchPrevious dayNext day

00:00:43<imer>arkiver: 1/s looks to be more than fine for 200/redirect at least, those are still going strong at 9-10 req/s (and lower of course)
00:06:51<imer>going to stop here and head off to bed though I think
00:07:31<thuban>added a bunch of stuff to the wiki page
00:08:02<thuban>a bit late for reference (sorry lmao, should have thought of it earlier), but perhaps of historical interest...
00:08:18<project10>imer: one last question, how long do bans last for?
00:08:51<imer>no clue, I think 24h were mentioned?
00:09:02<imer>i've got notes this time so I can check tomorrow
00:15:43anewarchiverlol2 quits [Ping timeout: 265 seconds]
01:24:37Exorcism quits [Remote host closed the connection]
01:25:43Exorcism (exorcism) joins
02:33:57iCesenberk|m joins
02:57:27Exorcism3 (exorcism) joins
02:58:17Exorcism quits [Read error: Connection reset by peer]
02:58:17Exorcism3 is now known as Exorcism
03:41:44Exorcism1 (exorcism) joins
03:43:22Exorcism quits [Read error: Connection reset by peer]
03:43:22Exorcism1 is now known as Exorcism
05:11:42<that_lurker>Is anyone YOLOing it with a greater than 1 concurrency?
05:13:09<Exorcism>me (20 concurrency)
05:15:08<pokechu22>Increasing the concurrency increases the delay so it doesn't really do anything useful
05:20:51<imer>been running 10 containers on a vm for testing and that seems to be holding still, that's going to probably get you super banned once arkiver tweaks the sleeps though
05:21:27<imer>(super ban being like a regular ban, but maybe slightly quicker)
06:06:44xxia|m joins
06:22:32<magmaus3>> Is anyone YOLOing it with a greater than 1 concurrency?
06:23:13<magmaus3>me (20 on my pc at home + 6 on an imstance on OCI)
07:59:26systwi quits [Ping timeout: 252 seconds]
07:59:46systwi__ (systwi) joins
08:13:39systwi (systwi) joins
08:13:44systwi__ quits [Ping timeout: 252 seconds]
08:24:48yts98 joins
08:32:21<DLoader>3=301 https://fb.audit.assoc.assoc.assoc.assoc.assoc.assoc.assoc.ecole.mairie.assoc.ecole.ecole.assoc.assoc.ecole.pagespro-orange.fr/
08:33:03<DLoader>this doesn't seem right, and there are lost of more items with "mairie" and "ecole" in url
08:33:25<DLoader>Starting WgetDownload for Item url:https://pagespro-orange.fr/skinethic.mairie.mairie.ecole.ecole.mairie.ecole.ecole.assoc/Communique%20FR.htmurl:https://cij.guyane.ecole.assoc.assoc.mairie.ecole.mairie.ecole.mairie.mairie.ecole.ecole.pagespro-orange.fr/url:https://pagespro-orange.fr/sheila.leirner.ecole.ecole.mairie.assoc.assoc.ecole.assoc.assoc.ecole/Site%20Entrevistas/Entrevistas.htmlurl:http://assoc.pagespro-orange.fr/hansi.assoc.mairie.
08:33:25<DLoader>ecole.mairie.assoc.ecole.ecole.assoc.ecole.ecole.mairie.mairie.ecole/url:http://ecole.pagespro-orange.fr/f6crp.ecole.ecole.mairie.ecole.assoc.assoc.ecole.ecole/
08:33:37<DLoader>arkiver: ^
08:34:17kdy (kdy) joins
08:34:50<BornOn420>ditto
08:35:57BornOn420 quits [Client Quit]
08:38:08<project10>yep, seeing same
08:41:09Bespork joins
08:42:14<Bespork>Hi all! My warrior is fetching domains like http://auvergne.contretemps.mairie.assoc.assoc.mairie.ecole.assoc.ecole.ecole.mairie.mairie.mairie.assoc.assoc.ecole.assoc.ecole.pagespro-orange.fr/ - I assume the string of "ecoles" and "mairies" are some kind of redirect bug. Should I let the warrior run, or stop it?
08:58:28<project10>JAA / arkiver: we should probably pause this until the runaway 'assoc.mairie' issue is figured out. Everyone is submitting same-sized claims, churning away on these items, and backfeed just continues to grow with these items
09:23:52<thuban>whoops, yeah, queue_all_versions checks whether the `site` slug is literally "assoc"/"mairie"/"ecole" but not whether it merely ends with them
09:23:58@ChanServ sets mode: +o flashfire42
09:24:02<thuban>should just strip them if sub == "pagespro-orange", then return nil if resulting `site` is empty
09:58:02Exorcism quits [Remote host closed the connection]
09:58:52Exorcism (exorcism) joins
10:17:41nulldata quits [Quit: The Lounge - https://thelounge.chat]
10:18:49nulldata (nulldata) joins
11:04:27kiryu quits [Remote host closed the connection]
11:19:51kiryu joins
11:19:51kiryu quits [Changing host]
11:19:51kiryu (kiryu) joins
11:52:05BornOn420 (BornOn420) joins
12:35:06<@arkiver>DLoader: oof
12:35:12<@arkiver>yep ous
12:35:13<@arkiver>ouch
12:35:15<@arkiver>sorry
12:35:28<@arkiver>don't worry i can easily filter those out luckily
12:36:00<@arkiver>paused!
12:38:44Exorcism quits [Remote host closed the connection]
12:39:52Exorcism (exorcism) joins
13:34:55UserH joins
13:40:50threedeeitguy39 (threedeeitguy) joins
14:00:11<Exorcism>https://thelounge.exorcism.repl.co/uploads/d9c571d46921b0f9/image.png Ah ?
14:04:12Exorcism1 (exorcism) joins
14:05:52Exorcism quits [Read error: Connection reset by peer]
14:05:52Exorcism1 is now known as Exorcism
14:08:13Exorcism4 (exorcism) joins
14:09:16Exorcism quits [Read error: Connection reset by peer]
14:09:16Exorcism4 is now known as Exorcism
14:22:05Peroniko quits [Client Quit]
14:23:12Peroniko (Peroniko) joins
14:33:38Peroniko quits [Ping timeout: 265 seconds]
14:34:14Peroniko (Peroniko) joins
14:40:56Peroniko quits [Ping timeout: 252 seconds]
14:41:49Peroniko (Peroniko) joins
14:42:25Peroniko quits [Client Quit]
14:42:43Peroniko (Peroniko) joins
15:07:05<@arkiver>this is somewhat annoying to filter out actually
15:16:18tarsubo joins
15:17:29<tarsubo>Issues with project code being out of date? I tried removing the container and all attached volumes so, I believe, it's pulling the latest version
15:17:35<@arkiver>yes
15:17:37<@arkiver>coming up almost!
15:17:54<tarsubo>got it, thank you
15:18:20Peroniko quits [Ping timeout: 252 seconds]
15:19:02Peroniko (Peroniko) joins
15:19:11<tarsubo>would you consider an opt-in feature where the max concurrency is dispatched along with the project?
15:19:23Peroniko quits [Remote host closed the connection]
15:19:41Peroniko (Peroniko) joins
15:19:52<imer>my stuff isnt unbanned so far
15:20:15<imer>tarsubo: we usually scale wait times between requests by the concurrency for these projects, so doesn't matter much if it's set high
15:20:27<imer>unless you mean something else
15:21:14<project10>by 'dispatched' do you mean, part of the project configuration? like a hint/default for concurrency on a per-project basis?
15:22:56<tarsubo>yes, so that you don't have to fine tune it (unless you want to); if you're compensating by adjusting wait times then it's fine, as long as it is an effective way to avoid bans
15:25:21Peroniko quits [Ping timeout: 265 seconds]
15:25:33<tarsubo>I joined this chat to ask about the "project out of date" problem and realized that I might have been running the wrong concurrency setting (2). I set my container to run ArchiveTeam’s Choice so it could switch to a different project at any time.
15:26:17Peroniko (Peroniko) joins
15:26:47jacksonchen666 (jacksonchen666) joins
15:31:22Peroniko quits [Client Quit]
15:31:41Peroniko (Peroniko) joins
15:35:06kiryu quits [Remote host closed the connection]
15:52:30jacksonchen666 quits [Remote host closed the connection]
16:16:05tarsubo quits [Remote host closed the connection]
16:24:26Exorcism8 (exorcism) joins
16:26:07Exorcism quits [Read error: Connection reset by peer]
16:26:07Exorcism8 is now known as Exorcism
16:32:29anarchiverishere joins
16:34:10<anarchiverishere>Hi I just started up my warrior appliance, it said project code was out of date, so I turned it off then on and it still says this. Am I doing something wrong to restart it?
16:35:46<pokechu22>You're not doing anything wrong; the project is currently paused to fix an issue where junky URLs like https://fb.audit.assoc.assoc.assoc.assoc.assoc.assoc.assoc.ecole.mairie.assoc.ecole.ecole.assoc.assoc.ecole.pagespro-orange.fr/ were being generated and no new version to fix that issue has been released yet
16:36:26<anarchiverishere>Ty
16:37:53anarchiverishere quits [Remote host closed the connection]
17:03:08BornOn420 quits [Client Quit]
17:03:48a_person joins
17:04:16a_person quits [Remote host closed the connection]
17:33:23@JAA sets the topic to: Pages Perso Orange: paused due to recursion issues, 1 concurrency recommended (but higher is fine, too), strict rate limits, needs lots of IPs | Finding ISP web hosting services before the Grim Reaper finds them. | https://archiveteam.org/index.php?title=ISP_Hosting
18:10:48kalle joins
18:12:01kalle quits [Remote host closed the connection]
19:05:03BornOn420 (BornOn420) joins
19:42:31Exorcism quits [Remote host closed the connection]
19:43:46Exorcism (exorcism) joins
19:56:38Peroniko quits [Ping timeout: 252 seconds]
19:57:26Peroniko (Peroniko) joins
20:23:04UserH quits [Read error: Connection reset by peer]
21:02:14Exorcism6 (exorcism) joins
21:03:55Exorcism quits [Read error: Connection reset by peer]
21:03:56Exorcism6 is now known as Exorcism
21:25:07Exorcism quits [Remote host closed the connection]
21:26:02Exorcism (exorcism) joins
21:46:29Exorcism quits [Remote host closed the connection]
21:47:17Exorcism (exorcism) joins
22:15:50@flashfire42 quits [Client Quit]
22:15:50kiska quits [Client Quit]
22:16:04flashfire42 joins
22:17:10kiska (kiska) joins
22:47:25catdurid joins
22:51:25catdurid quits [Remote host closed the connection]
23:03:05Peroniko quits [Ping timeout: 252 seconds]
23:03:47Peroniko (Peroniko) joins
23:07:35Exorcism quits [Remote host closed the connection]
23:08:22Exorcism (exorcism) joins
23:20:34Exorcism quits [Remote host closed the connection]
23:21:19Exorcism (exorcism) joins

HomeSearchPrevious dayNext day