00:07:44<TheTechRobo>If you're running on high concurrency, that sometimes happens when starting the container, but it should resolve itself after 10 seconds or so
00:07:48thenes quits [Remote host closed the connection]
00:08:07thenes (thenes) joins
00:11:52<nicolas17>oh I see, it starts the concurrent threads while the code is still being downloaded
00:12:00<nicolas17>kinda ugly but ok
00:12:44<nicolas17>I'm mostly getting "no free items available", do we have more workers than we need?
00:27:26<@Flashfire42>nicolas17 do I need to add another url shortener? I havent added one in a while.
00:27:47<nicolas17>maybe it's rate limited? idk how this project works :P
00:29:18<@Flashfire42>nicolas17 basically the way I usually set a shortener up is different to others I get it to send out one url per item where as some are doing like 50 urls per item. 1 url per item allows me to better work out what I inevitably break. this project basically runs hands free most of the time being low priority as its not serving WARCs and rather just
00:29:18<@Flashfire42>creating text documents on IA. they are slowly run through #// but they have been swamped too as of late
00:29:58<@Flashfire42>I can go in and add a new shortener but I am lazy and I would need to probably edit the wiki to do it. unless you have a specific shortener you want me to run
00:54:59<TheTechRobo>nicolas17: This project is usually pretty idle
01:06:47<phaeton>How are these fed in? Are all possibilities loaded in and then dished out or does it increment up based on the character set?
01:07:18<@Flashfire42>phaeton most of the projects do it incrementally. others have custom code that is beyond my understanding
01:13:26<phaeton>Interesting. Are there public examples on how these work? Been curious for a while on what it would take to add additional ones.
01:31:13<nstrom|m>I think we have more workers than we have work for this one most of the time but I was not here when this one was running tons of shorteners at once which I guess was a few years ago
01:32:50<nstrom|m>The custom code is in here from what I can tell https://github.com/ArchiveTeam/terroroftinytown/tree/develop/terroroftinytown/services
01:34:12<nicolas17>isn't goo.gl shutting down soon?
01:34:24<nstrom|m>And there's general info on what info is needed to add a new shortener on the wiki https://wiki.archiveteam.org/index.php/URLTeam
01:35:19<nstrom|m>Yeah I think so, there's a sub project starting soon for it #urlteamwasright
01:35:34<nicolas17>why isn't that going full steam here?
01:38:08<nstrom|m>I assume the rate limits were set so people don't get banned but no idea past that
01:39:08<nstrom|m>Think this project has been on autopilot mostly for past 1-1.5 yr at least
01:40:17<nstrom|m>I run it on my workers but it's been very chill
03:07:18nicolas17 quits [Remote host closed the connection]
03:24:21Shjosan quits [Quit: Am sleepy (-, – )…zzzZZZ]
03:26:06Shjosan (Shjosan) joins
06:10:13ArchivalEfforts quits [Quit: https://quassel-irc.org - Chat comfortably. Anywhere.]
06:10:23ArchivalEfforts joins
06:20:28pabs quits [Ping timeout: 260 seconds]
06:22:13pabs (pabs) joins
08:32:43Jens quits []
08:32:56Jens (JensRex) joins
09:15:29nulldata quits [Quit: So long and thanks for all the fish!]
09:16:36nulldata (nulldata) joins
11:06:42le0n_ quits [Ping timeout: 250 seconds]
11:07:41le0n (le0n) joins
13:14:55nulldata quits [Read error: Connection reset by peer]
13:17:42nulldata (nulldata) joins
17:38:40emberquill quits [Quit: The Lounge - https://thelounge.chat]
17:38:55emberquill (emberquill) joins
17:44:04kansei quits [Ping timeout: 250 seconds]
17:48:58kansei (kansei) joins
21:49:10andrew quits [Quit: ]
21:53:32andrew (andrew) joins