00:31:46britmob quits [Remote host closed the connection]
00:32:03britmob joins
00:32:11britmob2 quits [Quit: Ping timeout (120 seconds)]
00:32:47britmob2 joins
04:52:44qw3rty_ joins
04:56:25qw3rty__ quits [Ping timeout: 265 seconds]
08:51:50atirclog (atirclog) joins
08:51:50Topic: URL shorteners were a terrible idea | http://urlte.am/ | IRC Logs: https://archive.fart.website/bin/irclogger_log/urlteam https://logs.kiska.pw/urlteam/today | https://tracker.archiveteam.org:1338/
08:51:50Topic set by JAA at 2020-10-14 23:58:28Z
08:51:59Fusl (Fusl) joins
08:51:59@ChanServ sets mode: +o Fusl
08:52:02Current users: @Fusl (Fusl), atirclog (atirclog), BinzyBoi, OrIdow6 (OrIdow6), @chfoo_ (chfoo), nothere_, treora_, @kiska (kiska), Dallas (Dallas), janpaul123 (janpaul123), billy549- (Billy549), EggplantN2, Craigle (Craigle), Jake (Jake), AK (AK), Zerote_, ragu_, qw3rty__, britmob2, britmob, Terbium, systwi (systwi), sliccricc (sliccricc), flashfire42 (flashfire42), HackMii (hacktheplanet), Ryz (Ryz), Matthww, Atom, nepeat (nepeat), atphoenix (atphoenix), yanome (yano), tech234a (tech234a), mutantmonkey (mutantmonkey), yano (yano), klg (klg), @EggplantN (EggplantN), EggplantNBot, @arkiver (arkiver), jodizzle (jodizzle), Hecz (Hecz), @phuzion (phuzion), sneez, @AlsoJAA (JAA), luckcolors (luckcolors), n9nes, AltroskyAS207616_Mystique, JSharp (JSharp), @hook54321 (hook54321), RBecker (RBecker), seatsea, @ChanServ
08:52:47<BinzyBoi>"Process RunScraper returned exit code 1 for Item"
08:53:02<BinzyBoi>Followed by "Failed Runscraper for Item"
08:57:02<@AlsoJAA>That's how the 404 error shows for me sometimes when the exception isn't caught for some unknown reason.
08:57:36<BinzyBoi>Ah, so the issue can be just about anything?
08:58:12<@AlsoJAA>Most likely it's just the 404 error, which is normal.
08:59:24nyany (nyany) joins
08:59:38<BinzyBoi>Is it normal to happen multiple times consecutively? I haven't seen one successful so far, mind you I haven't run it for long
08:59:52Muad-Dib joins
09:00:42kpcyrd (kpcyrd) joins
09:00:43<@AlsoJAA>So what happens is that items (ranges or groups of URL shortener codes to scan) are generated on-the-fly by the tracker. However, there are global limits for how many items can be active at once so as to not overload the shortener services.
09:00:56JAA (JAA) joins
09:00:56@ChanServ sets mode: +o JAA
09:01:10<@AlsoJAA>And since there are more workers than items, many workers will constantly see 404s.
09:01:17<@AlsoJAA>It should eventually pick up an item though.
09:01:41<BinzyBoi>I see now, thanks for the explanation
09:02:22<flashfire42>Do I need to kick the tracker?
09:02:30<@AlsoJAA>The full error reads: '404 Client Error: No free items available currently. Don't worry; this is normal. You will be assigned items soon.'
09:02:36<@AlsoJAA>flashfire42: Nope, all fine.
09:02:40<flashfire42>I have been lazy about adding more shorteners because I hate trying to navigate the wiki
09:02:57<@AlsoJAA>I have no idea why the error doesn't show for you, but as I said, no experience with the actual warrior web interface at all.
09:03:36<BinzyBoi>Adding shorteners as in services that shorten URLs?
09:03:51<BinzyBoi>Or the shortened URLs themselves?
09:04:25<@AlsoJAA>The former
09:04:30<BinzyBoi>Gotcha
09:04:45<@AlsoJAA>If we had more shorteners in the tracker, we would also have more items available, thereby reducing the 404 errors.
09:04:56<@AlsoJAA>Well, and getting more shit done. :-)
09:05:39<BinzyBoi>Well, with that I think I'll be heading off then and heading to bed.
09:05:53<BinzyBoi>Nice meeting you, and thanks for introducing me a bit
09:06:43<@JAA>Of course. Yeah, I should probably do that as well. It's 10:06 here... :-| Good night!
09:08:02BinzyBoi quits [Client Quit]
09:32:30kiskaWeebChat (kiska) joins
09:32:31@ChanServ sets mode: +o kiskaWeebChat
09:35:14Kaz (Kaz) joins
09:35:14@ChanServ sets mode: +o Kaz
09:44:48aarchi (aarchi) joins
12:00:43sliccricc quits [Remote host closed the connection]
12:00:58sliccricc (sliccricc) joins
14:28:48<n9nes>getting ModuleNotFoundError: No module named 'requests' in the archive docker container. this has been working for years but eventually stopped. Any hints?
14:51:00<@EggplantN>n9nes What docker container are you using?
14:51:11<@EggplantN>I just docker build'd the container and ran it just fine
14:51:38<n9nes>archiveteam/warrior-dockerfile:latest
14:52:32<@EggplantN>ah I see yes okie
14:52:59<@EggplantN>atdr.meo.ws/archiveteam/warrior-dockerfil
14:53:02<@EggplantN>atdr.meo.ws/archiveteam/warrior-dockerfile **
14:53:11<@EggplantN>is the current image
14:53:18<n9nes>yes saw it seconds ago :D
14:53:21<@EggplantN>ah :P
14:53:27<n9nes>why did they update it without any notices :D
14:53:38<@EggplantN>We're trying (and by we I mean JAA ) to update the dockerhub image
14:53:54<@EggplantN>for now thats the current one
14:54:12<n9nes>ok, so I need to keep an eye open until it changes again?
14:54:34<@EggplantN>It should remain up at that URL for quite some time ;)
14:54:40<n9nes>anyway, thanks for the quick hint
14:54:45<@EggplantN>The warrior also will work on other projects
15:41:41Jens (JensRex) joins
15:45:03Jens quits [Client Quit]
15:46:20Jens (JensRex) joins
15:49:31sliccricc_ (sliccricc) joins
15:51:07sliccricc quits [Ping timeout: 264 seconds]
15:57:07sliccricc_ quits [Ping timeout: 264 seconds]
18:20:44<@JAA>Yeah, no news about that yet.
18:46:36sliccricc (sliccricc) joins
19:52:41britmob2 quits [Client Quit]
20:29:42sliccricc quits [Remote host closed the connection]
20:30:03sliccricc (sliccricc) joins
21:45:12BinzyBoi joins
22:17:11sliccricc quits [Client Quit]
23:33:05n9nes quits [Quit: ZNC 1.8.2 - https://znc.in]
23:34:34n9nes joins