| 00:09:08 | | tzt (tzt) joins |
| 00:18:55 | | quackifi quits [Client Quit] |
| 01:31:31 | | decky_e joins |
| 06:01:13 | | AlbertLarsan68 (AlbertLarsan68) joins |
| 06:08:10 | | qwertyasdfuiopghjkl quits [Remote host closed the connection] |
| 06:39:59 | | datechnoman quits [Quit: The Lounge - https://thelounge.chat] |
| 06:41:44 | | datechnoman (datechnoman) joins |
| 07:46:12 | <AlbertLarsan68> | Hello, |
| 07:46:12 | <AlbertLarsan68> | On the web interface, the overview number for the "SendDoneToTracker" step seems to constantly underflow. |
| 08:07:52 | | razul joins |
| 08:27:06 | | TokieSan joins |
| 08:29:22 | | qwertyasdfuiopghjkl (qwertyasdfuiopghjkl) joins |
| 09:03:02 | | decky_e quits [Client Quit] |
| 11:02:37 | | Jonboy345 quits [Read error: Connection reset by peer] |
| 13:21:04 | | BigBrain quits [Remote host closed the connection] |
| 13:21:25 | | BigBrain (bigbrain) joins |
| 13:24:03 | | diggan quits [Quit: Connection closed for inactivity] |
| 14:08:53 | | PredatorIWD quits [Quit: Leaving] |
| 16:13:47 | | LeGoupil joins |
| 16:17:18 | | LeGoupil1 joins |
| 16:18:02 | | LeGoupil quits [Ping timeout: 252 seconds] |
| 16:18:02 | | LeGoupil1 is now known as LeGoupil |
| 16:24:56 | | Dango360 quits [Read error: Connection reset by peer] |
| 16:26:52 | | Dango360 (Dango360) joins |
| 16:37:33 | | LeGoupil quits [Ping timeout: 258 seconds] |
| 16:57:05 | | threedeeitguy quits [Ping timeout: 252 seconds] |
| 16:57:48 | | Unholy2361 quits [Remote host closed the connection] |
| 16:59:28 | | Unholy2361 (Unholy2361) joins |
| 17:05:30 | | threedeeitguy (threedeeitguy) joins |
| 17:15:08 | | threedeeitguy quits [Read error: Connection reset by peer] |
| 17:15:19 | | threedeeitguy6 (threedeeitguy) joins |
| 17:40:09 | | nostalgebraist joins |
| 17:40:38 | <nostalgebraist> | i'm running warrior in docker, and sometimes there are long pauses between successive steps in the item logs, with nothing downloading or uploading. and no message about sleeping - often it comes between one successful request and the next. it doesn't seem to be isolated to one project. what would cause this? |
| 17:40:49 | <nostalgebraist> | there are long periods where all items are like this, and then it mysteriously stops and no items are like this for a while |
| 17:42:52 | | yasomi (yasomi) joins |
| 18:45:16 | | noname joins |
| 18:47:04 | <noname> | I'm looking for the way to use ArchiveTeam Warrior (especially in docker containers) on the ramdisk(tmpfs). I was thinking it could boost performence and less stressful for the SSDs. |
| 18:47:42 | | andrew quits [Client Quit] |
| 18:52:16 | | andrew (andrew) joins |
| 19:05:37 | | Urgo quits [Remote host closed the connection] |
| 19:14:53 | <@kaz> | noname: use the project-specific containers, and (iirc) mount /data to tmpfs |
| 19:15:21 | <@kaz> | nostalgebraist: possibly slow grabbing a specific URL - though would be weird to see it happening across *all* threads at the same time |
| 19:15:44 | <@JAA> | `--mount type=tmpfs,tmpfs-size=2G,destination=/grab/data` is the one I've seen. |
| 19:15:54 | <@JAA> | (For project images) |
| 19:16:45 | <noname> | Thanks, "use the project-specific containers" > Are you saying containers per projects? Like container 1 for reddit, container 2 for youtube. |
| 19:18:59 | <@kaz> | aye - so for example there is a reddit-specific container available at atdr.meo.ws/archiveteam/reddit-grab |
| 19:19:06 | <@kaz> | (though you get no webui with these - cli only) |
| 19:26:58 | | Urgo (Urgo) joins |
| 19:27:46 | <noname> | Oh cool thank you for information. And thanks again for the tmpfs informations. |
| 19:28:57 | <nostalgebraist> | kaz: yeah, it affects all threads at once. also, when i run the warrior on two machines simultaneously (my laptop + a cloud VM), on the same project, generally only 1 machine has the slowdown. which suggests it's not a property of specific urls being inherently slow to fetch - why would 1 machine get all of those and the other get none? - but instead something that differs persistently between machines (docker config, |
| 19:28:57 | <nostalgebraist> | network stuff?) |
| 19:29:23 | <@kaz> | is it always the same machine with the issue? |
| 19:29:42 | <nostalgebraist> | i think so, my laptop |
| 19:30:07 | <nostalgebraist> | not sure though |
| 19:31:06 | <@kaz> | might be something with your laptop - though to be honest unless it's causing a huge delay I wouldn't worry too much, as long as it picks up again later |
| 19:31:37 | <noname> | If it's off the topic please tell me, but how's it like using ArchiveTeam Warrior on the VPS? Whould it cost a lot of traffics (and money)? |
| 19:32:24 | <@kaz> | that very much depends on the project you run - most projects are (relatively) low bandwidth as we tend to have lots of workers to spread the load around |
| 19:32:27 | <Maakuth|m> | Oracle cloud free tier seems to work fine for me |
| 19:32:36 | <@kaz> | others (i.e where we're grabbing tons of videos) obviously use a lot more |
| 19:33:12 | <Maakuth|m> | I would expect many cheap vps providers to work fine. I've been meaning to try them out |
| 19:34:53 | <noname> | Oh cool, than I should move to my VPS. I don't want to run my desktop 24/7. |
| 20:06:22 | | deadling joins |
| 20:39:10 | | nostalgebraist quits [Client Quit] |
| 21:04:05 | | Chewie9999 joins |
| 21:04:35 | | @Sanqui quits [Ping timeout: 252 seconds] |
| 21:06:10 | <Chewie9999> | Hi everyone, is there a way of getting statics for a particular nick from the command line. I'd like to be able to get stats from all the projects I have been involved with, and it's a bit fiddly to just use the web page :( |
| 21:21:41 | | deadling quits [Client Quit] |
| 21:25:25 | | Sanqui joins |
| 21:26:17 | | deadling joins |
| 21:26:38 | | Sanqui is now authenticated as Sanqui |
| 21:26:38 | | Sanqui quits [Changing host] |
| 21:26:38 | | Sanqui (Sanqui) joins |
| 21:26:38 | | @ChanServ sets mode: +o Sanqui |
| 22:10:35 | | yawkat quits [Ping timeout: 252 seconds] |
| 22:24:29 | | yawkat (yawkat) joins |
| 23:18:16 | <TheTechRobo> | Chewie9999: Im not sure if there's any official way, but you can do something like |
| 23:19:13 | <TheTechRobo> | (for lineblog) |
| 23:19:15 | <TheTechRobo> | curl https://legacy-api.arpa.li/lineblog/stats.json | jq .downloader_bytes.TheTechRobo |
| 23:19:18 | <TheTechRobo> | for the bytes downloaded |
| 23:19:54 | <TheTechRobo> | (and downloader_count.TheTechRobo for the number of items) (obviously replace TheTechRobo with your nick) |
| 23:20:50 | <TheTechRobo> | That just downloads the statistics from the tracker and parses the json to get your nick; if it outputs null, you typed the nick wrong (remember that json is case-sensitive) |
| 23:23:55 | | G4te_Keep3r3492 quits [Quit: The Lounge - https://thelounge.chat] |
| 23:24:37 | | G4te_Keep3r3492 joins |