HomeSearchPrevious dayNext day

01:30:27DogsRNice joins
01:38:42Sluggs quits [Ping timeout: 250 seconds]
01:39:06kokos quits [Ping timeout: 260 seconds]
02:06:27kokos joins
02:14:10Sluggs joins
02:52:37DogsRNice quits [Client Quit]
04:04:45<pabs>channel topic maybe needs https://wiki.archiveteam.org/index.php/Internet_Archive ?
05:01:22HP_Archivist quits [Remote host closed the connection]
05:01:46HP_Archivist (HP_Archivist) joins
05:05:24DopefishJustin quits [Ping timeout: 250 seconds]
05:08:14DopefishJustin joins
07:03:08AlsoHP_Archivist joins
07:03:24atphoenix__ (atphoenix) joins
07:03:41fuzzy80211 (fuzzy80211) joins
07:03:53s-crypt6 (s-crypt) joins
07:04:00yano1 (yano) joins
07:04:06Flashfire427 joins
07:04:11DLoader8 joins
07:04:17ScenarioPlanet1 (ScenarioPlanet) joins
07:04:19HP_Archivist quits [*.net *.split]
07:04:19kokos quits [*.net *.split]
07:04:19tzt quits [*.net *.split]
07:04:19rewby quits [*.net *.split]
07:04:19atphoenix_ quits [*.net *.split]
07:04:19alexlehm quits [*.net *.split]
07:04:19ThreeHM quits [*.net *.split]
07:04:19yano quits [*.net *.split]
07:04:19igloo22225 quits [*.net *.split]
07:04:19Barto quits [*.net *.split]
07:04:19linuxgemini quits [*.net *.split]
07:04:19JTL quits [*.net *.split]
07:04:19KoalaBear84 quits [*.net *.split]
07:04:19Stagnant_ quits [*.net *.split]
07:04:19DLoader quits [*.net *.split]
07:04:19mgrandi quits [*.net *.split]
07:04:19rewby|backup quits [*.net *.split]
07:04:19@hook54321 quits [*.net *.split]
07:04:19murmur quits [*.net *.split]
07:04:19HCross quits [*.net *.split]
07:04:19Flashfire42 quits [*.net *.split]
07:04:19s-crypt quits [*.net *.split]
07:04:19fuzzy8021 quits [*.net *.split]
07:04:19IRC2DC quits [*.net *.split]
07:04:19luckcolors quits [*.net *.split]
07:04:19ScenarioPlanet quits [*.net *.split]
07:04:19magmaus3 quits [*.net *.split]
07:04:19@kaz quits [*.net *.split]
07:04:19Flashfire427 is now known as Flashfire42
07:04:19s-crypt6 is now known as s-crypt
07:04:20DLoader8 is now known as DLoader
07:04:23magmaus3_ (magmaus3) joins
07:04:34ScenarioPlanet1 is now known as ScenarioPlanet
07:04:39KoalaBear joins
07:04:43alexlehm (alexlehm) joins
07:04:44murmur joins
07:04:52mgrandi (mgrandi) joins
07:05:04HCross (HCross) joins
07:05:06rewby|backup (rewby) joins
07:05:14hook54321 (hook54321) joins
07:05:14@ChanServ sets mode: +o hook54321
07:05:28magmaus3_ is now known as magmaus3
07:07:04kokos joins
07:07:07luckcolors (luckcolors) joins
07:07:39tzt (tzt) joins
07:08:02Stagnant_ (Stagnant) joins
07:09:17ThreeHM (ThreeHeadedMonkey) joins
07:10:47rewby (rewby) joins
07:11:40magmaus3 quits [Read error: Connection reset by peer]
07:11:57JTL (JTL) joins
07:15:11magmaus3 (magmaus3) joins
07:17:59Barto (Barto) joins
07:22:41Barto quits [Ping timeout: 260 seconds]
07:23:02magmaus3 quits [Read error: Connection reset by peer]
07:25:33magmaus3 (magmaus3) joins
07:29:14Barto (Barto) joins
07:38:35magmaus3 quits [Read error: Connection reset by peer]
07:38:53magmaus3 (magmaus3) joins
08:14:10DLoader quits [Changing host]
08:14:10DLoader (DLoader) joins
10:52:17PredatorIWD25 quits [Read error: Connection reset by peer]
11:50:23Fusl quits [Excess Flood]
11:52:01Fusl (Fusl) joins
13:51:11tzt quits [Ping timeout: 260 seconds]
14:03:20tzt (tzt) joins
15:35:15IDK (IDK) joins
16:09:04pabs quits [Read error: Connection reset by peer]
17:09:58pabs (pabs) joins
17:17:27<@JAA>> FATAL ERROR: item was not located on any (online) primary servers
17:17:39<@JAA>Every day, there's a new exciting error message.
17:19:13<@JAA>(Task 4767272461, already fixed)
17:24:05<that_lurker>ahh the feel of speed you het at 22.50s/MiB
17:24:12<that_lurker>s/het/get
17:27:13<@JAA>Has anyone figured out what the 'finished' field in the task metadata means? It seems to be monotonically increasing with time but doesn't look like a timestamp.
17:29:03<@JAA>Trying to see if there's a programmatic way to get the completion time of a task.
19:14:37IDK quits [Quit: Connection closed for inactivity]
21:01:07BornOn420 quits [Remote host closed the connection]
21:01:49BornOn420 (BornOn420) joins
21:09:34SootBector quits [Remote host closed the connection]
21:10:54SootBector (SootBector) joins
22:02:37DogsRNice joins
22:40:21PredatorIWD25 joins
22:56:13DogsRNice quits [Client Quit]
23:26:16Grzesiek11 joins
23:27:05<Grzesiek11>ehhh the -c option in the ia tool seems to be very much broken
23:28:20<Grzesiek11>I resumed an upload with no queued jobs, everything was just fine
23:28:28<Grzesiek11>it skipped some files
23:28:54<Grzesiek11>but then it proceeded to upload hundreds gibibytes of already uploaded data
23:29:19<Grzesiek11>I guess I have to manually skip files
23:35:28<@JAA>Grzesiek11: Does the item have active or pending tasks?
23:35:53<Grzesiek11>well now it does after it started to reupload everything lol
23:36:00<@JAA>Hmm
23:36:06<@JAA>This is why I'm asking: https://github.com/jjjake/internetarchive/issues/289
23:36:10<Grzesiek11>but as I said, it had no queued nor running tasks
23:36:23<@JAA>Oh yeah, overlooked that.
23:36:34<Grzesiek11>yeah I've been warned of this, which is why I waited ~week for everything to complete
23:36:39<@JAA>I mean, I'm not particularly surprised there are more bugs in that area.
23:36:57<@JAA>I've been writing my own upload tools instead because the CLI is so ... not great.
23:37:41<@JAA>If you feel like trying something experimental, take a look at dir-to-ia from my little-things repo.
23:38:44<Grzesiek11>can you link that repo? I don't know where you host code lol, I've only been in this channel a few times
23:38:57<@JAA>https://gitea.arpa.li/JustAnotherArchivist/little-things
23:39:47<Grzesiek11>btw if the ia tool started uploading an already existing file, can I just cancel it
23:39:50<@JAA>I'm currently restructuring the code of dir-to-ia a little because I keep running into task errors breaking stuff, but it's working alright for me otherwise.
23:40:01<Grzesiek11>and will the file be in it's original form, before the reupload
23:40:02<@JAA>Yeah, that should be fine.
23:40:44<Grzesiek11>I guess I can just download it and diff with the original to be sure
23:41:02<@JAA>Or check the hash.
23:41:55<@JAA>That saves you a likely painfully slow download (unless you're physically close to IA).
23:42:20<Grzesiek11>yeah I've been wondering, how does the -c option do that?
23:42:26<Grzesiek11>it's not visible in the web UI
23:42:34<Grzesiek11>so it's probably some API
23:43:04<Grzesiek11>and since the item's running derive jobs now, would that even be accurate?
23:43:09<@JAA>It compares the MD5 hash returned in the item metadata, IIRC.
23:43:37<@JAA>If it's only derive.php and there are no other tasks pending, it should be accurate.
23:44:08<Grzesiek11>yes only derive.php it seems
23:48:01<Grzesiek11>ok this does match. I'll confirm all hashes en masse once I upload everything and tasks finish just in case.
23:51:37<@JAA>There's a little-thing for that, too: iasha1check
23:51:46<@JAA>Also, ia-wait-item-tasks

HomeSearchPrevious dayNext day