| 00:03:07 | | fuzzy80211 quits [Read error: Connection reset by peer] |
| 00:03:16 | | fuzzy8021 (fuzzy80211) joins |
| 01:52:15 | | JaffaCakes118 quits [Remote host closed the connection] |
| 03:42:53 | | DLoader quits [Client Quit] |
| 03:43:15 | | DLoader (DLoader) joins |
| 04:47:19 | | zhongfu quits [Ping timeout: 255 seconds] |
| 05:50:10 | | qwertyasdfuiopghjkl (qwertyasdfuiopghjkl) joins |
| 06:02:06 | | DLoader quits [Client Quit] |
| 07:22:44 | | DLoader (DLoader) joins |
| 07:40:22 | | DLoader quits [Client Quit] |
| 07:40:51 | | DLoader (DLoader) joins |
| 08:22:57 | | DLoader quits [Client Quit] |
| 08:23:29 | | DLoader (DLoader) joins |
| 10:10:55 | | pabs quits [Quit: Don't rest until all the world is paved in moss and greenery.] |
| 10:12:50 | | pabs (pabs) joins |
| 12:36:54 | | DLoader quits [Client Quit] |
| 12:37:18 | | DLoader (DLoader) joins |
| 13:21:34 | | MrMcNuggets (MrMcNuggets) joins |
| 14:22:49 | | MrMcNugg1 (MrMcNuggets) joins |
| 14:26:01 | | MrMcNuggets quits [Ping timeout: 255 seconds] |
| 15:57:32 | <@JAA> | > snowball lookahead hit non archive.php task wrapping up rollup |
| 15:57:58 | <@JAA> | Oh, nevermind |
| 15:58:18 | <@JAA> | Didn't see one at first, but there is indeed one. |
| 16:00:58 | | systwi quits [Ping timeout: 255 seconds] |
| 16:46:17 | | MrMcNugg1 quits [Remote host closed the connection] |
| 16:46:26 | | MrMcNuggets (MrMcNuggets) joins |
| 16:47:25 | <@JAA> | > sent 316 bytes received 10,853,710,333 bytes 2,014,983.88 bytes/sec |
| 16:47:42 | <@JAA> | For copying to the backup server internally. ._. |
| 16:52:24 | | MrMcNuggets quits [Client Quit] |
| 16:55:22 | | MrMcNuggets (MrMcNuggets) joins |
| 18:08:21 | | MrMcNuggets quits [Client Quit] |
| 18:14:41 | | qwertyasdfuiopghjkl quits [Client Quit] |
| 18:23:25 | <KoalaBear> | First I thought, thats fast after I've misread it. But it's not. 2 MB/s :| |
| 18:25:18 | <@JAA> | Yup |
| 18:25:30 | <@JAA> | And I have another one running now that's managed under 20 GiB in 2 hours so far. |
| 19:46:58 | | DogsRNice joins |
| 20:28:26 | <HP_Archivist> | What might be causing Errno 2 errors when downloading from the cli? |
| 20:28:36 | <HP_Archivist> | Getting these: error downloading file harry-potter-and-the-goblet-of-fire-game-chs/03.jpg, exception raised: [Errno 2] No such file or directory: b'harry-potter-and-the-goblet-of-fire-game-chs/03.jpg' |
| 20:28:36 | <HP_Archivist> | downloading 03.jpg: 0%| | 0.00/4.04M [00:00<?, ?iB/s] |
| 20:28:36 | <HP_Archivist> | error downloading file harry-potter-and-the-goblet-of-fire-game-cht/02.jpg, exception raised: [Errno 2] No such file or directory: b'harry-potter-and-the-goblet-of-fire-game-cht/02.jpg' |
| 21:08:37 | <pokechu22> | Does directory harry-potter-and-the-goblet-of-fire-game-chs/ exist? |
| 21:08:54 | <pokechu22> | on your side specifically |
| 21:21:28 | <HP_Archivist> | pokechu22: Yes it does |
| 21:21:36 | <HP_Archivist> | Which is why I'm confused |
| 21:21:53 | <HP_Archivist> | b'harry-potter-and-the-goblet-of-fire-game-chs/03.jpg' - No idea where the b comes from? |
| 21:21:57 | <HP_Archivist> | b' |
| 21:22:39 | <pokechu22> | HP_Archivist: b'' indicates python bytes instead of string (and probably is fine) |
| 21:23:14 | <HP_Archivist> | Ah okay thanks |
| 21:24:09 | <HP_Archivist> | What's odd is that I already have that file downloaded |
| 21:24:24 | <HP_Archivist> | But yet it errors out on it, instead of indicating it exists and skipping it like it does on others |
| 21:24:49 | <HP_Archivist> | And yup, the file opens up just fine. |
| 21:25:36 | <@JAA> | How are you using `ia` that you're getting bytes paths? |
| 21:25:55 | <@JAA> | What command? And what versions of `ia` and Python? |
| 21:26:52 | <HP_Archivist> | JAA: ia search --itemlist 'uploader:harrypotterarchival@gmail.com' | xargs -P 100 -n 1 ia download --exclude-source derivative |
| 21:27:02 | <HP_Archivist> | IA version 4.1.0 |
| 21:27:39 | <HP_Archivist> | Too high on the xargs maybe? No idea |
| 21:27:56 | <@JAA> | (Your email address is now in the public IRC logs.) |
| 21:28:12 | <HP_Archivist> | It's fine JAA, not concerned about that one. It's public |
| 21:28:19 | <@JAA> | Ok |
| 21:28:24 | <@JAA> | Python version? |
| 21:28:32 | <Barto> | (i always thought it was hewlett packard for HP) |
| 21:28:41 | <HP_Archivist> | Python 3.10.12 |
| 21:28:49 | <HP_Archivist> | Barto: I've gotten that before :P |
| 21:28:55 | <Barto> | :-) |
| 21:30:17 | <@JAA> | Is this happening for every item or only some? |
| 21:31:24 | <HP_Archivist> | Only some, JAA. ctl+f in the cli indicates 43 so far |
| 21:31:34 | <HP_Archivist> | The majority are fine though |
| 21:31:43 | <pokechu22> | Can you tell if anything with directories has successfully downloaded? |
| 21:32:11 | <pokechu22> | hmm, actually, https://archive.org/download/harry-potter-and-the-goblet-of-fire-game-chs isn't something with subdirectories, so that's probably not relevant |
| 21:32:46 | <pokechu22> | wait no it does have subdirectories, but 02.jpg exists both in the root and in the "HP4 CHINA" directory (with a space) |
| 21:32:49 | <HP_Archivist> | That does have subs |
| 21:33:09 | <@JAA> | Hmm |
| 21:33:29 | <@JAA> | `ia download --exclude-source derivative harry-potter-and-the-goblet-of-fire-game-chs` works perfectly fine for me with the same versions of Python and `ia`. |
| 21:33:35 | <HP_Archivist> | For this item specifically, the first 02.jpg is box art, the second is in the Manual directory |
| 21:34:42 | <HP_Archivist> | You're not using xargs though, I'm wondering if the the -P value is too high and it errors out? |
| 21:35:18 | <@JAA> | All xargs does is invoke that command (many times for different items). |
| 21:35:42 | <nicolas17> | any spaces? :P |
| 21:36:41 | <HP_Archivist> | No spaces. It should see that item and its files are downloaded already and skip it. Instead it throw that error |
| 21:37:12 | <@JAA> | Running the command again, I'm getting the expected: |
| 21:37:13 | <@JAA> | > skipping harry-potter-and-the-goblet-of-fire-game-chs/01.jpg, file already exists based on length and date. |
| 21:38:29 | <HP_Archivist> | Huh, weird |
| 21:38:40 | <@JAA> | OS? |
| 21:38:59 | <HP_Archivist> | Using Ubuntu / WSL2 on Windows 11 |
| 21:39:56 | <pokechu22> | Are you running it in a /mnt/c/ directory or something WSL-specific? |
| 21:40:20 | <@JAA> | Tried it with the parallel stuff, and also all fine as expected. |
| 21:40:22 | <HP_Archivist> | Exact directory is to: /mnt/g/iapsource |
| 21:40:25 | <pokechu22> | e.g. could case-insensitive filesystem stuff cause problems? |
| 21:40:27 | <@JAA> | Yeah, I expect WSL fuckiness. |
| 21:40:58 | <pokechu22> | Can you try it in your WSL home directory instead? (~) |
| 21:42:05 | <HP_Archivist> | I could try it yeah |
| 21:42:09 | <HP_Archivist> | Let me see |
| 21:45:32 | <HP_Archivist> | Hmm seems to be running just fine |
| 21:45:58 | <HP_Archivist> | Downloaded the first few jpgs just fine |
| 21:46:51 | <HP_Archivist> | Odd. Maybe I should start the arg over from scratch in a different directory? |
| 21:48:34 | <pokechu22> | It'd probably be better to copy the list of ones that failed from your output and then only run those (one item ID per line and then pass it to xargs the same way should work) |
| 21:49:42 | <HP_Archivist> | I'll give that a try see what happens, thank you |
| 21:53:23 | | tzt quits [Ping timeout: 256 seconds] |
| 22:05:34 | | tzt (tzt) joins |