| 03:21:48 | | qw3rty_ joins |
| 03:25:25 | | qw3rty__ quits [Ping timeout: 258 seconds] |
| 04:04:16 | | DogsRNice quits [Read error: Connection reset by peer] |
| 04:36:22 | | HP_Archivist (HP_Archivist) joins |
| 04:36:54 | <HP_Archivist> | I' |
| 04:36:58 | | Lord_Nightmare quits [Client Quit] |
| 04:37:24 | <HP_Archivist> | Trying to download an entire item through the CML. I have WSL for Windows open in a terminal. Looking at the docs https://archive.org/services/docs/api/internetarchive/cli.html |
| 04:37:25 | | Lord_Nightmare (Lord_Nightmare) joins |
| 04:37:46 | <HP_Archivist> | Configure my ia account credentials but not getting this to work. |
| 04:37:54 | <HP_Archivist> | I'd like to DL this entire item I have on there https://archive.org/details/talking-with-harry-potter-game-developers |
| 04:51:18 | <@JAA> | HP_Archivist: Define: 'does not work' |
| 05:03:02 | <HP_Archivist> | JAA: My novice prior experience with CML + Archive.org is showing heh |
| 05:03:13 | <HP_Archivist> | e.g. I'm not sure which series of commands to input |
| 05:03:26 | <HP_Archivist> | I tried: |
| 05:03:30 | <HP_Archivist> | $ ia download talking-with-harry-potter-game-developers |
| 05:03:37 | <HP_Archivist> | But didn't work |
| 05:04:11 | <@JAA> | That should work, I think. |
| 05:04:48 | <HP_Archivist> | No, I get a command not found |
| 05:05:07 | <@JAA> | Well, then it isn't installed correctly. |
| 05:05:26 | <@JAA> | Or the WSL environment is weird in that regard. No experience with that. |
| 05:06:54 | <@JAA> | How did you install it? |
| 05:12:10 | <HP_Archivist> | I have python installed and it should be updated but beyond that I don't think I installed the internetarchive binaries |
| 05:12:15 | <HP_Archivist> | Probably missing those ^ |
| 05:12:38 | <@JAA> | Well, yeah, you kind of have to install it to run it. |
| 05:13:18 | <HP_Archivist> | Ahh I know what I'm doing wrong |
| 05:13:29 | <HP_Archivist> | How do I initiate python in the CML? |
| 05:13:39 | <HP_Archivist> | Super noob question but I don't use it much |
| 05:14:12 | <@JAA> | What exactly do you mean by 'CML' anyway? |
| 05:14:38 | <HP_Archivist> | the CMI* sorry, command-line interface |
| 05:15:26 | <@JAA> | Never heard 'CMI' either. CMD.EXE was the traditional name, but it's been a decade since I've used it. |
| 05:16:00 | <HP_Archivist> | I'm probably not using the abbreviated terms correctly |
| 05:16:17 | <@JAA> | Anyway, to run Python in a terminal, you just run `python3`. Then you get a Python REPL. |
| 05:18:11 | <@JAA> | But you don't run `ia` from inside Python. |
| 05:18:48 | <Ryz> | So tried to archive just the link http://www.religion-research.org/ - because currently it now gives 403s, since I archived the website via AB some time ago; it gave this rather unique message I never seen before: Cannot fetch the target URL due to system overload. |
| 05:19:58 | <HP_Archivist> | JAA I put in python3. I have a line that says type help, copyright, credits, etc that's it |
| 05:20:13 | <HP_Archivist> | I have Py 3.8.2 |
| 05:20:16 | <@JAA> | Well, then at least Python is installed correctly. |
| 05:20:28 | <HP_Archivist> | Wait |
| 05:20:38 | <HP_Archivist> | I'm running this within the Ubunut terminal. oops |
| 05:20:43 | <HP_Archivist> | Ubuntu* |
| 05:21:35 | <HP_Archivist> | Erm, or maybe I had it right. I remember you're not supposed to run Py in WSL or something. Idk it's been a long time I've messed with any of this |
| 05:21:58 | <HP_Archivist> | I have Ubuntu / WSL on Windows and have been using that to test this |
| 05:23:36 | <@JAA> | That's probably the closest you'll get to a sane environment on Windows. |
| 05:23:46 | <@JAA> | Did you install the internetarchive Python package? |
| 05:24:11 | <HP_Archivist> | Heh. And I'm trying to do that now. I think have to install PIP first though, right? |
| 05:24:31 | <@JAA> | If you don't already have it, yeah. |
| 05:25:32 | <@JAA> | If `which pip` and `which pip3` don't return anything, it isn't installed. |
| 05:27:18 | <HP_Archivist> | I just installed pip3, so I have it yeah |
| 05:27:33 | <HP_Archivist> | Do I input this line next? $ sudo pip install internetarchive |
| 05:27:53 | <@JAA> | Either that or 'pip3' instead of 'pip': |
| 05:28:23 | <HP_Archivist> | Bah same thing. I get command not found |
| 05:28:34 | <HP_Archivist> | On either of those |
| 05:28:36 | <HP_Archivist> | pip3 or pip |
| 05:28:55 | <@JAA> | How did you install pip? |
| 05:28:56 | <HP_Archivist> | I think the $ is incorrect usage for WSL |
| 05:29:09 | <@JAA> | Oh, you're entering the dollar sign? |
| 05:29:17 | <HP_Archivist> | I am yes |
| 05:29:18 | <@JAA> | That's just a common prompt char. |
| 05:29:59 | <@JAA> | I.e. what the shell displays to you when it expects you to enter a command. |
| 05:30:11 | <HP_Archivist> | Ahh yeah. I thought it was. I recall I read that somewhere previously. Re-trying 'sudo pip install internetarchive' is working now |
| 05:30:25 | <HP_Archivist> | Yeah thank you ^ |
| 05:32:39 | <HP_Archivist> | Hm interesting. It's downloading that item now |
| 05:32:55 | <HP_Archivist> | But the progress bar is a bunch of 'ddddd' |
| 05:32:57 | <HP_Archivist> | wth |
| 05:33:05 | <HP_Archivist> | Is that typical? |
| 05:33:18 | <@JAA> | Yeah, one character for each file downloaded, I think. |
| 05:33:33 | <@JAA> | d = done, e = error, not sure what else exists. |
| 05:33:44 | <HP_Archivist> | Ah good to know |
| 05:34:09 | <@JAA> | I'm slightly surprised that it doesn't have the progress bar of uploads though. |
| 05:34:16 | <@JAA> | (I rarely download with that tool.) |
| 05:34:59 | <HP_Archivist> | Reason I wanted to do this in the first place is in the event I lose source and on things I upload and have to re-grab everything I uploaded to Archive. Since the download all button is broken or that PDF issue from months ago seems to break entire item downloads, downloading through the terminal is the only other way for mass-downloading an item vs one by one file |
| 05:35:25 | <HP_Archivist> | Annnnd success |
| 05:35:35 | <@JAA> | Downloading with the CLI is the only reasonable way to download more than one file in the first place. :-) |
| 05:35:57 | <@JAA> | Be sure to check whether it includes all the derived files or not. You probably don't want to keep those. |
| 05:37:05 | <HP_Archivist> | Yeah I'm seeing that JAA heh |
| 05:37:16 | <HP_Archivist> | Now I have to locate what folder it downloaded to |
| 05:37:34 | <@JAA> | Should be in whatever directory you're in. |
| 05:37:35 | <HP_Archivist> | For the derived files, I thought about that. I suppose not, but they are handy to have. Not sure. |
| 05:37:46 | <Jake> | If you are in WSL, you might want to go /mnt/c/ and then from there to the desktop or something. |
| 05:37:47 | <@JAA> | A directory with the item identifier as a name, I believe. |
| 05:38:51 | <@JAA> | (`pwd` to show which directory you're currently in.) |
| 05:38:55 | <HP_Archivist> | Thanks Jake |
| 05:39:30 | <HP_Archivist> | Ahh I'm in root |
| 05:39:33 | <HP_Archivist> | apparently |
| 05:39:55 | <@JAA> | Seems plausible. No idea what that maps to in WSL. |
| 05:40:01 | | @JAA hands over to Jake and goes to bed. :-) |
| 05:40:12 | <HP_Archivist> | Heh thanks for your help JAA |
| 05:41:22 | <Jake> | So root directory in WSL is in some stupid spot. You can delete it with `rm -rf` and then the name of the folder you just downloaded. Then we can move directories, `cd /mnt/c/Users/(username)/Desktop`, and redownload. |
| 05:41:55 | <HP_Archivist> | Okay thanks let me try that now |
| 05:42:42 | <Jake> | (So for example deleting it would be rm -rf talking-with-harry-potter-game-developers ) |
| 05:43:42 | <HP_Archivist> | Hm that didn't work, it's suggesting 'erf' |
| 05:44:21 | <Jake> | Could you paste the command you ran? |
| 05:44:37 | <HP_Archivist> | -rf talking-with-harry-potter-game-developers.zip since it'll be a zip |
| 05:44:50 | <HP_Archivist> | Ohh |
| 05:44:52 | <Jake> | you'll need rm at the start |
| 05:44:53 | <Jake> | haha |
| 05:44:54 | <Jake> | all good |
| 05:44:58 | <HP_Archivist> | Yes, I just saw that |
| 05:45:17 | <Jake> | (and -rf isn't needed unless it's a folder.) |
| 05:46:02 | <HP_Archivist> | 'rm: cannot remove 'talking-with-harry-potter-game-developers.zip': No such file or directory' |
| 05:46:18 | <HP_Archivist> | After running 'rm talking-with-harry-potter-game-developers.zip' |
| 05:46:31 | <Jake> | Hmm, try `ls` we might not be in the folder? |
| 05:46:58 | <HP_Archivist> | That's what I'm thinking |
| 05:48:24 | <HP_Archivist> | Yeah I still don't think I'm in the folder |
| 05:48:29 | <HP_Archivist> | So I closed the terminal and opened it again |
| 05:48:38 | <HP_Archivist> | What do I type to navigate to that folder? |
| 05:48:50 | <Jake> | So `cd` and then a folder name navigates you there |
| 05:49:58 | <HP_Archivist> | I typed in: cd /root which is apparently where WSL is or something |
| 05:50:05 | <HP_Archivist> | Then I typed in the rm command again and still an error |
| 05:50:20 | <HP_Archivist> | Should I be able to find this manually within explorer? |
| 05:50:43 | <Jake> | Oh I forgot, actually, one second |
| 05:51:37 | <Jake> | Hmm, actually that wasn't added yet. I don't think they have native ext4 for explorer yet |
| 05:51:44 | <HP_Archivist> | No no |
| 05:51:54 | <HP_Archivist> | I mean Just searching Windows explorer by going through C directory |
| 05:52:02 | <HP_Archivist> | find where wsl is |
| 05:52:02 | <HP_Archivist> | etc |
| 05:52:31 | <Jake> | I'm not actually sure if it's accessible like that? |
| 05:52:46 | <Jake> | Best move I think would be to move the files to actual windows, should be easier from there? |
| 05:53:13 | <HP_Archivist> | Before we go further - it downloaded that item. Where is it exactly if it's not on my local drive? |
| 05:54:02 | <Jake> | It's on your drive, but in the Ubuntu partition from what I understand. I think you should be able to see the folder with `ls` right now in the Ubuntu WSL terminal. |
| 05:54:48 | <HP_Archivist> | Ah alright, makes sense |
| 05:55:15 | <HP_Archivist> | I type in cd /ls ? |
| 05:55:44 | <Jake> | Just `ls` will show you what's in the directory you are in |
| 05:56:09 | <Jake> | from there, you can find the folder the ia tool downloaded, assuming we are in the right place. |
| 05:56:10 | <HP_Archivist> | No, that doesn't do anything |
| 05:56:15 | <HP_Archivist> | It just goes to the next line |
| 05:56:48 | <Jake> | Ok, try `cd ~` should bring you to the 'home' directory for your user, which is where I think it is. |
| 05:56:52 | <Jake> | Then `ls` |
| 05:57:45 | <HP_Archivist> | No, I'm not doing this right. I type cd ~ and it still only goes to the next line |
| 05:57:47 | <HP_Archivist> | Nothing comes up |
| 05:57:57 | <HP_Archivist> | So here's what I have |
| 05:58:04 | <HP_Archivist> | I have a clean terminal of WSL open |
| 05:58:12 | <HP_Archivist> | Nothing in it. I typed cd ~ and still nothing |
| 05:59:07 | <Jake> | Might already be in the right directory? Try `pwd` |
| 05:59:18 | <HP_Archivist> | Hm |
| 05:59:26 | <HP_Archivist> | pwd displays, on the next line /root |
| 05:59:35 | <HP_Archivist> | and then it just goes to the next line waiting for me to run something else |
| 06:00:01 | <Jake> | Sure. Does `ls` show you the directory we downloaded earlier? |
| 06:00:52 | <HP_Archivist> | no running 'ls' next just bring it to the next line |
| 06:01:23 | <HP_Archivist> | Again, so I type 'pwd' which displays '/root' |
| 06:01:27 | <Jake> | Ok, so there's nothing in the directory then. |
| 06:01:30 | <HP_Archivist> | and then typing 'ls' brings up nothing |
| 06:01:35 | <Jake> | I'm honestly not sure where we downloaded it the first time. |
| 06:01:47 | <HP_Archivist> | Huh |
| 06:01:47 | <HP_Archivist> | Odd |
| 06:01:57 | <Jake> | Would it be fine if we just downloaded it again? It didn't look that big on IA |
| 06:02:27 | <HP_Archivist> | Yeah we can. I just checked my drive space so hopefully it'll show even though it's not that big |
| 06:02:36 | <HP_Archivist> | Alright so let's try this once more heh |
| 06:02:57 | <Jake> | Alright. So we'll want to go to the actual windows drive. |
| 06:03:00 | <Jake> | `cd /mnt/c/Users/(username)/Desktop` |
| 06:03:57 | <HP_Archivist> | Got it |
| 06:04:27 | <Jake> | Now, you should be on your normal desktop, if you run `ls` you should see the normal files? |
| 06:04:42 | <HP_Archivist> | Yup, ran that and I see my desktop files |
| 06:04:51 | <Jake> | awesome. |
| 06:05:06 | <Jake> | We should be able to run `ia download talking-with-harry-potter-game-developers` again |
| 06:06:33 | <HP_Archivist> | Running now |
| 06:06:45 | <HP_Archivist> | Ahh nice |
| 06:06:49 | <HP_Archivist> | I already see the folder on my desktop |
| 06:06:53 | <HP_Archivist> | You're awesome |
| 06:07:46 | <Jake> | Woo! |
| 06:08:10 | <HP_Archivist> | Jake: Thank you for your patience. Always refreshing to find people online who have the patience of a saint when explaining technical inquiries |
| 06:08:23 | <Jake> | No problem! Happy to help. Ping me if you need anything else. |
| 06:09:08 | <HP_Archivist> | Will do. And yeah it finished succesfully. So now I can replicate this for future use. |
| 06:09:16 | <HP_Archivist> | I should sleep soon. Gnight! |
| 06:10:33 | <Jake> | Have a good night! |
| 06:51:39 | | HP_Archivist quits [Ping timeout: 258 seconds] |
| 11:46:49 | | OrIdow6 quits [Ping timeout: 258 seconds] |
| 11:50:25 | | OrIdow6 (OrIdow6) joins |
| 17:05:40 | | HP_Archivist (HP_Archivist) joins |
| 17:33:46 | | DogsRNice (Webuser299) joins |
| 18:06:03 | | spirit joins |
| 18:44:39 | | Wayward quits [Ping timeout: 258 seconds] |
| 18:49:37 | | Ryz quits [Remote host closed the connection] |
| 18:51:27 | | Ryz (Ryz) joins |
| 20:13:35 | | ats quits [Ping timeout: 258 seconds] |
| 20:23:15 | | ats (ats) joins |
| 20:24:35 | | HP_Archivist quits [Read error: Connection reset by peer] |
| 20:25:03 | | HP_Archivist (HP_Archivist) joins |
| 20:52:18 | | HP_Archivist quits [Ping timeout: 258 seconds] |
| 21:51:36 | | HP_Archivist (HP_Archivist) joins |
| 21:58:28 | | HP_Archivist quits [Read error: Connection reset by peer] |
| 21:58:55 | | HP_Archivist (HP_Archivist) joins |
| 22:35:02 | | HP_Archivist quits [Ping timeout: 258 seconds] |
| 23:18:44 | | ats quits [Ping timeout: 258 seconds] |
| 23:19:37 | | ats (ats) joins |
| 23:29:04 | | minus leaves [WeeChat 2.8] |