03:21:48qw3rty_ joins
03:25:25qw3rty__ quits [Ping timeout: 258 seconds]
04:04:16DogsRNice quits [Read error: Connection reset by peer]
04:36:22HP_Archivist (HP_Archivist) joins
04:36:54<HP_Archivist>I'
04:36:58Lord_Nightmare quits [Client Quit]
04:37:24<HP_Archivist>Trying to download an entire item through the CML. I have WSL for Windows open in a terminal. Looking at the docs https://archive.org/services/docs/api/internetarchive/cli.html
04:37:25Lord_Nightmare (Lord_Nightmare) joins
04:37:46<HP_Archivist>Configure my ia account credentials but not getting this to work.
04:37:54<HP_Archivist>I'd like to DL this entire item I have on there https://archive.org/details/talking-with-harry-potter-game-developers
04:51:18<@JAA>HP_Archivist: Define: 'does not work'
05:03:02<HP_Archivist>JAA: My novice prior experience with CML + Archive.org is showing heh
05:03:13<HP_Archivist>e.g. I'm not sure which series of commands to input
05:03:26<HP_Archivist>I tried:
05:03:30<HP_Archivist>$ ia download talking-with-harry-potter-game-developers
05:03:37<HP_Archivist>But didn't work
05:04:11<@JAA>That should work, I think.
05:04:48<HP_Archivist>No, I get a command not found
05:05:07<@JAA>Well, then it isn't installed correctly.
05:05:26<@JAA>Or the WSL environment is weird in that regard. No experience with that.
05:06:54<@JAA>How did you install it?
05:12:10<HP_Archivist>I have python installed and it should be updated but beyond that I don't think I installed the internetarchive binaries
05:12:15<HP_Archivist>Probably missing those ^
05:12:38<@JAA>Well, yeah, you kind of have to install it to run it.
05:13:18<HP_Archivist>Ahh I know what I'm doing wrong
05:13:29<HP_Archivist>How do I initiate python in the CML?
05:13:39<HP_Archivist>Super noob question but I don't use it much
05:14:12<@JAA>What exactly do you mean by 'CML' anyway?
05:14:38<HP_Archivist>the CMI* sorry, command-line interface
05:15:26<@JAA>Never heard 'CMI' either. CMD.EXE was the traditional name, but it's been a decade since I've used it.
05:16:00<HP_Archivist>I'm probably not using the abbreviated terms correctly
05:16:17<@JAA>Anyway, to run Python in a terminal, you just run `python3`. Then you get a Python REPL.
05:18:11<@JAA>But you don't run `ia` from inside Python.
05:18:48<Ryz>So tried to archive just the link http://www.religion-research.org/ - because currently it now gives 403s, since I archived the website via AB some time ago; it gave this rather unique message I never seen before: Cannot fetch the target URL due to system overload.
05:19:58<HP_Archivist>JAA I put in python3. I have a line that says type help, copyright, credits, etc that's it
05:20:13<HP_Archivist>I have Py 3.8.2
05:20:16<@JAA>Well, then at least Python is installed correctly.
05:20:28<HP_Archivist>Wait
05:20:38<HP_Archivist>I'm running this within the Ubunut terminal. oops
05:20:43<HP_Archivist>Ubuntu*
05:21:35<HP_Archivist>Erm, or maybe I had it right. I remember you're not supposed to run Py in WSL or something. Idk it's been a long time I've messed with any of this
05:21:58<HP_Archivist>I have Ubuntu / WSL on Windows and have been using that to test this
05:23:36<@JAA>That's probably the closest you'll get to a sane environment on Windows.
05:23:46<@JAA>Did you install the internetarchive Python package?
05:24:11<HP_Archivist>Heh. And I'm trying to do that now. I think have to install PIP first though, right?
05:24:31<@JAA>If you don't already have it, yeah.
05:25:32<@JAA>If `which pip` and `which pip3` don't return anything, it isn't installed.
05:27:18<HP_Archivist>I just installed pip3, so I have it yeah
05:27:33<HP_Archivist>Do I input this line next? $ sudo pip install internetarchive
05:27:53<@JAA>Either that or 'pip3' instead of 'pip':
05:28:23<HP_Archivist>Bah same thing. I get command not found
05:28:34<HP_Archivist>On either of those
05:28:36<HP_Archivist>pip3 or pip
05:28:55<@JAA>How did you install pip?
05:28:56<HP_Archivist>I think the $ is incorrect usage for WSL
05:29:09<@JAA>Oh, you're entering the dollar sign?
05:29:17<HP_Archivist>I am yes
05:29:18<@JAA>That's just a common prompt char.
05:29:59<@JAA>I.e. what the shell displays to you when it expects you to enter a command.
05:30:11<HP_Archivist>Ahh yeah. I thought it was. I recall I read that somewhere previously. Re-trying 'sudo pip install internetarchive' is working now
05:30:25<HP_Archivist>Yeah thank you ^
05:32:39<HP_Archivist>Hm interesting. It's downloading that item now
05:32:55<HP_Archivist>But the progress bar is a bunch of 'ddddd'
05:32:57<HP_Archivist>wth
05:33:05<HP_Archivist>Is that typical?
05:33:18<@JAA>Yeah, one character for each file downloaded, I think.
05:33:33<@JAA>d = done, e = error, not sure what else exists.
05:33:44<HP_Archivist>Ah good to know
05:34:09<@JAA>I'm slightly surprised that it doesn't have the progress bar of uploads though.
05:34:16<@JAA>(I rarely download with that tool.)
05:34:59<HP_Archivist>Reason I wanted to do this in the first place is in the event I lose source and on things I upload and have to re-grab everything I uploaded to Archive. Since the download all button is broken or that PDF issue from months ago seems to break entire item downloads, downloading through the terminal is the only other way for mass-downloading an item vs one by one file
05:35:25<HP_Archivist>Annnnd success
05:35:35<@JAA>Downloading with the CLI is the only reasonable way to download more than one file in the first place. :-)
05:35:57<@JAA>Be sure to check whether it includes all the derived files or not. You probably don't want to keep those.
05:37:05<HP_Archivist>Yeah I'm seeing that JAA heh
05:37:16<HP_Archivist>Now I have to locate what folder it downloaded to
05:37:34<@JAA>Should be in whatever directory you're in.
05:37:35<HP_Archivist>For the derived files, I thought about that. I suppose not, but they are handy to have. Not sure.
05:37:46<Jake>If you are in WSL, you might want to go /mnt/c/ and then from there to the desktop or something.
05:37:47<@JAA>A directory with the item identifier as a name, I believe.
05:38:51<@JAA>(`pwd` to show which directory you're currently in.)
05:38:55<HP_Archivist>Thanks Jake
05:39:30<HP_Archivist>Ahh I'm in root
05:39:33<HP_Archivist>apparently
05:39:55<@JAA>Seems plausible. No idea what that maps to in WSL.
05:40:01@JAA hands over to Jake and goes to bed. :-)
05:40:12<HP_Archivist>Heh thanks for your help JAA
05:41:22<Jake>So root directory in WSL is in some stupid spot. You can delete it with `rm -rf` and then the name of the folder you just downloaded. Then we can move directories, `cd /mnt/c/Users/(username)/Desktop`, and redownload.
05:41:55<HP_Archivist>Okay thanks let me try that now
05:42:42<Jake>(So for example deleting it would be rm -rf talking-with-harry-potter-game-developers )
05:43:42<HP_Archivist>Hm that didn't work, it's suggesting 'erf'
05:44:21<Jake>Could you paste the command you ran?
05:44:37<HP_Archivist>-rf talking-with-harry-potter-game-developers.zip since it'll be a zip
05:44:50<HP_Archivist>Ohh
05:44:52<Jake>you'll need rm at the start
05:44:53<Jake>haha
05:44:54<Jake>all good
05:44:58<HP_Archivist>Yes, I just saw that
05:45:17<Jake>(and -rf isn't needed unless it's a folder.)
05:46:02<HP_Archivist>'rm: cannot remove 'talking-with-harry-potter-game-developers.zip': No such file or directory'
05:46:18<HP_Archivist>After running 'rm talking-with-harry-potter-game-developers.zip'
05:46:31<Jake>Hmm, try `ls` we might not be in the folder?
05:46:58<HP_Archivist>That's what I'm thinking
05:48:24<HP_Archivist>Yeah I still don't think I'm in the folder
05:48:29<HP_Archivist>So I closed the terminal and opened it again
05:48:38<HP_Archivist>What do I type to navigate to that folder?
05:48:50<Jake>So `cd` and then a folder name navigates you there
05:49:58<HP_Archivist>I typed in: cd /root which is apparently where WSL is or something
05:50:05<HP_Archivist>Then I typed in the rm command again and still an error
05:50:20<HP_Archivist>Should I be able to find this manually within explorer?
05:50:43<Jake>Oh I forgot, actually, one second
05:51:37<Jake>Hmm, actually that wasn't added yet. I don't think they have native ext4 for explorer yet
05:51:44<HP_Archivist>No no
05:51:54<HP_Archivist>I mean Just searching Windows explorer by going through C directory
05:52:02<HP_Archivist>find where wsl is
05:52:02<HP_Archivist>etc
05:52:31<Jake>I'm not actually sure if it's accessible like that?
05:52:46<Jake>Best move I think would be to move the files to actual windows, should be easier from there?
05:53:13<HP_Archivist>Before we go further - it downloaded that item. Where is it exactly if it's not on my local drive?
05:54:02<Jake>It's on your drive, but in the Ubuntu partition from what I understand. I think you should be able to see the folder with `ls` right now in the Ubuntu WSL terminal.
05:54:48<HP_Archivist>Ah alright, makes sense
05:55:15<HP_Archivist>I type in cd /ls ?
05:55:44<Jake>Just `ls` will show you what's in the directory you are in
05:56:09<Jake>from there, you can find the folder the ia tool downloaded, assuming we are in the right place.
05:56:10<HP_Archivist>No, that doesn't do anything
05:56:15<HP_Archivist>It just goes to the next line
05:56:48<Jake>Ok, try `cd ~` should bring you to the 'home' directory for your user, which is where I think it is.
05:56:52<Jake>Then `ls`
05:57:45<HP_Archivist>No, I'm not doing this right. I type cd ~ and it still only goes to the next line
05:57:47<HP_Archivist>Nothing comes up
05:57:57<HP_Archivist>So here's what I have
05:58:04<HP_Archivist>I have a clean terminal of WSL open
05:58:12<HP_Archivist>Nothing in it. I typed cd ~ and still nothing
05:59:07<Jake>Might already be in the right directory? Try `pwd`
05:59:18<HP_Archivist>Hm
05:59:26<HP_Archivist>pwd displays, on the next line /root
05:59:35<HP_Archivist>and then it just goes to the next line waiting for me to run something else
06:00:01<Jake>Sure. Does `ls` show you the directory we downloaded earlier?
06:00:52<HP_Archivist>no running 'ls' next just bring it to the next line
06:01:23<HP_Archivist>Again, so I type 'pwd' which displays '/root'
06:01:27<Jake>Ok, so there's nothing in the directory then.
06:01:30<HP_Archivist>and then typing 'ls' brings up nothing
06:01:35<Jake>I'm honestly not sure where we downloaded it the first time.
06:01:47<HP_Archivist>Huh
06:01:47<HP_Archivist>Odd
06:01:57<Jake>Would it be fine if we just downloaded it again? It didn't look that big on IA
06:02:27<HP_Archivist>Yeah we can. I just checked my drive space so hopefully it'll show even though it's not that big
06:02:36<HP_Archivist>Alright so let's try this once more heh
06:02:57<Jake>Alright. So we'll want to go to the actual windows drive.
06:03:00<Jake>`cd /mnt/c/Users/(username)/Desktop`
06:03:57<HP_Archivist>Got it
06:04:27<Jake>Now, you should be on your normal desktop, if you run `ls` you should see the normal files?
06:04:42<HP_Archivist>Yup, ran that and I see my desktop files
06:04:51<Jake>awesome.
06:05:06<Jake>We should be able to run `ia download talking-with-harry-potter-game-developers` again
06:06:33<HP_Archivist>Running now
06:06:45<HP_Archivist>Ahh nice
06:06:49<HP_Archivist>I already see the folder on my desktop
06:06:53<HP_Archivist>You're awesome
06:07:46<Jake>Woo!
06:08:10<HP_Archivist>Jake: Thank you for your patience. Always refreshing to find people online who have the patience of a saint when explaining technical inquiries
06:08:23<Jake>No problem! Happy to help. Ping me if you need anything else.
06:09:08<HP_Archivist>Will do. And yeah it finished succesfully. So now I can replicate this for future use.
06:09:16<HP_Archivist>I should sleep soon. Gnight!
06:10:33<Jake>Have a good night!
06:51:39HP_Archivist quits [Ping timeout: 258 seconds]
11:46:49OrIdow6 quits [Ping timeout: 258 seconds]
11:50:25OrIdow6 (OrIdow6) joins
17:05:40HP_Archivist (HP_Archivist) joins
17:33:46DogsRNice (Webuser299) joins
18:06:03spirit joins
18:44:39Wayward quits [Ping timeout: 258 seconds]
18:49:37Ryz quits [Remote host closed the connection]
18:51:27Ryz (Ryz) joins
20:13:35ats quits [Ping timeout: 258 seconds]
20:23:15ats (ats) joins
20:24:35HP_Archivist quits [Read error: Connection reset by peer]
20:25:03HP_Archivist (HP_Archivist) joins
20:52:18HP_Archivist quits [Ping timeout: 258 seconds]
21:51:36HP_Archivist (HP_Archivist) joins
21:58:28HP_Archivist quits [Read error: Connection reset by peer]
21:58:55HP_Archivist (HP_Archivist) joins
22:35:02HP_Archivist quits [Ping timeout: 258 seconds]
23:18:44ats quits [Ping timeout: 258 seconds]
23:19:37ats (ats) joins
23:29:04minus leaves [WeeChat 2.8]