| 00:10:23 | | qw3rty_ quits [Ping timeout: 265 seconds] |
| 00:16:11 | | Arcorann (Arcorann) joins |
| 00:20:33 | <@arkiver> | tech234a: how large is the data? |
| 00:23:07 | | qw3rty joins |
| 00:27:26 | <@JAA> | arkiver: '9.46 GB in size (11.7 GB size on disk)' |
| 00:28:07 | <@JAA> | Well, that was before it was zipped, but close enough. |
| 00:43:24 | | qw3rty quits [Ping timeout: 240 seconds] |
| 02:04:43 | <tech234a> | The 4096 zip files total to 3.83GB |
| 02:04:53 | <@JAA> | Cute :-) |
| 02:39:44 | | dxrt quits [Ping timeout: 265 seconds] |
| 04:49:15 | | dxrt joins |
| 04:49:17 | | dxrt is now authenticated as dxrt |
| 04:49:17 | | dxrt quits [Changing host] |
| 04:49:17 | | dxrt (dxrt) joins |
| 05:46:17 | | HP_Archivist quits [Quit: Leaving] |
| 07:54:44 | | qw3rty joins |
| 07:57:01 | | Craigle quits [Ping timeout: 252 seconds] |
| 07:57:16 | | Craigle (Craigle) joins |
| 09:07:04 | | Arcorann quits [Ping timeout: 240 seconds] |
| 09:42:57 | | Arcorann (Arcorann) joins |
| 14:37:24 | | Arcorann quits [Ping timeout: 240 seconds] |
| 14:51:30 | | rsn_ quits [Ping timeout: 265 seconds] |
| 14:53:59 | | rsn joins |
| 16:35:38 | | britmob23 joins |
| 16:35:44 | | britmob2 quits [Ping timeout: 240 seconds] |
| 16:35:45 | | britmob23 is now known as britmob2 |
| 19:32:03 | | DogsRNice (Webuser299) joins |
| 21:24:57 | | prebala-publici joins |
| 21:53:33 | <mgrandi> | wait, isn't that what you do @JAA ? call ia upload multiple times (re my problems with ia upload --spreadsheet) |
| 21:55:05 | <mgrandi> | and @tech234a look into installing WSL, very handy for situations where you need linux but are running windows :) |
| 22:06:25 | <tech234a> | Thanks, I have WSL but didn't think of it for this |
| 22:06:47 | <tech234a> | Looks like the upload was interrupted, so I will resume |
| 22:08:09 | <mgrandi> | and no email back from IA over getting access to SPN ver 2, guess i'll have to make this work with the first version |
| 22:08:31 | <tech234a> | Another question: it seems the zip viewer isn't showing content for files in the zip (clicking on files gives a blank file)... is this because of a problem on my end or is it a problem with the viewer? |
| 22:08:44 | <tech234a> | Sample: https://ia801508.us.archive.org/view_archive.php?archive=/5/items/youtube-community-contributions/-/-z.zip&file=-z0J0g_us3k%2F-z0J0g_us3k_en_community_draft.json |
| 22:08:58 | <mgrandi> | its probably still processing |
| 22:10:31 | <tech234a> | In the list view a file size is shown. It's probably been just short of a day since the files I'm looking at have been uploaded... any idea roughly how long it will take to process? |
| 22:10:34 | <mgrandi> | go to the item history, and that will show what jobs are still running on it |
| 22:11:29 | <tech234a> | "No outstanding tasks." |
| 22:11:51 | <tech234a> | Looks like it has been derived and virus checked |
| 22:12:43 | <mgrandi> | so its all purple? |
| 22:12:56 | <@JAA> | mgrandi: Not concurrently (usually). |
| 22:13:24 | <@JAA> | Well, not concurrently to the same item. I've only done that once or twice because it's not recommended. |
| 22:13:47 | <@JAA> | I've often uploaded to multiple items in parallel though. |
| 22:14:21 | <mgrandi> | ah ok |
| 22:14:32 | <tech234a> | Yeah it's all purple in history |
| 22:16:20 | <tech234a> | Should I restart the upload with TARs instead? |
| 22:19:35 | | prebala-publici quits [Remote host closed the connection] |
| 22:19:43 | <mgrandi> | uh, not sure, i mean i dunno if it would fare any better, you said these were beefy zips? |
| 22:20:08 | <tech234a> | The individual zips are actually fairly small because of how I divided them |
| 22:20:33 | <mgrandi> | where is the main item page? |
| 22:20:46 | <tech234a> | https://archive.org/details/youtube-community-contributions |
| 22:21:31 | <mgrandi> | https://ia801508.us.archive.org/view_archive.php?archive=/5/items/youtube-community-contributions/2/2-.zip&file=2-6UH0j7Jzc%2F2-6UH0j7Jzc_en_uploader_provided.json tht works |
| 22:21:56 | <tech234a> | Yeah same here |
| 22:22:09 | <mgrandi> | might be that one zip, try downloading it and verifying |
| 22:22:16 | <tech234a> | Alright |
| 22:22:19 | <mgrandi> | could also be a fluke that will fix itself in a day or something |
| 22:22:21 | <@JAA> | I wonder if the viewer doesn't like the filename starting with a dash. |
| 22:22:44 | <mgrandi> | that could be it too |
| 22:23:16 | <mgrandi> | but as long as the zip itself is fine, i think its good enough, the viewer is probably more for convenience than anything else, anyone wanting the data is gonna download it |
| 22:23:36 | <tech234a> | Yeah I was just thinking that the viewer might not like the dash |
| 22:24:06 | <tech234a> | I was planning to make a searchable index that would allow downloading individual files though |
| 22:25:03 | <tech234a> | Resuming uploads... |
| 22:26:01 | <tech234a> | Is there somewhere else I can inquire about the dash bug... maybe it can be fixed? |
| 22:26:24 | <@JAA> | The ones I tried all worked, except for the ones starting with a dash. |
| 22:26:35 | <@JAA> | I'd send an email to info@archive.org about this. |
| 22:26:46 | <tech234a> | Alright, thanks! |
| 22:40:37 | <tech234a> | Email sent |
| 22:56:53 | <tech234a> | Uploading is going significantly faster today... yesterday individual files were typically taking more than 10 seconds to upload, today most are taking less than 1 second |
| 22:59:32 | | nothere quits [Quit: Leaving] |
| 23:01:08 | | Arcorann (Arcorann) joins |
| 23:05:55 | | nothere joins |
| 23:11:30 | <mgrandi> | AT might have been ddosing err..uploading something to them last night en masse =P |
| 23:21:36 | | OrIdow6^2 is now known as OrIdow6 |
| 23:54:54 | | Lord_Nightmare quits [Quit: ZNC - http://znc.in] |
| 23:58:04 | | Lord_Nightmare (Lord_Nightmare) joins |