HomeSearchPrevious dayNext day

00:18:00onetruth quits [Remote host closed the connection]
00:18:19onetruth joins
00:56:00<purplebot>RootsWeb edited by Hook54321 (-11) just now -- https://www.archiveteam.org/?diff=46299&oldid=42917
01:12:59C4K3 (C4K3) joins
01:26:58aleph quits [Client Quit]
01:35:03<thuban>right, my pdf generator is now working, so the last thing to figure out is the ia uploads...
01:38:37<thuban>https://archive.org/services/docs/api/internetarchive/api.html is pretty helpful, BUT doesn't seem to mention working with test items or collections.
01:38:44aleph joins
01:41:41<thuban>am i correct in thinking that the way to upload a test item is to include 'collection' : 'test_collection' in the metadata dict supplied to upload()?
01:54:41<OrIdow6>That's how it works in the CLI
01:54:57<OrIdow6>And I doubt there's special handling
01:56:21aleph quits [Client Quit]
02:08:40Jonimus quits [Ping timeout: 252 seconds]
02:15:28Jonimus joins
02:19:43aleph joins
02:25:52<@JAA>The inQuake forum sped up significantly and is already around 70 % done for the first leg.
02:28:57<@JAA>Oh yeah, quite a few threads are in login-required forums it seems.
02:29:04<@JAA>I also found some with a password protection.
02:43:29dbgft quits [Client Quit]
02:50:39Lord_Nightmare quits [Quit: ZNC - http://znc.in]
02:53:17Lord_Nightmare (Lord_Nightmare) joins
03:06:16<thuban>https://archive.org/details/hongkongdailypress19410930 opinions, people?
03:07:54<thuban>(also, can i count on the status code of the upload() response? that is, 200 is a success and anything else indicates failure?)
03:19:21klg quits [Ping timeout: 265 seconds]
03:19:51klg (klg) joins
03:20:49aleph quits [Client Quit]
03:22:18aleph joins
03:25:57<thuban>hm, whoops
03:28:00<thuban>i included loc/worldcat call numbers for the periodical, but ia's derive seems to have used them to add a lot of metadata that's dubious or outright wrong for this edition (including overwriting correct metadata i supplied)
03:31:21<thuban>i could disable derivation i guess, but wouldn't that prevent ocr and search engine indexing?
03:33:12<thuban>"Various book operations are available. Each are activated by including an argument named `op#` (where the # is replaced by a numeral) with a value specifying which book operation should be performed. Please contact IA for more information." thanks
03:38:19<OrIdow6>YOu have a nice volume of metadata
03:39:10<OrIdow6>I've often seen it that the date is included in the item title as well - could consider doing that
03:39:31<thuban>it was included in the item title! derive overwrote it!
03:39:33<OrIdow6>The PDF isn't showing up for me in the viewer - but apparently it's still deriving
03:39:34<OrIdow6>Oh
03:39:57<OrIdow6>Yeah, maybe you should try contacting them
03:40:15<OrIdow6>This seems like the sort of thing they'd be interested in
03:40:20<thuban>and added the wrong publisher, and incorrect issue information
03:40:35<thuban>seems fair, i was planning on emailing them anyway to set up a collection
03:51:37<thuban>ugh fuck
03:52:42<thuban>i thought that deleting the test item would, in fact, delete it, but apparently not--i can't reuse the identifier
03:59:26<OrIdow6>Yeah, the "x" button just darks it
04:00:29<OrIdow6>Enough legal identifier chars for you to add some punctuation to the date format, though
04:01:02<thuban>aaand now it thinks i'm spamming. the cli has a 'bulk upload' option, but looking at the code afaict it handles the list serially, so ?_?
04:01:23<thuban>i was NOT expecting this to be the hard part
04:02:11qw3rty_ joins
04:05:53qw3rty__ quits [Ping timeout: 244 seconds]
04:06:53DogsRNice quits [Read error: Connection reset by peer]
04:36:18<@JAA>inQuake forum qwarc archival finished a few minutes ago.
04:41:07<@JAA>Looks like some of the 'archive' is broken though: https://quake.ingame.de/forum/archive/index.php/t-256572.html
04:59:14qw3rty__ joins
05:03:01qw3rty_ quits [Ping timeout: 252 seconds]
05:19:00<purplebot>Smack Jeeves edited by Wickedplayer494 (+73, /* Shutdown */ Domain name's done …) just now -- https://www.archiveteam.org/?diff=46300&oldid=46023
05:20:13etnguyen03 quits [Client Quit]
05:40:22BlueMaxima quits [Read error: Connection reset by peer]
05:57:37<@JAA>inQuake forum stats: looks like I have about 2.65M posts in 93k threads (with 299k thread pages). That's some 350k posts and 9k threads below the stats on the homepage, but as mentioned, there are forums which require an account or are password-protected.
05:58:07<@JAA>Already uploaded to IA and deriving now.
05:58:12<@JAA>jodizzle, Fusl: ^
06:00:10<jodizzle>Nice
06:14:19BPCZ quits [Ping timeout: 265 seconds]
06:50:32<jodizzle>JAA: So would it be safe to set an ignore for all threads on the AB job?
07:03:59hooway joins
08:13:59sliccricc_ (sliccricc) joins
08:14:04sliccricc quits [Remote host closed the connection]
09:01:55<Ryz>Welp, this may be concerning for Chinese developers and developers that want to release games onto China with Steam releasing a beta version of the China-only Steam client: https://twitter.com/ZhugeEX/status/1357021592472219650
09:02:03<Ryz>May have to keep a close watch
09:28:25BPCZ (BPCZ) joins
09:53:31sliccricc_ quits [Ping timeout: 264 seconds]
10:12:57sec^nd quits [Ping timeout: 240 seconds]
10:18:00sec^nd (second) joins
10:21:03rsn_ quits [Remote host closed the connection]
10:21:45rsn_ joins
10:22:34rsn_ quits [Remote host closed the connection]
10:22:46icedice joins
10:38:14Ryz quits [Remote host closed the connection]
10:39:02Ryz (Ryz) joins
11:05:19Arcorann_ joins
11:06:27Arcorann quits [Ping timeout: 244 seconds]
11:22:42Arcorann__ joins
11:25:25Arcorann_ quits [Ping timeout: 240 seconds]
11:37:27Arcorann__ quits [Ping timeout: 244 seconds]
12:33:43lunik1 quits [Quit: Ping timeout (120 seconds)]
12:34:00lunik1 joins
12:44:49<icedice>I'm guessing ArchiveBot can't grab OneDrive links, right?
12:44:53kpcyrd quits [Quit: kpcyrd]
12:45:03kpcyrd (kpcyrd) joins
12:56:09<@Kaz>.b 45
12:59:34<OrIdow6>You forgot /topic
13:10:08ragu_ joins
13:13:37ragu__ quits [Ping timeout: 252 seconds]
13:15:37daalekz quits [Ping timeout: 244 seconds]
13:19:28yano quits [Quit: WeeChat, The Better IRC Client, https://weechat.org/]
13:21:31yanome (yano) joins
13:22:32yano (yano) joins
13:26:23tech234a quits [Read error: Connection reset by peer]
13:26:24@jrwr quits [Read error: Connection reset by peer]
13:26:34aarchi quits [Read error: No route to host]
13:26:36janpaul123 quits [Read error: Connection reset by peer]
13:26:36@EggplantN2 quits [Read error: Connection reset by peer]
13:26:36mgrandi quits [Read error: Connection reset by peer]
13:27:13space quits [Read error: Connection reset by peer]
13:28:04janpaul123 (janpaul123) joins
13:28:04mgrandi (mgrandi) joins
13:28:04jrwr (jrwr) joins
13:28:04@ChanServ sets mode: +o jrwr
13:28:22EggplantN2 joins
13:28:25tech234a (tech234a) joins
13:29:45space (space) joins
13:30:46<@Fusl>JAA: ty
13:30:55aarchi (aarchi) joins
13:31:04<@Fusl>Ryz: just keep them as is i guess
13:31:10<@Fusl>wont hurt to grab it again
13:31:11<@Fusl>just to make sure
13:32:43EggplantN2 quits [Changing host]
13:32:43EggplantN2 (EggplantN) joins
13:32:43@ChanServ sets mode: +o EggplantN2
13:58:31etnguyen03 (etnguyen03) joins
14:18:33onetruth quits [Remote host closed the connection]
14:18:54onetruth joins
14:38:56sliccricc_ (sliccricc) joins
14:41:47sliccricc_ quits [Remote host closed the connection]
14:42:13sliccricc_ (sliccricc) joins
14:50:32benjinsmith joins
14:52:56benjins quits [Ping timeout: 265 seconds]
15:03:05benjinsmith is now known as benjins
15:15:05nahka joins
15:30:59ThreeHeadedMonkey quits [Ping timeout: 244 seconds]
15:32:14ThreeHeadedMonkey (ThreeHeadedMonkey) joins
15:46:14sliccricc_ quits [Remote host closed the connection]
15:52:43justaguy is now known as AltroskyAS207616_Mystique
15:58:04sliccricc (sliccricc) joins
15:58:39sliccricc quits [Remote host closed the connection]
15:58:55sliccricc (sliccricc) joins
15:59:03<Lord_Nightmare>JAA: the anonymous cheer animated emote is at https://d3aqoihi2n8ty8.cloudfront.net/actions/anon/dark/animated/100/1.gif 2.gif 3.gif for cheer100, and i assume you replace '100' in the url with 1 10 etc for all the other variants
15:59:23<Lord_Nightmare>1.gif 2.gif 3.gif are different sizes for hi-dpi displays etc
16:12:07LeGoupil joins
16:16:54LeGoupil quits [Client Quit]
16:32:49xdd joins
16:33:17<@EggplantN>Ave from here forward we will need separate usernames. Ave_bigbiglarge as you used in mediafire I'm fine with
16:33:27<ave>EggplantN, If there's others feeding stuff through our username, they're not doing it to the knowledge of anyone who is in our group chat.
16:33:38W6 joins
16:33:54<@EggplantN>Okay does a Bell DSL line ring a bell?
16:33:58linuxgemini (linuxgemini) joins
16:33:59<ave>No?
16:34:29nintendo9713 joins
16:34:34<@EggplantN>See discord
16:35:32<ave>Ah.
16:36:53<ave>Just so that I also do this publicly: I admit fault.
16:38:26<nintendo9713>can a little guy like me ask what was at fault? Not part of the archive team crowd, just a halo obsessed dude grabbing personal profiles for random redditors on the last day it's up with a script I wrote
16:39:14<ave>nintendo9713, one friend who ran stuff at home forgot to take down instances.
16:39:44<ave>And yeah, I do accept fault, as we never even considered that. What we aimed our access to was the cloud fleet.
16:50:09rsn joins
16:55:49<nahka>Kaz About that Demi.fi site
17:18:21W6 quits [Remote host closed the connection]
17:34:59lennier2 joins
17:37:37lennier1 quits [Ping timeout: 252 seconds]
17:37:40lennier2 is now known as lennier1
17:51:29onetruth quits [Read error: Connection reset by peer]
18:10:03<@JAA>jodizzle: Probably? Not sure. I didn't grab any of the images, outlinks, etc. I guess I can extract stuff from my archive for separate !ao < jobs though if we want that.
18:14:14<Aoede>demi.fi API only seems to return 555 pages
18:15:22<Aoede>per subforum
18:25:35space quits [Read error: Connection reset by peer]
18:25:42space (space) joins
18:25:45mgrandi quits [Read error: Connection reset by peer]
18:25:57mgrandi (mgrandi) joins
18:32:17<@JAA>Yeah, 10k results per subforum it seems.
18:48:52<@JAA>I managed to get a thread count from the API at least: 757483
18:50:00benjinsmith joins
18:51:12<Aoede>do we need a warrior project for this
18:52:11benjins quits [Ping timeout: 265 seconds]
18:52:14benjinsmith is now known as benjins
18:55:44<Aoede>there isn't any mention when the forum will close, other than it will be a gradual shutdown
18:56:28<@JAA>The query I found is also limited to 10k results. :-(
18:59:51<Aoede>:S
19:16:36<@JAA>Threads are internally identified by a UUID, so bruteforcing is out of question as well.
19:17:08<@JAA>Same for categories (= subforums) and users, by the way.
19:32:28<jodizzle>JAA: I think that would be helpful, yeah. I'm not especially concerned about outlinks, but an !ao < for any page requisites and such would be helpful. I'd like to focus the AB job on users or any other non-thread content.
19:37:30<ave>Btw, did the plans on archiving gab ever get anywhere?
19:38:29<@JAA>jodizzle: Yeah, outlinks are definitely less urgent but would be nice to cover anyway. I'll look into extracting page requisites and user profile links.
19:38:59DLoader quits [Ping timeout: 244 seconds]
19:39:01<jodizzle>Okay, I'll set the AB ignore
19:47:09britmob quits [Read error: Connection reset by peer]
19:48:06britmob joins
19:50:14sliccricc quits [Remote host closed the connection]
19:50:22<Sanqui>!ig 57ewyae12nynj6hxzu671zu92 ^http://lkso\.publicvm\.com:85/
19:50:31sliccricc (sliccricc) joins
19:50:32<Sanqui>sorry wc
19:57:12DLoader joins
20:16:04Church joins
20:16:04aleph quits [Read error: Connection reset by peer]
20:19:10mary (mary) joins
20:19:34<mary>Reposting this here: 15:12 <mary> EggplantN: just a suggestion, but maybe you should follow Boinc and Folding@Home and add support for teams? That seems like it would fix your issues of knowing who is who and also help the people who get fun out of doing it as a team.
20:19:34<mary>15:16 <@HCross> not really worth it
20:19:34<mary>15:17 <@HCross> we've got limited development capacity, and we'd rather use that for actual archiving than leader-board-faffery
20:19:34<mary>15:17 <@HCross> there is 1 case where this is needed
20:19:34<mary>15:17 <@HCross> and... it really isn't
20:19:34<mary>15:18 <mary> if you're not up to it, I wouldn't mind taking a look at doing it myself if the code is opensource
20:19:59<@HCross>please also don't tag spam
20:20:25<@HCross>but... mary meet Fusl
20:20:52<thuban>https://github.com/ArchiveTeam/universal-tracker
20:21:40<@HCross>that's not "the tracker" anymore
20:21:59<thuban>lol, figures. where is it?
20:22:04<@HCross>Fusl's head
20:23:15<@Fusl>mary: add tracker feature requests here https://git.kiska.pw/ArchiveTeam/trackerproxy/issues
20:27:36<Ajay>Is the UI still from the GitHub repo?
20:28:48<@Fusl>yeah
20:28:57<@Fusl>but it wont be in the future
20:43:55sliccricc quits [Ping timeout: 264 seconds]
20:54:00<purplebot>URLTeam/torrents edited by Aarchi (+101808, Update torrent list: curl 'https://archive.org/services/search/v1/scrape?q=subject:terroroftinytown&count=10000' …) just now -- https://www.archiveteam.org/?diff=46302&oldid=27463
20:54:00<purplebot>CurrentWarriorProject edited by ATWarriorBot (+1) just now -- https://www.archiveteam.org/?diff=46303&oldid=46301
21:07:00<purplebot>Make Magazine edited by Hook54321 (+1401) just now -- https://www.archiveteam.org/?diff=46305&oldid=39727
21:17:00<purplebot>Toshiba Support edited by Hook54321 (-76) just now -- https://www.archiveteam.org/?diff=46306&oldid=30152
21:19:00<purplebot>CurrentWarriorProject edited by JustAnotherArchivist (-1, Reverted edits by [[Special:Contributions/ATWarriorBot|ATWarriorBot]] …) 24 minutes ago -- https://www.archiveteam.org/?diff=46304&oldid=46303
21:32:35britmob quits [Read error: Connection reset by peer]
21:34:39<@hook54321>anyone know what's up with this? https://archive.fart.website/archivebot/viewer/job/9cn77
21:40:25<@JAA>I saw another one like that recently. No idea. SketchTheCow?
21:44:55britmob joins
21:57:00<purplebot>FileTrip edited by Hook54321 (-5) just now -- https://www.archiveteam.org/?diff=46307&oldid=46189
22:22:01daalekz (daalekz) joins
22:27:39daalekz quits [Client Quit]
22:36:17<nahka>THe last "Demi" paper magazine is due to release at 8th of April 2021. So I'd wager the forums will be closed permanently after that.
22:41:22nahka quits [Ping timeout: 244 seconds]
22:44:32mutantmonkey quits [Remote host closed the connection]
22:44:58mutantmonkey (mutantmonkey) joins
23:04:03BlueMaxima joins
23:04:26@jrwr quits [Read error: Connection reset by peer]
23:04:26janpaul123 quits [Read error: Connection reset by peer]
23:04:33janpaul123 (janpaul123) joins
23:04:47jrwr (jrwr) joins
23:04:47@ChanServ sets mode: +o jrwr
23:18:34treora quits [Ping timeout: 244 seconds]
23:28:41treora joins
23:51:40@kiska quits [Quit: Ping timeout (120 seconds)]
23:52:33kiska (kiska) joins
23:52:33@ChanServ sets mode: +o kiska

HomeSearchPrevious dayNext day