00:00:42dm4v quits [Read error: Connection reset by peer]
00:01:10dm4v joins
00:01:12dm4v quits [Changing host]
00:01:12dm4v (dm4v) joins
00:33:45driib quits [Ping timeout: 258 seconds]
00:35:23driib (driib) joins
00:59:26HP_Archivist quits [Ping timeout: 258 seconds]
01:02:28dm4v quits [Client Quit]
01:03:45Iki joins
01:04:05phiresky joins
01:04:57BlueMaxima joins
01:05:43dm4v joins
01:05:45dm4v quits [Changing host]
01:05:45dm4v (dm4v) joins
01:25:47yawkat (yawkat) joins
01:28:34Limeysoda quits [Ping timeout: 258 seconds]
01:46:37Binzy quits [Read error: Connection reset by peer]
01:54:09HP_Archivist (HP_Archivist) joins
02:07:54nertzy (nertzy) joins
02:27:37Connection closed.
02:27:54atirclog (atirclog) joins
02:27:54Topic: Wanna bikeshed about the topic? | We can't be back on our bullshit if we were never off our bullshit FOREHEADTAP.GIF
02:27:54Topic set by Fusl at 2019-09-06 21:43:25Z
02:27:59Current users: atirclog (atirclog), rewby (rewby), ThreeHM (ThreeHeadedMonkey), nertzy (nertzy), HP_Archivist (HP_Archivist), yawkat (yawkat), dm4v (dm4v), BlueMaxima, phiresky, Iki, driib (driib), Arcorann_, Stiletto, DogsRNice (Webuser299), JackeithWelley, Ryz (Ryz), grafck, lunik1, Mateon1, jamesatjaminit (jamesatjaminit), superkuh_, britmob, sec^nd (second), JensRex (JensRex), Hackerpcs (Hackerpcs), useretail, igloo22225, qw3rty__, tzt, aleph, lukash7, Larsenv (Larsenv), Matthww8, knecht420 (knecht420), Doranwen (Doranwen), [42] (N4Y), Myself (myself), ArchivalEfforts, rsn, m0nika (m0nika), Gereon (Gereon), Barto (Barto), marked1, fuzzy8021 (fuzzy8021), swebb, Ruthalas (Ruthalas), sdomi, HackMii (hacktheplanet), robbi5 (robbi5), thuban, atphoenix_ (atphoenix), wizards, RJHacker36297, Nay (JeDa), Meli (Meli), redlizard_, Atom, Wingy (Wingy), VerifiedJ (VerifiedJ), hexa- (hexa-), HotSwap`, mutantmnky (mutantmonkey), pabs (pabs), Krownest1 (Krownest), SCSi (SCSi), @dxrt (dxrt), ave (ave), flashmeow (flashmeow), systwi (systwi), Mayk78, balrog (balrog), EdSavoie_srv, atomicthumbs, grawity (grawity), yano (yano), yanome (yano), G4te_Keep3r, kiskaWeebChat (kiska), monoxane (monoxane), Lord_Nightmare (Lord_Nightmare), ivan (ivan), Kinille (Kinille), fionera (Fionera), @ChanServ, jodizzle (jodizzle), avoozl (avoozl), pie_, @JAA (JAA), maxfan8 (maxfan8), phuzion (phuzion), Jon, Sanqui (Sanqui), revi (revi), pmlo1, kpcyrd (kpcyrd), @HCross (HCross), brabo (brabo), Ctrl-S, archzz, Somebody2 (Somebody2), Frogging101, asie, sknebel (sknebel), djsrv (djsrv), Aoede (Aoede), meowe (meowe), @chfoo (chfoo), @AlsoJAA (JAA), @Kaz (Kaz), mrfooooo, simon816 (simon816), kiska (kiska), SketchTheCow, shoghicp (shoghicp), mgrandi (mgrandi), luckcolors (luckcolors), c00k13, masterX244 (masterX244), pnJay___, programmerq (programmerq), notbasetwo, cadence (cadence), xit, fofofofofofofofo, duce1337 (duce1337), @arkiver (arkiver), nothere, h3ndr1k (h3ndr1k), benjins (benjins), kiskaLogBot, Ajay, AK (AK), wickedplayer494 (wickedplayer494), s-crypt (s-crypt), flashfire42 (flashfire42), bradp, wessel1512 (wessel1512), sembiance (sembiance), Muad-Dib, jspiros (jspiros), Hecz (Hecz), nyany (nyany), Dj-Wawa (Dj-Wawa), Terbium, billy549 (Billy549), chriscoffee (chriscoffee), Soulflare (Soulflare), Suika, @Fusl (Fusl), Craigle (Craigle), iandees, justaguy, betamax (betamax), yarrow (yarrow), themadpro (themadpro), girst (girst), @jrwr (jrwr), Jake (Jake), Gaelan (Gaelan), @hook54321 (hook54321), jut (jut), tech234a (tech234a), aarchi (aarchi), mr_archive, @Fusl_ (Fusl), Dallas (Dallas), Dragnog, @EggplantN (EggplantN)
03:52:23qw3rty_ joins
03:56:09qw3rty__ quits [Ping timeout: 258 seconds]
03:59:53<Doranwen>I love how the postgres documentation says it supports collation for indexes but doesn't provide any info on what that actually IS
04:00:50Doranwen doesn't even know if she needs an index, but is suspecting she might, given that there are over a million records in this database and there are cases where the name column might need to be compared to one in another table of nearly as many records…
04:01:47<Doranwen>pgadmin is pretty clear about how to set up an index, at least - if I can figure out which options I need, lol
04:05:50Stiletto quits [Read error: Connection reset by peer]
04:05:51Stilett0 joins
04:07:51BinzyBoi joins
04:10:36HP_Archivist quits [Client Quit]
04:20:58<thuban>the rule of thumb i was taught is that if you will often need to select less than 10% of the records from a table, you should index the column(s) you're selecting on. this kind of 'name' setup is a pretty classic example
04:21:54<Doranwen>yeah, definitely would need it
04:22:08<Doranwen>the collation option confused me
04:22:39DogsRNice quits [Read error: Connection reset by peer]
04:24:02<Doranwen>also I had no idea about the fill factor
04:24:44<Doranwen>or whether I should cluster the table, lol
04:24:47<Doranwen>so many options!
04:24:50<Doranwen>it does not explain them
04:24:58Doranwen should know this stuff, apparently
04:26:55<Doranwen>and I have to select an operator class but that seems fairly straightforward - text column, so text_pattern_ops
04:28:49<thuban>respectively: don't worry about it, don't worry about it unless you know you're going to be doing a lot of updates (and set it back to default when you're done), and not unless you know you're going to be doing a lot of range-based selections (so in this case no)
04:29:12<Doranwen>ah, so don't pick an operator class, let it go with the default?
04:29:28<Doranwen>I kind of *have* to pick one, actually
04:29:43<thuban>the default should be text_ops
04:30:02<Doranwen>hmm, text_ops isn't an option
04:30:05<Doranwen>there's six options
04:30:12<Doranwen>only text_pattern_ops has "text" in it
04:30:22<Doranwen>I can try leaving blank
04:30:27<Doranwen>see if it'll let me go with that
04:30:53<Doranwen>collation options look like a horde of language specs and at the top C, C.UTF-8, and POSIX
04:31:19<Doranwen>I'm guessing UTF-8
04:31:21<thuban>yes, it has to do with sort order
04:31:29<Doranwen>yeah, I'm sort of figuring that
04:31:42<Doranwen>was about to start trying to see how they sort and get an idea
04:31:56<Doranwen>though I'm not sure what C by itself is
04:32:03<Doranwen>and I don't think searching for that will be very effective
04:32:54<thuban>https://wiki.debian.org/Locale
04:33:00<Doranwen>ahhhh
04:33:04Doranwen goes to read
04:33:23<Doranwen>I know what a locale is but that wasn't coming to mind when I looked at that list
04:36:32<thuban>seriously though, you should not worry about it. if pgadmin's interface makes you specify everything for some reason, use the console to create it in sql and let postgres choose the defaults; it's as simple as `create index <name> on <table> (<column(s)>)`
04:36:49<Doranwen>LOL, Stackexchange question about the collations - first line of reply: "The PostgreSQL documentation leaves a lot to be desired (just sayin' 😼 )."
04:38:50<Doranwen>ok, thanks for that - that helps a lot
04:41:14<Doranwen>I'm going to get these indices built and test pulling some data and then I should leave it for the night, lol
05:46:56driib quits [Ping timeout: 250 seconds]
05:53:47driib (driib) joins
06:20:06Viniter69 (Viniter) joins
06:23:25BlueMaxima quits [Remote host closed the connection]
06:23:44BlueMaxima joins
06:29:54ParkerR joins
06:30:30<ParkerR>Holy moly. Just went on a rabbit hole of Wait Wait NPR episodes that led me to their old download server still being alive https://gist.github.com/7eefa965f1ad1c70c0941554127d5e28
07:05:04<ParkerR>2000-2005 is uploading to archive.org as we speak
07:09:02<thuban>nice :D
07:10:28<ParkerR>Bunch of looking at the handful of archived webpages and guessing the URL schemes, finding nested playlist links, etc
07:10:55<ParkerR>To their credit it was all on the same server. Pain is they dont do directory listing
07:11:00<ParkerR>That'd be too easy
07:13:03<ParkerR>I used some bash expansion and wget to scrape it all. Thankfully the abundance of 404 requests was outweighed by get url list only using a single connection per attempt
07:13:13<ParkerR>*wget
07:18:58kiska quits [Quit: Ping timeout (120 seconds)]
07:22:42@Fusl_ quits [Ping timeout: 250 seconds]
07:24:07kiska (kiska) joins
07:25:00Fusl_ (Fusl) joins
07:25:00@ChanServ sets mode: +o Fusl_
07:27:26@Fusl_ quits [Max SendQ exceeded]
07:32:44Fusl_ (Fusl) joins
07:32:44@ChanServ sets mode: +o Fusl_
07:33:53pnJay___ quits [Ping timeout: 622 seconds]
07:37:26pnJay___ joins
07:44:32kiskaLogBot quits [Remote host closed the connection]
07:45:04kiskaLogBot joins
07:48:34kiskaLogBot quits [Remote host closed the connection]
07:49:06kiskaLogBot joins
08:01:18<ParkerR>Realized I missed some multi part files (things with 01 in them) but here's the initial page https://archive.org/details/wait-wait-2000-2005
08:01:39<ParkerR>Got the missing downloaded just waiting for processing to clear before adding the rest
08:13:32knecht420 quits [Quit: The Lounge - https://thelounge.chat]
08:13:45knecht420 (knecht420) joins
08:20:03<asie>The Polish pre-Facebook social media platform focused on schools and universities, Nasza-Klasa, is shutting down today
08:20:23<asie>https://nk.pl/ - might be worth running a job on it
08:20:36<asie>except it's too big to
08:40:44<ArchivalEfforts>asie Archivebot is already running on it, but won't finish
08:40:54<ArchivalEfforts>http://dashboard.at.ninjawedding.org/3/?showNicks=1
09:42:52BlueMaxima quits [Client Quit]
12:00:25<JackeithWelley>I like all those archiveteam domains
13:28:51Iki quits [Ping timeout: 258 seconds]
13:49:17Iki joins
14:42:27Barto quits [Ping timeout: 258 seconds]
14:42:43Barto (Barto) joins
15:03:32Iki quits [Ping timeout: 258 seconds]
15:23:39Iki joins
15:38:52Iki quits [Ping timeout: 250 seconds]
16:16:22Arcorann_ quits [Ping timeout: 258 seconds]
16:35:59LeGoupil joins
16:42:49VerifiedJ quits [Quit: The Lounge - https://thelounge.chat]
16:43:20VerifiedJ (VerifiedJ) joins
16:50:46LeGoupil quits [Client Quit]
16:52:40DogsRNice (Webuser299) joins
16:53:35DogsRNice quits [Read error: Connection reset by peer]
16:53:50DogsRNice (Webuser299) joins
17:07:56notbasetwo quits [Quit: o/]
17:12:21notbasetwo joins
17:13:05archivalefforts_ joins
17:13:55archivalefforts_ quits [Client Quit]
17:27:12G4te_Keep3r quits [Ping timeout: 250 seconds]
17:27:40lunik1 quits [Ping timeout: 258 seconds]
17:55:09BinzyBoi quits [Client Quit]
18:35:07HP_Archivist (HP_Archivist) joins
18:36:36lunik1 joins
18:40:39SenileOvaltine joins
19:21:27<DogsRNice>https://twitter.com/BabyLamb5/status/1420064893395365889?s=20
19:21:56<DogsRNice>might be worth archiving content related to arthur
20:07:48ParkerR73 joins
20:08:07<@EggplantN>fionera: hmmmmmmmmmmmmm
20:08:15<@EggplantN>fus l just showed me your cursed shit
20:21:17<Frogging101>?
20:39:02<AK>Don't worry Frogging101, it's probably something weird
20:39:17<@arkiver>most definitely*
20:39:37<AK>EggplantN, thought's on Hawkes Urban Orchard?
20:42:13<@Kaz>i had a can once
20:42:36<@Kaz>i don't think it was terrible, but it's been a while
20:48:40<AK>It's probably my new favourite drink tbh, fully expecting to be shamed for that though haha
20:57:28<@EggplantN>Never tried AK I always just brew it instead
20:57:34<@EggplantN>Tons cheaper and tastes better
21:29:10Mateon1 quits [Remote host closed the connection]
21:29:16Mateon1 joins
21:30:50<AK>That makes sense, I do want to try brewing at some point
21:35:04useretail quits [Read error: Connection reset by peer]
21:35:28useretail joins
21:49:06<fionera>EggplantN: thats not curse
21:49:07<fionera>d
21:49:47ParkerR73 quits [Remote host closed the connection]
22:32:50OrIdow6 (OrIdow6) joins
22:32:50@ChanServ sets mode: +o OrIdow6
22:49:46BlueMaxima joins
22:54:23BlueMaxima quits [Client Quit]
23:02:34useretail quits [Read error: Connection reset by peer]
23:10:15useretail joins
23:32:13Arcorann_ joins
23:48:03ParkerR quits [Remote host closed the connection]
23:51:29sec^nd quits [Ping timeout: 276 seconds]