| 00:01:11 | | dm4v_ joins |
| 00:01:11 | | dm4v quits [Read error: Connection reset by peer] |
| 00:01:23 | | dm4v_ is now known as dm4v |
| 00:01:26 | | dm4v is now authenticated as dm4v |
| 00:01:26 | | dm4v quits [Changing host] |
| 00:01:26 | | dm4v (dm4v) joins |
| 00:08:37 | | Ruthalas9 (Ruthalas) joins |
| 00:10:24 | | Ruthalas quits [Ping timeout: 250 seconds] |
| 00:10:24 | | Ruthalas9 is now known as Ruthalas |
| 00:37:49 | | Arcorann joins |
| 00:37:49 | | Arcorann is now authenticated as Arcorann |
| 01:01:22 | | mileclipses quits [Remote host closed the connection] |
| 01:02:26 | | dm4v quits [Read error: Connection reset by peer] |
| 01:05:08 | | dm4v joins |
| 01:05:10 | | dm4v is now authenticated as dm4v |
| 01:05:10 | | dm4v quits [Changing host] |
| 01:05:10 | | dm4v (dm4v) joins |
| 01:28:27 | | HP_Archivist (HP_Archivist) joins |
| 01:33:55 | | Video quits [Ping timeout: 252 seconds] |
| 01:34:58 | | Megame quits [Client Quit] |
| 01:42:55 | | Video joins |
| 02:16:48 | | Video quits [Ping timeout: 244 seconds] |
| 02:24:47 | | Atom joins |
| 02:42:48 | | Video joins |
| 02:44:47 | | Arcorann quits [Remote host closed the connection] |
| 02:51:56 | | qwertyasdfuiopghjkl quits [Ping timeout: 244 seconds] |
| 02:52:31 | | qwertyasdfuiopghjkl joins |
| 03:04:22 | | jacobk joins |
| 03:10:43 | | jacobk quits [Ping timeout: 252 seconds] |
| 03:12:17 | | AntiLiberal joins |
| 03:16:44 | | Video quits [Ping timeout: 244 seconds] |
| 03:18:49 | | EdSavoie_srv quits [Remote host closed the connection] |
| 03:24:38 | | jacobk joins |
| 03:42:40 | | Video joins |
| 03:43:52 | | qw3rty__ joins |
| 03:46:38 | | phillipsjk256 quits [Ping timeout: 250 seconds] |
| 03:47:30 | | qw3rty_ quits [Ping timeout: 250 seconds] |
| 04:04:55 | | Campbell joins |
| 04:16:32 | | Video quits [Ping timeout: 250 seconds] |
| 04:42:37 | | Video joins |
| 04:50:15 | | AntiLiberal quits [Ping timeout: 244 seconds] |
| 05:16:36 | | Video quits [Ping timeout: 244 seconds] |
| 05:29:55 | <@OrIdow6> | Will see about doing estimates on Google Drive |
| 05:30:28 | <@OrIdow6> | Will be naive, but may give an idea of how big the problem is |
| 05:42:07 | | Video joins |
| 05:42:35 | <@OrIdow6> | Confusing this with Mediafire |
| 06:16:08 | | Video quits [Ping timeout: 250 seconds] |
| 06:41:58 | | Video joins |
| 07:00:24 | | wickedplayer494 is now authenticated as wickedplayer494 |
| 07:15:57 | | Video quits [Ping timeout: 244 seconds] |
| 07:41:40 | | Video joins |
| 07:54:11 | | HP_Archivist quits [Ping timeout: 244 seconds] |
| 08:00:08 | | britmob256 quits [Quit: britmob256] |
| 08:01:48 | | Arcorann (Arcorann) joins |
| 08:04:00 | | qwertyasdfuiopghjkl quits [Ping timeout: 244 seconds] |
| 08:15:43 | | Video quits [Ping timeout: 250 seconds] |
| 08:41:33 | | Video joins |
| 09:15:32 | | Video quits [Ping timeout: 250 seconds] |
| 09:41:32 | | Video joins |
| 10:15:14 | | Video quits [Ping timeout: 244 seconds] |
| 10:41:15 | | Video joins |
| 11:31:36 | | balrog quits [Ping timeout: 250 seconds] |
| 11:44:06 | | jacobk quits [Ping timeout: 244 seconds] |
| 11:47:46 | | jacobk joins |
| 11:48:40 | <@arkiver> | OrIdow6: so you were actually talking about mediafire ot? |
| 11:48:42 | <@arkiver> | or* |
| 11:48:55 | <@OrIdow6> | arkiver: No |
| 11:49:10 | <@OrIdow6> | Just remarking that it's structurally similar |
| 11:49:16 | <@arkiver> | on google drive - not sure how much we can do on that |
| 11:49:19 | <@arkiver> | right |
| 11:49:27 | <@arkiver> | do we have URLs? |
| 11:49:32 | <@OrIdow6> | Yeah I suspect it will be big |
| 11:49:41 | <@OrIdow6> | All I've done so far is download some WBM CDX listings |
| 11:50:06 | <@OrIdow6> | So sort of, but not really, since there's a lot of processing to do on those |
| 11:51:11 | | balrog (balrog) joins |
| 11:52:10 | | BlueMaxima quits [Client Quit] |
| 11:52:58 | <@arkiver> | OrIdow6: yeah we're likely looking at 100s of TBs |
| 11:53:09 | <@arkiver> | if we find only a select number of URLs, we could give it a try |
| 11:53:16 | <@OrIdow6> | At least 100s |
| 11:53:16 | <@arkiver> | but i'm not sure about spending 100s of TBs on this |
| 11:53:48 | <@arkiver> | at least youtube will be nicely playable through the wayback machine |
| 11:57:36 | | britmob256 joins |
| 11:57:41 | <Sanqui> | https://github.com/DataHenHQ/till |
| 11:57:43 | <Sanqui> | interesting... |
| 12:05:53 | <@OrIdow6> | Anyhow, on Google Drive, what I plan to do is get a little prototype for the grab process written first, then run that on a sample of URLs |
| 12:08:02 | <@arkiver> | sure |
| 12:08:15 | <@arkiver> | OrIdow6: do you have a sample of URLs available? do i know what type of data this is |
| 12:08:42 | <@arkiver> | and well, i think we'll not get 100s of TBs of google drive to be honest - unless we find very interesting data sources |
| 12:12:29 | <@arkiver> | OrIdow6: any rough estimate btw when you might have something to check? no worries if not yet |
| 12:13:32 | <@OrIdow6> | arkiver: Here are some random lines from WBM CDX, this is only from 1 URL format of at least 2 https://transfer.archivete.am/WSejD/some_gdrive_from_cdx |
| 12:13:40 | <@OrIdow6> | No rough estimate yet |
| 12:14:39 | <@OrIdow6> | Got my attention dragged away from it fairly quickly |
| 12:20:33 | <h2ibot> | Usernam edited List of websites excluded from the Wayback Machine (+37): https://wiki.archiveteam.org/?diff=47028&oldid=46979 |
| 12:20:34 | <h2ibot> | TheTechRobo edited Deathwatch (+176, add Enderman): https://wiki.archiveteam.org/?diff=47029&oldid=47019 |
| 12:21:34 | <h2ibot> | Beano edited Why Back Up? (+44): https://wiki.archiveteam.org/?diff=47030&oldid=37344 |
| 12:21:35 | <h2ibot> | M.RITA edited Deathwatch (+212): https://wiki.archiveteam.org/?diff=47031&oldid=47029 |
| 12:21:36 | <h2ibot> | Beano edited YouTube (+1328, Archival incentives): https://wiki.archiveteam.org/?diff=47032&oldid=47024 |
| 12:21:37 | <h2ibot> | Gridkr edited Coronavirus (+106, /* Thailand */): https://wiki.archiveteam.org/?diff=47033&oldid=47005 |
| 12:33:04 | | Ryz quits [Remote host closed the connection] |
| 12:34:30 | | Ryz (Ryz) joins |
| 12:38:20 | | shoghicp quits [Ping timeout: 250 seconds] |
| 12:43:09 | | shoghicp (shoghicp) joins |
| 12:44:44 | | shoghicp quits [Client Quit] |
| 12:45:39 | | jacobk quits [Client Quit] |
| 12:46:05 | | shoghicp (shoghicp) joins |
| 12:46:40 | | jacobk joins |
| 13:00:52 | | Video quits [Ping timeout: 250 seconds] |
| 13:02:14 | | Video joins |
| 13:27:19 | <JensRex> | The danish version of The Daily Stormer is shutting down --> https://dagensblaeser.net/ |
| 13:27:23 | <JensRex> | Announcement: https://dagensblaeser.net/2021/08/03/dagens-blaeser-siger-tak-for-denne-gang/ |
| 13:28:12 | <JensRex> | "Turning off saturday evening 7th august." |
| 13:29:16 | <JensRex> | I gotta head out for a bit, but I just came across this. |
| 13:30:01 | <rewby> | Oh that's not good\ |
| 13:32:28 | <JensRex> | They had a podcast as well with 156 episodes as far as I can tell. |
| 13:32:34 | <JensRex> | http://radio266b.libsyn.com/rss |
| 13:33:07 | <JensRex> | Really gone this time, I'm super duper late... |
| 14:01:20 | | Minkafighter2 quits [Client Quit] |
| 14:01:36 | | Minkafighter2 joins |
| 14:04:54 | | Minkafighter24 joins |
| 14:06:11 | | Minkafighter2 quits [Ping timeout: 244 seconds] |
| 14:06:11 | | Minkafighter24 is now known as Minkafighter2 |
| 14:16:14 | | monoxane7 (monoxane) joins |
| 14:18:04 | | monoxane quits [Ping timeout: 244 seconds] |
| 14:18:05 | | monoxane7 is now known as monoxane |
| 14:42:59 | | Megame (Megame) joins |
| 15:05:56 | | AntiLiberal joins |
| 15:07:24 | | monoxane quits [Ping timeout: 250 seconds] |
| 15:20:37 | | monoxane (monoxane) joins |
| 15:21:09 | | Megame quits [Client Quit] |
| 15:26:04 | | Arcorann quits [Ping timeout: 252 seconds] |
| 15:42:33 | | Campbell leaves |
| 15:42:42 | | Campbell joins |
| 15:42:50 | <@arkiver> | JensRex: thanks, it's in archivebot |
| 15:56:38 | | qwertyasdfuiopghjkl joins |
| 16:03:57 | | j joins |
| 16:05:33 | | TheTechRobo joins |
| 16:05:48 | <TheTechRobo> | I'm running grab-site, and my wpull process seems to have crashed |
| 16:06:09 | <TheTechRobo> | Or at least frozen |
| 16:06:23 | <TheTechRobo> | I made my computer fall asleep, forgetting that it was running. |
| 16:06:53 | <TheTechRobo> | I tried disabling the Internet for a few seconds to try to get a Broken pipe error, to no avail. I also tried pausing the progress for a few seconds to get a timeout, also to no avail. |
| 16:07:17 | <TheTechRobo> | Is there any way to fix this? |
| 16:07:38 | | jacobk quits [Ping timeout: 250 seconds] |
| 16:07:51 | <TheTechRobo> | Ah, nevermind...it seems to have continued just as I asked! |
| 16:08:16 | | TheTechRobo quits [Remote host closed the connection] |
| 16:24:35 | | Wayward (wayward) joins |
| 16:35:11 | | jamesp joins |
| 16:40:15 | | AntiLiberal quits [Read error: Connection reset by peer] |
| 16:40:32 | | AntiLiberal joins |
| 17:02:52 | | AntiLiberal quits [Ping timeout: 252 seconds] |
| 17:21:30 | | LeGoupil joins |
| 17:28:54 | | Ryz quits [Remote host closed the connection] |
| 17:30:48 | | Ryz (Ryz) joins |
| 17:50:28 | | atirclog quits [Quit: Bye] |
| 17:50:28 | | Connection closed. |
| 17:51:30 | | atirclog (atirclog) joins |
| 17:51:30 | | Topic: Lengthy Archive Team related discussions here | General archiving & offtopic: #archiveteam-ot | https://twitter.com/textfiles/status/1069715869994020867 |
| 17:51:30 | | Topic set by JAA at 2021-03-26 20:19:18Z |
| 17:51:38 | | Current users: atirclog (atirclog), Ryz (Ryz), LeGoupil, jamesp, Wayward (wayward), j, qwertyasdfuiopghjkl, Campbell, monoxane (monoxane), Minkafighter2, Video, shoghicp (shoghicp), britmob256, balrog (balrog), qw3rty__, Atom, dm4v (dm4v), Ruthalas (Ruthalas), Stiletto, lennier1 (lennier1), wyatt8740, Mateon1, pekster (pekster), knecht420 (knecht420), cpina, wickedplayer494 (wickedplayer494), pabs (pabs), G4te_Keep3r, GunDigger, Wingy (Wingy), Iki, h3ndr1k (h3ndr1k), driib (driib), mutantmonkey (mutantmonkey), fuzzy8021 (fuzzy8021), nico_32 (nico), Barto (Barto), duce1337, rsn_, h2ibot (h2ibot), x9fff00 (x9fff00), gazorpazorp, Hackerpcs (Hackerpcs), masterX244 (masterX244), JensRex (JensRex), m0nika (m0nika), Viniter69 (Viniter), yanome (yano), taavi (taavi), robbi5 (robbi5), Mopman, FalconK (FalconK), grawity (grawity), Larsenv (Larsenv), jodizzle (jodizzle), programmerq (programmerq), asie, HackMii (hacktheplanet), simon816 (simon816), kpcyrd (kpcyrd), HotSwap, maxfan8 (maxfan8), avoozl, @AlsoJAA (JAA), pie_, c00k13_, tzt (tzt), Aoede (Aoede), sknebel (sknebel), Ajay, xkey (eyo), holbrooke, Somebody2, atomicthumbs, @arkiver (arkiver), kiskaLogBot, djsrv_ (djsrv), luckcolors (luckcolors), aphitex22, @JAA (JAA), BPCZ (BPCZ), summerisle (summerisle), mrfooooo, starship_8601 (starship_8601), phuzion (phuzion), Soulflare, ArchivalEfforts, treora, Ctrl-S, yawkat` (yawkat), phiresky, xit, [42] (N4Y), cadence- (cadence), revi (revi), jtagcat (jtagcat), nothere_, @chfoo (chfoo), Doran (Doranwen), RKenshin, Sanqui (Sanqui), notbase2, @Fusl_ (Fusl), endrift|ZNC, Frogging101, @Kaz (Kaz), VerifiedJ (VerifiedJ), britm0b, AK (AK), lukash7, HugsNotDrugs`, jmtd, SketchTh1Cow, Gereon (Gereon), Jonboy3451, apache2_, atphoenix_ (atphoenix), benjins (benjins), sec^nd (second), C4K3 (C4K3), @OrIdow6 (OrIdow6), lunik1, Matthww8, swebb, ThreeHM (ThreeHeadedMonkey), wizards, Pingerfowder (Pingerfowder), flashmeow (flashmeow), leo60228 (leo60228), Krownest (Krownest), rewby (rewby), Dj-Wawa (Dj-Wawa), superkuh_, Jake (Jake), sneezey, pm5, meowe (meowe), thuban, Deewiant (Deewiant), jonty (jonty), kiska (kiska), igloo22225, aleph, katocala (katocala), Myself (myself), marked1, RJHacker36297, Nay (JeDa), MrKen, DopefishJustin (DopefishJustin), coderobe (coderobe), s-crypt (s-crypt), flashfire42 (flashfire42), bradp (bradp), wessel1512 (wessel1512), mikael, sembiance (sembiance), Muad-Dib, jspiros (jspiros), Hecz (Hecz), nyany (nyany), Terbium, billy549 (Billy549), chriscoffee (chriscoffee), Suika, @Fusl (Fusl), Craigle (Craigle), voltagex, justaguy, betamax (betamax), celestial, murmur, themadpro (themadpro), girst (girst), @jrwr (jrwr), devsnek (devsnek), russss (russss), Gaelan (Gaelan), @hook54321 (hook54321), jut (jut), colona, tech234a (tech234a), aarchi (aarchi), JSharp (JSharp), mr_archive, Dallas (Dallas), Dragnog, @EggplantN (EggplantN), ats (ats), mgrandi (mgrandi), archzz, @HCross (HCross), pmlo1, @ChanServ, fionera (Fionera), Kinille (Kinille), Lord_Nightmare (Lord_Nightmare), genofire (genofire), kiskaWeebChat (kiska), cm, yano (yano), Mayk78, Eighty (Eighty), lun4 (lun4), ave (ave), @dxrt (dxrt), SCSi (SCSi), _kallsyms, hexa- (hexa-), Jonimus (Jonimus) |
| 17:56:26 | | HP_Archivist (HP_Archivist) joins |
| 17:59:06 | | sec^nd quits [Remote host closed the connection] |
| 18:05:35 | | sec^nd (second) joins |
| 18:07:03 | | LeGoupil quits [Client Quit] |
| 19:02:21 | <JensRex> | rewby: I don't think they'll be missed. |
| 19:03:56 | <JensRex> | From what I can gather, they're shutting down because they aren't getting very much traffic. At least one of the authors hinted at that being an issue previously. |
| 19:41:42 | | lennier1 quits [Ping timeout: 250 seconds] |
| 19:42:02 | | lennier1 (lennier1) joins |
| 20:19:32 | | lennier1 quits [Client Quit] |
| 20:21:51 | | lennier1 (lennier1) joins |
| 20:34:12 | | Video quits [Ping timeout: 244 seconds] |
| 20:35:26 | | AntiLiberal joins |
| 20:40:41 | | Video joins |
| 20:45:24 | | AntiLiberal quits [Ping timeout: 250 seconds] |
| 20:46:49 | | AntiLiberal joins |
| 21:05:20 | | AntiLiberal quits [Ping timeout: 250 seconds] |
| 21:05:46 | | RJHacker36297 quits [Ping timeout: 250 seconds] |
| 21:06:12 | | ave quits [Ping timeout: 250 seconds] |
| 21:06:12 | | lun4 quits [Ping timeout: 250 seconds] |
| 21:07:10 | | ave (ave) joins |
| 21:07:10 | | lun4 (lun4) joins |
| 21:08:28 | | nepeat joins |
| 21:09:26 | | nepeat is now known as RJHacker17275 |
| 21:15:19 | | Video quits [Ping timeout: 252 seconds] |
| 21:39:48 | | Video joins |
| 22:14:10 | | Video quits [Ping timeout: 252 seconds] |
| 22:38:43 | | HP_Archivist quits [Ping timeout: 244 seconds] |
| 22:39:42 | | Video joins |
| 23:38:44 | | BlueMaxima joins |
| 23:42:38 | | Barto quits [Ping timeout: 250 seconds] |
| 23:48:20 | | Barto (Barto) joins |
| 23:56:28 | | jacobk joins |