HomeSearchPrevious dayNext day

00:09:40tzt joins
00:11:17mutantmonkey quits [Remote host closed the connection]
00:11:32mutantmonkey (mutantmonkey) joins
00:16:26fuzzy8021 quits [Read error: Connection reset by peer]
00:16:32BlueMaxima quits [Read error: Connection reset by peer]
00:16:43fuzzy8021 joins
00:16:43fuzzy8021 quits [Changing host]
00:16:43fuzzy8021 (fuzzy8021) joins
00:16:46BlueMaxima joins
00:55:13Peetz1r quits [Client Quit]
00:56:26<lmx>what's the status on Parler?
00:56:53<EggplantN>Best to ask at #neparlepas
00:57:11<lmx>pretty sure you need to be voiced to talk there?
00:57:38<@Kaz>pretty sure you don't
00:58:00<@JAA>No, and even if that was still the case, that doesn't mean asking in another channel is appropriate.
00:58:26<lmx>I guess I should have used -ot
00:58:32<@JAA>No
00:58:58<lmx>alright
00:59:18<lmx>I guess it's not a subject people like talking about
00:59:59<@JAA>That's not my point. If there is a dedicated channel for a project, that's where questions about it belong, and nowhere else.
01:04:20Ajay quits [Remote host closed the connection]
01:21:48Ajay joins
01:35:45BlueMaxima quits [Read error: Connection reset by peer]
01:36:49BlueMaxima joins
01:39:56BlueMaxima quits [Client Quit]
01:57:08<SketchTheCow>Boop
01:57:30<SketchTheCow>archiveteam.org is back. DNS got changed twice, some people will have issues with that, sorry.
01:57:36<EggplantN>excellent
01:58:34<purplebot>File:Pr0gramm-icon.png uploaded by Arkiver (+0) 9 minutes ago -- https://www.archiveteam.org/?diff=46209&oldid=0
01:58:53<EggplantN>LIFE
01:58:55<SketchTheCow>https://internetarchive.archiveteam.org/ is working.
02:41:30<fuzzy8021>seen github getting close to 400tb. whats previous max project size?
02:41:46<@JAA>1.4 PiB from Google+ I think.
02:42:36<fuzzy8021>ahh thanks. couldnt put my finger on that one
02:42:52<@JAA>There's a list of the biggest projects somewhere on the wiki.
02:42:58<@JAA>Also, this is why the navigation box sucks: https://archiveteam.org/index.php?title=Special:WhatLinksHere/Google%2B
02:44:30<@JAA>fuzzy8021: https://archiveteam.org/index.php?title=List_of_largest_ArchiveTeam_projects
02:44:42<fuzzy8021>thanks
02:44:42<@JAA>Could use an update though.
02:44:53<@JAA>Lots of projects from the last few years are missing there.
02:46:10<fuzzy8021>hmm wont load but just https://archiveteam.org/ will
02:52:34<purplebot>URLs created by JustAnotherArchivist (+471, Created page with "{{Infobox project …) just now -- https://www.archiveteam.org/?diff=46210&oldid=0
02:55:58BlueMaxima joins
02:59:03<atphoenix>If additional archiveteam.org subdomains are a possibility, here are a few ideas to unify the URLs to commonly used AT resources:
02:59:04<atphoenix>1.) archivebot.archiveteam.org as an alias to the dashboard we see at http://dashboard.at.ninjawedding.org/ or http://archivebot.com/
02:59:04<atphoenix>2.) archivebotviewer.archiveteam.org as an alias to the https://archive.fart.website/archivebot/viewer/
02:59:04<atphoenix>3.) dash.archiveteam.org as an alias to the https://atdash.meo.ws/ dashboards
02:59:05<atphoenix>4.) docker.archiveteam.org as an alias to atdr.meo.ws docker images
03:22:49BlueMaxima_ joins
03:24:34<purplebot>.eu domains created by JustAnotherArchivist (+1213, Created page with "{{Infobox project …) just now -- https://www.archiveteam.org/?diff=46211&oldid=0
03:25:17BlueMaxima__ joins
03:26:34<purplebot>Current Projects edited by JustAnotherArchivist (+92, Add URLs, link .eu domains page) just now -- https://www.archiveteam.org/?diff=46212&oldid=46196
03:26:44BlueMaxima quits [Ping timeout: 240 seconds]
03:27:40BlueMaxima joins
03:29:04BlueMaxima_ quits [Ping timeout: 240 seconds]
03:30:40BlueMaxima_ joins
03:31:23BlueMaxima__ quits [Ping timeout: 265 seconds]
03:33:59BlueMaxima__ joins
03:34:46BlueMaxima quits [Ping timeout: 265 seconds]
03:37:38<purplebot>MediaFire edited by JustAnotherArchivist (+195, Update status, add details on deletion …) just now -- https://www.archiveteam.org/?diff=46213&oldid=46161
03:38:01BlueMaxima_ quits [Ping timeout: 252 seconds]
03:38:14BlueMaxima__ quits [Client Quit]
03:40:34<purplebot>Deathwatch edited by JustAnotherArchivist (-3, Dead sites are dead) just now -- https://www.archiveteam.org/?diff=46214&oldid=46201
04:15:32qw3rty__ joins
04:18:44qw3rty_ quits [Ping timeout: 240 seconds]
04:20:50Eighty quits [Quit: leaving]
04:24:11Eighty joins
04:35:11Krownest quits [Ping timeout: 265 seconds]
04:39:10Craigle quits [Quit: The Lounge - https://thelounge.chat]
04:40:13Craigle (Craigle) joins
04:40:46Krownest joins
04:48:04Krownest quits [Ping timeout: 240 seconds]
04:50:03etnguyen03 quits [Client Quit]
04:53:41godane1 joins
04:56:04godane quits [Ping timeout: 240 seconds]
04:57:55DogsRNice quits [Read error: Connection reset by peer]
04:58:58Krownest joins
05:10:12godane2 joins
05:12:24godane1 quits [Ping timeout: 240 seconds]
05:25:05lmx quits [Client Quit]
06:06:31SaveDaBits quits [Ping timeout: 252 seconds]
06:55:30godane (godane) joins
06:57:46godane2 quits [Ping timeout: 265 seconds]
07:27:55Mateon1 quits [Ping timeout: 252 seconds]
07:31:54Mateon1 joins
07:34:35Mateon1 quits [Remote host closed the connection]
07:35:49Mateon1 joins
07:40:24Mateon1 quits [Remote host closed the connection]
07:42:51Mateon1 joins
07:45:33Mateon1 quits [Remote host closed the connection]
07:58:10Mateon1 joins
08:00:01Mateon1 quits [Remote host closed the connection]
08:01:22Arcorann (Arcorann) joins
08:04:21Mateon1 joins
08:29:18hooway joins
09:00:18britmob2 quits [Quit: britmob2]
10:20:27hexa- quits [Ping timeout: 600 seconds]
10:24:18hexa- (hexa-) joins
10:28:30Matthww joins
10:49:40godane1 joins
10:52:40godane quits [Ping timeout: 265 seconds]
11:10:30r3v2d0g quits []
12:25:56LeGoupil joins
12:37:40Krownest1 joins
12:38:04sliccricc quits [Ping timeout: 240 seconds]
12:39:06sliccricc (sliccricc) joins
12:40:04Krownest quits [Ping timeout: 240 seconds]
12:53:31LeGoupil quits [Ping timeout: 252 seconds]
12:57:48LeGoupil joins
13:42:19godane1 quits [Ping timeout: 265 seconds]
13:50:16britmob2 joins
13:53:50jeff-kao-propublica-org quits [Client Quit]
14:24:51Arcorann quits [Ping timeout: 265 seconds]
14:28:44Jonboy345 quits [Ping timeout: 240 seconds]
14:28:50Jonboy345 joins
14:35:06Jens quits [Quit: Jens]
14:35:20Jens (JensRex) joins
14:50:34<purplebot>Webzdarma edited by Sanqui (+25, /* ArchiveBot jobs */) just now -- https://www.archiveteam.org/?diff=46215&oldid=46208
15:03:27Ryz quits [Remote host closed the connection]
15:04:45Ryz (Ryz) joins
15:47:31Guest69 joins
15:49:32Guest69 is now known as SaveDaBits
16:17:55DogsRNice (Webuser299) joins
17:00:22<@arkiver>OrIdow6: any news on so-net?
17:32:22jeff-kao-propublica-org joins
18:03:00Mineroboter joins
18:04:01Mineroboter quits [Client Quit]
18:08:13astri52 (astri) joins
18:13:01summerisle quits [Quit: In my vision, I was on the veranda of a vast estate, a palazzo of some fantastic proportion.]
18:13:07summerisle (summerisle) joins
18:14:33<astri52>I just want to ask here about ideas for #youtubearchive after Google Drive stops offering unlimited storage, since over there they admit they don't have any great plans
18:42:02spirit joins
19:00:42<avoozl>JAA, Sanqui: how large are the larger forums? in postcount or number of thread-pages.. I'm tempted to see what kind of size I can currently handle
19:03:36mutantmonkey quits [Remote host closed the connection]
19:03:37sliccricc quits [Write error: Broken pipe]
19:04:47sliccricc (sliccricc) joins
19:06:26mutantmonkey (mutantmonkey) joins
19:06:32<@JAA>avoozl: There are forums with many millions of posts. Not sure what's the largest one we've archived though. A good candidate are the Steam Powered User Forums with 1.36M threads and 14M posts. Archives are at https://archive.org/details/archiveteam_steamforums
19:07:53<avoozl>thanks, that looks good
19:08:09<avoozl>I'm currently looking in detail at the .na. part of the LoL forums
19:08:26<avoozl>i see around 9M pages, so that should be a serious amount of posts too
19:08:50<avoozl>safe to say that if that runs well in my current index structure, I'll be pretty happy
19:09:00<@JAA>:-)
19:09:41<avoozl>I'm currently at the stage where I can do ./warceater --index myindex ingest /big/forums/lol/*.na.*warc.gz and sit back
19:10:09<avoozl>then run ./warceater --index myindex search "id:post1723132" to get a single post or "some keywords" for a full text search
19:10:21<@JAA>Nice
19:10:40<avoozl>next step is to bolt on some JSON and get the web part going, but don't know when I'll have time for that
19:10:57<avoozl>(and maybe run a profiler to see what is eating the most time on ingest)
19:11:59<avoozl>I'll probably need to do a bit of magic on the HTML output part so that hosted images and such can just point to a 'ia archive' hosted version of the same warcs... will look up how that works
19:12:15<avoozl>don't want to reinvent the wheel there
19:14:47<atphoenix>astri52, it isn't clear. Large scale distributed storage might be possibility. https://www.archiveteam.org/index.php?title=Valhalla
19:15:31<astri52>yeah
19:21:34<avoozl>atphoenix: looking at the software list, would nowadays IPFS be an option?
19:24:07<Sanqui>https://archiveteam.org/index.php?title=INTERNETARCHIVE.BAK/ipfs_implementation
19:24:10<Sanqui>welp
19:24:48<avoozl>dated, 2015... *crickets*
19:24:58<@JAA>https://logs.kiska.pw/archiveteam-bs/search?q=ipfs
19:25:52<avoozl>that's a 500 internal server error here
19:27:00<@JAA>Hmm, will dig into that in a second, just try a few times for now.
19:29:53<atphoenix>ipfs:// added to Brave: https://www.zdnet.com/article/brave-becomes-first-browser-to-add-native-support-for-the-ipfs-protocol/
19:34:08Hackerpcs quits [Quit: Hackerpcs]
19:34:28godane (godane) joins
19:35:59Hackerpcs (Hackerpcs) joins
19:36:11godane1 joins
19:38:16atirclog quits [Quit: Bye]
19:38:16Connection closed.
19:38:32atirclog (atirclog) joins
19:38:32Topic: Lengthy Archive Team related discussions here | General archiving & offtopic: #archiveteam-ot | https://twitter.com/textfiles/status/1069715869994020867
19:38:32Topic set by Fusl at 2019-09-06 21:43:01Z
19:38:34Current users: atirclog (atirclog), godane1, Hackerpcs (Hackerpcs), godane (godane), mutantmonkey (mutantmonkey), sliccricc (sliccricc), spirit, summerisle (summerisle), astri52 (astri), jeff-kao-propublica-org, DogsRNice (Webuser299), SaveDaBits, Ryz (Ryz), Jens (JensRex), Jonboy345, britmob2, LeGoupil, Krownest1, Matthww, hexa- (hexa-), hooway, Mateon1, Craigle (Craigle), Eighty, qw3rty__, Ajay, fuzzy8021 (fuzzy8021), tzt, KiiwiiWasTaken (kiiwiiwastaken), jut (jut), themadpro (themadpro), @HCross (HCross), thuban, monoxane (monoxane), Ruthalas (Ruthalas), Muad_Dib, igloo22225 (igloo22225), systwi (systwi), poopsmith, balrog (balrog), Lord_Nightmare (Lord_Nightmare), VerifiedJ (VerifiedJ), atphoenix (atphoenix), prebala-publici, nepeat, no112, colona, @Fusl (Fusl), nertzy (nertzy), lunik1, nerdguy1138 (nerdguy1138), ragu_, BPCZ, betamax (betamax), lennier1 (lennier1), Barto (Barto), aphitex (aphitex), divi (divi), BurritoMan, sec^nd (second), onetruth, TheLovinator, DopefishJustin (DopefishJustin), blue507 (blue507), benjins (benjins), user777, HackMii (hacktheplanet), simon816 (simon816), yawkat (yawkat), tech234a (tech234a), marked1957, AK (AK), DLoader, brad, pgup (pgup), avoozl, treora, aleph, HP_Archivist (HP_Archivist), rsn, revi (revi), lukash7, Doranwen (Doranwen), Datechnom (Datechnom), Zerote_, wickedplayer494 (wickedplayer494), devsnek (devsnek), ColdIce, Mopman (Mopman), groente_, OrIdow6 (OrIdow6), katocala (katocala), ALTROSKY_mystique, Jon (jon), @dxrt (dxrt), SketchTheCow, ave (ave), limb (limb), nico_32, @kiska (kiska), s-crypt (s-crypt), flashfire42 (flashfire42), brabo, vela (vela), HugsNotDrugs (HugsNotDrugs), Kenshin, Jake (Jake), atomicthumbs (atomicthumbs), lincoln1 (lincoln), mjh (mjh), jtt123 (jtt123), JSharp (JSharp), Billy549 (Billy549), holbrooke (holbrooke), yano (yano), archzz, britmob, HotSwap, rolll, Dallas (Dallas), mazet, rewby (rewby), Gaelan (Gaelan), jlu5 (jlu5), endrift, purplebot, sembiance (sembiance), Dj-Wawa (Dj-Wawa), Wingy (Wingy), VonGuard, Larsenv (Larsenv), kpcyrd (kpcyrd), xit, cadence (cadence), Aoede (Aoede), seatsea, Stiletto, @Fusl_ (Fusl), Terbium, EggplantNBot, wessel1512 (wessel1512), @JAA (JAA), luckcolors (luckcolors), mgrandi (mgrandi), Jonimus, FalconK (FalconK), pmlo, @kiskaWeebChat (kiska), ftl, Sanqui (Sanqui), @chfoo (chfoo), @Kaz (Kaz), @arkiver (arkiver), celestial, girst (girst), ThisAsYou, @ChanServ, fionera (Fionera), sknebel (sknebel), nothere, Suika, jodizzle (jodizzle), pie_, Hecz (Hecz), kallsyms, yanome (yano), kiskaLogBot, MrKen, nyany (nyany), klg (klg), step, space (space), EggplantN (EggplantN), justcool393 (justcool393), Ctrl-S, Dragnog, @jrwr (jrwr), voltagex, Kaz__, @hook54321 (hook54321), phuzion (phuzion), c00k13, @AlsoJAA (JAA), programmerq (programmerq), maxfan8 (maxfan8), mupf, deni (deni)
19:38:44godane quits [Ping timeout: 240 seconds]
19:48:53<astri52>I have heard that IFPS has been considered
19:59:16<EggplantN>I assume you mean IPFS. But not that I'm aware of it has been properly considered
19:59:26<EggplantN>I don't know how it would be of any use.
20:03:07<astri52>oh yeah I misspelled it
20:05:56Krownest1 is now known as Krownest
20:14:04sliccricc quits [Ping timeout: 240 seconds]
20:29:27<AK>Question about the wiki and pages like (https://archiveteam.org/index.php?title=ArchiveBot/Google_people), some are not saved yet, will they be automatically saved as they're on the wiki? Or do they get manually triggered?
20:31:03sliccricc (sliccricc) joins
20:33:35<@JAA>The bot that was updating those pages has been out of operation for a while, it wasn't always reliable (which might explain some of those 'Not saved yet'), and its functionality will be integrated into the replacement for the ArchiveBot viewer.
20:34:46<AK>Ahh okay
20:34:58<@JAA>But yes, when it still worked and wasn't malfunctioning, once the archives of an ArchiveBot job showed up on IA, it would be marked as saved on those pages by the bot.
21:32:41BlueMaxima joins
21:37:02LeGoupil quits [Client Quit]
21:37:58c00k13 quits [Quit: bye~]
21:38:34spirit quits [Client Quit]
21:44:56mutantmonkey quits [Remote host closed the connection]
21:45:12mutantmonkey (mutantmonkey) joins
21:53:52c00k13 joins
22:00:08jeff-kao-propublica-org quits [Client Quit]
22:01:06jeff-kao-propublica-org joins
22:23:43astri52 quits [Ping timeout: 244 seconds]
22:51:02astri (astri) joins
23:16:05Arcorann (Arcorann) joins
23:33:28astri quits [Ping timeout: 244 seconds]
23:41:54hooway quits [Client Quit]
23:45:46godane1 quits [Read error: Connection reset by peer]
23:46:21godane (godane) joins
23:51:19Barto quits [Ping timeout: 265 seconds]
23:57:08Barto (Barto) joins
23:59:35astri (astri) joins

HomeSearchPrevious dayNext day