HomeSearchPrevious dayNext day

00:00:34jtagcat quits [Client Quit]
00:02:20jtagcat (jtagcat) joins
00:19:18Megame1_ (Megame) joins
00:21:00Megame quits [Read error: Connection reset by peer]
00:22:36Megame1_ is now known as Megame
00:24:22<nicolas17>wow
00:24:25<nicolas17>my system got all laggy
00:24:30<nicolas17>turns out it was swapping
00:24:42<nicolas17>because the archivebot.com tab was using 3GB of RAM and growing
00:26:51<Pedrosso>Haha. It tends to do that
00:27:41<@JAA>How long did you have it open?
00:27:53<nicolas17>like a minute or two, idk what's up with that
00:28:04<@JAA>I've had it open for hours, and it uses under 200 MB.
00:28:05<nicolas17>I expanded the log of a job
00:28:13<nicolas17>which may have affected it
00:29:24<@JAA>~300 MB when expanding all logs, although it disappeared from about:performance for a bit. lol
00:30:16<@JAA>Firefox, by the way.
00:32:12<nicolas17>I should change my support.apple.com scraping script to not trash my SSD...
00:32:30<@JAA>/dev/shm <3
00:32:47<nicolas17>instead of "rm data/*; download everything; if git diff --quiet; then commit; fi"
00:33:03<nicolas17>I should read the existing file and compare it with what was downloaded, if it's the same then don't write anything
00:33:07icedice quits [Client Quit]
00:36:03<@JAA>Ah
00:56:35<nicolas17>it's like 480MB, I wouldn't want to keep that in memory between runs
01:10:26<Pedrosso>Oh yeah not from like a minute or two, at least for me
02:14:44Arcorann quits [Remote host closed the connection]
02:20:31Arcorann (Arcorann) joins
03:16:59pabs quits [Quit: Don't rest until all the world is paved in moss and greenery.]
03:18:49pabs (pabs) joins
03:29:14M--mlv|m quits [*.net *.split]
03:29:15marius851000 quits [*.net *.split]
03:29:15that_lurker|m quits [*.net *.split]
03:29:15hillow596|m quits [*.net *.split]
03:29:15Nulo|m quits [*.net *.split]
03:29:15sonst-was|m quits [*.net *.split]
03:29:15EvanBoehs|m quits [*.net *.split]
03:29:15alexshpilkin quits [*.net *.split]
03:29:15qq44|m quits [*.net *.split]
03:29:15Misty|m quits [*.net *.split]
03:29:15username675f|m quits [*.net *.split]
03:29:15AntoninDelFabbro|m quits [*.net *.split]
03:29:15Maakuth|m quits [*.net *.split]
03:29:15Peetz0r|m quits [*.net *.split]
03:29:15EmeraldSnorlax|m quits [*.net *.split]
03:29:15kaz__|m quits [*.net *.split]
03:29:15ram|m quits [*.net *.split]
03:29:15Passiing|m quits [*.net *.split]
03:29:15noxious quits [*.net *.split]
03:29:16yetanotherarchiver|m quits [*.net *.split]
03:29:16trumad|m quits [*.net *.split]
03:29:16NickS|m quits [*.net *.split]
03:29:16haha-whered-it-go|m quits [*.net *.split]
03:29:16joepie91|m quits [*.net *.split]
03:29:16gwetchen|m quits [*.net *.split]
03:29:16superusercode quits [*.net *.split]
03:29:16noobirc|m quits [*.net *.split]
03:29:16GRBaset quits [*.net *.split]
03:29:16lasdkfj|m quits [*.net *.split]
03:29:16nyuuzyou quits [*.net *.split]
03:29:16jevinskie quits [*.net *.split]
03:29:16will|m quits [*.net *.split]
03:29:16JC|m quits [*.net *.split]
03:29:16pannekoek11|m quits [*.net *.split]
03:29:16jwoglom|m quits [*.net *.split]
03:29:16gungagungagunga|m quits [*.net *.split]
03:29:17coro quits [*.net *.split]
03:29:17Cydog|m quits [*.net *.split]
03:29:17t3chler|m quits [*.net *.split]
03:29:17akaibu|m quits [*.net *.split]
03:29:17qyxojzh|m quits [*.net *.split]
03:29:17thermospheric quits [*.net *.split]
03:29:17hlgs|m quits [*.net *.split]
03:29:17vexr quits [*.net *.split]
03:29:17Video quits [*.net *.split]
03:29:17Ruk8 quits [*.net *.split]
03:29:17Max|m12 quits [*.net *.split]
03:29:17iCesenberk|m quits [*.net *.split]
03:29:17octylFractal|m quits [*.net *.split]
03:29:17wrangle|m quits [*.net *.split]
03:29:17nosamu|m quits [*.net *.split]
03:29:17masterx244|m quits [*.net *.split]
03:29:17voltagex|m quits [*.net *.split]
03:29:17mikolaj|m quits [*.net *.split]
03:29:17tech234a|m quits [*.net *.split]
03:29:17Roki_100|m quits [*.net *.split]
03:29:17finalti|m quits [*.net *.split]
03:29:18moe-a-m|m quits [*.net *.split]
03:29:18schwarzkatz|m quits [*.net *.split]
03:29:18jackt1365|m quits [*.net *.split]
03:29:18saouroun|m quits [*.net *.split]
03:29:18madpro|m quits [*.net *.split]
03:29:18Minkafighter|m quits [*.net *.split]
03:29:18yzqzss quits [*.net *.split]
03:29:18x9fff00 quits [*.net *.split]
03:29:18Exorcism quits [*.net *.split]
03:29:18phaeton quits [*.net *.split]
03:29:18Tom|m1 quits [*.net *.split]
03:29:18Froxcey|m quits [*.net *.split]
03:29:18manu|m quits [*.net *.split]
03:29:18s-crypt|m|m quits [*.net *.split]
03:29:18CrispyAlice2 quits [*.net *.split]
03:29:18Fletcher quits [*.net *.split]
03:29:18ragu|m quits [*.net *.split]
03:29:18flashfire42|m quits [*.net *.split]
03:29:18MinePlayersPEMyNey|m quits [*.net *.split]
03:29:18Thibaultmol quits [*.net *.split]
03:29:18nstrom|m quits [*.net *.split]
03:29:18Hans5958 quits [*.net *.split]
03:29:18theblazehen|m quits [*.net *.split]
03:29:18mpeter|m quits [*.net *.split]
03:29:18rewby|m quits [*.net *.split]
03:29:18Vokun quits [*.net *.split]
03:29:18tomodachi94 quits [*.net *.split]
03:29:19audrooku|m quits [*.net *.split]
03:29:19britmob|m quits [*.net *.split]
03:29:19xxia|m quits [*.net *.split]
03:29:19cmostracker|m quits [*.net *.split]
03:29:19DigitalDragon quits [*.net *.split]
03:29:19andrewvieyra|m quits [*.net *.split]
03:29:19mind_combatant quits [*.net *.split]
03:29:19@Sanqui|m quits [*.net *.split]
03:29:19igneousx quits [*.net *.split]
03:29:19Ajay quits [*.net *.split]
03:36:24<Ryz>Is there anything else to save from Evernote? Is there user content to get? Considering https://techcrunch.com/2023/11/29/its-official-evernote-will-restrict-free-users-to-50-notes/
03:38:59M--mlv|m joins
03:38:59marius851000 joins
03:38:59that_lurker|m joins
03:38:59hillow596|m joins
03:38:59Nulo|m joins
03:38:59sonst-was|m joins
03:38:59EvanBoehs|m joins
03:38:59qq44|m joins
03:38:59alexshpilkin joins
03:38:59Misty|m joins
03:39:00username675f|m joins
03:39:00AntoninDelFabbro|m joins
03:39:00Maakuth|m joins
03:39:00Peetz0r|m joins
03:39:00EmeraldSnorlax|m joins
03:39:00kaz__|m joins
03:39:00ram|m joins
03:39:00Passiing|m joins
03:39:00noxious joins
03:39:00Exorcism (exorcism) joins
03:39:00JC|m joins
03:39:00s-crypt|m|m joins
03:39:00iCesenberk|m joins
03:39:00qyxojzh|m joins
03:39:00octylFractal|m joins
03:39:00flashfire42|m joins
03:39:00coro joins
03:39:00phaeton (phaeton) joins
03:39:00Vokun (Vokun) joins
03:39:00Video joins
03:39:00yetanotherarchiver|m joins
03:39:00noobirc|m joins
03:39:00cmostracker|m joins
03:39:00gungagungagunga|m joins
03:39:00Tom|m1 joins
03:39:00Cydog|m joins
03:39:00trumad|m joins
03:39:00Roki_100|m joins
03:39:00nosamu|m joins
03:39:00jwoglom|m joins
03:39:00Max|m12 joins
03:39:00manu|m joins
03:39:00superusercode (superusercode) joins
03:39:00nyuuzyou (nyuuzyou) joins
03:39:00vexr joins
03:39:00wrangle|m joins
03:39:00moe-a-m|m joins
03:39:00Hans5958 (Hans5958) joins
03:39:00will|m joins
03:39:00jevinskie (jevinskie) joins
03:39:00gwetchen|m joins
03:39:00yzqzss (yzqzss) joins
03:39:00CrispyAlice2 (CrispyAlice2) joins
03:39:00voltagex|m joins
03:39:00tomodachi94 (tomodachi94) joins
03:39:00Fletcher (Fletcher) joins
03:39:00Thibaultmol joins
03:39:00finalti|m joins
03:39:00lasdkfj|m joins
03:39:00Minkafighter|m joins
03:39:00GRBaset (GRBaset) joins
03:39:00Froxcey|m joins
03:39:00Sanqui|m (Sanqui) joins
03:39:00masterx244|m joins
03:39:00akaibu|m joins
03:39:00DigitalDragon (DigitalDragon) joins
03:39:00NickS|m joins
03:39:00igneousx (igneousx) joins
03:39:00Ajay joins
03:39:00audrooku|m joins
03:39:00schwarzkatz|m joins
03:39:00ragu|m joins
03:39:00britmob|m joins
03:39:00madpro|m joins
03:39:00x9fff00 (x9fff00) joins
03:39:00jackt1365|m joins
03:39:00t3chler|m joins
03:39:00haha-whered-it-go|m joins
03:39:00saouroun|m joins
03:39:00mind_combatant joins
03:39:00nstrom|m joins
03:39:00theblazehen|m joins
03:39:00andrewvieyra|m joins
03:39:00hlgs|m joins
03:39:00xxia|m joins
03:39:00mpeter|m joins
03:39:00thermospheric (Thermospheric) joins
03:39:00mikolaj|m joins
03:39:00Ruk8 (Ruk8) joins
03:39:00MinePlayersPEMyNey|m joins
03:39:00tech234a|m joins
03:39:00ing.hackint.org sets mode: +o Sanqui|m
03:39:00pannekoek11|m joins
03:39:00joepie91|m joins
03:39:00rewby|m joins
03:39:05coderobe quits [Max SendQ exceeded]
03:39:26coderobe (coderobe) joins
03:40:05<nicolas17>Ryz: I think it's all private content sooo
03:41:25<lindowsME>Hey were the videos from funnyordie.com saved?
03:41:25<lindowsME>they're not on the site anymore (since years ago), but seem to all still be on S3. the old cdn used to redirect, now 404s.
03:41:35<lindowsME>https://web.archive.org/cdx/search/cdx?url=vo.fod4.com/v/*&limit=1000
03:41:41<lindowsME>https://web.archive.org/cdx/search/cdx?url=http://s3.amazonaws.com/production.videos.funnyordie.com/v/*&limit=1000
03:42:11<lindowsME>archive.org 403s
03:54:43qwertyasdfuiopghjkl quits [Remote host closed the connection]
03:54:51qwertyasdfuiopghjkl (qwertyasdfuiopghjkl) joins
03:56:18qwertyasdfuiopghjkl quits [Excess Flood]
03:58:12qwertyasdfuiopghjkl (qwertyasdfuiopghjkl) joins
04:05:35kitonthe2et quits [Ping timeout: 272 seconds]
04:05:55kitonthe1et joins
04:11:17kitonthe1et quits [Ping timeout: 272 seconds]
04:12:56M--mlv|m quits [*.net *.split]
04:12:58marius851000 quits [*.net *.split]
04:12:58that_lurker|m quits [*.net *.split]
04:12:58hillow596|m quits [*.net *.split]
04:12:58Nulo|m quits [*.net *.split]
04:12:58sonst-was|m quits [*.net *.split]
04:12:58EvanBoehs|m quits [*.net *.split]
04:12:58qq44|m quits [*.net *.split]
04:12:58alexshpilkin quits [*.net *.split]
04:12:58Misty|m quits [*.net *.split]
04:12:58username675f|m quits [*.net *.split]
04:12:58AntoninDelFabbro|m quits [*.net *.split]
04:12:58Maakuth|m quits [*.net *.split]
04:12:58Peetz0r|m quits [*.net *.split]
04:12:58EmeraldSnorlax|m quits [*.net *.split]
04:12:58kaz__|m quits [*.net *.split]
04:12:58ram|m quits [*.net *.split]
04:12:58Passiing|m quits [*.net *.split]
04:12:58noxious quits [*.net *.split]
04:12:58yetanotherarchiver|m quits [*.net *.split]
04:12:58trumad|m quits [*.net *.split]
04:12:58NickS|m quits [*.net *.split]
04:12:58haha-whered-it-go|m quits [*.net *.split]
04:12:58joepie91|m quits [*.net *.split]
04:12:58gwetchen|m quits [*.net *.split]
04:12:58superusercode quits [*.net *.split]
04:12:58noobirc|m quits [*.net *.split]
04:12:58lasdkfj|m quits [*.net *.split]
04:12:58GRBaset quits [*.net *.split]
04:12:58nyuuzyou quits [*.net *.split]
04:12:58jevinskie quits [*.net *.split]
04:12:59will|m quits [*.net *.split]
04:12:59JC|m quits [*.net *.split]
04:12:59pannekoek11|m quits [*.net *.split]
04:12:59jwoglom|m quits [*.net *.split]
04:12:59gungagungagunga|m quits [*.net *.split]
04:12:59coro quits [*.net *.split]
04:12:59Cydog|m quits [*.net *.split]
04:13:00t3chler|m quits [*.net *.split]
04:13:00akaibu|m quits [*.net *.split]
04:13:00qyxojzh|m quits [*.net *.split]
04:13:00hlgs|m quits [*.net *.split]
04:13:00thermospheric quits [*.net *.split]
04:13:00vexr quits [*.net *.split]
04:13:00Video quits [*.net *.split]
04:13:00Ruk8 quits [*.net *.split]
04:13:00iCesenberk|m quits [*.net *.split]
04:13:00octylFractal|m quits [*.net *.split]
04:13:00wrangle|m quits [*.net *.split]
04:13:00nosamu|m quits [*.net *.split]
04:13:00Max|m12 quits [*.net *.split]
04:13:00masterx244|m quits [*.net *.split]
04:13:00voltagex|m quits [*.net *.split]
04:13:00mikolaj|m quits [*.net *.split]
04:13:00tech234a|m quits [*.net *.split]
04:13:00Roki_100|m quits [*.net *.split]
04:13:00finalti|m quits [*.net *.split]
04:13:01moe-a-m|m quits [*.net *.split]
04:13:01schwarzkatz|m quits [*.net *.split]
04:13:01jackt1365|m quits [*.net *.split]
04:13:01saouroun|m quits [*.net *.split]
04:13:01madpro|m quits [*.net *.split]
04:13:01Minkafighter|m quits [*.net *.split]
04:13:01yzqzss quits [*.net *.split]
04:13:01x9fff00 quits [*.net *.split]
04:13:01Exorcism quits [*.net *.split]
04:13:01phaeton quits [*.net *.split]
04:13:01Tom|m1 quits [*.net *.split]
04:13:01Froxcey|m quits [*.net *.split]
04:13:01manu|m quits [*.net *.split]
04:13:01s-crypt|m|m quits [*.net *.split]
04:13:01CrispyAlice2 quits [*.net *.split]
04:13:02Fletcher quits [*.net *.split]
04:13:02ragu|m quits [*.net *.split]
04:13:02flashfire42|m quits [*.net *.split]
04:13:02MinePlayersPEMyNey|m quits [*.net *.split]
04:13:02Thibaultmol quits [*.net *.split]
04:13:02nstrom|m quits [*.net *.split]
04:13:02Hans5958 quits [*.net *.split]
04:13:02theblazehen|m quits [*.net *.split]
04:13:02mpeter|m quits [*.net *.split]
04:13:02rewby|m quits [*.net *.split]
04:13:02tomodachi94 quits [*.net *.split]
04:13:02Vokun quits [*.net *.split]
04:13:02audrooku|m quits [*.net *.split]
04:13:02britmob|m quits [*.net *.split]
04:13:02xxia|m quits [*.net *.split]
04:13:02cmostracker|m quits [*.net *.split]
04:13:02andrewvieyra|m quits [*.net *.split]
04:13:02DigitalDragon quits [*.net *.split]
04:13:02mind_combatant quits [*.net *.split]
04:13:02@Sanqui|m quits [*.net *.split]
04:13:02igneousx quits [*.net *.split]
04:13:02Ajay quits [*.net *.split]
04:16:50kitonthe1et joins
04:21:50kitonthe1et quits [Ping timeout: 240 seconds]
04:34:02kitonthenet joins
04:40:25kitonthenet quits [Ping timeout: 272 seconds]
05:35:45Megame quits [Client Quit]
06:19:13Irene quits [Quit: WeeChat 3.8]
06:26:49Irenes (ireneista) joins
06:35:20lflare quits [Ping timeout: 240 seconds]
06:44:27DogsRNice quits [Read error: Connection reset by peer]
06:44:32lflare (lflare) joins
07:04:08hitgrr8 joins
08:34:52Doran (Doranwen) joins
08:35:23Doranwen quits [Ping timeout: 272 seconds]
08:46:53decky_e joins
08:49:57decky quits [Ping timeout: 272 seconds]
09:34:53qwertyasdfuiopghjkl quits [Client Quit]
09:39:49Wohlstand (Wohlstand) joins
09:48:28qwertyasdfuiopghjkl (qwertyasdfuiopghjkl) joins
10:00:01Bleo1826 quits [Client Quit]
10:00:26Wohlstand quits [Client Quit]
10:01:21Bleo1826 joins
10:08:43Island quits [Read error: Connection reset by peer]
10:52:54neggles quits [Quit: bye friends - ZNC - https://znc.in]
11:00:16parfait_ quits [Quit: Leaving]
11:30:34BornOn420_ quits [Quit: https://quassel-irc.org - Chat comfortably. Anywhere.]
11:35:45BornOn420 (BornOn420) joins
11:39:08decky_e quits [Read error: Connection reset by peer]
11:39:48decky_e joins
11:52:18Inti83 joins
11:53:12<Inti83>Hi, I am here with a request similar to EndOfTerm archive but for Argentina, as the incoming government has already stated it's intent to dismantle most agencies
11:54:10<Inti83>We are already working on archiving the data by downloading it as wee understand archive.org doesn't necessarily automatically index all pages. We understand ArchiveBot helps with this
11:54:36<Inti83>The new term starts on 10th of December
11:55:20<Inti83>We have compiled a list of sites which is not exchaustive
11:55:36<Inti83>I found argentina.gob.ar and educ.ar in the archive but there are quite a few more that are not
11:56:33<Inti83>It would be prefereable to have the sites in archive.org rather than just downloading for preservation as this ensures public access to all whereas the distribution aspect after downloading is complex
12:06:42<Inti83>Some of the content is multimedia and we are having a hard time knowing how to archive it
12:06:57<Inti83>Example https://www.cont.ar/
12:14:41<@Sanqui>Inti83: Hello, please stick around, we're definitely able to help with this.
12:15:27<@Sanqui>ArchiveBot is able to crawl and download many websites, which then get uploaded to the Internet Archive and become possible to browse in the Wayback Machine
12:15:35<@Sanqui>It has its limitations though
12:15:54<@Sanqui>A good start would be to create a page on the wiki with a list of websites, then we can make notes for if individual websites were successful to crawl with ArchiveBot
12:16:11<@Sanqui>(BTW, I can't access cont.ar at all over here at Europe. I'm getting a Cloudflare block page.)
12:17:13<Inti83>Hi, cloudflare may be a problem, we encountered some problems with this even at this end
12:17:32<Inti83>OK, I'll get started on a wiki page
12:28:18neggles (neggles) joins
12:33:13<Inti83> What is a good nomeclature for such a page?
12:38:47Inti83 quits [Ping timeout: 243 seconds]
12:47:59Inti joins
12:56:00Inti quits [Remote host closed the connection]
13:10:20Arcorann quits [Ping timeout: 240 seconds]
13:13:27Wohlstand (Wohlstand) joins
13:25:20kiryu quits [Ping timeout: 240 seconds]
13:27:51kiryu joins
13:27:51kiryu quits [Changing host]
13:27:51kiryu (kiryu) joins
13:29:49Ketchup901 (Ketchup901) joins
13:44:27Inti83 joins
13:45:21<Inti83>Hi, I keep getting disconnected. I wrote earlier about an End Of Term archive for Argentina. I was wondering how to follow nomenclature norms in order to start a new page and add the links as suggested?
13:45:44<Inti83>There's a Government Backup page but it is US based
13:48:06<thuban>Inti83: "Argentina" is fine (we have a number of country pages, and can always add other sections/subpages as needed)
13:48:21<Inti83>ok
14:03:00eroc1990 quits [Client Quit]
14:03:24eroc1990 (eroc1990) joins
14:18:45<Inti83>Hey, OK. I sent the page for review
14:19:13<Inti83>It has a list of pages we have compiled so far as relevant, although we have issued out a call so will be most likely adding more
14:20:55<Inti83>I'll likely get disconnected again soon but I will connect again when poss
14:21:07Inti83 quits [Remote host closed the connection]
14:33:06Inti83 joins
14:51:42kitonthenet joins
14:56:20kitonthenet quits [Ping timeout: 240 seconds]
15:01:02<@rewby|backup>Inti83: I've approved your page.
15:01:09<Inti83>Thank you!
15:01:29<h2ibot>Inti83 created Argentina (+4734, Add cultural links & YT): https://wiki.archiveteam.org/?title=Argentina
15:05:40<Inti83>Thanks, we are going to test using grab-site to save these. If this works, do we consider the site saved? Or how do you usually proceeed in these cases? This tool: https://github.com/ArchiveTeam/grab-site
15:28:00<TheTechRobo>Inti83: Generally, WARCs from most people won't get added to the Wayback Machine as there is the possibility of tampering. But if it works with grab-site, it will almost certainly work with ArchiveBot as they share the same crawling code
15:35:55sepro quits [Ping timeout: 272 seconds]
15:36:16icedice (icedice) joins
15:47:46kitonthenet joins
15:50:20nfriedly quits [Ping timeout: 240 seconds]
15:58:05Earendil7 quits [Ping timeout: 272 seconds]
16:10:20kitonthenet quits [Ping timeout: 240 seconds]
16:23:16Inti83 quits [Remote host closed the connection]
16:23:47Inti83 joins
16:23:50sepro (sepro) joins
16:34:00Earendil7 (Earendil7) joins
16:38:21kitonthenet joins
16:42:03<Naruyoko>https://abcnews.go.com/Business/google-begins-process-deleting-inactive-gmail-accounts/story?id=105281283
16:42:24<Naruyoko>Have anyone noticed this? Google will start deleting inactive accounts.
16:49:50<Naruyoko>(I wasn't in #googlecrash, so I can't see history)
16:51:59nfriedly joins
16:55:50kitonthenet quits [Ping timeout: 240 seconds]
17:09:11kitonthe2et joins
17:14:50kitonthe2et quits [Ping timeout: 240 seconds]
17:28:01aninternettroll quits [Ping timeout: 272 seconds]
17:33:43Inti83 quits [Remote host closed the connection]
17:37:45kitonthe1et joins
17:41:52aninternettroll (aninternettroll) joins
17:46:23kitonthe1et quits [Ping timeout: 272 seconds]
17:47:14kitonthenet joins
17:55:15kitonthenet quits [Ping timeout: 272 seconds]
18:03:42inti83 joins
18:08:09kitonthe1et joins
18:15:26<nulldata>Naruyoko - Yeah, that is what is prompted the grab for Blogger. #frogger
18:21:02soap joins
18:25:15<Naruyoko>I see
18:26:54<soap>I have a list of ~2000 or so cdn.discordapp.com urls from wiki.tockdom.com, would someone mind adding them to archivebot for me?https://transfer.archivete.am/j5cLW/tockdom_discord_urls.txt
18:26:55<eggdrop>inline (for browser viewing): https://transfer.archivete.am/inline/j5cLW/tockdom_discord_urls.txt
18:27:21<soap>or is there something else I should do with them?
18:27:49<@JAA>soap: Sure, I'll throw them in.
18:28:41<soap>thanks!
18:29:52soap leaves
18:36:23DogsRNice joins
18:39:12sec^nd quits [Remote host closed the connection]
18:39:32sec^nd (second) joins
19:06:00sec^nd quits [Remote host closed the connection]
19:06:12sec^nd (second) joins
19:18:01qwertyasdfuiopghjkl quits [Client Quit]
19:21:20Wohlstand quits [Ping timeout: 240 seconds]
19:24:21<nicolas17>JAA: what are the requirements for an archivebot pipeline?
19:25:18<nicolas17>if there's more .ar sites blocked so they only work from Argentina, it could be a problem
19:25:30<nicolas17>"I can't access cont.ar at all over here at Europe. I'm getting a Cloudflare block page."
19:26:33<inti83>cont.ar and cine.ar have user only content which may be why
19:27:49<@JAA>nicolas17: Right. Stable machine with uptime measured at least in the months. Clean network. For the hardware, SSDs are basically required to operate at an acceptable speed, but otherwise, things can be scaled to fit what's available; the ideal machine would have a good number of CPU cores/threads.
19:28:21<@JAA>RAM is rarely relevant, but more is better for caching.
19:28:30<nicolas17>running an archivebot crawler from a .ar IP would help with those cases, I doubt I can offer hardware for that but maybe I (or inti83) can find people who can?
19:29:08<@JAA>For a more targeted project rather than a general pipeline, the uptime requirement would be less strict, I suppose.
19:29:24<inti83>is that something like grab-site?
19:29:27<@JAA>Since we'll want to archive these things within weeks anyway.
19:29:35<inti83>yes; i think i can find people
19:29:40<inti83>what do i need to do?
19:29:41<@JAA>grab-site is essentially a local version of ArchiveBot.
19:30:56<@JAA>'Local' as in 'not distributed'; AB has a control node to coordinate the different machines (pipelines).
19:31:15<inti83>how would we run the archivebot from here?
19:32:03<nicolas17>I think I know people with servers inside the Cabase IXP :D
19:33:54<inti83>cool let me know and i can ask people who are on this whether they have the hardware capacity, may be possible
19:34:21<@JAA>So the AB setup is fairly messy, and the install notes aren't entirely complete I think. If I can get access to a suitable server provided by a trustworthy party, I can set it up.
19:35:03<pokechu22>I assume this would be set up as a matchonly pipeline (though probably without matchonly in the name so that -p matchonly doesn't hit it), to avoid long-running jobs accidentally ending up on it?
19:35:48<@JAA>Yes
20:03:51BlueMaxima joins
20:14:09riku quits [Quit: WeeChat 4.1.1]
20:14:30riku (riku) joins
20:17:20<nicolas17>I just found something interesting for future data-analysis purposes, archive.org has "access-control-allow-origin: *", so you can make client-side JS code to eg. get a cdx file and process it and return the extracted data, and do distributed computing by just giving people a link, kind of like the imgur bruteforce thing :D
20:45:07<inti83>do you have any tips on archiving atom archives? we are having some trouble: https://share.riseup.net/#G_1seXPsbK1wKVUwdMCNpw
20:47:30wickedplayer494 quits [Remote host closed the connection]
20:50:37<inti83>so many links
20:51:24<pokechu22>That probably needs ignores of some sort but I don't have any specific recomendations
20:53:28<inti83>yeah, sadly this endpoint is used for everything: it always goes through it :/
20:53:52<@JAA>It looks like there is filter faceting, but that might not be the only thing.
20:57:44IDK (IDK) joins
21:01:30wickedplayer494 joins
21:15:16andrew quits [Client Quit]
21:18:39rewby|m joins
21:21:50joepie91|m joins
21:21:50pannekoek11|m joins
21:21:50MinePlayersPEMyNey|m joins
21:21:50Sanqui|m (Sanqui) joins
21:21:50Ruk8 (Ruk8) joins
21:21:50@ChanServ sets mode: +o Sanqui|m
21:21:50mikolaj|m joins
21:21:50thermospheric (Thermospheric) joins
21:21:50mpeter|m joins
21:21:50hlgs|m joins
21:21:50tech234a|m joins
21:21:50andrewvieyra|m joins
21:21:51xxia|m joins
21:21:51theblazehen|m joins
21:21:51mind_combatant joins
21:21:51nstrom|m joins
21:21:51haha-whered-it-go|m joins
21:21:51saouroun|m joins
21:21:51t3chler|m joins
21:21:51jackt1365|m joins
21:21:51schwarzkatz|m joins
21:21:51madpro|m joins
21:21:51x9fff00 (x9fff00) joins
21:21:51ragu|m joins
21:21:51britmob|m joins
21:21:51audrooku|m joins
21:21:51Ajay joins
21:21:51igneousx (igneousx) joins
21:21:51NickS|m joins
21:21:51akaibu|m joins
21:21:51masterx244|m joins
21:21:51Froxcey|m joins
21:21:51GRBaset (GRBaset) joins
21:21:51DigitalDragon (DigitalDragon) joins
21:21:51Minkafighter|m joins
21:21:51lasdkfj|m joins
21:21:51finalti|m joins
21:21:51Thibaultmol joins
21:21:51manu|m joins
21:21:51tomodachi94 (tomodachi94) joins
21:21:52Fletcher (Fletcher) joins
21:21:52voltagex|m joins
21:21:52yzqzss (yzqzss) joins
21:21:52CrispyAlice2 (CrispyAlice2) joins
21:21:52gwetchen|m joins
21:21:52Hans5958 (Hans5958) joins
21:21:52moe-a-m|m joins
21:21:52wrangle|m joins
21:21:52vexr joins
21:21:52superusercode (superusercode) joins
21:21:52nyuuzyou (nyuuzyou) joins
21:21:52Max|m12 joins
21:21:52jwoglom|m joins
21:21:52Cydog|m joins
21:21:52nosamu|m joins
21:21:52Roki_100|m joins
21:21:52trumad|m joins
21:21:52Tom|m1 joins
21:21:52gungagungagunga|m joins
21:21:52cmostracker|m joins
21:21:52noobirc|m joins
21:21:52yetanotherarchiver|m joins
21:21:52Video joins
21:21:52Vokun (Vokun) joins
21:21:52phaeton (phaeton) joins
21:21:52coro joins
21:21:52flashfire42|m joins
21:21:52octylFractal|m joins
21:21:52qyxojzh|m joins
21:21:52iCesenberk|m joins
21:21:53s-crypt|m|m joins
21:21:53JC|m joins
21:21:53Exorcism (exorcism) joins
21:22:03Passiing|m joins
21:22:03ram|m joins
21:22:03Peetz0r|m joins
21:22:04noxious joins
21:22:04EmeraldSnorlax|m joins
21:22:04kaz__|m joins
21:22:04Maakuth|m joins
21:22:05AntoninDelFabbro|m joins
21:22:05jevinskie (jevinskie) joins
21:22:05will|m joins
21:22:06username675f|m joins
21:22:20alexshpilkin joins
21:22:20EvanBoehs|m joins
21:22:20Misty|m joins
21:22:20qq44|m joins
21:22:21hillow596|m joins
21:22:21sonst-was|m joins
21:22:21that_lurker|m joins
21:22:21Nulo|m joins
21:22:21marius851000 joins
21:24:22inti83 quits [Remote host closed the connection]
21:28:03wickedplayer494 quits [Ping timeout: 272 seconds]
21:34:22andrew (andrew) joins
21:38:26wickedplayer494 joins
21:45:30wickedplayer494 quits [Read error: Connection reset by peer]
21:48:19wickedplayer494 joins
21:54:52aninternettroll quits [Read error: Connection reset by peer]
21:54:54aninternettroll (aninternettroll) joins
22:04:26Island joins
22:09:17hitgrr8 quits [Client Quit]
22:49:31<AK>Woot possibly more AB pipelines?
22:49:33M--mlv|m joins
23:06:46IDK quits [Client Quit]
23:21:32Arcorann (Arcorann) joins
23:51:35Lord_Nightmare quits [Quit: ZNC - http://znc.in]
23:55:34Lord_Nightmare (Lord_Nightmare) joins

HomeSearchPrevious dayNext day