00:00:33Webuser192545 joins
00:01:50<Webuser192545>Hi - is there any way someone can use the archive bot to add this URL(https://docs.crestron.com/en-us/8525/Content/Topics/Home.htm) and all sub-pages to the way back machine? This company is very anti-consumer and may take this down at any moment
00:02:22Webuser192545 quits [Client Quit]
00:12:26cyanbox joins
00:17:57Medaka joins
00:41:29HP_Archivist quits [Read error: Connection reset by peer]
00:42:10HP_Archivist (HP_Archivist) joins
00:43:00HP_Archivist quits [Client Quit]
00:43:15HP_Archivist (HP_Archivist) joins
01:13:30chunkynutz6 quits [Read error: Connection reset by peer]
01:13:44chunkynutz6 joins
01:35:22<@JAA>Larsenv: No
01:47:36pedantic-darwin joins
02:02:48<nicolas17>JAA: what do you think of that crestron request?
02:03:34<@JAA>Very scripty :-/
02:04:00<nicolas17>yeah I meant in terms of "should we"
02:04:07<nicolas17>I'm looking into the technical details now
02:04:11<@JAA><aatt.png>
02:04:24<nicolas17>oh god system-design.htm gets worse
02:04:44<@JAA>There's also ../ stuff, which won't work in AB like that.
02:04:45<nicolas17>this is horrifyingly scripty
02:04:59<@JAA>Probably someone needs to compile a list of URLs. :-|
02:06:43<nicolas17>and I can't find the main code
02:07:33<nicolas17>ah madcap
02:27:41<nicolas17>this seems doable
02:28:08<nicolas17>I'll have to parse HTML, XML, and JSON (extracting it from a JS function call), but doable
02:30:01<@JAA>Sounds lovely :-|
02:30:38<nicolas17>https://docs.crestron.com/en-us/8525/Data/Concepts.js
02:30:50<nicolas17>jsonp?
02:31:07<nicolas17>oh that's not valid json due to the trailing comma, that will make things more fun
03:43:07jinn6 quits [Ping timeout: 258 seconds]
03:48:24ericgallager quits [Quit: This computer has gone to sleep]
03:53:41jinn6 joins
04:11:37ericgallager joins
04:16:31jinn6 quits [Ping timeout: 260 seconds]
04:24:03ericgallager quits [Client Quit]
04:27:41jinn6 joins
04:35:46ericgallager joins
04:44:36<h2ibot>Usernam edited List of websites excluded from the Wayback Machine (-22): https://wiki.archiveteam.org/?diff=55599&oldid=55598
04:45:41datechnoman quits [Ping timeout: 260 seconds]
04:53:08datechnoman (datechnoman) joins
04:57:43ericgallager quits [Client Quit]
05:00:38<h2ibot>Usernam edited List of websites excluded from the Wayback Machine (+262): https://wiki.archiveteam.org/?diff=55600&oldid=55599
05:05:21Medaka quits [Quit: Leaving]
05:17:25Megame quits [Quit: Leaving]
05:35:22Medaka joins
05:56:22ericgallager joins
06:10:42chunkynutz6 quits [Ping timeout: 258 seconds]
06:10:59Wohlstand (Wohlstand) joins
06:40:23chunkynutz6 joins
06:56:17Webuser681976 joins
07:04:23Webuser681976 quits [Client Quit]
07:04:44<pabs>Medaka: ArchiveBot can't set a google/custom UA
07:38:41Island quits [Read error: Connection reset by peer]
07:38:42Island_ quits [Read error: Connection reset by peer]
07:43:03beardicus quits [Quit: Ping timeout (120 seconds)]
07:44:21beardicus (beardicus) joins
08:01:07BornOn420 quits [Remote host closed the connection]
08:01:42BornOn420 (BornOn420) joins
08:04:40<Medaka>pabs: Oh, I see... Thanks for telling me.
09:22:45@Sanqui quits [Ping timeout: 258 seconds]
09:35:57ericgallager quits [Quit: This computer has gone to sleep]
09:36:08Sanqui joins
09:36:10Sanqui quits [Changing host]
09:36:10Sanqui (Sanqui) joins
09:36:10@ChanServ sets mode: +o Sanqui
10:13:29@arkiver quits [Remote host closed the connection]
10:13:44arkiver (arkiver) joins
10:13:44@ChanServ sets mode: +o arkiver
10:16:30MrMcNuggets (MrMcNuggets) joins
10:39:55@arkiver quits [Remote host closed the connection]
10:41:13arkiver (arkiver) joins
10:41:13@ChanServ sets mode: +o arkiver
10:42:23Medaka quits [Quit: Leaving]
10:59:01Dango360 (Dango360) joins
11:00:01Bleo182600722719623455 quits [Quit: The Lounge - https://thelounge.chat]
11:02:54Bleo182600722719623455 joins
11:03:49<BlankEclair>i'm curious how many government sites that AT has archived
11:11:16ducky quits [Ping timeout: 260 seconds]
11:12:14katia2 quits [Remote host closed the connection]
11:12:49ducky (ducky) joins
11:35:04<datechnoman>Id say in some way or another we have archived atleast a few pages from every government site due to our reach
11:39:20<BlankEclair>i was thinking more of a targeted archive of a site instead of a coincidence caused by outlinks
11:39:29<BlankEclair>(and excluding the us gov, we all know that lol)
11:41:58ericgallager joins
11:42:58<datechnoman>in #// I have been queuing millions (over a billion) of any .gov urls that have been found. This leads on to a spider crawl affect as we then archive the sitemap and front page up to 3 clicks in
11:43:19<datechnoman>This is not a full targeted approach like you say, but gives us a good starting point
11:43:32<datechnoman>The sheer amount of data would be enormous if we were to get it all
11:44:05<BlankEclair>close enough, thanks ^_^
11:46:08<datechnoman>But if there are websites your would like us to look at, we can most certainly look into them
11:46:17<datechnoman>Just comes down to size and effort etc
12:51:14etnguyen03 (etnguyen03) joins
13:07:45Megame (Megame) joins
13:11:37nine joins
13:11:37nine quits [Changing host]
13:11:37nine (nine) joins
13:14:02Tugboat joins
13:14:03etnguyen03 quits [Client Quit]
13:15:30<pabs>#UncleSamsArchive did a recursive crawl of .gov .mil I thought
13:26:36ducky quits [Ping timeout: 260 seconds]
13:27:01etnguyen03 (etnguyen03) joins
13:27:49Tugboat quits [Client Quit]
13:33:15Tugboat joins
13:39:40ducky (ducky) joins
13:50:31Tugboat quits [Ping timeout: 260 seconds]
13:50:39nine quits [Client Quit]
13:50:51nine joins
13:50:51nine quits [Changing host]
13:50:51nine (nine) joins
13:58:11Tugboat joins
14:16:56etnguyen03 quits [Client Quit]
14:27:45etnguyen03 (etnguyen03) joins
14:38:49Wohlstand quits [Quit: Wohlstand]
15:01:31<h2ibot>BlankEclair edited WikiTeam (+135, /* Wikifarms */ Add MyWikis): https://wiki.archiveteam.org/?diff=55601&oldid=55394
15:02:55driib9 quits [Quit: The Lounge - https://thelounge.chat]
15:06:05driib9 (driib) joins
15:16:28Dango360 quits [Quit: Leaving]
15:19:40Wohlstand (Wohlstand) joins
15:48:51cyanbox quits [Read error: Connection reset by peer]
16:09:16grill (grill) joins
16:19:29hackbug quits [Remote host closed the connection]
16:29:45hackbug (hackbug) joins
16:34:21ericgallager quits [Quit: This computer has gone to sleep]
16:50:19sec^nd quits [Remote host closed the connection]
16:50:46sec^nd (second) joins
17:12:20grill quits [Ping timeout: 258 seconds]
17:38:05grill (grill) joins
18:02:25sec^nd quits [Ping timeout: 240 seconds]
18:06:22sec^nd (second) joins
18:06:34driib9 quits [Quit: The Lounge - https://thelounge.chat]
18:16:57Wohlstand1 (Wohlstand) joins
18:17:06Wohlstand quits [Ping timeout: 260 seconds]
18:17:06Wohlstand1 is now known as Wohlstand
18:22:59MrMcNuggets quits [Quit: WeeChat 4.3.2]
18:25:03Webuser564052 joins
18:25:11<Webuser564052>I used the wikiteam3 tool to make a backup of my wiki. It did not work for the images, it saved only a few of the 4k pictures. Any help? Wiki is https://handhelds.miraheze.org/wiki/Main_Page
18:32:44<xkey>Webuser564052: sorry to redirect you again, you wanna join #wikiteam
19:18:56grill quits [Ping timeout: 260 seconds]
19:40:27BluRS quits [Read error: Connection reset by peer]
20:12:24dabs joins
20:25:20Island joins
21:11:13lflare quits [Quit: Ping timeout (120 seconds)]
21:16:03lflare (lflare) joins
21:41:27Wohlstand quits [Remote host closed the connection]
21:45:49@kaz quits [Quit: Killed]
21:46:31Megame quits [Quit: Leaving]
21:51:12kaz (Kaz) joins
21:51:12@ChanServ sets mode: +o kaz
22:28:33atirclog (atirclog) joins
22:28:33Topic: Lengthy ArchiveTeam-related discussions, questions here | Offtopic: #archiveteam-ot | https://twitter.com/textfiles/status/1069715869994020867
22:28:33Topic set by JAA at 2021-11-02 03:43:57Z
22:28:46Current users: atirclog (atirclog), CYBERDEV, @kaz (Kaz), lflare (lflare), Island, dabs, Webuser564052, sec^nd (second), hackbug (hackbug), etnguyen03 (etnguyen03), Tugboat, nine (nine), ducky (ducky), Bleo182600722719623455, @arkiver (arkiver), @Sanqui (Sanqui), BornOn420 (BornOn420), beardicus (beardicus), chunkynutz6, datechnoman (datechnoman), jinn6, pedantic-darwin, HP_Archivist (HP_Archivist), wickedplayer494 (wickedplayer494), PredatorIWD25, APOLLO03, lennier2, benjins3_, cmlow, BennyOtt (BennyOtt), Matthww, Yakov (Yakov), LunarianBunny1147 (LunarianBunny1147), croissant, pixel (pixel), evergreen (evergreen), Webuser005265, Sluggs, archiveDrill, some_body, arch, xarph_, beastbg8_, nyakase (nyakase), magmaus3 (magmaus3), Naruyoko, Hackerpcs (Hackerpcs), pabs (pabs), devkev (devkev), Dalek (Dalek), Snivy (Snivy), abirkill (abirkill), kansei (kansei), ymgve_, makeworld, atphoenix (atphoenix), BearFortress, Larsenv (Larsenv), eroc1990 (eroc1990), wyatt8750, Barto (Barto), @rewby (rewby), ichdasich, balrog (balrog), chrismrtn (chrismrtn), szczot3k (szczot3k), feed (feed), runxiyu (runxiyu), bladem (bladem), Radzig, Shjosan (Shjosan), yasomi (yasomi), katocala (katocala), ahm258760, DLoader (DLoader), Medowar (Medowar), entrox, NatTheCat (NatTheCat), bilboed0, chrismeller (chrismeller), phillipsjk, tzt (tzt), Jake (Jake), fionera (Fionera), cow_2001, VerifiedJ (VerifiedJ), danwellby, DigitalDragons (DigitalDragons), nepeat (nepeat), igloo22225 (igloo22225), midou, nulldata (nulldata), notarobot1, cm, pokechu22 (pokechu22), flotwig, simon816 (simon816), khaoohs, aninternettroll (aninternettroll), riteo (riteo), T31M (T31M), kedihacker (kedihacker), Jens (JensRex), useretail, void09, Riku_V (riku), catbottom, DopefishJustin (DopefishJustin), Stagnant_ (Stagnant), CraftByte (DragonSec|CraftByte), xkey (xkey), SDRedneck (SDRedneck), Gadelhas562873784, fuzzy80211 (fuzzy80211), JayEmbee (JayEmbee), legoktm, ax (ax), evanim (evanim), f_ (funderscore), night (night), jspiros (jspiros), IRC2DC, fangfufu (fangfufu), G4te_Keep3r34924156, nicolas17 (nicolas17), Deewiant (Deewiant), Juest (Juest), yano (yano), i_have_n0_idea3 (i_have_n0_idea), sensitiveParrot (sensitiveParrot), ThreeHM (ThreeHeadedMonkey), murb (murb), BlankEclair (BlankEclair), Sokar, Exorcism (exorcism), Ryz (Ryz), @dxrt (dxrt), kiska52, lunik1, tek_dmn (tek_dmn), IDK (IDK), Cronfox (Cronfox), leo60228 (leo60228), emphatic, unlobito (unlobito), girst (girst), klg (klg), Lord_Nightmare (Lord_Nightmare), camrod63 (camrod), skyrocket, AK (AK), hexa (hexa-), endrift, systwi_, emily (pseudorizer), orange (orange), triplecamera|m, gamer191-1|m, hexagonwin (hexagonwin), itrooz (itrooz), programmerq (programmerq), jasons7 (jasons), threedeeitguy6 (threedeeitguy), adamus1red (adamus1red), ThetaDev, clever, ell7 (ell), eythian, TheTechRobo (TheTechRobo), ScenarioPlanet (ScenarioPlanet), Pedrosso, UwU, @Fusl (Fusl), dave (dave), Irenes (ireneista), Coderjo_, ATWF_notcarl, shreyasminocha (shreyasminocha), JTL (JTL), cptcobalt, efi (efi), anarcat (anarcat), Blueacid, luckcolors (luckcolors), kokos, thehedgeh0g (mrHedgehog0), mystique_altrosky, andrewnyr, mrfooooo, @hook54321 (hook54321), billy549 (Billy549), @rewby|backup (rewby), @HCross (HCross), loopy, zifnab06, HugsNotDrugs, nimaje, za3k, mgrandi (mgrandi), JSharp (JSharp), th3ph3d, alexlehm (alexlehm), dan-, ShadowJonathan (ShadowJonathan), murmur, atweedie, Flashfire42 (flashfire42), opl (opl), Czechball, Ryz2 (Ryz), s-crypt (s-crypt), valdikss, codecrafters, mind_combatant (mind_combatant), ATinySpaceMarine, NotGLaDOS, aars, glassy, PhoHale|m, masterX244 (masterX244), Doomaholic (Doomaholic), kiska (kiska), jonty (jonty), seadog007__, justcool393 (justcool393), thejsa, quartermaster, todb, ramsey (ramsey), Swryl, monohedron (monohedron), russss (russss), VonGuard, Ctrl-S, riking, qxtal (qxtal), eggdrop (eggdrop), M--mlv|m, AntoninDelFabbro|m, yarnover|m, gareth48|m, mat|m1, Tyrasuki|m, Valkum|m, rain|m, hillow596|m, saouroun|m, Cronfox|m, kaz__|m, username675f|m, noxious, ram|m, Passiing|m, e2mau|m, ax|m, victor_vaughn|m, Hans5958 (Hans5958), Fijxu|m, katia|m, tech234a (tech234a), th3z0l4|m, szczot3k|m, froxcey|m, tomodachi94 (tomodachi94), spearcat|m, nyuuzyou (nyuuzyou), mister_x, upperbody321|m, anon00001|m, l0rd_enki|m, mikolaj|m, GhostIsBeHere|m, aaq|m, v1cs, bogsen (bogsen), that_lurker|m, Tom|m1, octylFractal|m, flashfire42|m (flashfire42), coro, Vokun (Vokun), Video, Misty|m, noobirc|m, cmostracker|m, trumad|m, Roki_100|m, nosamu|m, Exorcism|m, jwoglom|m, superusercode (superusercode), wrangle|m, will|m, jevinskie (jevinskie), Fletcher (Fletcher), manu|m, Thibaultmol, finalti|m, Minkafighter|m, GRBaset (GRBaset), igneousx (igneousx), audrooku|m, britmob|m, DigitalDragon (DigitalDragon), ragu|m, madpro|m, x9fff00 (x9fff00), jackt1365|m, schwarzkatz|m, nstrom|m, theblazehen|m, andrewvieyra|m, Ruk8 (Ruk8), tech234a|m-backup, pannekoek11|m, @Sanqui|m (Sanqui), nightpool (nightpool), Alienmaster|m, nano412510 (nano412510), Adamvoltagex|m, supermariofan67|m, vics, yetanotherarchiver|m, Nulo|m, s-crypt|m|m, iCesenberk|m, qyxojzh|m, EvanBoehs|m, alexshpilkin, phaeton (phaeton), Cydog|m, MaxG, vexr, moe-a-m|m, CrispyAlice2 (CrispyAlice2), yzqzss (yzqzss), lasdkfj|m, masterx244|m (masterx244|m), akaibu|m, NickS|m, Ajay, haha-whered-it-go|m, hlgs|m, xxia|m, mpeter|m, thermospheric (Thermospheric), MinePlayersPEMyNey|m, joepie91|m, rewby|m, that_lurker (that_lurker), Doranwen (Doranwen), ArchivalEfforts, OctopusET, c3manu (c3manu), jacksonchen666 (jacksonchen666), kf (kf), alittleglitchy, evan, monoxane (monoxane), @JAA (JAA), atluxity, peaches, trix (trix), Miori, asie, @AlsoJAA (JAA), Thijn, inedia (inedia), plcp, d10n, klaffty, Aoede (Aoede), PAARCLiCKS (s4n1ty), Craigle (Craigle), lindowsME, ^ (^), lexikiq, ConstantK, Arachnophine (Arachnophine), mgrytbak, yourfate (yourfate), pie_ (pie_), jodizzle (jodizzle), agtsmith, Soulflare, qw3rty_, Chris5010 (Chris5010), sighsloth1090 (sighsloth1090), Kenshin (Kenshin), @imer (imer), nothere, itachi1706 (itachi1706), colla (colla), tertu (tertu), raccoon (raccoon), ats (ats), Suika, colona (colona), kdy (kdy), mete, Terbium, Meroje (Meroje), fluke, kokos|, angenieux2 (angenieux), monika (boom), lumidify (lumidify), Church (Church), Rince (Rince), neggles (neggles), knecht (knecht), katia_ (katia), szczot3k|t (szczot3k), lurk3r (lurk3r), apache2_, steering (steering), @OrIdow6 (OrIdow6), redbees, mattx433 (mattx433), celestial, phuzion (phuzion), Jonimus, mikael, nickofnicks (nickofnicks), katia (katia), citty, @ChanServ, kpcyrd (kpcyrd), summerisle, [42] (N4Y), FireFly, Jon (Jon), Xesxen (Xesxen), lea (lea_), @chfoo (chfoo), cultpony (cultpony), maxfan8_ (maxfan8), FalconK (FalconK), kallsyms, betamax (betamax), erenrich, siinus (siinus), sknebel (sknebel), Dj-Wawa (Dj-Wawa), Muad-Dib, nyany (nyany), aismallard
22:32:32h2ibot (h2ibot) joins
22:32:45ericgallager joins
22:38:46CYBERDEV quits [Read error: Connection reset by peer]
22:38:53CYBERDEV joins
22:50:22Webuser281163 joins
22:50:48Webuser281163 quits [Client Quit]
23:50:48Webuser564052 quits [Quit: Ooops, wrong browser tab.]