00:00:33 | Webuser192545 joins | |
00:01:50 | <Webuser192545> | Hi - is there any way someone can use the archive bot to add this URL(https://docs.crestron.com/en-us/8525/Content/Topics/Home.htm) and all sub-pages to the way back machine? This company is very anti-consumer and may take this down at any moment |
00:02:22 | Webuser192545 quits [Client Quit] | |
00:12:26 | cyanbox joins | |
00:17:57 | Medaka joins | |
00:41:29 | HP_Archivist quits [Read error: Connection reset by peer] | |
00:42:10 | HP_Archivist (HP_Archivist) joins | |
00:43:00 | HP_Archivist quits [Client Quit] | |
00:43:15 | HP_Archivist (HP_Archivist) joins | |
01:13:30 | chunkynutz6 quits [Read error: Connection reset by peer] | |
01:13:44 | chunkynutz6 joins | |
01:35:22 | <@JAA> | Larsenv: No |
01:47:36 | pedantic-darwin joins | |
02:02:48 | <nicolas17> | JAA: what do you think of that crestron request? |
02:03:34 | <@JAA> | Very scripty :-/ |
02:04:00 | <nicolas17> | yeah I meant in terms of "should we" |
02:04:07 | <nicolas17> | I'm looking into the technical details now |
02:04:11 | <@JAA> | <aatt.png> |
02:04:24 | <nicolas17> | oh god system-design.htm gets worse |
02:04:44 | <@JAA> | There's also ../ stuff, which won't work in AB like that. |
02:04:45 | <nicolas17> | this is horrifyingly scripty |
02:04:59 | <@JAA> | Probably someone needs to compile a list of URLs. :-| |
02:06:43 | <nicolas17> | and I can't find the main code |
02:07:33 | <nicolas17> | ah madcap |
02:27:41 | <nicolas17> | this seems doable |
02:28:08 | <nicolas17> | I'll have to parse HTML, XML, and JSON (extracting it from a JS function call), but doable |
02:30:01 | <@JAA> | Sounds lovely :-| |
02:30:38 | <nicolas17> | https://docs.crestron.com/en-us/8525/Data/Concepts.js |
02:30:50 | <nicolas17> | jsonp? |
02:31:07 | <nicolas17> | oh that's not valid json due to the trailing comma, that will make things more fun |
03:43:07 | jinn6 quits [Ping timeout: 258 seconds] | |
03:48:24 | ericgallager quits [Quit: This computer has gone to sleep] | |
03:53:41 | jinn6 joins | |
04:11:37 | ericgallager joins | |
04:16:31 | jinn6 quits [Ping timeout: 260 seconds] | |
04:24:03 | ericgallager quits [Client Quit] | |
04:27:41 | jinn6 joins | |
04:35:46 | ericgallager joins | |
04:44:36 | <h2ibot> | Usernam edited List of websites excluded from the Wayback Machine (-22): https://wiki.archiveteam.org/?diff=55599&oldid=55598 |
04:45:41 | datechnoman quits [Ping timeout: 260 seconds] | |
04:53:08 | datechnoman (datechnoman) joins | |
04:57:43 | ericgallager quits [Client Quit] | |
05:00:38 | <h2ibot> | Usernam edited List of websites excluded from the Wayback Machine (+262): https://wiki.archiveteam.org/?diff=55600&oldid=55599 |
05:05:21 | Medaka quits [Quit: Leaving] | |
05:17:25 | Megame quits [Quit: Leaving] | |
05:35:22 | Medaka joins | |
05:56:22 | ericgallager joins | |
06:10:42 | chunkynutz6 quits [Ping timeout: 258 seconds] | |
06:10:59 | Wohlstand (Wohlstand) joins | |
06:40:23 | chunkynutz6 joins | |
06:56:17 | Webuser681976 joins | |
07:04:23 | Webuser681976 quits [Client Quit] | |
07:04:44 | <pabs> | Medaka: ArchiveBot can't set a google/custom UA |
07:38:41 | Island quits [Read error: Connection reset by peer] | |
07:38:42 | Island_ quits [Read error: Connection reset by peer] | |
07:43:03 | beardicus quits [Quit: Ping timeout (120 seconds)] | |
07:44:21 | beardicus (beardicus) joins | |
08:01:07 | BornOn420 quits [Remote host closed the connection] | |
08:01:42 | BornOn420 (BornOn420) joins | |
08:04:40 | <Medaka> | pabs: Oh, I see... Thanks for telling me. |
09:22:45 | @Sanqui quits [Ping timeout: 258 seconds] | |
09:35:57 | ericgallager quits [Quit: This computer has gone to sleep] | |
09:36:08 | Sanqui joins | |
09:36:10 | Sanqui is now authenticated as Sanqui | |
09:36:10 | Sanqui quits [Changing host] | |
09:36:10 | Sanqui (Sanqui) joins | |
09:36:10 | @ChanServ sets mode: +o Sanqui | |
10:13:29 | @arkiver quits [Remote host closed the connection] | |
10:13:44 | arkiver (arkiver) joins | |
10:13:44 | @ChanServ sets mode: +o arkiver | |
10:16:30 | MrMcNuggets (MrMcNuggets) joins | |
10:39:55 | @arkiver quits [Remote host closed the connection] | |
10:41:13 | arkiver (arkiver) joins | |
10:41:13 | @ChanServ sets mode: +o arkiver | |
10:42:23 | Medaka quits [Quit: Leaving] | |
10:59:01 | Dango360 (Dango360) joins | |
11:00:01 | Bleo182600722719623455 quits [Quit: The Lounge - https://thelounge.chat] | |
11:02:54 | Bleo182600722719623455 joins | |
11:03:49 | <BlankEclair> | i'm curious how many government sites that AT has archived |
11:11:16 | ducky quits [Ping timeout: 260 seconds] | |
11:12:14 | katia2 quits [Remote host closed the connection] | |
11:12:49 | ducky (ducky) joins | |
11:35:04 | <datechnoman> | Id say in some way or another we have archived atleast a few pages from every government site due to our reach |
11:39:20 | <BlankEclair> | i was thinking more of a targeted archive of a site instead of a coincidence caused by outlinks |
11:39:29 | <BlankEclair> | (and excluding the us gov, we all know that lol) |
11:41:58 | ericgallager joins | |
11:42:58 | <datechnoman> | in #// I have been queuing millions (over a billion) of any .gov urls that have been found. This leads on to a spider crawl affect as we then archive the sitemap and front page up to 3 clicks in |
11:43:19 | <datechnoman> | This is not a full targeted approach like you say, but gives us a good starting point |
11:43:32 | <datechnoman> | The sheer amount of data would be enormous if we were to get it all |
11:44:05 | <BlankEclair> | close enough, thanks ^_^ |
11:46:08 | <datechnoman> | But if there are websites your would like us to look at, we can most certainly look into them |
11:46:17 | <datechnoman> | Just comes down to size and effort etc |
12:51:14 | etnguyen03 (etnguyen03) joins | |
13:07:45 | Megame (Megame) joins | |
13:11:37 | nine joins | |
13:11:37 | nine is now authenticated as nine | |
13:11:37 | nine quits [Changing host] | |
13:11:37 | nine (nine) joins | |
13:14:02 | Tugboat joins | |
13:14:03 | etnguyen03 quits [Client Quit] | |
13:15:30 | <pabs> | #UncleSamsArchive did a recursive crawl of .gov .mil I thought |
13:26:36 | ducky quits [Ping timeout: 260 seconds] | |
13:27:01 | etnguyen03 (etnguyen03) joins | |
13:27:49 | Tugboat quits [Client Quit] | |
13:33:15 | Tugboat joins | |
13:39:40 | ducky (ducky) joins | |
13:50:31 | Tugboat quits [Ping timeout: 260 seconds] | |
13:50:39 | nine quits [Client Quit] | |
13:50:51 | nine joins | |
13:50:51 | nine is now authenticated as nine | |
13:50:51 | nine quits [Changing host] | |
13:50:51 | nine (nine) joins | |
13:58:11 | Tugboat joins | |
14:16:56 | etnguyen03 quits [Client Quit] | |
14:27:45 | etnguyen03 (etnguyen03) joins | |
14:38:49 | Wohlstand quits [Quit: Wohlstand] | |
15:01:31 | <h2ibot> | BlankEclair edited WikiTeam (+135, /* Wikifarms */ Add MyWikis): https://wiki.archiveteam.org/?diff=55601&oldid=55394 |
15:02:55 | driib9 quits [Quit: The Lounge - https://thelounge.chat] | |
15:06:05 | driib9 (driib) joins | |
15:16:28 | Dango360 quits [Quit: Leaving] | |
15:19:40 | Wohlstand (Wohlstand) joins | |
15:48:51 | cyanbox quits [Read error: Connection reset by peer] | |
16:09:16 | grill (grill) joins | |
16:19:29 | hackbug quits [Remote host closed the connection] | |
16:29:45 | hackbug (hackbug) joins | |
16:34:21 | ericgallager quits [Quit: This computer has gone to sleep] | |
16:50:19 | sec^nd quits [Remote host closed the connection] | |
16:50:46 | sec^nd (second) joins | |
17:12:20 | grill quits [Ping timeout: 258 seconds] | |
17:38:05 | grill (grill) joins | |
18:02:25 | sec^nd quits [Ping timeout: 240 seconds] | |
18:06:22 | sec^nd (second) joins | |
18:06:34 | driib9 quits [Quit: The Lounge - https://thelounge.chat] | |
18:16:57 | Wohlstand1 (Wohlstand) joins | |
18:17:06 | Wohlstand quits [Ping timeout: 260 seconds] | |
18:17:06 | Wohlstand1 is now known as Wohlstand | |
18:22:59 | MrMcNuggets quits [Quit: WeeChat 4.3.2] | |
18:25:03 | Webuser564052 joins | |
18:25:11 | <Webuser564052> | I used the wikiteam3 tool to make a backup of my wiki. It did not work for the images, it saved only a few of the 4k pictures. Any help? Wiki is https://handhelds.miraheze.org/wiki/Main_Page |
18:32:44 | <xkey> | Webuser564052: sorry to redirect you again, you wanna join #wikiteam |
19:18:56 | grill quits [Ping timeout: 260 seconds] | |
19:40:27 | BluRS quits [Read error: Connection reset by peer] | |
20:12:24 | dabs joins | |
20:25:20 | Island joins | |
21:11:13 | lflare quits [Quit: Ping timeout (120 seconds)] | |
21:16:03 | lflare (lflare) joins | |
21:41:27 | Wohlstand quits [Remote host closed the connection] | |
21:45:49 | @kaz quits [Quit: Killed] | |
21:46:31 | Megame quits [Quit: Leaving] | |
21:51:12 | kaz (Kaz) joins | |
21:51:12 | @ChanServ sets mode: +o kaz | |
22:28:33 | atirclog (atirclog) joins | |
22:28:33 | Topic: Lengthy ArchiveTeam-related discussions, questions here | Offtopic: #archiveteam-ot | https://twitter.com/textfiles/status/1069715869994020867 | |
22:28:33 | Topic set by JAA at 2021-11-02 03:43:57Z | |
22:28:46 | Current users: atirclog (atirclog), CYBERDEV, @kaz (Kaz), lflare (lflare), Island, dabs, Webuser564052, sec^nd (second), hackbug (hackbug), etnguyen03 (etnguyen03), Tugboat, nine (nine), ducky (ducky), Bleo182600722719623455, @arkiver (arkiver), @Sanqui (Sanqui), BornOn420 (BornOn420), beardicus (beardicus), chunkynutz6, datechnoman (datechnoman), jinn6, pedantic-darwin, HP_Archivist (HP_Archivist), wickedplayer494 (wickedplayer494), PredatorIWD25, APOLLO03, lennier2, benjins3_, cmlow, BennyOtt (BennyOtt), Matthww, Yakov (Yakov), LunarianBunny1147 (LunarianBunny1147), croissant, pixel (pixel), evergreen (evergreen), Webuser005265, Sluggs, archiveDrill, some_body, arch, xarph_, beastbg8_, nyakase (nyakase), magmaus3 (magmaus3), Naruyoko, Hackerpcs (Hackerpcs), pabs (pabs), devkev (devkev), Dalek (Dalek), Snivy (Snivy), abirkill (abirkill), kansei (kansei), ymgve_, makeworld, atphoenix (atphoenix), BearFortress, Larsenv (Larsenv), eroc1990 (eroc1990), wyatt8750, Barto (Barto), @rewby (rewby), ichdasich, balrog (balrog), chrismrtn (chrismrtn), szczot3k (szczot3k), feed (feed), runxiyu (runxiyu), bladem (bladem), Radzig, Shjosan (Shjosan), yasomi (yasomi), katocala (katocala), ahm258760, DLoader (DLoader), Medowar (Medowar), entrox, NatTheCat (NatTheCat), bilboed0, chrismeller (chrismeller), phillipsjk, tzt (tzt), Jake (Jake), fionera (Fionera), cow_2001, VerifiedJ (VerifiedJ), danwellby, DigitalDragons (DigitalDragons), nepeat (nepeat), igloo22225 (igloo22225), midou, nulldata (nulldata), notarobot1, cm, pokechu22 (pokechu22), flotwig, simon816 (simon816), khaoohs, aninternettroll (aninternettroll), riteo (riteo), T31M (T31M), kedihacker (kedihacker), Jens (JensRex), useretail, void09, Riku_V (riku), catbottom, DopefishJustin (DopefishJustin), Stagnant_ (Stagnant), CraftByte (DragonSec|CraftByte), xkey (xkey), SDRedneck (SDRedneck), Gadelhas562873784, fuzzy80211 (fuzzy80211), JayEmbee (JayEmbee), legoktm, ax (ax), evanim (evanim), f_ (funderscore), night (night), jspiros (jspiros), IRC2DC, fangfufu (fangfufu), G4te_Keep3r34924156, nicolas17 (nicolas17), Deewiant (Deewiant), Juest (Juest), yano (yano), i_have_n0_idea3 (i_have_n0_idea), sensitiveParrot (sensitiveParrot), ThreeHM (ThreeHeadedMonkey), murb (murb), BlankEclair (BlankEclair), Sokar, Exorcism (exorcism), Ryz (Ryz), @dxrt (dxrt), kiska52, lunik1, tek_dmn (tek_dmn), IDK (IDK), Cronfox (Cronfox), leo60228 (leo60228), emphatic, unlobito (unlobito), girst (girst), klg (klg), Lord_Nightmare (Lord_Nightmare), camrod63 (camrod), skyrocket, AK (AK), hexa (hexa-), endrift, systwi_, emily (pseudorizer), orange (orange), triplecamera|m, gamer191-1|m, hexagonwin (hexagonwin), itrooz (itrooz), programmerq (programmerq), jasons7 (jasons), threedeeitguy6 (threedeeitguy), adamus1red (adamus1red), ThetaDev, clever, ell7 (ell), eythian, TheTechRobo (TheTechRobo), ScenarioPlanet (ScenarioPlanet), Pedrosso, UwU, @Fusl (Fusl), dave (dave), Irenes (ireneista), Coderjo_, ATWF_notcarl, shreyasminocha (shreyasminocha), JTL (JTL), cptcobalt, efi (efi), anarcat (anarcat), Blueacid, luckcolors (luckcolors), kokos, thehedgeh0g (mrHedgehog0), mystique_altrosky, andrewnyr, mrfooooo, @hook54321 (hook54321), billy549 (Billy549), @rewby|backup (rewby), @HCross (HCross), loopy, zifnab06, HugsNotDrugs, nimaje, za3k, mgrandi (mgrandi), JSharp (JSharp), th3ph3d, alexlehm (alexlehm), dan-, ShadowJonathan (ShadowJonathan), murmur, atweedie, Flashfire42 (flashfire42), opl (opl), Czechball, Ryz2 (Ryz), s-crypt (s-crypt), valdikss, codecrafters, mind_combatant (mind_combatant), ATinySpaceMarine, NotGLaDOS, aars, glassy, PhoHale|m, masterX244 (masterX244), Doomaholic (Doomaholic), kiska (kiska), jonty (jonty), seadog007__, justcool393 (justcool393), thejsa, quartermaster, todb, ramsey (ramsey), Swryl, monohedron (monohedron), russss (russss), VonGuard, Ctrl-S, riking, qxtal (qxtal), eggdrop (eggdrop), M--mlv|m, AntoninDelFabbro|m, yarnover|m, gareth48|m, mat|m1, Tyrasuki|m, Valkum|m, rain|m, hillow596|m, saouroun|m, Cronfox|m, kaz__|m, username675f|m, noxious, ram|m, Passiing|m, e2mau|m, ax|m, victor_vaughn|m, Hans5958 (Hans5958), Fijxu|m, katia|m, tech234a (tech234a), th3z0l4|m, szczot3k|m, froxcey|m, tomodachi94 (tomodachi94), spearcat|m, nyuuzyou (nyuuzyou), mister_x, upperbody321|m, anon00001|m, l0rd_enki|m, mikolaj|m, GhostIsBeHere|m, aaq|m, v1cs, bogsen (bogsen), that_lurker|m, Tom|m1, octylFractal|m, flashfire42|m (flashfire42), coro, Vokun (Vokun), Video, Misty|m, noobirc|m, cmostracker|m, trumad|m, Roki_100|m, nosamu|m, Exorcism|m, jwoglom|m, superusercode (superusercode), wrangle|m, will|m, jevinskie (jevinskie), Fletcher (Fletcher), manu|m, Thibaultmol, finalti|m, Minkafighter|m, GRBaset (GRBaset), igneousx (igneousx), audrooku|m, britmob|m, DigitalDragon (DigitalDragon), ragu|m, madpro|m, x9fff00 (x9fff00), jackt1365|m, schwarzkatz|m, nstrom|m, theblazehen|m, andrewvieyra|m, Ruk8 (Ruk8), tech234a|m-backup, pannekoek11|m, @Sanqui|m (Sanqui), nightpool (nightpool), Alienmaster|m, nano412510 (nano412510), Adamvoltagex|m, supermariofan67|m, vics, yetanotherarchiver|m, Nulo|m, s-crypt|m|m, iCesenberk|m, qyxojzh|m, EvanBoehs|m, alexshpilkin, phaeton (phaeton), Cydog|m, MaxG, vexr, moe-a-m|m, CrispyAlice2 (CrispyAlice2), yzqzss (yzqzss), lasdkfj|m, masterx244|m (masterx244|m), akaibu|m, NickS|m, Ajay, haha-whered-it-go|m, hlgs|m, xxia|m, mpeter|m, thermospheric (Thermospheric), MinePlayersPEMyNey|m, joepie91|m, rewby|m, that_lurker (that_lurker), Doranwen (Doranwen), ArchivalEfforts, OctopusET, c3manu (c3manu), jacksonchen666 (jacksonchen666), kf (kf), alittleglitchy, evan, monoxane (monoxane), @JAA (JAA), atluxity, peaches, trix (trix), Miori, asie, @AlsoJAA (JAA), Thijn, inedia (inedia), plcp, d10n, klaffty, Aoede (Aoede), PAARCLiCKS (s4n1ty), Craigle (Craigle), lindowsME, ^ (^), lexikiq, ConstantK, Arachnophine (Arachnophine), mgrytbak, yourfate (yourfate), pie_ (pie_), jodizzle (jodizzle), agtsmith, Soulflare, qw3rty_, Chris5010 (Chris5010), sighsloth1090 (sighsloth1090), Kenshin (Kenshin), @imer (imer), nothere, itachi1706 (itachi1706), colla (colla), tertu (tertu), raccoon (raccoon), ats (ats), Suika, colona (colona), kdy (kdy), mete, Terbium, Meroje (Meroje), fluke, kokos|, angenieux2 (angenieux), monika (boom), lumidify (lumidify), Church (Church), Rince (Rince), neggles (neggles), knecht (knecht), katia_ (katia), szczot3k|t (szczot3k), lurk3r (lurk3r), apache2_, steering (steering), @OrIdow6 (OrIdow6), redbees, mattx433 (mattx433), celestial, phuzion (phuzion), Jonimus, mikael, nickofnicks (nickofnicks), katia (katia), citty, @ChanServ, kpcyrd (kpcyrd), summerisle, [42] (N4Y), FireFly, Jon (Jon), Xesxen (Xesxen), lea (lea_), @chfoo (chfoo), cultpony (cultpony), maxfan8_ (maxfan8), FalconK (FalconK), kallsyms, betamax (betamax), erenrich, siinus (siinus), sknebel (sknebel), Dj-Wawa (Dj-Wawa), Muad-Dib, nyany (nyany), aismallard | |
22:32:32 | h2ibot (h2ibot) joins | |
22:32:45 | ericgallager joins | |
22:38:46 | CYBERDEV quits [Read error: Connection reset by peer] | |
22:38:53 | CYBERDEV joins | |
22:50:22 | Webuser281163 joins | |
22:50:48 | Webuser281163 quits [Client Quit] | |
23:50:48 | Webuser564052 quits [Quit: Ooops, wrong browser tab.] |