HomeSearchPrevious dayNext day

00:05:37HackMii_ is now known as HackMii
01:09:41thuban quits [Client Quit]
02:07:09thuban joins
02:31:28jojomcbean joins
02:35:18<jojomcbean>!list
03:55:05nostrum-tango quits [Remote host closed the connection]
03:59:29nostrum-tango joins
04:03:47jojomcbean quits [Ping timeout: 265 seconds]
04:04:12geezabiscuit quits [Ping timeout: 255 seconds]
04:06:29geezabiscuit (geezabiscuit) joins
04:14:58HP_Archivist quits [Remote host closed the connection]
04:15:20HP_Archivist (HP_Archivist) joins
04:23:19ragu|m joins
04:41:37michaelblob_ (michaelblob) joins
04:45:09michaelblob quits [Ping timeout: 255 seconds]
05:20:49Iki quits [Remote host closed the connection]
05:20:49HP_Archivist quits [Remote host closed the connection]
05:20:50AlsoHP_Archivist joins
05:20:57Iki joins
05:23:13<@OrIdow6^2>Who has the ability to compile and run wget-at? Not in a docker container or anything fancy, just on your computer
05:24:05<@OrIdow6^2>If they just ran text files and coordinated on the wiki back in the old days we can still do that for MBNet
05:24:13balrog quits [Client Quit]
05:24:13dm4v quits [Client Quit]
05:24:13Iki quits [Remote host closed the connection]
05:24:17dm4v joins
05:24:18Iki joins
05:25:22balrog (balrog) joins
05:30:54qwertyasdfuiopghjkl quits [Remote host closed the connection]
05:30:59<h2ibot>Ryz edited URLTeam (+385, /* Alive */ Added wu.to): https://wiki.archiveteam.org/?diff=49076&oldid=49075
05:42:47BlueMaxima quits [Read error: Connection reset by peer]
05:42:59<@rewby>OrIdow6^2: Anyone can just pull the wget-at binary out of the docker image and run it. No need to compile.
05:47:02<h2ibot>Ryz edited URLTeam (+429, /* Alive */ Added wn.nr): https://wiki.archiveteam.org/?diff=49077&oldid=49076
05:58:03<h2ibot>Ryz edited URLTeam (+274, /* Alive */ Added okt.to): https://wiki.archiveteam.org/?diff=49078&oldid=49077
06:06:20<Maakuth|m>OrIdow6^2: this one? https://github.com/ArchiveTeam/wget-lua
06:06:28<Maakuth|m>I can do it
06:09:05<h2ibot>Ryz edited URLTeam/Dead (+47, /* Dead or Broken */ Added hoot.to): https://wiki.archiveteam.org/?diff=49079&oldid=48563
06:15:06<h2ibot>Ryz edited URLTeam (+200, /* Alive */ Added ptix.at): https://wiki.archiveteam.org/?diff=49080&oldid=49078
06:15:26<Maakuth|m>I suppose it's no problem running it in docker, seems to be easiest way to have it built
06:17:57qwertyasdfuiopghjkl joins
06:24:04<Jake>I've had wget-at compiled for a while. Happy to help with anything.
06:27:11<h2ibot>Ryz edited URLTeam (+413, /* Alive */ Added dibb.me): https://wiki.archiveteam.org/?diff=49081&oldid=49080
06:37:37<@OrIdow6^2>Great Jake and Maakuth|m, basically my idea (not actually my idea, this is how AT did things before the automated tracker) as of present is that there will be an Etherpad with "items" that represent sets of subdomains; a person "claims" an item by editing the pad to say so, puts it into a bash script that calls wget, uploads it, then puts the link to the upload into the pad
06:37:51<@OrIdow6^2>Will try to get something set up w/i the next hour
06:38:18<@OrIdow6^2>And I'll warn you there's a ~60% chance this will in the end be unnecessary because #Y will become operational
06:38:30<@OrIdow6^2>I guess this should move to #webroasting
06:46:26<Maakuth|m>ok, I'll join there
06:47:29<Jake>Just let me know. I'm going to bed somewhat soon, but just ping me and I'm happy to help.
06:49:21<@OrIdow6^2>Ok
07:37:53michaelblob (michaelblob) joins
07:41:16michaelblob_ quits [Ping timeout: 240 seconds]
07:55:12Pingerfowder quits [Quit: ZNC - https://znc.in]
07:55:20Pingerfowder (Pingerfowder) joins
08:29:15march_happy quits [Ping timeout: 255 seconds]
08:29:30march_happy (march_happy) joins
09:07:34march_happy quits [Remote host closed the connection]
09:10:18march_happy (march_happy) joins
10:14:34march_happy quits [Remote host closed the connection]
10:19:37march_happy (march_happy) joins
10:52:04march_happy quits [Ping timeout: 240 seconds]
10:52:24march_happy (march_happy) joins
11:36:52BenB joins
12:09:17<Maakuth|m>any ideas about 502 errors on upload on transfer.archivete.am? http://paste.debian.net/1256536/
12:09:26<Maakuth|m>what is BunnyCDN anyway
12:10:11<Maakuth|m>too big item perhaps?
12:27:55fuzzy8021 quits [Read error: Connection reset by peer]
12:28:34fuzzy8021 (fuzzy8021) joins
13:01:15Iki quits [Ping timeout: 265 seconds]
13:21:09tech_exorcist (tech_exorcist) joins
13:21:45Arcorann quits [Ping timeout: 255 seconds]
13:31:16Stilett0 quits [Ping timeout: 240 seconds]
13:52:28jacobk_ quits [Ping timeout: 240 seconds]
13:58:02jacobk joins
14:04:28jacobk quits [Ping timeout: 240 seconds]
14:46:37tech_exorcist quits [Client Quit]
14:47:15datechnoman quits [Ping timeout: 255 seconds]
14:59:55datechnoman (datechnoman) joins
15:07:27TheTechRobo quits [Client Quit]
15:36:48jacobk joins
15:59:01T31M quits [Quit: ZNC - https://znc.in]
15:59:21T31M joins
16:19:30TheTechRobo (TheTechRobo) joins
16:28:39spirit joins
17:09:50AlsoHP_Archivist quits [Client Quit]
17:12:09march_happy quits [Ping timeout: 255 seconds]
17:17:13<@JAA>Maakuth|m: Yeah, BunnyCDN errors out if you try to upload a too large file.
17:20:44<@HCross>JAA: if the offload to S3 takes too long, that may cause the issues
17:24:58ThreeHM_ (ThreeHeadedMonkey) joins
17:26:04ThreeHM quits [Ping timeout: 240 seconds]
17:40:51tech_exorcist (tech_exorcist) joins
17:40:54<TheTechRobo>I made an IRC bot that archives the metadata and chat of Twitch vods. It actually kinda works. Channel name suggestions?
17:45:05<@JAA>HCross: Well yeah, if anything from the user to the transfer origin takes too long, I think. Depending on how the upload is done, the file gets buffered on the server before offloading to S3, by the way.
17:45:12<spirit>twirch?
17:46:01<@JAA>burnthetwitch (which mgrandi is sitting on since two months ago, lol)
17:50:23<@JAA>Oh right, that was actually the channel name on EFnet.
17:52:54<TheTechRobo>I'm up for whatever. :-)
19:17:20tech_exorcist quits [Client Quit]
19:21:08Iki joins
19:37:19lennier1 quits [Client Quit]
19:38:01<Jake>Can't remember who asked, but forum.tek.com is _very_ hard to crawl. Got a additional things to try.
19:38:06lennier1 (lennier1) joins
20:15:23DopefishJustin joins
20:18:44Ryz2 quits [Quit: Ping timeout (120 seconds)]
20:18:53Ryz2 (Ryz) joins
20:21:13Gereon620 quits [Read error: Connection reset by peer]
20:21:19Gereon620 (Gereon) joins
20:25:35spirit quits [Client Quit]
20:27:16nikow3 quits [Ping timeout: 240 seconds]
20:30:59mutantm0nkey quits [Remote host closed the connection]
20:33:29mutantm0nkey (mutantmonkey) joins
20:37:09Bluebanana joins
20:41:36<Bluebanana>Hello! I wonder what the difference is between "--level=" and "--page-requisites-level=" when using grab-site? Thanks in advance!
20:42:44nikow3 joins
20:52:36<TheTechRobo>Bluebanana: --level is for links, --page-requisites-level is for page requisites (like stylesheets, images, iframes, etc) iirc
21:01:10<Bluebanana>TheTechRobo Thanks for the help!
21:01:23<TheTechRobo>Bluebanana: Any time!
21:02:02<TheTechRobo>Remember that offsite links ignore --level.
21:17:16<h2ibot>LegitSi edited Alive... OR ARE THEY (-464, i updated the identify your breyer entry based…): https://wiki.archiveteam.org/?diff=49084&oldid=49062
21:17:17<h2ibot>Hiccup edited Wii Shop Channel (+168): https://wiki.archiveteam.org/?diff=49085&oldid=48548
21:19:21mutantm0nkey quits [Remote host closed the connection]
21:20:16mutantm0nkey (mutantmonkey) joins
21:50:17march_happy (march_happy) joins
22:00:09sec^nd quits [Ping timeout: 255 seconds]
22:00:51<Bluebanana>Is it normal to get this error message in the beginning of the crawl?
22:01:20<Bluebanana> /home/username/gs-venv/lib/python3.8/site-packages/wpull/protocol/http/client.py:185: UserWarning: HTTP session did not complete. warnings.warn(_('HTTP session did not complete.'))
22:04:09sec^nd (second) joins
22:09:05<Bluebanana>TheTechRobo
22:12:21<TheTechRobo>Bluebanana: Yes
22:12:24<TheTechRobo>I get that a lot
22:12:52<Bluebanana>TheTechRobo OK, thanks!
22:12:52<TheTechRobo>Don't worry, if anything fails it'll get retried
22:13:08<TheTechRobo>i think the default is 4 tries
22:13:35<Bluebanana>The weird thing is that it always in the start of the crawl, but not later.
22:13:45<Bluebanana>*it's always
22:14:23<Bluebanana>No matter the domain. But I guess I can ignore it then :)
22:24:35sec^nd quits [Remote host closed the connection]
22:25:16sec^nd (second) joins
22:41:28<h2ibot>TheTechRobo edited Elwha River Restoration Project (+30): https://wiki.archiveteam.org/?diff=49086&oldid=48906
22:49:03wickedplayer494 quits [Remote host closed the connection]
23:00:51HackMii quits [Remote host closed the connection]
23:02:26wickedplayer494 joins
23:02:35HackMii (hacktheplanet) joins
23:04:14HackMii quits [Remote host closed the connection]
23:05:16HackMii (hacktheplanet) joins
23:10:34ThreeHM_ is now known as ThreeHM
23:12:45<TheTechRobo>I guess I'Ll do #burnthetwitch since a few people are there already
23:13:17BlueMaxima joins
23:31:57sec^nd quits [Ping timeout: 255 seconds]
23:33:57sec^nd (second) joins
23:35:42Arcorann (Arcorann) joins

HomeSearchPrevious dayNext day