| 00:00:32 | | sec^nd quits [Remote host closed the connection] |
| 00:00:53 | | sec^nd (second) joins |
| 00:25:55 | | hooway quits [Client Quit] |
| 00:29:18 | <purplebot> | Running Archive Team Projects with Docker edited by Tech234a (+2231, Add more Docker information), Tech234a (-1, Remove extra blank space) 18 minutes ago -- https://www.archiveteam.org/?diff=45924&oldid=45922 |
| 00:50:13 | <OrIdow6> | arkiver: How much of an advantage is there, to doing multiple items per session, when there is a 15-second delay between the items anyway? |
| 00:50:21 | <OrIdow6> | Due to rate limits |
| 00:50:41 | <OrIdow6> | If this is some great burden on the tracker, I will modify the URLs project |
| 00:50:47 | <OrIdow6> | Else what I have works quite well |
| 00:51:27 | <@arkiver> | multiple items is mostly to keep load off of the tracker |
| 00:51:31 | <@arkiver> | where is the code? |
| 01:05:58 | <OrIdow6> | Done fighting Git |
| 01:06:20 | <OrIdow6> | arkiver: https://github.com/OrIdow6/eu-domains-check-maybe obviously I have not made all cosmetic changes |
| 01:06:26 | <OrIdow6> | Very simple |
| 01:08:32 | <@arkiver> | OrIdow6: what will your item list look like? |
| 01:08:51 | <OrIdow6> | Each item is just domain:[something].eu |
| 01:08:53 | <OrIdow6> | From those lists |
| 01:09:30 | <@arkiver> | '.iewiewr' :) i like it |
| 01:09:42 | <@arkiver> | alright |
| 01:09:49 | <OrIdow6> | It's so that I don't accidentally contact the real tracker |
| 01:09:49 | <@arkiver> | all have been queued to URLs as well |
| 01:09:59 | <@arkiver> | yep |
| 01:11:25 | <OrIdow6> | This is obviously WIP |
| 01:14:09 | <@JAA> | .invalid ftw |
| 01:14:37 | <@arkiver> | .blub |
| 01:24:02 | <tech234a> | Alright I think my Docker tutorial is getting there. https://archiveteam.org/index.php?title=Running_Archive_Team_Projects_with_Docker |
| 01:25:13 | <tech234a> | A few ideas: the ability to specify a Docker image in the wiki Infobox template, and perhaps a "current project" Docker image that just refers to the current project so people can be automatically updated to a current project, sort of like on the Warrior. |
| 01:28:20 | <tech234a> | (FYI for anyone reading I just updated the page to add a sentence specifying the requirements for the image address) |
| 01:31:20 | <@arkiver> | Craigle: you're an automoderated user now |
| 01:32:18 | <purplebot> | Current Projects edited by Wickedplayer494 (+149, Freshlive to Scripts only) just now -- https://www.archiveteam.org/?diff=45928&oldid=45861 |
| 01:32:19 | <purplebot> | Freshlive edited by Craigle (+91) just now -- https://www.archiveteam.org/?diff=45929&oldid=45876 |
| 01:32:19 | <purplebot> | Coronavirus edited by Wessel1512 (+35, /* Netherlands */) just now -- https://www.archiveteam.org/?diff=45930&oldid=45889 |
| 01:32:34 | | HP_Archivist (HP_Archivist) joins |
| 01:36:52 | <@arkiver> | tech234a: looks very nice from first view, will road more thoroughly later |
| 01:37:02 | <tech234a> | Thanks! |
| 01:37:52 | <OrIdow6> | arkiver: So thoughts on that? |
| 01:40:18 | <purplebot> | Running Archive Team Projects with Docker edited by Tech234a (+264, Add mention of Docker Desktop), Tech234a (+278, Add note about automatic container …), Tech234a (+130, Add requirements for image address) 13 minutes ago -- https://www.archiveteam.org/?diff=45927&oldid=45924 |
| 02:00:01 | | Dallas quits [Client Quit] |
| 02:04:05 | | Dallas (Dallas) joins |
| 02:37:18 | | Arcorann_ quits [Ping timeout: 252 seconds] |
| 03:04:24 | | AeonG quits [Ping timeout: 240 seconds] |
| 03:39:51 | <Craigle> | arkiver: Sweet, thanks! |
| 03:41:48 | <Craigle> | tech234a: I was going to bring up adding the Docker link to the infobox. My concern though is that since there is no webpage associated with the Docker catalog, that it may confuse people when they try to click it |
| 03:42:33 | <Craigle> | With that said, it brings up the question of if we want random people hopping in without joining the channel first. |
| 03:43:36 | <tech234a> | Fair point... but I do feel there is a discoverability problem with the Docker images right now |
| 03:44:19 | <tech234a> | And yeah they look like links which is also confusing... perhaps if we formatted them differently |
| 03:44:33 | <tech234a> | like in a <code> tag it would help a bit |
| 03:44:56 | <Craigle> | I completely agree. I actually tried to add the link when I added the project and tracker links. Then realized it wouldn't work since it needed to be added to the infobox itself. |
| 03:45:43 | <tech234a> | Here's the template: https://archiveteam.org/index.php?title=Template:Infobox_project |
| 03:46:01 | <tech234a> | I didn't want to change it without JAA's approval though |
| 03:46:15 | <Craigle> | That may be an idea. Or maybe something like: "Docker image can be pulled from "https://atdr.meo.ws/whatever"" |
| 03:46:34 | <tech234a> | (except there is no https:// for Docker images) |
| 03:46:44 | <tech234a> | or at least not with a docker run command |
| 03:47:05 | <Craigle> | But I am a little concerned about people blindly running the docker image without being in the channel for coordination, and explaining that the containers need to be updated, etc |
| 03:47:25 | <tech234a> | In my tutorial I set them up with Watchtower |
| 03:47:32 | <tech234a> | for automatic updates |
| 03:47:34 | <Craigle> | Yeah, my bad. I copy/pasted it from above. The one K.az posted earlier doesn't work either because it has capital letters in it |
| 03:47:51 | <tech234a> | Yeah I ran into that too |
| 03:48:01 | <Craigle> | Oh cool. I hadn't had a chance to read that guide yet, but that should be great |
| 03:49:29 | <tech234a> | I was also thinking we should have a "default Docker image" for people to use, which would basically just have a Dockerfile containing "FROM atdr.meo.ws/currentproject" so people could possibly be automatically switched to a current project |
| 03:50:14 | <tech234a> | Sort of like default project on Warrior |
| 03:50:36 | <tech234a> | I'm not entirely sure if that will work or if the default image would have to be rebuilt each time the project image is rebuilt |
| 03:51:16 | <tech234a> | But still it would be closer to how the Warrior worked for volunteers who want to just run a script in the background |
| 03:51:25 | <Craigle> | I think that would be great, but yeah, I think the image would have to be manually updated to the current project every time to change it |
| 03:52:55 | <tech234a> | That said, I assume it wouldn't be too hard to automate something like that serverside with a few scripts |
| 03:54:09 | <Craigle> | It may not be, I honestly just don't know |
| 03:54:12 | <@JAA> | I don't have a strong opinion on adding the Docker image to the infobox. I feel like it's a bit redundant with the GitHub repo since the images have the same name, so maybe it should just be added to the readme file there. |
| 03:55:05 | <tech234a> | I was beginning to wonder if the images always had the same name as the repo, thanks for confirming that |
| 03:55:11 | <@JAA> | Don't waste time on the warrior stuff, Fusl has plans for that already. |
| 03:55:37 | <Craigle> | That's not a bad idea. It would require new people to at least half ass read the readme before spinning a container up |
| 03:55:41 | <@JAA> | They didn't in the past when it was still on Docker Hub, I think, but since our own registry, they always do. |
| 03:55:51 | <@JAA> | As far as I know, anyway. (I'm not actually running them.) |
| 03:56:39 | <tech234a> | Yeah the "default Docker image" idea wouldn't be a Warrior replacement, it was just a quick, short-term alternative I was thinking of |
| 03:57:19 | <tech234a> | Since it would basically just point to the image for the current project for autoupdating/Watchtower purposes |
| 04:50:48 | | qw3rty_ joins |
| 04:54:38 | | qw3rty quits [Ping timeout: 252 seconds] |
| 05:32:04 | | nerdguy1138 quits [Ping timeout: 240 seconds] |
| 07:49:53 | | godane (godane) joins |
| 08:06:33 | | ragu (ragu) joins |
| 08:19:27 | <@HCross> | arkiver: speak to me about the zeelandnet data please |
| 08:21:29 | <@HCross> | I spent many hours randomly clicking through those sites getting thoroughly confused at early Dutch internet |
| 08:41:35 | | hooway joins |
| 08:43:06 | | bksq joins |
| 08:55:48 | | Arcorann_ joins |
| 09:25:05 | | nerdguy1138 (nerdguy1138) joins |
| 09:44:02 | <bksq> | hi, does anyone have a heritrix instance ready to crawl a page? |
| 09:44:39 | | spirit joins |
| 09:52:07 | <spirit> | looks like torrentbytes.net lost their domain :( |
| 09:56:18 | | HP_Archivist quits [Client Quit] |
| 09:59:18 | <jodizzle> | http://www.archiviolastampa.it/ now has a message claiming that service will return beginning February 15th of next year. |
| 10:03:02 | <jodizzle> | I have a remaining freshlive job that seems to be only 404s. Is the content gone? |
| 10:19:57 | <OrIdow6> | Yes |
| 10:24:34 | <jodizzle> | Okay. So if I cancel out of this job that's running, is there a target I should use for partial data? Can I just use the kiska one? |
| 10:29:53 | <OrIdow6> | Don't know |
| 10:30:10 | <OrIdow6> | But you've made your ping, so hopefully you'll get an answer |
| 10:32:37 | <OrIdow6> | By the way, I've checked, and the transport segments themselves are indeed gone, in addition to the sitre |
| 10:32:40 | <OrIdow6> | *site |
| 10:40:41 | <@kiska> | Sure :D |
| 10:40:57 | <@kiska> | I guess if it kills my packer oh well :D |
| 10:47:59 | | honno joins |
| 11:02:43 | | Zerote quits [Read error: Connection reset by peer] |
| 11:20:41 | | Zerote joins |
| 11:28:44 | | honno quits [Client Quit] |
| 11:37:07 | | systwi quits [Read error: Connection reset by peer] |
| 11:43:03 | | systwi (systwi) joins |
| 11:49:45 | | LeGoupil joins |
| 12:20:19 | | `md leaves |
| 12:30:20 | | LeGoupil quits [Client Quit] |
| 13:47:56 | | DLoader_ joins |
| 13:50:53 | | DLoader quits [Ping timeout: 252 seconds] |
| 13:50:57 | | DLoader_ is now known as DLoader |
| 14:11:46 | | bksq quits [Ping timeout: 244 seconds] |
| 14:22:04 | | ragu_ joins |
| 14:22:56 | | ragu__ joins |
| 14:23:30 | | ragu quits [Ping timeout: 252 seconds] |
| 14:26:24 | | ragu_ quits [Ping timeout: 240 seconds] |
| 14:33:46 | | Arcorann_ quits [Ping timeout: 252 seconds] |
| 14:58:45 | | systwi quits [Read error: Connection reset by peer] |
| 15:13:31 | | systwi (systwi) joins |
| 16:10:18 | <purplebot> | Who We Are edited by Cook Me Plox (+16, Change IRC link to point to [[Archiveteam:IRC]] …) just now -- https://www.archiveteam.org/?diff=45931&oldid=37373 |
| 16:20:33 | | Hackerpcs quits [Quit: Hackerpcs] |
| 16:22:40 | | Hackerpcs (Hackerpcs) joins |
| 16:38:15 | | systwi quits [Read error: Connection reset by peer] |
| 16:41:13 | | systwi (systwi) joins |
| 17:06:49 | | QuartzProto (QuartzProto) joins |
| 17:22:30 | | HackMii quits [Remote host closed the connection] |
| 17:22:52 | | HackMii (hacktheplanet) joins |
| 18:36:53 | | godane quits [Ping timeout: 252 seconds] |
| 18:49:02 | | godane joins |
| 18:49:02 | | godane is now authenticated as godane |
| 19:00:36 | | Cook_Me_Plox joins |
| 19:01:23 | <Cook_Me_Plox> | Hey folks! I was wondering if anyone had advice on how to search the Internet Archive by *suffix* rather than url and prefix |
| 19:01:39 | <Cook_Me_Plox> | Or whether such a thing is even feasible |
| 19:02:54 | <Cook_Me_Plox> | There are a bunch of old IP addresses (e.g. https://web.archive.org/web/*/66.28.11.52/*) that have files that I care about, but I don't know in advance what most of the IPs are |
| 19:30:36 | <jodizzle> | kiska: Looks like my freshlive job finished on it's own, so it should be uploaded now. But thanks! |
| 19:40:49 | | Cook_Me_Plox quits [Remote host closed the connection] |
| 20:14:31 | | Larsenv quits [Quit: ZNC 1.8.0 - https://znc.in] |
| 20:17:10 | | Larsenv (Larsenv) joins |
| 20:24:03 | | ragu__ quits [Client Quit] |
| 20:48:04 | | godane1 joins |
| 20:50:42 | | godane quits [Ping timeout: 252 seconds] |
| 21:47:04 | | icedice joins |
| 21:48:14 | <icedice> | I'm guessing you guys are going to archive MediaFire files now? |
| 21:48:35 | <icedice> | If so, I'd suggest scraping links from Lost Media Wiki and The Pokémon Community |
| 21:48:56 | <icedice> | They both have files hosted on MediaFire that are not easily replaceable |
| 21:54:40 | | ragu joins |
| 21:55:10 | | ragu is now authenticated as ragu |
| 21:56:45 | <icedice> | Edit: The correct name is The PokéCommunity |
| 21:57:44 | <icedice> | https://www.pokecommunity.com/ |
| 21:57:53 | <icedice> | They have a lot of fan games |
| 22:13:47 | <@JAA> | #mediaonfire |
| 22:18:39 | <icedice> | Thanks |
| 22:35:24 | | HackMii quits [Ping timeout: 240 seconds] |
| 22:35:48 | | HackMii (hacktheplanet) joins |
| 22:41:05 | | whanos joins |
| 22:54:14 | | whanos quits [Remote host closed the connection] |
| 23:15:01 | | quartz_ joins |
| 23:19:02 | | QuartzProto quits [Ping timeout: 252 seconds] |
| 23:46:12 | | Arcorann_ joins |
| 23:52:22 | | hooway quits [Client Quit] |
| 23:56:27 | <Arcorann_> | Apparently various Pastebin pastes are getting set to private due to a new filter |