| 00:00:03 | | Hackerpcs (Hackerpcs) joins |
| 00:08:26 | | Barto quits [Ping timeout: 252 seconds] |
| 00:12:35 | | Barto (Barto) joins |
| 00:19:44 | | Barto quits [Ping timeout: 240 seconds] |
| 00:25:19 | | Barto (Barto) joins |
| 01:15:02 | <ivan> | it looks like some Google Sites are going down November 1, 2020 per https://www.archiveteam.org/index.php?title=Google_Sites and #nearlylostmygoogles doesn't seem to have started |
| 01:15:22 | <ivan> | oh, only if they haven't been viewed in a while |
| 01:16:02 | <Ajay> | It has started |
| 01:16:14 | <ivan> | ah |
| 01:19:37 | <ivan> | JAA: #containerspill |
| 01:20:15 | <@JAA> | Looks like we're using #failwhale despite the Twitter association. |
| 01:22:06 | <thuban> | don't stereotype, failwhales are v. diverse |
| 01:30:41 | | Joel quits [Read error: Connection reset by peer] |
| 01:40:34 | <tech234a> | ivan: Google Sites has started, but complete discovery remains an issue. About 17 million sites have been found by searching for links on the internet as well as scraping the internal Google Sites search engine on various keywords (this is still ongoing). |
| 01:44:28 | <cadence> | what's the deal with the name failwhale? |
| 01:46:20 | <@JAA> | cadence: https://en.wikipedia.org/wiki/Failwhale |
| 01:46:48 | <cadence> | I see |
| 01:58:26 | | Stiletto quits [Ping timeout: 252 seconds] |
| 02:02:04 | | Dallas quits [Ping timeout: 240 seconds] |
| 02:08:48 | | Stiletto joins |
| 02:13:59 | | Dallas (Dallas) joins |
| 02:25:15 | <nico_32> | OrIdow6: yes framabee, framadrop, framanews, framastory |
| 02:26:45 | <nico_32> | framadrop is still up |
| 02:28:28 | <tech234a> | https://usercontent.irccloud-cdn.com/file/QRwyqSPf/ima15059258469648676385.png |
| 02:28:36 | <tech234a> | https://usercontent.irccloud-cdn.com/file/KgiPhAhU/ima7450677160033218090.png |
| 02:29:03 | <tech234a> | Images from cadence in Invidious Matrix |
| 02:29:44 | | Dallas quits [Ping timeout: 240 seconds] |
| 02:30:02 | <tech234a> | Glad to see the CEO of GitHub wants to see the YouTube-DL repo restored |
| 02:33:25 | <tech234a> | Though it seems they have been having difficulty contacting the maintainer |
| 02:34:02 | <@JAA> | This is not the right channel for that. |
| 02:38:35 | <tech234a> | Ok so that is for -ot, sorry |
| 02:55:59 | <nico_32> | https://arstechnica.com/gaming/2020/10/how-indiana-jones-fought-the-communists-and-led-an-era-of-activist-video-games/ |
| 02:56:12 | <nico_32> | i am sending the url into IA |
| 02:56:24 | <nico_32> | need to check after if it run from wbm |
| 03:13:54 | | SketchTheCow is now authenticated as SketchTheCow |
| 04:08:00 | | Dallas (Dallas) joins |
| 04:08:22 | | Jean-Fred quits [Ping timeout: 244 seconds] |
| 04:32:38 | | qw3rty__ joins |
| 04:36:04 | | qw3rty_ quits [Ping timeout: 240 seconds] |
| 05:08:11 | <mgrandi> | Welp, Playstation seems to have banned my IP lol |
| 05:08:36 | <mgrandi> | They allowed me to download all of my links and that finished more than 12 hours ago, hopefully the unban me soon |
| 05:51:41 | | 3INAAREDS is now known as Ctrl-S |
| 06:47:33 | | Smiley (Smiley) joins |
| 06:49:44 | | SmileyG quits [Ping timeout: 252 seconds] |
| 06:49:59 | <s-crypt> | What does scripts only mean for the google sites warrior project? |
| 06:54:43 | <Jake> | it won't run directly on the warrior VMs, you'll have to clone the script and run it or use the docker container. |
| 07:09:35 | <Arcorann> | It seems like there have been quite a few of those lately |
| 07:09:57 | <s-crypt> | So that would have nothing to do with why there is no console output on warrior web UI for google sites projects? |
| 07:10:46 | <Jake> | yes, the "scripts only" one's won't work on regular warriors. It should have an error somewhere. |
| 07:14:17 | <s-crypt> | It does not give me an error when I select it in the warrior. I am using the VM. |
| 07:17:45 | <s-crypt> | According to the repo, I can just select it from the UI |
| 07:22:34 | <cadence> | have you seen this issue? https://github.com/blackjack4494/yt-dlc/issues/9 |
| 07:22:51 | <cadence> | I like the idea that was posted there of moving discussion to a mailing list |
| 07:23:09 | <cadence> | mailing lists are not hard to use, and I think they're good because they don't require signing up for yet another account |
| 07:23:44 | <cadence> | of course the main advantage is that if the mailing list server gets taken offline, people can use their inboxes to reconstruct everything |
| 07:27:16 | | godane1 joins |
| 07:30:05 | | godane2 quits [Ping timeout: 252 seconds] |
| 07:39:56 | <s-crypt> | Ill move to #nearlylostmygoogles |
| 08:02:16 | <s-crypt> | Would it be appropriate to change the 'active' projects that are not available in warrior to 'hiatus'? |
| 08:02:26 | <s-crypt> | on https://archiveteam.org/index.php?title=Warrior_projects |
| 08:11:02 | <lennier1> | mgrandi Jean-Fred: The main problem I saw in WBM crawls of the Playstation store is that M-rated games got stuck on the age gate. Regarding completeness, I don't know. |
| 08:21:05 | <mgrandi> | Hmm, might need a cookie or smarter handling of those |
| 08:21:21 | <mgrandi> | I'm currently ip banned from playstation LOL, will need to do it on my DO box |
| 08:21:31 | <mgrandi> | Really hope this is temporary or else my ps4 is quite useless |
| 08:23:39 | | CorentinB joins |
| 08:58:52 | <mgrandi> | so, hot tip, don't be lazy and run stuff on your home network |
| 11:11:59 | <cadence> | I'm sure it'll be temporary since home IPs typically rotate. PS wouldn't want to ban people who got rotated onto a formerly banned address. Give it a couple of days. |
| 11:12:15 | <cadence> | Or if your address rotates, unplug and replug the router. |
| 11:13:28 | <mgrandi> | yeah. was being lazy , now its running on a Digital ocean instance |
| 11:13:56 | <mgrandi> | the funny thing was is that it completed successfully? so like if they thought i was flooding them then they aren't doing a good job at i |
| 11:15:03 | <mgrandi> | the site is awful, i can't get to the other regions without going to this specific page, clicking on a link, and then copying either the cookie or referer URL and putting that in my script |
| 11:54:21 | <mgrandi> | wget-at is suddenly not getting stuff it was retrieving before as page prereqs =/ skipping images |
| 12:13:20 | | dashcloud quits [Ping timeout: 252 seconds] |
| 12:35:57 | | tar-xvf quits [Ping timeout: 240 seconds] |
| 13:27:43 | | CorentinB quits [Client Quit] |
| 14:15:37 | | hurricos joins |
| 14:16:23 | | hurricos quits [Client Quit] |
| 14:23:10 | | Arcorann quits [Read error: Connection reset by peer] |
| 16:05:35 | | VADemon joins |
| 16:08:32 | | Wayward quits [Ping timeout: 252 seconds] |
| 16:12:41 | | Wayward (wayward) joins |
| 16:18:00 | | Wayward quits [Remote host closed the connection] |
| 16:33:17 | | LuMa joins |
| 16:34:19 | <LuMa> | i installed this https://hub.docker.com/r/archiveteam/warrior-dockerfile/ shouldnt it work with more then only URLTeam 2? |
| 16:38:04 | <justcool393> | "so, hot tip, don't be lazy and run stuff on your home network" 👀 i run way too many things on my home network |
| 16:39:25 | <tech234a> | LuMa: That is a docker for the whole warrior, you’d need to pull an image for the specific project you want to run https://hub.docker.com/u/warcforceone |
| 16:48:10 | | @arkiver quits [Excess Flood] |
| 16:48:22 | <LuMa> | So i install it and run it as a seperate thing? |
| 16:48:42 | | arkiver (arkiver) joins |
| 16:48:42 | | @ChanServ sets mode: +o arkiver |
| 17:13:29 | | dashcloud joins |
| 17:15:25 | | Ajay quits [Remote host closed the connection] |
| 17:36:59 | | klg quits [Quit: Lost terminal] |
| 17:40:12 | | klg (klg) joins |
| 17:46:38 | | dashcloud quits [Ping timeout: 252 seconds] |
| 18:08:44 | | HP_Archivist quits [Ping timeout: 240 seconds] |
| 18:12:22 | | Dallas quits [Client Quit] |
| 18:15:15 | | marked195 quits [Client Quit] |
| 18:15:22 | | Dallas (Dallas) joins |
| 18:15:38 | | OrIdow6 quits [Read error: Connection reset by peer] |
| 18:15:56 | | OrIdow6 (OrIdow6) joins |
| 18:20:40 | | tar-xvf joins |
| 18:21:41 | | tar-xvf is now known as odemg |
| 18:22:41 | | marked195 joins |
| 18:27:43 | | summerisle (summerisle) joins |
| 18:29:18 | <purplebot> | Warrior projects edited by S-crypt (+364, Added google sites, github, and …) just now -- https://www.archiveteam.org/?diff=45709&oldid=44433 |
| 18:30:06 | <tech234a> | LuMa: yes. I think you have to pull and run the project image. |
| 18:33:45 | <LuMa> | I could get the whole warrior running but i don't know how to run a specific image |
| 18:44:39 | <tech234a> | Elsewhere someone provided this example: docker run warcforceone/google-sites-grab:latest username |
| 18:44:47 | <tech234a> | (replace username with your name) |
| 19:01:34 | <tech234a> | LuMa: ^ |
| 19:09:20 | <LuMa> | Got it running any way to interface with it and can i run multiple different projects |
| 19:23:56 | <tech234a> | LuMa: not really sure... I think there is a web server that runs by default. And there are a few CLI parameters you can set like --concurrent N |
| 19:24:21 | <tech234a> | If you want to run multiple separate docker containers, you can run multiple projects |
| 19:25:41 | <tech234a> | Tagging arkiver and Orldow6 just to make sure what I said above is correct |
| 19:25:43 | <LuMa> | Doe you know what port it runs on? |
| 19:26:59 | <tech234a> | I think default is 8001 (based on looking at source code) |
| 19:28:01 | <tech234a> | 8688 or 8681 also appear in the code but I don't think it's on those |
| 19:29:22 | <LuMa> | Nope doesnt work for me but i noticed it doesnt say any port on the docker like the normal warrior |
| 19:29:46 | <LuMa> | https://cdn.discordapp.com/attachments/399975242417569795/770368555186651186/unknown.png |
| 19:31:45 | <tech234a> | Also pinging wessel1512 in case they know anything about this ^ |
| 19:38:43 | <tech234a> | LuMa: here is a list of parameters for the CLI, you can try specifying a port https://www.irccloud.com/pastebin/zbfBGBgM/ |
| 19:42:33 | <LuMa> | So say i want to specifiy the port 8002 how would i type it? |
| 19:42:58 | <@JAA> | I think you need to expose the port through Docker as well, else it's only available in the container? I'm not very familiar with Docker though. |
| 19:48:13 | <LuMa> | run-pipeline3: error: the following arguments are required: PIPELINE, DOWNLOADER |
| 19:48:38 | <LuMa> | What should i type? |
| 19:50:14 | <tech234a> | On one project I just built the image with the command I needed https://www.irccloud.com/pastebin/DJfnmyjs/Dockerfile |
| 19:50:38 | <tech234a> | (edited to remove timestamp) |
| 19:52:51 | <tech234a> | LuMa: try building and running the image like these examples in the Docker docs: https://docs.docker.com/get-started/part2/#build-and-test-your-image https://docs.docker.com/get-started/part2/#build-and-test-your-image |
| 19:55:57 | <LuMa> | Might do that later but i can see it working in the logs and i see my name leaderboard so for now i will let it be but if i start another project i will try with what you linked |
| 19:58:34 | <tech234a> | Alright :) |
| 19:59:07 | <mgrandi> | The args are the pipeline script and your username for the tracker |
| 20:05:46 | | lennier2 joins |
| 20:08:24 | | lennier1 quits [Ping timeout: 240 seconds] |
| 20:08:26 | | lennier2 is now known as lennier1 |
| 20:17:25 | <mgrandi> | The only thing was that the docket image couldn't build the wget-at binary, it needs to be upgraded to a later version of ubuntu |
| 20:39:10 | | dashcloud joins |
| 21:07:58 | | fionera quits [Quit: fionera] |
| 21:08:12 | | fionera (Fionera) joins |
| 21:23:51 | | godane1 quits [Read error: Connection reset by peer] |
| 21:24:56 | | godane (godane) joins |
| 22:32:00 | | Dallas quits [Client Quit] |
| 22:35:19 | | Arcorann (Arcorann) joins |
| 22:35:35 | | Dallas (Dallas) joins |
| 22:48:22 | <Ryz> | Wondering if RedBubble is worth a proactive archive because of https://twitter.com/DAVID_FIRTH/status/1320570963117903878 - problem is, shopping website of the wazoo |
| 22:59:35 | <@arkiver> | a project is coming up archiving URLs (outlinks) discovered in some projects and from other sources |
| 22:59:46 | <@arkiver> | not sure if it was mentioned here already |
| 23:00:04 | <@arkiver> | was talked about a bit in other channels |
| 23:00:58 | <@arkiver> | in this case the outlinks would be archived without page requisites (at least for now), so it'll mostly be HTML, but without the images |
| 23:01:10 | <@arkiver> | this is due to size, to keep it down, but at the same time archive valuable data |
| 23:19:24 | | Dallas quits [Ping timeout: 240 seconds] |
| 23:39:00 | | DLoader_ joins |
| 23:41:56 | | DLoader quits [Ping timeout: 252 seconds] |
| 23:42:00 | | DLoader_ is now known as DLoader |
| 23:54:19 | <purplebot> | File:Docker-Logo-White-RGB Vertical.png uploaded by Arkiver (+0) just now -- https://www.archiveteam.org/?diff=45710&oldid=0 |
| 23:55:20 | <purplebot> | File:Docker-Logo-White-RGB Horizontal.png uploaded by Arkiver (+0) just now -- https://www.archiveteam.org/?diff=45711&oldid=0 |
| 23:55:20 | <purplebot> | File:Horizontal-logo-monochromatic-white.png uploaded by Arkiver (+0) just now -- https://www.archiveteam.org/?diff=45712&oldid=0 |
| 23:55:20 | <purplebot> | File:Vertical-logo-monochromatic.png uploaded by Arkiver (+0) just now -- https://www.archiveteam.org/?diff=45713&oldid=0 |
| 23:55:20 | <purplebot> | File:Docker-Logo-White-RGB Moby.png uploaded by Arkiver (+0) just now -- https://www.archiveteam.org/?diff=45714&oldid=0 |
| 23:55:20 | <purplebot> | File:Moby-logo.png uploaded by Arkiver (+0) just now -- https://www.archiveteam.org/?diff=45715&oldid=0 |