| 00:00:54 | <h2ibot> | JAABot edited List of websites excluded from the Wayback Machine (+0): https://wiki.archiveteam.org/?diff=51830&oldid=51827 |
| 00:20:57 | <h2ibot> | Bear edited List of websites excluded from the Wayback Machine (+72, Merged my duplicate with existing "www." entry…): https://wiki.archiveteam.org/?diff=51831&oldid=51830 |
| 00:37:00 | <h2ibot> | Bear edited List of websites excluded from the Wayback Machine (+191, Deno, Market-Ticker (not excluded as of 2019)): https://wiki.archiveteam.org/?diff=51832&oldid=51831 |
| 00:48:02 | <h2ibot> | Bear edited List of websites excluded from the Wayback Machine/Former exclusions (+137, unibo.it - excluded in 2014): https://wiki.archiveteam.org/?diff=51833&oldid=51829 |
| 00:56:51 | | midou quits [Ping timeout: 272 seconds] |
| 01:01:04 | <h2ibot> | JAABot edited List of websites excluded from the Wayback Machine (+0): https://wiki.archiveteam.org/?diff=51834&oldid=51832 |
| 01:05:54 | <tzt> | did we grab telam.com.ar before it was shut down? |
| 01:06:35 | | datechnoman quits [Quit: The Lounge - https://thelounge.chat] |
| 01:07:10 | | datechnoman (datechnoman) joins |
| 01:12:28 | <fireonlive> | tzt: looks like there was a job on 20240302: https://archive.fart.website/archivebot/viewer/?q=telam.com.ar https://archive.fart.website/archivebot/viewer/job/202403021304579zj4w |
| 01:15:50 | | atphoenix quits [Read error: Connection reset by peer] |
| 01:16:41 | | Carnildo quits [Remote host closed the connection] |
| 01:16:44 | | HP_Archivist quits [Read error: Connection reset by peer] |
| 01:16:49 | | Carnildo joins |
| 01:17:09 | | HP_Archivist (HP_Archivist) joins |
| 01:17:26 | | atphoenix (atphoenix) joins |
| 01:20:44 | <fireonlive> | idk why, but this popped up in my search alerts. so have a look if you haven't seen it already maybe? https://www.youtube-nocookie.com/embed/fYI_XtT7sgQ?rel=0 |
| 01:20:57 | <fireonlive> | "DEF CON 19 - Jason Scott - Archive Team: A Distributed Preservation of Service Attack" |
| 02:58:10 | | angenieux quits [Client Quit] |
| 02:58:40 | | angenieux (angenieux) joins |
| 03:00:21 | | cascode quits [Ping timeout: 272 seconds] |
| 03:03:29 | | cascode joins |
| 03:04:28 | | cascode quits [Read error: Connection reset by peer] |
| 03:04:44 | | cascode joins |
| 03:21:45 | | icedice quits [Client Quit] |
| 05:15:15 | | Earendil7 quits [Ping timeout: 272 seconds] |
| 05:15:38 | | Earendil7 (Earendil7) joins |
| 05:31:36 | | BlueMaxima quits [Read error: Connection reset by peer] |
| 05:36:29 | | Island quits [Read error: Connection reset by peer] |
| 05:50:35 | | bilboed quits [Quit: The Lounge - https://thelounge.chat] |
| 05:50:58 | | bilboed joins |
| 06:51:00 | | lukash988 joins |
| 06:52:47 | | lukash98 quits [Ping timeout: 272 seconds] |
| 06:55:34 | | lukash988 quits [Ping timeout: 255 seconds] |
| 07:00:30 | <@arkiver> | JAA: would it be possible to get those complete notes online? |
| 07:00:55 | <@arkiver> | it would be good to have a possibility again to archive onions |
| 07:01:08 | <@arkiver> | it would not be used for other stuff thouhg |
| 07:01:09 | <@arkiver> | though* |
| 07:01:42 | <@JAA> | Oh, I forgor to actually say it, yeah, I'll try to get those notes into the repo soon. |
| 07:02:18 | <@arkiver> | was this where we previously put the AB Tor WARCs in? https://archive.org/details/archiveteam_tor |
| 07:02:52 | <@JAA> | Yeah |
| 07:03:13 | <@arkiver> | yeah we can push them to there again |
| 07:04:14 | <@arkiver> | among the things we archived back then https://web.archive.org/web/20170828222033/http://dstormer6em3i4km.onion/ |
| 07:04:29 | <fireonlive> | ah! i was just about to ask if onions would be visible in the WBM |
| 07:04:30 | <fireonlive> | :) |
| 07:04:37 | <@arkiver> | fireonlive: absolutely |
| 07:04:45 | <fireonlive> | awesome |
| 07:06:16 | <@arkiver> | fireonlive: another https://web.archive.org/web/20170907044151/http://v4gn2k725iokfu4u.onion/ |
| 07:06:31 | | pabs wonders if we should let the Tor community know about this |
| 07:06:43 | <fireonlive> | :) |
| 07:06:53 | <@arkiver> | pabs: i think we can treat it as we treat normal AB |
| 07:07:04 | <@arkiver> | pabs: or do you mean the wayback machine viewable stuff? |
| 07:07:22 | <@arkiver> | https://web.archive.org/web/20170906085941/http://highkua2k3ytqdqs.onion/ |
| 07:07:27 | <pabs> | I mean that AB will be saving onions again |
| 07:07:36 | <pabs> | they might have some ideas of things to save |
| 07:07:36 | <fireonlive> | hmm, I2P would be interesting one day perhaps |
| 07:08:01 | <fireonlive> | oh, i was thinking of ipfs |
| 07:08:14 | <fireonlive> | two different things! |
| 07:08:18 | <@arkiver> | fireonlive: i never looked into I2P much |
| 07:08:23 | <@arkiver> | oh IPFS |
| 07:08:25 | | pabs wonders if IA will start sharing things over IPFS :) |
| 07:08:26 | <@arkiver> | yeah maybe |
| 07:08:46 | <@arkiver> | pabs: no idea, i didn't hear much about it |
| 07:08:54 | <fireonlive> | i saw an I2P link on https://web.archive.org/web/20170907044151/http://v4gn2k725iokfu4u.onion/ and confused it with ipfs for a moment |
| 07:09:27 | <@arkiver> | pabs: yeah on the tor community. at the same time, the general "internet community" would have ideas about what to archive on the internet with AB, and we're not explicitly advertising AB to the world |
| 07:09:36 | <@arkiver> | i think we could treat TorAB the same |
| 07:09:42 | <pabs> | true |
| 07:10:00 | <@arkiver> | if it makes sense to mention somewhere, we could go "hey, you might want to let AT know, they have a Tor archiving operation running" |
| 07:12:07 | <fireonlive> | could an existing pipeline be used for tor as well or would it need a new dedi i wonder |
| 07:12:18 | <fireonlive> | pipeline's server* i guess |
| 07:13:01 | | Arcorann (Arcorann) joins |
| 07:13:17 | <@arkiver> | probably best answered by JAA ^ |
| 07:13:45 | <@arkiver> | but i wonder if we can just disable the Tor one by default, and only enable it when explicitly given as pipeline to run on? |
| 07:14:18 | <@JAA> | I'll have to look for the notes from the 2018 iteration. I think that did some iptables magic. Which *could* be made to work on an existing machine in principle, I guess. |
| 07:14:29 | <magmaus3> | for example as an parameter? |
| 07:14:42 | <@JAA> | arkiver: Yes, that's how it worked in 2018. The Tor pipelines only processed jobs queued with `--pipeline tor`. |
| 07:14:46 | <magmaus3> | ah |
| 07:15:25 | <@arkiver> | that could work |
| 07:15:54 | <@arkiver> | maybe with a special !a-tor or so command for h2ibot which subsequently posts a `--pipeline tor` one |
| 07:16:44 | <pabs> | -p tor isn't too much to type that !a-tor seems needed? |
| 07:17:12 | <@JAA> | Yeah, `--pipeline` = `-p`, so that's short enough, I'd say. |
| 07:19:09 | <@arkiver> | alright |
| 07:36:57 | | qwertyasdfuiopghjkl quits [Remote host closed the connection] |
| 07:38:23 | <@arkiver> | SootBector: we'll likely look now first into getting a tor pipeline on one of the existing machine (or, well, JAA is going to check that) |
| 07:40:49 | | Viper joins |
| 07:41:16 | | Viper quits [Remote host closed the connection] |
| 07:51:10 | | Chris5010 quits [Remote host closed the connection] |
| 07:54:56 | <pabs> | arkiver JAA - another thing to consider is Tor exit node IP reputation varies quite a bit, so being able to rotate exit nodes or choose which country to exit from would be useful |
| 07:55:29 | <pabs> | the country stuff would be really useful for geoblocked sites that AB curren'tly can't access |
| 07:57:46 | <@JAA> | pabs: IIRC, this kind of stuff is a massive pain to do programmatically. Last time I played with that, the only and poor solution to 'I need a new circuit for X' was 'restart Tor entirely'. |
| 08:00:21 | <pabs> | I think there are things to do that now. selektor for eg is a GUI. python3-stem for Python |
| 08:00:47 | <fireonlive> | hmm there's newnym, but it's not granular |
| 08:00:53 | <@JAA> | > Stem is mostly unmaintained. |
| 08:00:55 | <@JAA> | Sounds fun. |
| 08:01:58 | <fireonlive> | https://spec.torproject.org/control-spec/commands.html#signal |
| 08:02:29 | <pabs> | also https://github.com/torpyorg/torpy |
| 08:02:58 | <pabs> | oh, only v2 onions |
| 08:03:51 | <@JAA> | Oh, you can't change the circuit for just a single site at all? TIL. |
| 08:06:01 | <@JAA> | So we'd need a separate Tor instance per job to be able to control the circuit at that granularity at least, I guess. Ugh... |
| 08:06:25 | <fireonlive> | not up on the new stuff but i don't think so |
| 08:07:09 | <@JAA> | Yeah, I don't see that happening soon. |
| 08:08:37 | <fireonlive> | yeah indeed.. |
| 08:09:54 | <@arkiver> | pabs: does that matter much for .onion addresses? |
| 08:10:08 | <pabs> | no, only for clearnet stuff |
| 08:10:38 | <pabs> | exit nodes aren't involved in onion services |
| 08:48:39 | | Darken2 quits [Remote host closed the connection] |
| 08:49:05 | | Darken2 (Darken) joins |
| 09:10:13 | | nulldata quits [Ping timeout: 272 seconds] |
| 09:16:43 | | nulldata (nulldata) joins |
| 09:21:37 | | lennier2_ quits [Ping timeout: 272 seconds] |
| 09:26:22 | <katia> | needs kubernetes |
| 09:28:11 | | testing joins |
| 09:28:27 | | testing quits [Remote host closed the connection] |
| 09:39:21 | | TastyWiener954 quits [Ping timeout: 272 seconds] |
| 09:39:34 | | TastyWiener954 (TastyWiener95) joins |
| 09:45:30 | | qwertyasdfuiopghjkl (qwertyasdfuiopghjkl) joins |
| 10:00:01 | | Bleo18260 quits [Client Quit] |
| 10:01:22 | | Bleo18260 joins |
| 10:17:02 | | midou joins |
| 10:26:51 | | midou quits [Ping timeout: 272 seconds] |
| 11:15:49 | | bigcoolplane1291 joins |
| 11:16:01 | | bigcoolplane1291 quits [Remote host closed the connection] |
| 11:44:17 | | nulldata quits [Client Quit] |
| 12:03:50 | | nulldata (nulldata) joins |
| 12:44:55 | | Arcorann quits [Ping timeout: 272 seconds] |
| 13:00:39 | | inti83 joins |
| 13:00:57 | <inti83> | hi all, how are you? I've been in and out here in regards to Argentina archive |
| 13:01:33 | <inti83> | So yesterday the main public news provider and archive Telam was taken down, most of it was archived by AB and others luckily |
| 13:02:30 | <inti83> | And now they are talking of taking down cine.ar, which has most nationally produced cinema. This site is behind Cloudflare so wasn't archived. It was spoken about here that you may have contacts in Buenos Aires to host a local ArchiveBot... Did anythingcome of it? |
| 13:04:50 | <inti83> | I think JAA mentioned they had contacts in https://www.cabase.org.ar |
| 13:05:22 | <inti83> | We have some automation in place to use as a way to download the content, but we don't have the space to do it |
| 13:06:33 | <inti83> | Just to reiterate, the site we are talking about is cine.ar - it has most if not all of the INCAA produced cinema, another organism they are taking down |
| 13:11:34 | <pabs> | looks like you have to register to watch anything? |
| 13:29:27 | <inti83> | anyone can register |
| 13:29:43 | <inti83> | Anyone in Argentina at least |
| 13:30:02 | <inti83> | I understand at least grab-site and wpull have an authn option |
| 13:59:45 | <SootBector> | arkiver: JAA - great. ping me in any case if the install notes get updated - I have a server mostly sitting idle and would like to try installing just to see how things fit together. |
| 13:59:52 | <SootBector> | re: selecting Tor exits/countries, an approach might be to configure a list in torrc each on its own SocksPort then have AB just change which port it connects to. |
| 14:17:55 | <SootBector> | sending a different socks username:password (which can be anything) will give you a fresh circuit but not necessarily a different exit |
| 14:20:53 | | Maika (Maika) joins |
| 14:21:19 | | Maika quits [Client Quit] |
| 14:23:30 | | Ketchup901 quits [Ping timeout: 255 seconds] |
| 14:23:48 | | Ketchup901 (Ketchup901) joins |
| 14:41:55 | <SootBector> | manpage seems to say you can't select ExitNodes [countrycode] per-SocksPort, but a tor process could be spun up on demand with that option set on the commandline |
| 14:46:54 | | icedice (icedice) joins |
| 14:55:20 | | midou joins |
| 14:59:58 | | Letur quits [Quit: Client Quit] |
| 15:03:35 | | Letur joins |
| 15:09:47 | <SootBector> | tor --SocksPort 9090 --ExitNodes {ES} yes that works |
| 15:11:56 | | Matthww quits [Quit: Ping timeout (120 seconds)] |
| 15:12:09 | | Matthww joins |
| 15:32:20 | <SootBector> | and a map of exits https://hackertarget.com/tor-exit-node-visualization/ |
| 15:36:32 | | Wohlstand (Wohlstand) joins |
| 15:56:01 | | f_ quits [Ping timeout: 255 seconds] |
| 15:57:13 | | Swryl quits [Client Quit] |
| 16:01:58 | <@arkiver> | queuing bot will now note when it is started and stopped |
| 16:03:11 | <inti83> | I have to go now will check logs for any updates, thanks! |
| 16:03:15 | | inti83 quits [Remote host closed the connection] |
| 16:06:17 | | Wohlstand quits [Client Quit] |
| 16:07:08 | <@arkiver> | there was also a big that caused slots to be hardly found, effectively making one job run at a time, that is fixed now |
| 16:10:24 | | Darken2 quits [Remote host closed the connection] |
| 16:10:48 | | Darken2 (Darken) joins |
| 16:52:20 | | f_ (funderscore) joins |
| 16:56:07 | <fireonlive> | https://dl.fireon.live/irc/d6790cdce49fe76f/image.png < “Hidden Birds” site/wiki (from the “TeraLeak” (ugh)) to go down |
| 16:56:33 | <fireonlive> | oh and forum. not sure at the moment where they reside… |
| 16:56:56 | <@arkiver> | forum is discord here? :P |
| 16:57:13 | <fireonlive> | ah: https://hiddenbirds.ultra0.ar/ |
| 16:57:27 | <fireonlive> | :P |
| 16:58:14 | <@arkiver> | some day people will discover we archived a ton of imgur, label it a leak, put some stupid name on it, and advertise it as something new they found |
| 16:58:38 | <@arkiver> | fireonlive: they did make the front page of https://hiddenbirds.ultra0.ar/ pretty nice thouhg |
| 16:58:43 | <fireonlive> | ugh yeah xD |
| 16:58:52 | <fireonlive> | indeed! |
| 17:02:32 | <fireonlive> | *someone finds our wiki* “holy crap, leak motherload” |
| 17:35:26 | | lennier1 (lennier1) joins |
| 17:35:48 | | T31M quits [Quit: ZNC - https://znc.in] |
| 17:36:08 | | T31M joins |
| 17:37:44 | | T31M is now authenticated as T31M |
| 18:00:19 | | systwi quits [Ping timeout: 272 seconds] |
| 18:04:48 | | systwi (systwi) joins |
| 18:06:40 | | Wohlstand (Wohlstand) joins |
| 18:14:46 | <@JAA> | inti83: That wasn't me. |
| 18:15:02 | <@JAA> | SootBector: Good info, thanks! |
| 18:17:50 | <SootBector> | I'll investigate if changing ExitNodes is possible via commands to ControlPort |
| 18:18:18 | <@JAA> | FWIW, integrating that into AB still sounds painful and unlikely to happen soon, but yeah, would be nice. |
| 18:20:32 | <SootBector> | also found a feature where you append an exit's fingerprint and .exit to the URL's domain to set it on-the-fly. not yet sure if you can enable that for * |
| 18:31:17 | <@JAA> | inti83: I can access cine.ar fine, but it looks like accessing the content may require registration. |
| 18:32:13 | | karlosescrito joins |
| 18:32:55 | | karlosescrito quits [Remote host closed the connection] |
| 18:35:36 | | BearFortress quits [Quit: https://quassel-irc.org - Chat comfortably. Anywhere.] |
| 18:36:50 | | Island joins |
| 18:39:17 | | Darken2 quits [Remote host closed the connection] |
| 18:47:31 | | Darken (Darken) joins |
| 18:50:12 | | Darken quits [Remote host closed the connection] |
| 18:57:02 | | BearFortress joins |
| 19:07:26 | <fireonlive> | "Rooster Teeth to shut down" https://twitter.com/geoffkeighley/status/1765424377166708930 |
| 19:07:26 | <eggdrop> | nitter: https://farside.link/nitter/geoffkeighley/status/1765424377166708930 |
| 19:08:35 | <fireonlive> | more details: https://deadline.com/2024/03/rooster-teeth-shut-down-warner-bros-discovery-roost-podcast-continue-1235847264/ |
| 19:10:03 | <fireonlive> | 8.9k videos on their main channel wow lol |
| 19:34:24 | <fireonlive> | threw the main channel to DTT but will have to return to it later |
| 19:35:07 | | icedice2 (icedice) joins |
| 19:39:13 | | icedice quits [Ping timeout: 255 seconds] |
| 19:39:17 | | Wohlstand quits [Client Quit] |
| 19:52:23 | | line joins |
| 19:53:43 | | icedice2 quits [Client Quit] |
| 20:09:37 | <mikolaj|m> | pabs: might be worth archiving all this, some mailing lists (such as agda and agda-dev) are public https://lists.chalmers.se/mailman/listinfo |
| 20:45:16 | | Guest54 joins |
| 20:53:34 | | BlueMaxima joins |
| 21:48:57 | | Earendil7 quits [Ping timeout: 272 seconds] |
| 21:49:02 | | Earendil7_ (Earendil7) joins |
| 21:59:48 | | thuban quits [Read error: Connection reset by peer] |
| 22:01:49 | | lunik173 is now known as lunik1 |
| 22:03:16 | <lunik1> | + 3.1k on Achievement Hunter, + 4k on Let's Play and there's more besides… |
| 22:39:00 | <fireonlive> | lunik1: if you have a list of their youtube channels please do let #down-the-tube know |
| 22:39:26 | <fireonlive> | i haven't been able to return to looking up who/what they are quite yet |
| 22:40:03 | <lunik1> | will do. won't be exhaustive but I'll send what I remember |
| 22:40:25 | <lunik1> | what's the preferred pastebin to use? |
| 22:41:00 | <katia> | https://transfer.archivete.am |
| 22:51:42 | <fireonlive> | for the channels directly you can `!ac <channel url> -e "https://deadline.com/2024/03/rooster-teeth-shut-down-warner-bros-discovery-roost-podcast-continue-1235847264/"` |
| 22:51:46 | <fireonlive> | -e is "explain" in this instance |
| 22:52:42 | <fireonlive> | (anything can be added if it falls within the "scope" of #down-the-tube, explain is to say why it does: https://wiki.archiveteam.org/index.php/YouTube#Scope) but let's take further talk there |
| 23:31:33 | | Matthww quits [Ping timeout: 272 seconds] |
| 23:36:52 | | Matthww joins |
| 23:57:18 | | thuban (thuban) joins |