| 00:00:02 | | Guest50 quits [Client Quit] |
| 00:01:30 | | Guest50 joins |
| 00:06:40 | | umgr036 quits [Remote host closed the connection] |
| 00:06:54 | | umgr036 joins |
| 00:20:56 | | Guest50 quits [Ping timeout: 252 seconds] |
| 00:29:55 | | DopefishJustin quits [Ping timeout: 265 seconds] |
| 00:33:36 | | fishingforsoup joins |
| 00:35:31 | | UserH joins |
| 00:55:55 | | umgr036 quits [Remote host closed the connection] |
| 00:59:09 | | umgr036 joins |
| 00:59:58 | | umgr036 quits [Remote host closed the connection] |
| 01:00:12 | | umgr036 joins |
| 01:00:52 | <lennier1> | Might be hard to actually find an old account unless you're already following it. I kind of assume they're just making this up as they go. |
| 01:06:56 | <jamesp> | I wonder how users can view the archived accounts |
| 01:18:56 | | DopefishJustin joins |
| 01:18:56 | | DopefishJustin is now authenticated as DopefishJustin |
| 01:22:07 | | jamesp quits [Remote host closed the connection] |
| 01:22:51 | | dumbgoy__ joins |
| 01:26:34 | | dumbgoy_ quits [Ping timeout: 252 seconds] |
| 01:44:14 | | HP_Archivist (HP_Archivist) joins |
| 01:54:37 | | DopefishJustin quits [Ping timeout: 252 seconds] |
| 01:55:34 | | DopefishJustin (DopefishJustin) joins |
| 02:11:08 | | A joins |
| 02:12:17 | | icedice quits [Read error: Connection reset by peer] |
| 02:14:53 | | A quits [Remote host closed the connection] |
| 02:41:22 | | Sluggs quits [Excess Flood] |
| 02:43:03 | | Sluggs joins |
| 02:49:04 | | spirit quits [Ping timeout: 252 seconds] |
| 02:49:18 | | spirit joins |
| 02:53:40 | <h2ibot> | Tech234a edited List of largest ArchiveTeam projects (+424, Add some additional projects): https://wiki.archiveteam.org/?diff=49754&oldid=41691 |
| 02:54:46 | <tech234a> | ^ this page is still very incomplete but I tried to add the projects with more than 1 PiB of data |
| 03:03:22 | | dumbgoy__ quits [Ping timeout: 252 seconds] |
| 03:08:19 | | HP_Archivist quits [Ping timeout: 252 seconds] |
| 03:14:02 | <Jake> | voltagex|m: do you have any details on which are removed or links to them? |
| 03:14:10 | <@JAA> | voltagex|m: Is this another one than what was previously announced for 1 May? |
| 03:14:19 | <@JAA> | https://old.reddit.com/r/DataHoarder/comments/10da7a9/official_synology_download_site_closing_legacy/ |
| 03:15:07 | <@JAA> | https://archive.synology.com/download/ was archived completely in January. |
| 03:15:20 | <voltagex|m> | Sorry, slow on the uptake. I saw a YouTube video about it and thought it was a new announcement |
| 03:15:48 | <@arkiver> | voltagex|m: no need to apologize, always good to double check this is or has been on the radar |
| 03:15:57 | <@JAA> | ^ |
| 03:16:08 | <@JAA> | Louis Rossmann did a video it seems. |
| 03:18:50 | <@JAA> | Do you have any more details about it? Source for the date perhaps? |
| 04:01:42 | <voltagex|m> | An email forwarded to Rossmann by a viewer |
| 04:03:04 | | nicolas17 quits [Ping timeout: 265 seconds] |
| 04:44:57 | | TastyWiener95 (TastyWiener95) joins |
| 04:53:25 | | user__ joins |
| 04:53:27 | | umgr036 quits [Remote host closed the connection] |
| 05:02:28 | | user__ quits [Remote host closed the connection] |
| 05:02:42 | | user__ joins |
| 05:15:11 | | ZizzyDizzyMC quits [Remote host closed the connection] |
| 05:26:47 | | Island quits [Read error: Connection reset by peer] |
| 05:49:47 | | QuantumLTU joins |
| 05:53:34 | | umgr036 joins |
| 05:54:26 | | lflare (lflare) joins |
| 05:55:12 | | user__ quits [Ping timeout: 265 seconds] |
| 06:11:07 | | Minkafighter7225 quits [Quit: The Lounge - https://thelounge.chat] |
| 06:11:39 | | Minkafighter7225 joins |
| 06:13:39 | | BlueMaxima quits [Client Quit] |
| 06:18:15 | | gamer191 joins |
| 06:20:13 | | gamer191 quits [Remote host closed the connection] |
| 06:27:16 | <vokunal|m> | The network charts on my web ui aren't working |
| 06:31:18 | <h2ibot> | Tech234a edited Reddit (+270, Add some recent updates): https://wiki.archiveteam.org/?diff=49755&oldid=49729 |
| 06:35:17 | | systwi quits [Read error: Connection reset by peer] |
| 06:36:07 | | systwi (systwi) joins |
| 06:36:10 | | datechnoman quits [Quit: The Lounge - https://thelounge.chat] |
| 06:36:46 | | datechnoman (datechnoman) joins |
| 06:37:01 | | tsblock (tsblock) joins |
| 06:45:20 | <h2ibot> | Tech234a edited Tracker (+414, Add some updates, mention the userscript): https://wiki.archiveteam.org/?diff=49756&oldid=48655 |
| 06:46:20 | <h2ibot> | Tech234a edited Tracker (+17, Userscript is unofficial): https://wiki.archiveteam.org/?diff=49757&oldid=49756 |
| 06:53:48 | | Sluggs quits [Read error: Connection reset by peer] |
| 06:59:00 | | NuVanDibe joins |
| 07:00:20 | | Arcorann (Arcorann) joins |
| 07:01:04 | | NuVanDibe quits [Remote host closed the connection] |
| 07:07:24 | <h2ibot> | Knot126 edited Geometry Dash (+175, Old URL is dead, replacing with new URL and…): https://wiki.archiveteam.org/?diff=49758&oldid=49322 |
| 07:17:47 | | qwertyasdfuiopghjkl quits [Client Quit] |
| 07:19:05 | | qwertyasdfuiopghjkl (qwertyasdfuiopghjkl) joins |
| 09:00:45 | <h2ibot> | JAABot edited CurrentWarriorProject (+2): https://wiki.archiveteam.org/?diff=49759&oldid=49741 |
| 09:22:48 | | tempuser joins |
| 09:25:44 | | QuantumLTU quits [Remote host closed the connection] |
| 09:26:43 | | quantumltu joins |
| 09:29:52 | | LeGoupil joins |
| 09:43:07 | | fplayer joins |
| 09:45:25 | <fplayer> | Hello everyone, i've got a question. I was trying to find old xfire archives but i'm not really capable of understanding the technical part of it. I've found some bonefire stuff thats around 25--20GB and then i downloaded the Warrior app on a virtual machine and i was supposed to select Xfire on the project list but i can't find it. I just want to |
| 09:45:26 | <fplayer> | see if i can fnd any of my screenshots or videos. Could you guys help me out? |
| 09:50:12 | <appledash> | It's kind of quiet here for the past few hours, so you may be waiting a bit, but hopefully someone will be able to help you |
| 09:58:19 | | fplayer quits [Ping timeout: 265 seconds] |
| 10:10:51 | | BigBrain quits [Ping timeout: 245 seconds] |
| 10:23:28 | | BigBrain (bigbrain) joins |
| 10:37:06 | <masterx244|m> | the warrior is used for gathering data and not for extracting. |
| 10:37:06 | <masterx244|m> | the data captured back then got added to the wayback machine |
| 10:44:14 | | TastyWiener95 quits [Ping timeout: 265 seconds] |
| 10:57:57 | | sec^nd quits [Ping timeout: 245 seconds] |
| 11:00:06 | <h2ibot> | JAABot edited CurrentWarriorProject (-2): https://wiki.archiveteam.org/?diff=49760&oldid=49759 |
| 11:00:56 | | sec^nd (second) joins |
| 11:02:03 | | HP_Archivist (HP_Archivist) joins |
| 11:10:11 | | umgr036 quits [Remote host closed the connection] |
| 11:10:29 | | umgr036 joins |
| 11:23:22 | | user_ joins |
| 11:23:24 | | umgr036 quits [Remote host closed the connection] |
| 11:34:33 | | htesttwi quits [Remote host closed the connection] |
| 11:35:30 | | x-56k-modem (x-56k-modem) joins |
| 11:39:06 | | fplayer joins |
| 11:39:19 | <fplayer> | hopefully |
| 11:48:13 | <Billy549> | fplayer - content is stored at https://archive.org/details/archiveteam_xfire |
| 11:48:30 | <Billy549> | "Archives are stored in WARC format on the Internet Archive in the archiveteam_xfire collection. Content is also be accessible through the Wayback Machine, however, note that much of the content couldn't be saved from their original urls, but from crash.xfire.com instead of social.xfire.com, so ArchiveTeam's crawls must be searched for in the Wayback Machine that way. Also, for technical reasons, html pages of the |
| 11:48:30 | <Billy549> | screenshots weren't saved, only the screenshots themselves." |
| 11:55:59 | <@rewby|backup> | fplayer is already gone |
| 11:56:05 | <@rewby|backup> | Oh wait they're back |
| 12:04:40 | | dumbgoy__ joins |
| 12:05:16 | | icedice (icedice) joins |
| 12:11:23 | | user__ joins |
| 12:11:24 | | user_ quits [Remote host closed the connection] |
| 12:12:17 | | HP_Archivist quits [Client Quit] |
| 12:24:29 | | eroc1990 quits [Quit: The Lounge - https://thelounge.chat] |
| 12:25:10 | | eroc1990 (eroc1990) joins |
| 12:44:22 | | sonick quits [Client Quit] |
| 12:45:04 | | fplayer quits [Ping timeout: 265 seconds] |
| 12:45:04 | | elon quits [Ping timeout: 265 seconds] |
| 13:30:09 | | Rotietip joins |
| 13:30:36 | <Rotietip> | Hello all. According to https://wiki.archiveteam.org/index.php/Frequently_Asked_Questions#halp_pls_halp I must have a "whitelisted" account in Internet Archive for the content of a uploaded WARC to be indexed in Wayback Machine. Now, where should I request that (the FAQ doesn't make it clear) and how long does it take to get it approved? |
| 13:33:15 | <@kaz> | this is uh, not entirely trie |
| 13:33:41 | <@kaz> | true*. It just needs to have mediatype:web set on the item (and uploaded to a collection with the same) I believe. No doubt I'll get corrected in a second |
| 13:34:19 | <masterx244|m> | and being in a collection below the web crawls collection. regular users cannot get something in that collection "tree" |
| 13:37:32 | <Rotietip> | And what about https://gist.github.com/Asparagirl/6206247 ? Is it still valid? |
| 13:41:11 | | HP_Archivist (HP_Archivist) joins |
| 13:41:13 | | VerifiedJ quits [Quit: The Lounge - https://thelounge.chat] |
| 13:41:40 | | VerifiedJ (VerifiedJ) joins |
| 13:41:46 | <masterx244|m> | that document shows how to do the mediatype and upload without the IA commandline tool. but it looks basically like it would be correct (setting mediatype to web). using the IA tool is more straightforward since it got commandline syntax for setting the headers |
| 13:45:24 | | Arcorann quits [Ping timeout: 252 seconds] |
| 13:47:01 | <Rotietip> | masterx244|m, do you mean https://archive.org/developers/internetarchive/cli.html ? |
| 13:49:53 | | Guest50 joins |
| 13:52:07 | <masterx244|m> | yes. that tool. |
| 13:53:58 | | HP_Archivist quits [Client Quit] |
| 13:56:19 | <Rotietip> | Perfect, I'll try this later to see how it turns out. Thanks for the information |
| 14:09:14 | | Jonboy345 joins |
| 14:21:43 | | elon joins |
| 14:36:46 | | Island joins |
| 14:43:42 | | Rotietip quits [Ping timeout: 252 seconds] |
| 14:53:29 | <pabs> | is there any archiving of Tor onion services? |
| 14:56:48 | | hitgrr8 joins |
| 14:57:24 | <sunny_starscout> | pretty sure the fbi does |
| 14:57:36 | <sunny_starscout> | data's in safe hands, dw |
| 15:17:47 | | sonick (sonick) joins |
| 15:21:11 | | elon quits [Ping timeout: 265 seconds] |
| 15:31:18 | | user_ joins |
| 15:34:01 | | user__ quits [Remote host closed the connection] |
| 15:36:49 | | user__ joins |
| 15:39:48 | <Billy549> | lol |
| 15:40:10 | | user_ quits [Ping timeout: 252 seconds] |
| 15:40:17 | | umgr036 joins |
| 15:42:22 | | user__ quits [Ping timeout: 252 seconds] |
| 15:45:00 | | user_ joins |
| 15:45:14 | | ZizzyDizzyMC joins |
| 15:47:52 | | umgr036 quits [Ping timeout: 252 seconds] |
| 15:58:29 | | LeGoupil quits [Client Quit] |
| 16:09:45 | | user__ joins |
| 16:10:13 | | elon joins |
| 16:12:37 | | user_ quits [Ping timeout: 252 seconds] |
| 16:13:25 | | umgr036 joins |
| 16:15:11 | | yoyo930021 joins |
| 16:15:13 | | user_ joins |
| 16:15:22 | | user__ quits [Ping timeout: 252 seconds] |
| 16:18:04 | | user__ joins |
| 16:18:18 | | umgr036 quits [Ping timeout: 252 seconds] |
| 16:20:52 | | user_ quits [Ping timeout: 252 seconds] |
| 16:21:01 | | Guest50 quits [Client Quit] |
| 16:23:39 | | user_ joins |
| 16:24:30 | | yoyo930021 quits [Ping timeout: 265 seconds] |
| 16:25:10 | <imer> | JAA: any updates on getting the spinrilla audio to you? (I can hold onto it longer if you need more time, no worries at all) |
| 16:26:55 | | user__ quits [Ping timeout: 252 seconds] |
| 16:27:10 | | umgr036 joins |
| 16:29:49 | | user_ quits [Ping timeout: 265 seconds] |
| 16:31:57 | | user_ joins |
| 16:35:08 | | umgr036 quits [Ping timeout: 265 seconds] |
| 16:43:28 | <@rewby|backup> | Sorry, i need to arrange a target area for that |
| 16:43:54 | <@rewby|backup> | I'll deal with it in a bit |
| 16:44:08 | | Megame (Megame) joins |
| 17:05:25 | | imer quits [Ping timeout: 252 seconds] |
| 17:06:20 | | tsblock quits [Read error: Connection reset by peer] |
| 17:14:13 | | lukash quits [Ping timeout: 252 seconds] |
| 17:22:47 | | sonick quits [Client Quit] |
| 17:33:28 | | hitgrr8 quits [Client Quit] |
| 17:40:10 | | imer (imer) joins |
| 17:40:42 | <imer> | im in no rush, can figure out the other target stuff first |
| 18:05:37 | | Megame quits [Client Quit] |
| 18:11:06 | | Sluggs joins |
| 18:37:13 | | spirit quits [Client Quit] |
| 18:39:37 | <h2ibot> | Entartet edited Twitter (+130, /* Vital Signs */ Elon Musk later clarified…): https://wiki.archiveteam.org/?diff=49761&oldid=49753 |
| 18:54:49 | | elon quits [Ping timeout: 265 seconds] |
| 19:21:21 | | HP_Archivist (HP_Archivist) joins |
| 19:28:46 | | TastyWiener95 (TastyWiener95) joins |
| 19:28:47 | | hitgrr8 joins |
| 19:30:46 | <h2ibot> | Tech234a edited In The Media (+232, /* 2023 */ Add article from The Verge): https://wiki.archiveteam.org/?diff=49762&oldid=49730 |
| 20:00:51 | <h2ibot> | JAABot edited Main Page/In The Media (-2): https://wiki.archiveteam.org/?diff=49763&oldid=49733 |
| 20:01:22 | | Guest50 joins |
| 20:10:02 | | Guest50 quits [Ping timeout: 252 seconds] |
| 20:37:57 | | elon joins |
| 20:39:23 | | hitgrr8 quits [Client Quit] |
| 20:54:08 | | Megame (Megame) joins |
| 20:55:30 | | katocala quits [Remote host closed the connection] |
| 21:00:05 | | Emitewiki joins |
| 21:01:16 | | BigBrain quits [Ping timeout: 245 seconds] |
| 21:10:39 | <@JAA> | imer, Jake: I'm setting something up now. I hope you have working IPv6. |
| 21:11:38 | <imer> | Sorta, i'll make it work |
| 21:14:37 | | BigBrain (bigbrain) joins |
| 21:20:03 | | user_ quits [Remote host closed the connection] |
| 21:21:49 | | katocala joins |
| 21:22:15 | | katocala is now authenticated as katocala |
| 21:23:01 | | elon quits [Remote host closed the connection] |
| 21:26:02 | <@rewby|backup> | imer, Jake, JAA: If you can't make it work, I'll deal with it |
| 21:44:56 | | lennier1 quits [Client Quit] |
| 21:45:34 | | lennier1 (lennier1) joins |
| 21:48:59 | | atomicthumbs joins |
| 21:49:29 | <atomicthumbs> | question: is it considered rude to spin up arbitrary numbers of warriors on the same machine, in order to make more use of available resources |
| 21:49:45 | <atomicthumbs> | assuming the project I'm on (imgur) is highly unlikely to IP ban me for this |
| 21:49:57 | <@rewby|backup> | Incorrect |
| 21:50:00 | <@rewby|backup> | Imgur does ip ban |
| 21:50:13 | <atomicthumbs> | question answered then. thank |
| 21:50:18 | | atomicthumbs quits [Remote host closed the connection] |
| 21:50:49 | <@rewby|backup> | ... could've let me type up my second message |
| 21:51:27 | <@rewby|backup> | Second reason it's rude is that we're limited on the backend right now. If you over scale it will implode when I get the backend fixed |
| 21:52:13 | <@rewby|backup> | I have tens and tens of gigabits of connectivity at my disposal, if I can get rid of data at sufficient speed I can process a *lot* |
| 21:52:16 | <h2ibot> | Tech234a edited Dev/Warrior (+1402, Add some updates for newer 3.2 architecture): https://wiki.archiveteam.org/?diff=49764&oldid=30638 |
| 21:52:55 | <@rewby|backup> | And I can and will saturate your uplink unless you have 40g network servers |
| 21:53:26 | <@rewby|backup> | I've literally done 30gbps before across targets |
| 21:53:37 | <@rewby|backup> | Given the compression ratios we get with zstd... |
| 21:53:38 | <@rewby|backup> | Well |
| 21:53:51 | | Guest50 joins |
| 21:53:52 | <@rewby|backup> | Imagine how many gigabits of traffic that was inbound on workers |
| 21:53:53 | <@JAA> | RIP derive queue :-P |
| 21:54:27 | <@rewby|backup> | JAA: This was at the last few hours of a project |
| 21:54:31 | <@rewby|backup> | Do or die moment |
| 21:54:35 | <@JAA> | Ah yes |
| 21:55:02 | <@rewby|backup> | That moment when there are no fucks left to give |
| 21:55:14 | <@rewby|backup> | And you'd rather blow up derive than lose data |
| 21:55:28 | <@JAA> | Indeed |
| 22:11:10 | | Chris5010 quits [Client Quit] |
| 22:11:33 | | Chris5010 (Chris5010) joins |
| 22:16:29 | | wyatt8740 joins |
| 22:17:38 | | wyatt8750 quits [Ping timeout: 252 seconds] |
| 22:18:21 | | atomicthumbs joins |
| 22:19:02 | <atomicthumbs> | howdy. sorry for the join/leave spam. a second question: is there any reason I *shouldn't* spin up a whole bunch of warrior instances on Azure? |
| 22:19:34 | <atomicthumbs> | in container instances; seems pretty cheap to run em with the bare minimum of resources |
| 22:19:53 | <@rewby|backup> | Same issue about shared public ips. Also, I'll copy paste message |
| 22:20:13 | <@rewby|backup> | 23:50:49 <@rewby|backup> ... could've let me type up my second message |
| 22:20:13 | <@rewby|backup> | 23:51:27 <@rewby|backup> Second reason it's rude is that we're limited on the backend right now. If you over scale it will implode when I get the backend fixed |
| 22:20:13 | <@rewby|backup> | 23:52:13 <@rewby|backup> I have tens and tens of gigabits of connectivity at my disposal, if I can get rid of data at sufficient speed I can process a *lot* |
| 22:20:42 | <@rewby|backup> | Imgur isn't in need of workers right now. |
| 22:21:04 | <atomicthumbs> | got it, thanks! |
| 22:22:07 | <@JAA> | atomicthumbs: Also, for larger scales, you might want the project images rather than the warrior. Less overhead, higher concurrency limit. You lose the automatic project switching but can in return run multiple projects in parallel. |
| 22:22:43 | <atomicthumbs> | is the backend infra shared between projects? |
| 22:22:55 | <threedeeitguy> | atomicthumbs also watch out for the bill, container instances are cheap but bandwidth is not. If you did want to do something like that then digital ocean droplets, even the lowest teir comes with 0.5tb of bandwidth per instance and additional bandwidth is only $1 per tb. |
| 22:26:03 | <lennier1> | You can use up to concurrency 20 on Docker (though I got 429s with concurrency 10 on imgur at one point). |
| 22:26:11 | <atomicthumbs> | i've already got nine hetzner VMs running warriors; they get 20tb each |
| 22:29:45 | <lennier1> | https://wiki.archiveteam.org/index.php/Running_Archive_Team_Projects_with_Docker |
| 22:34:36 | <atomicthumbs> | i'm using an acquaintance's docker-compose file along with a cloud-init script i built with it currently, gonna check out to see how i can work scale settings into that https://cohost.org/atomicthumbs/post/1473218-edit-bump-for-tho |
| 23:07:59 | <@rewby|backup> | It's worth pointing out btw that the correct channel for discussions about the imgur project is #imgone |
| 23:25:03 | | BlueMaxima joins |
| 23:29:14 | | endrift|ZNC is now known as endrift |
| 23:33:24 | | BigBrain quits [Remote host closed the connection] |
| 23:34:10 | | BigBrain (bigbrain) joins |
| 23:40:20 | | icedice quits [Client Quit] |