00:00:02Guest50 quits [Client Quit]
00:01:30Guest50 joins
00:06:40umgr036 quits [Remote host closed the connection]
00:06:54umgr036 joins
00:20:56Guest50 quits [Ping timeout: 252 seconds]
00:29:55DopefishJustin quits [Ping timeout: 265 seconds]
00:33:36fishingforsoup joins
00:35:31UserH joins
00:55:55umgr036 quits [Remote host closed the connection]
00:59:09umgr036 joins
00:59:58umgr036 quits [Remote host closed the connection]
01:00:12umgr036 joins
01:00:52<lennier1>Might be hard to actually find an old account unless you're already following it. I kind of assume they're just making this up as they go.
01:06:56<jamesp>I wonder how users can view the archived accounts
01:18:56DopefishJustin joins
01:22:07jamesp quits [Remote host closed the connection]
01:22:51dumbgoy__ joins
01:26:34dumbgoy_ quits [Ping timeout: 252 seconds]
01:44:14HP_Archivist (HP_Archivist) joins
01:54:37DopefishJustin quits [Ping timeout: 252 seconds]
01:55:34DopefishJustin (DopefishJustin) joins
02:11:08A joins
02:12:17icedice quits [Read error: Connection reset by peer]
02:14:53A quits [Remote host closed the connection]
02:41:22Sluggs quits [Excess Flood]
02:43:03Sluggs joins
02:49:04spirit quits [Ping timeout: 252 seconds]
02:49:18spirit joins
02:53:40<h2ibot>Tech234a edited List of largest ArchiveTeam projects (+424, Add some additional projects): https://wiki.archiveteam.org/?diff=49754&oldid=41691
02:54:46<tech234a>^ this page is still very incomplete but I tried to add the projects with more than 1 PiB of data
03:03:22dumbgoy__ quits [Ping timeout: 252 seconds]
03:08:19HP_Archivist quits [Ping timeout: 252 seconds]
03:14:02<Jake>voltagex|m: do you have any details on which are removed or links to them?
03:14:10<@JAA>voltagex|m: Is this another one than what was previously announced for 1 May?
03:14:19<@JAA>https://old.reddit.com/r/DataHoarder/comments/10da7a9/official_synology_download_site_closing_legacy/
03:15:07<@JAA>https://archive.synology.com/download/ was archived completely in January.
03:15:20<voltagex|m>Sorry, slow on the uptake. I saw a YouTube video about it and thought it was a new announcement
03:15:48<@arkiver>voltagex|m: no need to apologize, always good to double check this is or has been on the radar
03:15:57<@JAA>^
03:16:08<@JAA>Louis Rossmann did a video it seems.
03:18:50<@JAA>Do you have any more details about it? Source for the date perhaps?
04:01:42<voltagex|m>An email forwarded to Rossmann by a viewer
04:03:04nicolas17 quits [Ping timeout: 265 seconds]
04:44:57TastyWiener95 (TastyWiener95) joins
04:53:25user__ joins
04:53:27umgr036 quits [Remote host closed the connection]
05:02:28user__ quits [Remote host closed the connection]
05:02:42user__ joins
05:15:11ZizzyDizzyMC quits [Remote host closed the connection]
05:26:47Island quits [Read error: Connection reset by peer]
05:49:47QuantumLTU joins
05:53:34umgr036 joins
05:54:26lflare (lflare) joins
05:55:12user__ quits [Ping timeout: 265 seconds]
06:11:07Minkafighter7225 quits [Quit: The Lounge - https://thelounge.chat]
06:11:39Minkafighter7225 joins
06:13:39BlueMaxima quits [Client Quit]
06:18:15gamer191 joins
06:20:13gamer191 quits [Remote host closed the connection]
06:27:16<vokunal|m>The network charts on my web ui aren't working
06:31:18<h2ibot>Tech234a edited Reddit (+270, Add some recent updates): https://wiki.archiveteam.org/?diff=49755&oldid=49729
06:35:17systwi quits [Read error: Connection reset by peer]
06:36:07systwi (systwi) joins
06:36:10datechnoman quits [Quit: The Lounge - https://thelounge.chat]
06:36:46datechnoman (datechnoman) joins
06:37:01tsblock (tsblock) joins
06:45:20<h2ibot>Tech234a edited Tracker (+414, Add some updates, mention the userscript): https://wiki.archiveteam.org/?diff=49756&oldid=48655
06:46:20<h2ibot>Tech234a edited Tracker (+17, Userscript is unofficial): https://wiki.archiveteam.org/?diff=49757&oldid=49756
06:53:48Sluggs quits [Read error: Connection reset by peer]
06:59:00NuVanDibe joins
07:00:20Arcorann (Arcorann) joins
07:01:04NuVanDibe quits [Remote host closed the connection]
07:07:24<h2ibot>Knot126 edited Geometry Dash (+175, Old URL is dead, replacing with new URL and…): https://wiki.archiveteam.org/?diff=49758&oldid=49322
07:17:47qwertyasdfuiopghjkl quits [Client Quit]
07:19:05qwertyasdfuiopghjkl (qwertyasdfuiopghjkl) joins
09:00:45<h2ibot>JAABot edited CurrentWarriorProject (+2): https://wiki.archiveteam.org/?diff=49759&oldid=49741
09:22:48tempuser joins
09:25:44QuantumLTU quits [Remote host closed the connection]
09:26:43quantumltu joins
09:29:52LeGoupil joins
09:43:07fplayer joins
09:45:25<fplayer>Hello everyone, i've got a question. I was trying to find old xfire archives but i'm not really capable of understanding the technical part of it. I've found some bonefire stuff thats around 25--20GB and then i downloaded the Warrior app on a virtual machine and i was supposed to select Xfire on the project list but i can't find it. I just want to
09:45:26<fplayer>see if i can fnd any of my screenshots or videos. Could you guys help me out?
09:50:12<appledash>It's kind of quiet here for the past few hours, so you may be waiting a bit, but hopefully someone will be able to help you
09:58:19fplayer quits [Ping timeout: 265 seconds]
10:10:51BigBrain quits [Ping timeout: 245 seconds]
10:23:28BigBrain (bigbrain) joins
10:37:06<masterx244|m>the warrior is used for gathering data and not for extracting.
10:37:06<masterx244|m>the data captured back then got added to the wayback machine
10:44:14TastyWiener95 quits [Ping timeout: 265 seconds]
10:57:57sec^nd quits [Ping timeout: 245 seconds]
11:00:06<h2ibot>JAABot edited CurrentWarriorProject (-2): https://wiki.archiveteam.org/?diff=49760&oldid=49759
11:00:56sec^nd (second) joins
11:02:03HP_Archivist (HP_Archivist) joins
11:10:11umgr036 quits [Remote host closed the connection]
11:10:29umgr036 joins
11:23:22user_ joins
11:23:24umgr036 quits [Remote host closed the connection]
11:34:33htesttwi quits [Remote host closed the connection]
11:35:30x-56k-modem (x-56k-modem) joins
11:39:06fplayer joins
11:39:19<fplayer>hopefully
11:48:13<Billy549>fplayer - content is stored at https://archive.org/details/archiveteam_xfire
11:48:30<Billy549>"Archives are stored in WARC format on the Internet Archive in the archiveteam_xfire collection. Content is also be accessible through the Wayback Machine, however, note that much of the content couldn't be saved from their original urls, but from crash.xfire.com instead of social.xfire.com, so ArchiveTeam's crawls must be searched for in the Wayback Machine that way. Also, for technical reasons, html pages of the
11:48:30<Billy549> screenshots weren't saved, only the screenshots themselves."
11:55:59<@rewby|backup>fplayer is already gone
11:56:05<@rewby|backup>Oh wait they're back
12:04:40dumbgoy__ joins
12:05:16icedice (icedice) joins
12:11:23user__ joins
12:11:24user_ quits [Remote host closed the connection]
12:12:17HP_Archivist quits [Client Quit]
12:24:29eroc1990 quits [Quit: The Lounge - https://thelounge.chat]
12:25:10eroc1990 (eroc1990) joins
12:44:22sonick quits [Client Quit]
12:45:04fplayer quits [Ping timeout: 265 seconds]
12:45:04elon quits [Ping timeout: 265 seconds]
13:30:09Rotietip joins
13:30:36<Rotietip>Hello all. According to https://wiki.archiveteam.org/index.php/Frequently_Asked_Questions#halp_pls_halp I must have a "whitelisted" account in Internet Archive for the content of a uploaded WARC to be indexed in Wayback Machine. Now, where should I request that (the FAQ doesn't make it clear) and how long does it take to get it approved?
13:33:15<@kaz>this is uh, not entirely trie
13:33:41<@kaz>true*. It just needs to have mediatype:web set on the item (and uploaded to a collection with the same) I believe. No doubt I'll get corrected in a second
13:34:19<masterx244|m>and being in a collection below the web crawls collection. regular users cannot get something in that collection "tree"
13:37:32<Rotietip>And what about https://gist.github.com/Asparagirl/6206247 ? Is it still valid?
13:41:11HP_Archivist (HP_Archivist) joins
13:41:13VerifiedJ quits [Quit: The Lounge - https://thelounge.chat]
13:41:40VerifiedJ (VerifiedJ) joins
13:41:46<masterx244|m>that document shows how to do the mediatype and upload without the IA commandline tool. but it looks basically like it would be correct (setting mediatype to web). using the IA tool is more straightforward since it got commandline syntax for setting the headers
13:45:24Arcorann quits [Ping timeout: 252 seconds]
13:47:01<Rotietip>masterx244|m, do you mean https://archive.org/developers/internetarchive/cli.html ?
13:49:53Guest50 joins
13:52:07<masterx244|m>yes. that tool.
13:53:58HP_Archivist quits [Client Quit]
13:56:19<Rotietip>Perfect, I'll try this later to see how it turns out. Thanks for the information
14:09:14Jonboy345 joins
14:21:43elon joins
14:36:46Island joins
14:43:42Rotietip quits [Ping timeout: 252 seconds]
14:53:29<pabs>is there any archiving of Tor onion services?
14:56:48hitgrr8 joins
14:57:24<sunny_starscout>pretty sure the fbi does
14:57:36<sunny_starscout>data's in safe hands, dw
15:17:47sonick (sonick) joins
15:21:11elon quits [Ping timeout: 265 seconds]
15:31:18user_ joins
15:34:01user__ quits [Remote host closed the connection]
15:36:49user__ joins
15:39:48<Billy549>lol
15:40:10user_ quits [Ping timeout: 252 seconds]
15:40:17umgr036 joins
15:42:22user__ quits [Ping timeout: 252 seconds]
15:45:00user_ joins
15:45:14ZizzyDizzyMC joins
15:47:52umgr036 quits [Ping timeout: 252 seconds]
15:58:29LeGoupil quits [Client Quit]
16:09:45user__ joins
16:10:13elon joins
16:12:37user_ quits [Ping timeout: 252 seconds]
16:13:25umgr036 joins
16:15:11yoyo930021 joins
16:15:13user_ joins
16:15:22user__ quits [Ping timeout: 252 seconds]
16:18:04user__ joins
16:18:18umgr036 quits [Ping timeout: 252 seconds]
16:20:52user_ quits [Ping timeout: 252 seconds]
16:21:01Guest50 quits [Client Quit]
16:23:39user_ joins
16:24:30yoyo930021 quits [Ping timeout: 265 seconds]
16:25:10<imer>JAA: any updates on getting the spinrilla audio to you? (I can hold onto it longer if you need more time, no worries at all)
16:26:55user__ quits [Ping timeout: 252 seconds]
16:27:10umgr036 joins
16:29:49user_ quits [Ping timeout: 265 seconds]
16:31:57user_ joins
16:35:08umgr036 quits [Ping timeout: 265 seconds]
16:43:28<@rewby|backup>Sorry, i need to arrange a target area for that
16:43:54<@rewby|backup>I'll deal with it in a bit
16:44:08Megame (Megame) joins
17:05:25imer quits [Ping timeout: 252 seconds]
17:06:20tsblock quits [Read error: Connection reset by peer]
17:14:13lukash quits [Ping timeout: 252 seconds]
17:22:47sonick quits [Client Quit]
17:33:28hitgrr8 quits [Client Quit]
17:40:10imer (imer) joins
17:40:42<imer>im in no rush, can figure out the other target stuff first
18:05:37Megame quits [Client Quit]
18:11:06Sluggs joins
18:37:13spirit quits [Client Quit]
18:39:37<h2ibot>Entartet edited Twitter (+130, /* Vital Signs */ Elon Musk later clarified…): https://wiki.archiveteam.org/?diff=49761&oldid=49753
18:54:49elon quits [Ping timeout: 265 seconds]
19:21:21HP_Archivist (HP_Archivist) joins
19:28:46TastyWiener95 (TastyWiener95) joins
19:28:47hitgrr8 joins
19:30:46<h2ibot>Tech234a edited In The Media (+232, /* 2023 */ Add article from The Verge): https://wiki.archiveteam.org/?diff=49762&oldid=49730
20:00:51<h2ibot>JAABot edited Main Page/In The Media (-2): https://wiki.archiveteam.org/?diff=49763&oldid=49733
20:01:22Guest50 joins
20:10:02Guest50 quits [Ping timeout: 252 seconds]
20:37:57elon joins
20:39:23hitgrr8 quits [Client Quit]
20:54:08Megame (Megame) joins
20:55:30katocala quits [Remote host closed the connection]
21:00:05Emitewiki joins
21:01:16BigBrain quits [Ping timeout: 245 seconds]
21:10:39<@JAA>imer, Jake: I'm setting something up now. I hope you have working IPv6.
21:11:38<imer>Sorta, i'll make it work
21:14:37BigBrain (bigbrain) joins
21:20:03user_ quits [Remote host closed the connection]
21:21:49katocala joins
21:23:01elon quits [Remote host closed the connection]
21:26:02<@rewby|backup>imer, Jake, JAA: If you can't make it work, I'll deal with it
21:44:56lennier1 quits [Client Quit]
21:45:34lennier1 (lennier1) joins
21:48:59atomicthumbs joins
21:49:29<atomicthumbs>question: is it considered rude to spin up arbitrary numbers of warriors on the same machine, in order to make more use of available resources
21:49:45<atomicthumbs>assuming the project I'm on (imgur) is highly unlikely to IP ban me for this
21:49:57<@rewby|backup>Incorrect
21:50:00<@rewby|backup>Imgur does ip ban
21:50:13<atomicthumbs>question answered then. thank
21:50:18atomicthumbs quits [Remote host closed the connection]
21:50:49<@rewby|backup>... could've let me type up my second message
21:51:27<@rewby|backup>Second reason it's rude is that we're limited on the backend right now. If you over scale it will implode when I get the backend fixed
21:52:13<@rewby|backup>I have tens and tens of gigabits of connectivity at my disposal, if I can get rid of data at sufficient speed I can process a *lot*
21:52:16<h2ibot>Tech234a edited Dev/Warrior (+1402, Add some updates for newer 3.2 architecture): https://wiki.archiveteam.org/?diff=49764&oldid=30638
21:52:55<@rewby|backup>And I can and will saturate your uplink unless you have 40g network servers
21:53:26<@rewby|backup>I've literally done 30gbps before across targets
21:53:37<@rewby|backup>Given the compression ratios we get with zstd...
21:53:38<@rewby|backup>Well
21:53:51Guest50 joins
21:53:52<@rewby|backup>Imagine how many gigabits of traffic that was inbound on workers
21:53:53<@JAA>RIP derive queue :-P
21:54:27<@rewby|backup>JAA: This was at the last few hours of a project
21:54:31<@rewby|backup>Do or die moment
21:54:35<@JAA>Ah yes
21:55:02<@rewby|backup>That moment when there are no fucks left to give
21:55:14<@rewby|backup>And you'd rather blow up derive than lose data
21:55:28<@JAA>Indeed
22:11:10Chris5010 quits [Client Quit]
22:11:33Chris5010 (Chris5010) joins
22:16:29wyatt8740 joins
22:17:38wyatt8750 quits [Ping timeout: 252 seconds]
22:18:21atomicthumbs joins
22:19:02<atomicthumbs>howdy. sorry for the join/leave spam. a second question: is there any reason I *shouldn't* spin up a whole bunch of warrior instances on Azure?
22:19:34<atomicthumbs>in container instances; seems pretty cheap to run em with the bare minimum of resources
22:19:53<@rewby|backup>Same issue about shared public ips. Also, I'll copy paste message
22:20:13<@rewby|backup>23:50:49 <@rewby|backup> ... could've let me type up my second message
22:20:13<@rewby|backup>23:51:27 <@rewby|backup> Second reason it's rude is that we're limited on the backend right now. If you over scale it will implode when I get the backend fixed
22:20:13<@rewby|backup>23:52:13 <@rewby|backup> I have tens and tens of gigabits of connectivity at my disposal, if I can get rid of data at sufficient speed I can process a *lot*
22:20:42<@rewby|backup>Imgur isn't in need of workers right now.
22:21:04<atomicthumbs>got it, thanks!
22:22:07<@JAA>atomicthumbs: Also, for larger scales, you might want the project images rather than the warrior. Less overhead, higher concurrency limit. You lose the automatic project switching but can in return run multiple projects in parallel.
22:22:43<atomicthumbs>is the backend infra shared between projects?
22:22:55<threedeeitguy>atomicthumbs also watch out for the bill, container instances are cheap but bandwidth is not. If you did want to do something like that then digital ocean droplets, even the lowest teir comes with 0.5tb of bandwidth per instance and additional bandwidth is only $1 per tb.
22:26:03<lennier1>You can use up to concurrency 20 on Docker (though I got 429s with concurrency 10 on imgur at one point).
22:26:11<atomicthumbs>i've already got nine hetzner VMs running warriors; they get 20tb each
22:29:45<lennier1>https://wiki.archiveteam.org/index.php/Running_Archive_Team_Projects_with_Docker
22:34:36<atomicthumbs>i'm using an acquaintance's docker-compose file along with a cloud-init script i built with it currently, gonna check out to see how i can work scale settings into that https://cohost.org/atomicthumbs/post/1473218-edit-bump-for-tho
23:07:59<@rewby|backup>It's worth pointing out btw that the correct channel for discussions about the imgur project is #imgone
23:25:03BlueMaxima joins
23:29:14endrift|ZNC is now known as endrift
23:33:24BigBrain quits [Remote host closed the connection]
23:34:10BigBrain (bigbrain) joins
23:40:20icedice quits [Client Quit]