00:07:49benjinsm is now known as benjins
00:24:44Emitewiki quits [Remote host closed the connection]
00:26:29Guest50 quits [Ping timeout: 252 seconds]
00:29:13nostalgebraist_ joins
00:31:43Icyelut (Icyelut) joins
00:32:44nostalgebraist quits [Ping timeout: 252 seconds]
00:58:30sonick (sonick) joins
01:07:03soundguy7440 joins
01:08:43<soundguy7440>Hey all, I really like the Grafana that is running for the Imgur stats and would love to integrate some of those stats into some of my own personal dashboards. Are those stats publicly available outside of that dashboard? Would anyone be able to point me in the right direction?
01:12:51<pokechu22>lflare: ^
01:16:09nostalgebraist_ quits [Client Quit]
01:19:59TastyWiener95 (TastyWiener95) joins
01:28:03sunny_starscout quits [Remote host closed the connection]
01:32:06lennier1 quits [Client Quit]
01:34:45lennier1 (lennier1) joins
01:44:03user__ quits [Remote host closed the connection]
01:47:02pabs quits [Remote host closed the connection]
01:49:45pabs (pabs) joins
02:24:24michaelblob (michaelblob) joins
02:38:53Guest50 joins
02:42:03Letur quits [Remote host closed the connection]
02:46:23lennier1 quits [Client Quit]
02:47:01lennier1 (lennier1) joins
02:53:11<Hans5958|m>AT should have its own Grafana instance
02:56:05dumbgoy quits [Ping timeout: 252 seconds]
02:56:44BlueMaxima quits [Read error: Connection reset by peer]
03:04:46<@JAA>We had one. It died from overload, and we spent our resources on more important things instead (i.e. archiving shit).
03:23:13<Hans5958|m><JAA> "We had one. It died from..." <- Ah, at least you tried
03:38:05Shjosan quits [Quit: Am sleepy (-, – )…zzzZZZ]
03:38:42Shjosan (Shjosan) joins
04:05:30<h2ibot>Pokechu22 edited ISP Hosting (+98, +MultiNet, in progress as I'm working on it…): https://wiki.archiveteam.org/?diff=49774&oldid=49770
04:21:05Guest50 quits [Client Quit]
04:28:41soundguy7440 quits [Remote host closed the connection]
04:30:15nicolas17 quits [Client Quit]
05:01:52parfait (kdqep) joins
05:58:56Stiletto joins
06:46:28JackThompson3 quits [Ping timeout: 265 seconds]
06:47:04Wingy3 (Wingy) joins
06:47:47JackThompson3 joins
06:48:11Wingy quits [Ping timeout: 252 seconds]
06:48:11Wingy3 is now known as Wingy
06:59:13systwi_ quits [Quit: systwi_]
06:59:16nothere quits [Quit: Leaving]
06:59:44systwi_ joins
07:00:13systwi_ quits [Client Quit]
07:13:34qwertyasdfuiopghjkl quits [Client Quit]
07:14:14<immibis>I think they are the same tracker stats you can see on the tracker page, just recorded over time
07:14:20<immibis>i doubt the tracker records them over time
07:15:16<lflare>Well, he's no longer online, but yes, it's the exact stats on the tracker page
07:15:32<lflare>It's nothing amazing, I literally just piped the stats to prometheus, took me 10 minutes
07:16:18qwertyasdfuiopghjkl (qwertyasdfuiopghjkl) joins
07:20:06qwertyasdfuiopghjkl quits [Client Quit]
07:20:40nothere joins
07:40:02ZizzyDizzyMC quits [Remote host closed the connection]
07:40:55systwi_ joins
07:44:49Island quits [Read error: Connection reset by peer]
08:21:39Letur joins
08:27:12qwertyasdfuiopghjkl (qwertyasdfuiopghjkl) joins
08:55:31JackThompson3 quits [Ping timeout: 265 seconds]
08:58:33JackThompson3 joins
09:06:03<AK>That was a fun week when everything got overloaded. Iirc the tracker page got cached/disabled for a bit as there were so many people watching/scraping
09:06:08<AK>Can't remember what project caused it though
09:06:09sonick quits [Client Quit]
09:07:16<masterx244|m>tracker got a spanner in the gears again... and i guess its related to imgur
09:12:00<@JAA>Remember when the tracker page had *graphs*? Pepperidge Farm remembers.
09:13:04<@JAA>That caused the stats to be reloaded regularly for redrawing IIRC.
09:13:14<AK>I miss the grafana, it was so useful seeing who had/hadn't updated, and how much throughput we were all doing
09:13:43<@JAA>(I'm talking about graphs on the tracker page itself, to be clear.)
09:13:47<AK>Spinning up 30 new Hetzner servers with Eggplant and competing to see who could get the most throughput
09:14:05<AK>(Oh yeah I know, just remembering the grafana, not sure I ever really saw the tracker graphs, think I joined too late)
09:14:50<@arkiver>those graphs were nice for short term projects
09:31:30Minkafighter7225 quits [Quit: The Lounge - https://thelounge.chat]
09:31:48Minkafighter7225 joins
09:45:05icedice (icedice) joins
09:56:25TastyWiener95 quits [Ping timeout: 265 seconds]
10:05:07qw3rty quits [Ping timeout: 265 seconds]
10:09:03QuantumLTU quits [Client Quit]
10:09:24lflare quits [Client Quit]
10:09:50lflare (lflare) joins
10:11:23imer quits [Client Quit]
10:13:26QuantumLTU joins
10:24:44imer (imer) joins
10:27:05qw3rty joins
10:59:14Jonboy3452 quits [Read error: Connection reset by peer]
12:07:51x-56k-modem quits [Client Quit]
12:48:20NameUser77 joins
13:06:20haltingstate joins
13:06:46<haltingstate>How do I extract jpg,gif,jpeg,jpg from warc files on linux?
13:07:06<haltingstate>I tried 3 tools and I cannot extract the files from the WARC archvie
13:14:16Dango360 (Dango360) joins
13:19:21x-56k-modem (x-56k-modem) joins
13:23:46bilboed quits [Quit: The Lounge - https://thelounge.chat]
13:24:11bilboed joins
13:33:30katocala quits [Remote host closed the connection]
13:38:09nicolas17 joins
13:39:46<masterx244|m>which warc files? and what tools did you try so far?
13:48:30katocala joins
13:49:16ymgve joins
13:52:14ymgve_ quits [Ping timeout: 252 seconds]
14:06:21<nicolas17><JAA> Does rclone also check whether you have files locally that aren't on the server anymore?
14:06:51<nicolas17>JAA: 5 days later, nothing has changed in the ftp server contents :P
14:07:24<nicolas17>not the first time this happens, I set up something to monitor a server for changes and then the server never changes
14:07:38HP_Archivist (HP_Archivist) joins
14:07:45Megame (Megame) joins
14:27:16HP_Archivist quits [Client Quit]
14:44:44sec^nd quits [Remote host closed the connection]
14:45:03sec^nd (second) joins
14:45:06lflare quits [Killed (nuke.hackint.org (Nickname regained by services))]
14:45:07lflare (lflare) joins
14:45:26Dango360_ (Dango360) joins
14:45:27Dango360 quits [Ping timeout: 265 seconds]
14:50:00Arcorann quits [Ping timeout: 252 seconds]
14:51:12hitgrr8 joins
14:55:33sonick (sonick) joins
14:58:06nostalgebraist joins
15:02:58Guest50 joins
15:12:01nostalgebraist_ joins
15:14:56nostalgebraist quits [Ping timeout: 252 seconds]
15:19:24Guest50 quits [Client Quit]
15:28:08tsblock quits [Ping timeout: 252 seconds]
15:32:08Island joins
15:47:06Letur quits [Remote host closed the connection]
15:51:42Letur joins
15:52:00<masterx244|m><nicolas17> "not the first time this happens,..." <- Happened for me, too after i rigged some automated monitoring. And another annoying variant: automated handling works and then suddenly it breaks out of nowhere in unexplainable ways (or a bug sneaks up while you are traveling)
16:04:14parfait quits [Ping timeout: 265 seconds]
16:09:12<pcr>Opportunity to archive google earth data? https://cloud.google.com/blog/products/maps-platform/create-immersive-3d-map-experiences-photorealistic-3d-tiles
16:26:45<Ryz>Any updates on someone trying to archive MTV News?
16:53:56DLoader quits [Ping timeout: 252 seconds]
17:14:32icedice quits [Client Quit]
17:19:23icedice (icedice) joins
17:24:12icedice quits [Client Quit]
17:25:28icedice (icedice) joins
18:07:47rocketdive joins
18:08:22Megame quits [Ping timeout: 252 seconds]
18:12:11<rocketdive>hi how do i put a few twitter accounts through to be archived?
18:12:41<rocketdive>trying to get links from snscrape but it's not getting all the tweets
18:14:55<pokechu22>I can run them via socialbot in #archivebot, but only via twitter-profile which is limited to the 3200 most recent tweets (and has some other socialbot-specific bugs)
18:15:25<pokechu22>twitter-user uses search, and search is broken (not sure if the standalone snscrape has that issue fixed or not)
18:21:26<rocketdive>yea it's broken that's why i asked
18:21:44<rocketdive>it's a shame it's just 3000 recent tweets
18:37:16TastyWiener95 (TastyWiener95) joins
18:53:30icedice quits [Client Quit]
19:18:58icedice (icedice) joins
19:19:02<lennier1>rocketdive: JAA has been working on snscrape, so the new code (not in the release build) can get more tweets.
19:22:33<rocketdive>awesome. could i send a txt file and someone puts it through the bot that would be much appreciated! i just got a bunch of friends to let me know which inactive accounts hey want archived
19:36:40Guest50 joins
19:40:47<lennier1>rocketdive: I'm running a script to identify formerly verified accounts that haven't tweeted recently. If you upload a list to https://transfer.archivete.am/, maybe they can run those at the same time. Would be nice to have a list of all popular accounts (like by number of followers), but I don't know of a way to get that.
19:42:50<rocketdive>here's the link, thanks in advance!! https://transfer.archivete.am/hqZyC/tweets.txt
19:47:44<vokunal|m>looks like they're cramming more links than any spam wave i've seen https://imgur.com/cTEAYha
19:48:23<vokunal|m>from a quick skim, looks like just about every link i've grabbed recently was one of these
19:49:10<vokunal|m>this was not the channel i thoguht it was
20:00:12parfait (kdqep) joins
20:29:21HP_Archivist (HP_Archivist) joins
21:00:50hitgrr8 quits [Client Quit]
21:28:07rocketdives joins
21:31:27rocketdive quits [Ping timeout: 265 seconds]
21:41:23Guest50 quits [Ping timeout: 252 seconds]
21:42:22DLoader joins
22:30:54qwertyasdfuiopghjkl quits [Ping timeout: 265 seconds]
22:50:54BigBrain quits [Remote host closed the connection]
22:51:16BigBrain (bigbrain) joins
23:13:29rocketdiver joins
23:17:06rocketdives quits [Ping timeout: 252 seconds]
23:20:07dumbgoy joins
23:22:34icedice quits [Client Quit]
23:30:42soundguy7440 joins
23:36:46rampy joins
23:51:13<h2ibot>JustAnotherArchivist edited Deathwatch (+46, /* 2023 */ Add Wysp): https://wiki.archiveteam.org/?diff=49775&oldid=49769
23:54:13<h2ibot>Entartet edited Twitter (+287, /* Vital Signs */ Twitter's inactive account…): https://wiki.archiveteam.org/?diff=49776&oldid=49773