HomeSearchPrevious dayNext day

00:11:30fishingforsoup joins
00:26:23tzt quits [Ping timeout: 265 seconds]
00:27:50tzt (tzt) joins
00:48:21Arcorann_ quits [Ping timeout: 250 seconds]
00:49:23<jamesp>I posted in #archiveteam that @joinmastodon was just banned from Twitter
00:49:53<jamesp>It seems like any twitter account that mentions mastodon could get banned and we might have to start archiving some notable ones at this point
00:50:21Arcorann_ joins
01:00:34<phuzion>chfoo_: you around to help possibly troubleshoot some seesaw issues?
01:00:56ivan (ivan) joins
01:01:23<ivan>jamesp: just saw someone get suspended for posting a mastodon handle to elonjet with screenshots of the suspension
01:01:30<ivan>https://twitter.com/micahflee/status/1603548208063385600
01:03:27<ivan>https://web.archive.org/web/20221216003152/https://twitter.com/micahflee/status/1603548208063385600
01:06:11<benjins>I've seen reports of a lot of accounts being suspended, not sure what for: atrupar igd_news drewharwell RMac18 donie MattBinder
01:09:11<ivan>let's see if I get deleted for posting elonjet.net
01:12:18<ivan>banned search terms returning 0 results I guess:
01:12:29<ivan>https://twitter.com/search?q=url%3Agrndcntrl.net&src=spelling_expansion_revert_click
01:12:31<ivan>https://twitter.com/search?q=url%3Aelonjet.net&src=typed_query&f=live
01:17:45godane1 joins
01:18:10BlueMaxima quits [Client Quit]
01:18:32<ivan>https://twitter.com/MikaelThalen/status/1603558634981842945
01:20:12pabs sends that person to snscrape
01:21:30godane quits [Ping timeout: 268 seconds]
01:39:30<pabs>more suspended: https://twitter.com/igd_news https://twitter.com/joinmastodon http://twitter.com/drewharwell https://twitter.com/donie https://twitter.com/RMac18
01:43:01klg (klg) joins
02:09:36<anarcat>what a garbage fire
02:20:02<pabs>this post mentions more suspended folks https://infosec.exchange/@micahflee/109520648205436407
02:24:43katocala joins
02:38:41<benjins>W7VOA now as well
02:48:26decay joins
02:50:03<decay>how's the twitter data collection going? are there alternative data streams that're being used other than the trickle I'm seeing from the twitterstream collection?
03:34:16<ivan>users can be submitted in #archivebot
03:34:33<ivan>there's stuff that goes into WBM but without WARCs available
03:48:33sonick quits [Client Quit]
04:08:40foo joins
04:12:41foo quits [Remote host closed the connection]
04:48:35systwi_ is now known as systwi
05:21:34<pabs>more banned folks https://mastodon.social/@danluu/109521316258129814 https://news.ycombinator.com/item?id=34010112
06:04:33hackbug quits [Ping timeout: 268 seconds]
06:38:17godane1 quits [Client Quit]
06:43:51sec^nd quits [Ping timeout: 245 seconds]
06:45:16CompArison9 quits [Remote host closed the connection]
06:48:13Island quits [Read error: Connection reset by peer]
06:54:30sec^nd (second) joins
07:14:56LeGoupil joins
07:48:46JackThompson3 quits [Ping timeout: 268 seconds]
07:51:03JackThompson3 joins
08:15:56sec^nd quits [Ping timeout: 245 seconds]
08:19:09sec^nd (second) joins
08:40:04hitgrr8 joins
08:43:31sec^nd quits [Remote host closed the connection]
08:43:48sec^nd (second) joins
09:06:37franga2000 joins
09:12:24sonick (sonick) joins
10:13:22lukash799 joins
10:17:43<Arcorann_>I hear Elon shut down Twitter Spaces after he found one with a bunch of people he suspended
10:18:07<Arcorann_>(probably better in -ot)
10:29:03lukash799 quits [Client Quit]
10:39:24LeGoupil quits [Remote host closed the connection]
11:46:59sonick quits [Client Quit]
12:20:49Megame (Megame) joins
12:26:29sonick (sonick) joins
12:29:46Jackster joins
12:31:20<Jackster>Trying to backup some old game mods and maps from a publicly accessible apache server. One can brows the files via the Apache generated file browser. I am looking for a tool to help me backup all the files on these sites. Any suggestions?
12:32:00<ivan>Jackster: wget, grab-site, HTTrack
12:33:33<@JAA>Or tell us the URL, and we can archive it into the Wayback Machine.
12:33:56<Jackster>I have tried wget and HTTrack, both result in issues. The config files with the mods is not formatted, as in the text is all one line. The large files sometimes come down as .html files instead of their original file types
12:35:53<Jackster>I will give grab-site a go
12:46:19<monika>highly recommend opendirectorydownloader for this kind of stuff
12:46:49<monika>you can feed the generated links to wget/aria2c/whatever
12:47:16<monika>grab-site is horrendously complicated
12:47:40<monika>https://github.com/KoalaBear84/OpenDirectoryDownloader
12:50:15<@JAA>grab-site horrendously complicated? I guess you haven't tried to use Heritrix then.
12:50:33<Jackster>I will give that a go then first!
12:50:43<@JAA>But grab-site produces WARCs, not flat files, so that might not be what you want.
12:51:42<@JAA>If you don't mind sharing it, I'd still be interested in the URL even if you find a way that suits you. Open directories for old games don't last forever.
12:51:58<Jackster>Can one not extract that into normal files?
12:52:11<@JAA>You can, but it's a bit of a pain.
12:52:20<monika>you can but it requires Effort™
12:52:22<monika>aa
12:52:40<Jackster>Here is one example http://f4hmod.site.nfoservers.com/server/
12:53:11<Jackster>I have a few dozen to go through. Ideally I am going to combine it all into a single archive instead of having multiple copies of the same files
12:53:48<monika>17.65 GB 1662 files
12:55:50<@JAA>Call of Duty 4 is old? Now I feel old. lol :-)
12:57:26<@JAA>Looks like at least quite a few of these are on Mod DB, FWIW.
12:57:31hackbug (hackbug) joins
12:57:40CreaZyp154 joins
12:57:45<Jackster>It is dying out. Trying to archive a few maps and mods that I have an interest in but might as well go fully in
12:58:05<Jackster>Most are on there. But that is more effort xD
12:58:20<@JAA>Yeah, very true.
13:05:32<CreaZyp154>Seeing everything happening on Twitter I thing we should archive all new tweets like with Reddit
13:08:54<monika>that's just too much volume for archiveteam to handle
13:08:59<TheTechRobo>^
13:09:05<monika>not to mention the stupid rate limit/guest token crap
13:09:10<TheTechRobo>existing accounts/hashtags can still be run through in #archivebot
13:09:42<CreaZyp154>But how is Reddit ok then ?
13:09:55<@JAA>Reddit is a *LOT* smaller than Twitter.
13:10:33<@JAA>I doubt there are any recent statistics, but prior to you-know-what, Twitter had something like 500 million tweets a day.
13:10:41<CreaZyp154>Oh yeah. I forgot about that
13:11:10<@JAA>Reddit only just reached 2 billion posts very recently after 17 years of operation.
13:11:33<@JAA>So just a couple orders of magnitude between the two.
13:19:43Arcorann_ quits [Ping timeout: 265 seconds]
13:23:44sec^nd quits [Remote host closed the connection]
13:24:12sec^nd (second) joins
13:28:37<monika>just checked the latest pushshift dumps from october, there were 35.6 million posts and 237.3 million comments in that month alone
13:30:19CreaZyp154 quits [Remote host closed the connection]
13:31:17<@JAA>Sounds reasonable. So two months of Reddit are equivalent to one day of Twitter in terms of message count. Close to albeit not quite two orders of magnitude.
13:33:07<Jackster>monika That is working well now with wget. Config files are also coming through clean
13:33:18<monika>glad to hear
13:41:09<Jackster>I'd love to properly archive all the maps and mods and documentation though for public access
13:41:37<Jackster>A lot of the programming wikis and forums are long gone. Some on wayback but it is hit and miss
13:58:03qwertyasdfuiopghjkl joins
14:25:05Megame quits [Client Quit]
15:33:35Island joins
16:03:01sec^nd quits [Ping timeout: 245 seconds]
16:04:39wyatt8750 joins
16:05:01wyatt8740 quits [Ping timeout: 265 seconds]
16:06:09sec^nd (second) joins
16:13:13Jackster quits [Remote host closed the connection]
17:05:37datechnoman quits [Ping timeout: 268 seconds]
17:23:06datechnoman (datechnoman) joins
17:35:28Ram joins
17:35:49fishingforsoup quits [Read error: Connection reset by peer]
18:00:32sembiance quits [Ping timeout: 265 seconds]
18:01:57sembiance (sembiance) joins
18:02:57<Ram>Hey, I have about 1500 websites for Ontario municipalities and civicweb (a government document portal).Can someone with creds for archivebot run them?
18:45:58Ruthalas quits [Ping timeout: 265 seconds]
18:46:04Ruthalas5 (Ruthalas) joins
18:48:50fishingforsoup joins
19:23:28fishingforsoup_ joins
19:55:37<Mateon1>Just found out about this: https://tomlehrersongs.com/ "NOTICE: THIS WEBSITE WILL BE SHUT DOWN AT SOME DATE IN THE NOT TOO DISTANT FUTURE, SO IF YOU WANT TO DOWNLOAD ANYTHING, DON’T WAIT TOO LONG."
19:57:25<@JAA>Huh, they changed it.
19:57:32<@JAA>It's been on Deathwatch for a while.
19:57:48<@JAA>But it was originally announced to go down at the end of 2024.
19:58:34<Mateon1>Huh, I scanned my logs and didn't see any mentions of this except for a single archivebot job in Feb 2021
20:01:33<@JAA>May*, and the previous one in October 2020 is when it was first mentioned.
20:02:14<Mateon1>May? I only see the message on 2021-02-06T23:21:29.000Z in this channel
20:03:00<@JAA>That's when someone linked it here, yeah, but the AB jobs were in Oct 2020 and May 2021.
20:03:16<Mateon1>Ah.
20:03:39<Mateon1>Is there some place where you can check if something has been ran through archivebot?
20:04:03<@JAA>The viewer http://archive.fart.website/archivebot/viewer/ although it's not entirely reliable.
20:05:06<Mateon1>Ah, I see
20:22:35monika quits [Client Quit]
20:22:54monika (boom) joins
20:38:30fishingforsoup_ quits [*.net *.split]
20:38:30katocala quits [*.net *.split]
20:38:30klg quits [*.net *.split]
20:38:30tzt quits [*.net *.split]
20:38:30phuzion quits [*.net *.split]
20:38:30Jonimus quits [*.net *.split]
20:38:30Iki quits [*.net *.split]
20:38:30geezabiscuit quits [*.net *.split]
20:38:30benjins quits [*.net *.split]
20:38:30Church_ quits [*.net *.split]
20:38:30@Fusl quits [*.net *.split]
20:38:30wickedplayer494 quits [*.net *.split]
20:38:30@AlsoJAA quits [*.net *.split]
20:38:30VerifiedJ quits [*.net *.split]
20:38:30marked1 quits [*.net *.split]
20:38:30DiscantX_ quits [*.net *.split]
20:38:30Dalek_ quits [*.net *.split]
20:38:30jodizzle quits [*.net *.split]
20:38:30le0n_ quits [*.net *.split]
20:38:30daxxy_ quits [*.net *.split]
20:38:30Doran quits [*.net *.split]
20:38:30RKenshin quits [*.net *.split]
20:38:30Czechball quits [*.net *.split]
20:38:30Mateon1 quits [*.net *.split]
20:38:30@chfoo_ quits [*.net *.split]
20:38:30[42] quits [*.net *.split]
20:38:30thelounge27 quits [*.net *.split]
20:38:30Wingy quits [*.net *.split]
20:38:30lun4 quits [*.net *.split]
20:38:30driib quits [*.net *.split]
20:38:30kiska quits [*.net *.split]
20:38:30Chris5010 quits [*.net *.split]
20:38:30flashfire42 quits [*.net *.split]
20:38:30schwarzkatz quits [*.net *.split]
20:38:30s-crypt2 quits [*.net *.split]
20:38:30Craigle quits [*.net *.split]
20:38:30atphoenix_ quits [*.net *.split]
20:38:30Hackerpcs quits [*.net *.split]
20:38:30ArchivalEfforts quits [*.net *.split]
20:38:30@rewby quits [*.net *.split]
20:38:30Stiletto quits [*.net *.split]
20:38:30qw3rty quits [*.net *.split]
20:38:30JTL quits [*.net *.split]
20:38:30@Sanqui quits [*.net *.split]
20:38:30lunik17 quits [*.net *.split]
20:38:30girst quits [*.net *.split]
20:38:30adia4 quits [*.net *.split]
20:38:30xkey quits [*.net *.split]
20:38:30knecht420 quits [*.net *.split]
20:38:30pabs quits [*.net *.split]
20:38:30Minkafighter7 quits [*.net *.split]
20:38:30ave quits [*.net *.split]
20:38:30nepeat quits [*.net *.split]
20:38:30IDK quits [*.net *.split]
20:38:30kiskaLogBot quits [*.net *.split]
20:38:30Pingerfowder quits [*.net *.split]
20:38:30h3ndr1k quits [*.net *.split]
20:38:30FalconK quits [*.net *.split]
20:38:30Sluggs quits [*.net *.split]
20:38:30fangfufu_ quits [*.net *.split]
20:38:30celestial quits [*.net *.split]
20:38:30erenrich quits [*.net *.split]
20:38:30nimaje quits [*.net *.split]
20:38:30Jake quits [*.net *.split]
20:38:30fionera quits [*.net *.split]
20:38:30summerisle_ quits [*.net *.split]
20:38:30thehedgeh0g quits [*.net *.split]
20:38:30mikael quits [*.net *.split]
20:38:30mrfooooo quits [*.net *.split]
20:38:30ivan quits [*.net *.split]
20:38:30SketchCow quits [*.net *.split]
20:38:30colona quits [*.net *.split]
20:38:30dunger quits [*.net *.split]
20:38:30JensRex quits [*.net *.split]
20:38:30njha quits [*.net *.split]
20:38:30pie_ quits [*.net *.split]
20:38:30Arachnophine3 quits [*.net *.split]
20:38:30Nulo quits [*.net *.split]
20:38:30BPCZ quits [*.net *.split]
20:38:30DopefishJustin quits [*.net *.split]
20:38:30mwfc quits [*.net *.split]
20:38:30Hecz quits [*.net *.split]
20:38:30balrog quits [*.net *.split]
20:38:30HotSwap quits [*.net *.split]
20:38:30TappyToes quits [*.net *.split]
20:38:30Suika_ quits [*.net *.split]
20:38:30coderobe quits [*.net *.split]
20:38:30Kinille_ quits [*.net *.split]
20:38:30_kallsyms quits [*.net *.split]
20:38:30Deewiant quits [*.net *.split]
20:38:30maxfan8 quits [*.net *.split]
20:38:30f0x2 quits [*.net *.split]
20:38:30pekster` quits [*.net *.split]
20:38:30masterX244_ quits [*.net *.split]
20:38:30betamax quits [*.net *.split]
20:38:30MrRadar_ quits [*.net *.split]
20:38:30luckcolors_ quits [*.net *.split]
20:38:30Dj-Wawa quits [*.net *.split]
20:38:30yano quits [*.net *.split]
20:38:30CraftByte quits [*.net *.split]
20:38:30@hook54321 quits [*.net *.split]
20:38:30@HCross quits [*.net *.split]
20:38:30russss quits [*.net *.split]
20:38:30notbasetwo quits [*.net *.split]
20:38:30@kaz quits [*.net *.split]
20:38:30@arkiver quits [*.net *.split]
20:38:30HugsNotDrugs` quits [*.net *.split]
20:38:30murmur quits [*.net *.split]
20:38:30JSharp quits [*.net *.split]
20:38:30cptcobalt quits [*.net *.split]
20:38:30Ctrl-S quits [*.net *.split]
20:38:30omni_ quits [*.net *.split]
20:38:30abirkill quits [*.net *.split]
20:38:30jmtd quits [*.net *.split]
20:38:30@dxrt quits [*.net *.split]
20:38:30Ryz quits [*.net *.split]
20:38:30sknebel quits [*.net *.split]
20:38:30aismallard quits [*.net *.split]
20:38:30Gaelan quits [*.net *.split]
20:38:30apache2 quits [*.net *.split]
20:38:30sloop quits [*.net *.split]
20:38:30marto_8 quits [*.net *.split]
20:38:30shreyasminocha quits [*.net *.split]
20:38:30pie_ joins
20:38:30omni joins
20:38:30daxxy joins
20:38:30murmur joins
20:38:30cptcobalt joins
20:38:30Nulo joins
20:38:30betamax (betamax) joins
20:38:31Stiletto joins
20:38:31fionera (Fionera) joins
20:38:31luckcolors (luckcolors) joins
20:38:31nimaje joins
20:38:31drallamsia joins
20:38:31Ctrl-S joins
20:38:31mwfc (mwfc) joins
20:38:31AlsoJAA (JAA) joins
20:38:31HotSwap joins
20:38:31qw3rty joins
20:38:31mrfooooo joins
20:38:31@ChanServ sets mode: +o AlsoJAA
20:38:31Deewiant (Deewiant) joins
20:38:31adia4 (adia) joins
20:38:31Mateon2 joins
20:38:31CraftByte (DragonSec|CraftByte) joins
20:38:31dunger joins
20:38:31Dj-Wawa joins
20:38:31marto_8 joins
20:38:32Czechball joins
20:38:32klg (klg) joins
20:38:32DopefishJustin joins
20:38:33Jake (Jake) joins
20:38:33masterX244 (masterX244) joins
20:38:33sloop_ joins
20:38:33TappyToes_ joins
20:38:34f0x2 joins
20:38:34SketchCo1 joins
20:38:35Dalek (Dalek) joins
20:38:35kiskaLogBot joins
20:38:35Pingerfo- joins
20:38:35Hecz joins
20:38:35Suika joins
20:38:35geezabiscuit joins
20:38:35apache2 joins
20:38:35VerifiedJ (VerifiedJ) joins
20:38:35fangfufu joins
20:38:36Chris5010 (Chris5010) joins
20:38:36Iki joins
20:38:37arkiver (arkiver) joins
20:38:37kallsyms joins
20:38:37flashfire42 (flashfire42) joins
20:38:37colona_ joins
20:38:44geezabiscuit quits [Changing host]
20:38:44geezabiscuit (geezabiscuit) joins
20:38:44FalconK joins
20:38:45Gaelan (Gaelan) joins
20:38:45rewby joins
20:38:45@ChanServ sets mode: +o arkiver
20:38:46h3ndr1k_ (h3ndr1k) joins
20:38:46ArchivalEfforts joins
20:38:48russss joins
20:38:48rewby quits [Signing in (rewby)]
20:38:48rewby (rewby) joins
20:38:49tzt joins
20:38:49Jonimus joins
20:38:49Church_ joins
20:38:50phuz-test (phuzion) joins
20:38:50summerisle (summerisle) joins
20:38:50JSharp joins
20:38:51marked1 joins
20:38:51katocala joins
20:38:51sknebel (sknebel) joins
20:38:52ave (ave) joins
20:38:52notbasetwo joins
20:38:52mikael joins
20:38:53JensRex (JensRex) joins
20:38:54s-crypt2 (s-crypt) joins
20:38:55fishingforsoup_ joins
20:38:55MrRadar (MrRadar) joins
20:38:56wickedplayer494 joins
20:38:58thehedgeh0g (mrHedgehog0) joins
20:38:58shreyasminocha (shreyasminocha) joins
20:39:00tzt quits [Signing in (tzt)]
20:39:00tzt (tzt) joins
20:39:00schwarzkatz joins
20:39:04ivan joins
20:39:04Doran (Doranwen) joins
20:39:04Wingy (Wingy) joins
20:39:06Hecz quits [Changing host]
20:39:06Hecz (Hecz) joins
20:39:07thelounge27 joins
20:39:08le0n (le0n) joins
20:39:12jodizzle (jodizzle) joins
20:39:16pabs (pabs) joins
20:39:19atphoenix_ (atphoenix) joins
20:39:19chfoo (chfoo) joins
20:39:19@ChanServ sets mode: +o chfoo
20:39:20[42] (N4Y) joins
20:39:22Sluggs joins
20:39:27abirkill (abirkill) joins
20:39:28HCross (HCross) joins
20:39:28@ChanServ sets mode: +o HCross
20:39:29atphoenix_ quits [Remote host closed the connection]
20:39:29nepeat (nepeat) joins
20:39:30hook54321 (hook54321) joins
20:39:30@ChanServ sets mode: +o hook54321
20:39:45njha joins
20:39:46benjins joins
20:39:52kiska (kiska) joins
20:39:53DiscantX_ joins
20:40:03yano (yano) joins
20:40:13atphoenix_ (atphoenix) joins
20:40:15celestial joins
20:40:31kaz (Kaz) joins
20:40:31@ChanServ sets mode: +o kaz
20:40:41Minkafighter7 joins
20:40:49driib (driib) joins
20:40:51coderobe (coderobe) joins
20:40:54Kinille (Kinille) joins
20:40:55Kenshin joins
20:40:55JTL (jtl) joins
20:40:58Mateon2 is now known as Mateon1
20:41:01HugsNotDrugs joins
20:41:03Ryz (Ryz) joins
20:41:24dxrt joins
20:41:27dxrt quits [Changing host]
20:41:27dxrt (dxrt) joins
20:41:27@ChanServ sets mode: +o dxrt
20:41:34maxfan8 (maxfan8) joins
20:41:37xkey (xkey) joins
20:41:38BPCZ (BPCZ) joins
20:42:52Jon joins
20:43:05lun4 (lun4) joins
20:43:05Sanqui joins
20:43:08Sanqui quits [Changing host]
20:43:08Sanqui (Sanqui) joins
20:43:08@ChanServ sets mode: +o Sanqui
20:43:14Craigle (Craigle) joins
20:43:25erenrich joins
20:45:20Arachnophine (Arachnophine) joins
20:45:26girst (girst) joins
20:48:23pekster (pekster) joins
20:50:29lunik17 joins
20:51:29Fusl (Fusl) joins
20:51:29@ChanServ sets mode: +o Fusl
20:57:20balrog (balrog) joins
20:58:46Ram quits [Remote host closed the connection]
21:14:57IDK (IDK) joins
21:20:10tzt quits [Client Quit]
21:21:37tzt (tzt) joins
21:23:20Giuliano joins
21:23:57Giuliano quits [Remote host closed the connection]
21:24:56IDK_ joins
21:58:43Arcorann_ joins
22:07:08<anarcat>https://tomlehrersongs.com/ is on the radar?
22:22:13<@JAA>anarcat: Yes, already archived two years ago when they originally announced the shutdown for the end of 2024. :-)
23:07:28Wingy quits [Client Quit]
23:08:16Wingy (Wingy) joins
23:15:58hitgrr8 quits [Client Quit]
23:16:03h3ndr1k_ is now known as h3ndr1k
23:25:07lennier1 quits [Ping timeout: 250 seconds]
23:25:25lennier1 (lennier1) joins
23:25:56HackMii quits [Ping timeout: 245 seconds]
23:28:04HackMii (hacktheplanet) joins
23:29:06lennier1 quits [Client Quit]
23:30:19lennier1 (lennier1) joins
23:54:16sec^nd quits [Ping timeout: 245 seconds]
23:54:53sec^nd (second) joins

HomeSearchPrevious dayNext day