HomeSearchPrevious dayNext day

00:00:30<@JAA>thuban: Actually, wrong repo for snscrape. https://github.com/JustAnotherArchivist/snscrape
00:08:59<SCSi>so snscrape just gives me the links, then i feed the individual links to archivebot
00:09:06<thuban>https://github.com/JustAnotherArchivist/snscrape/issues/175
00:09:23<SCSi>oh
00:09:30<SCSi>crap
00:09:40<@JAA>This is the reason why socialbot exists.
00:09:59<@JAA>It includes the profile page and outlinks in the output.
00:10:24<@JAA>Unless you have a very good reason not to, please just use socialbot instead of snscrape as it does The Right Thing.
00:10:38<@JAA>(For usage with ArchiveBot, that is.)
00:12:39<SCSi>gotcha
00:46:28<SCSi>so did https://twitter.com/nyancrimew/ ever get sent to socialbot?
00:46:36<mgrandi>I put it in
00:46:46<SCSi>ok coo, i dont have voice so i cant add stuff to the botz
00:47:01<mgrandi>You can do socialbot without voice
00:47:12<SCSi>oh, maybe im thinking of archivebot needs voice
00:47:25<mgrandi>Dunno if that is intentional lol
00:48:38<@JAA>It is intentional.
01:27:19Arcorann joins
01:40:14sonick joins
01:53:47sonick quits [Remote host closed the connection]
01:54:32sdf_ joins
02:06:01katocala quits [Remote host closed the connection]
02:08:31sdf_ quits [Client Quit]
02:13:31katocala joins
02:14:29sonick joins
02:15:05<purplebot>Archive.today edited by Nintendofan885 (+1, /* Funding */ Fix ref link) just now -- https://www.archiveteam.org/?diff=46401&oldid=46398
02:24:11@arkiver quits [Remote host closed the connection]
02:24:25arkiver (arkiver) joins
02:24:25@ChanServ sets mode: +o arkiver
02:28:24<Ryz>What the hell is Twitter doing with 'NFT'? Related to Twitter posts? Can these still be archived? https://www.theverge.com/22310188/nft-explainer-what-is-blockchain-crypto-art-faq
02:31:57<Ryz>There's apparently a bunch of bots set up for this scenario
02:32:13<Ryz>Might be worth a lot of proactive archiving
02:35:20Mineroboter_ joins
02:35:52<@JAA>Not really.
02:36:08Mineroboter quits [Ping timeout: 250 seconds]
02:36:34<Ryz>Apparently you can, but it's wouldn't be considered the original s:
02:38:59<@JAA>I mean, there is no such thing as 'the original' with digital data.
02:39:50sonick quits [Remote host closed the connection]
02:40:29<@JAA>Archiving these various NFT platforms might be interesting to preserve what bits some people spend thousands of monies on.
02:42:00<Ryz>Yeah, definitely, gotta archive what's trending and blowing up and what could be part of our everyday life s:
02:49:25<Ryz>Welp, someone pointed out that there used to be YouTube videos and pages of Adam Savage trying to make a raptor costume and earlier it was taken down: https://old.reddit.com/r/tested/comments/m0iuk3/video_adam_savage_makes_dinosaur_skin_for_his/
02:53:27<Arcorann>I hear there are bots going around making NFTs for art they find on Twitter
02:54:06godane1 quits [Ping timeout: 264 seconds]
02:54:10<Ryz>Arcorann or anyone else, if you can find any, especially Twitter accounts, should be worth archiving via AB
02:56:02<Arcorann>https://nitter.42l.fr/WeirdUndead/status/1369210982518693888#m <-- relevant tweet to my previous message
03:17:31lennier2 joins
03:20:46lennier1 quits [Ping timeout: 250 seconds]
03:20:52lennier2 is now known as lennier1
03:21:33<Ryz>This is related to NFTs, something to consider overseeing: https://twitter.com/Tamschi_/status/1369265717481246724
03:21:40<Ryz>https://opensea.io/
03:39:56Mineroboter joins
03:41:34Mineroboter_ quits [Ping timeout: 250 seconds]
03:44:35Lord_Nightmare quits [Quit: ZNC - http://znc.in]
03:47:17Lord_Nightmare (Lord_Nightmare) joins
04:25:12DogsRNice quits [Read error: Connection reset by peer]
04:31:50Arcorann quits [Ping timeout: 250 seconds]
04:32:20qw3rty__ joins
04:36:10qw3rty_ quits [Ping timeout: 250 seconds]
04:40:11nertzy quits [Quit: Leaving]
05:01:17nertzy (nertzy) joins
05:10:06etnguyen03 quits [Client Quit]
05:13:27jlu5 quits [Ping timeout: 240 seconds]
05:19:34jlu5 (jlu5) joins
05:28:36BlueMaxima quits [Client Quit]
06:31:06<jodizzle>HuffPost Canada and HuffPost Québec shut down: https://www.huffingtonpost.ca/
06:31:20<jodizzle>Allegedly without notice: https://twitter.com/Samantha_KB/status/1369346927641387011
06:32:59<jodizzle>According to the site, there will be an online archive, but that doesn't seem to be available at the moment
06:39:48BlueMaxima joins
07:20:11jazza3 joins
07:20:36Ctrl-S_ joins
07:20:39deni_ (deni) joins
07:20:41revi_ (revi) joins
07:20:41justcool393_ (justcool393) joins
07:20:58devsnek_ (devsnek) joins
07:20:59SketchTh1Cow joins
07:21:08JSharp_ (JSharp) joins
07:21:42girst_ (girst) joins
07:22:38girst quits [Ping timeout: 252 seconds]
07:22:39kiskaLogBot quits [Ping timeout: 252 seconds]
07:22:39step quits [Ping timeout: 252 seconds]
07:22:39jazza quits [Ping timeout: 252 seconds]
07:22:39HugsNotDrugs quits [Ping timeout: 252 seconds]
07:22:40endrift quits [Ping timeout: 252 seconds]
07:22:40SketchTheCow quits [Read error: Connection reset by peer]
07:22:40endrift|ZNC joins
07:22:40jazza3 is now known as jazza
07:22:40step_ joins
07:22:44HugsNotDrugs joins
07:23:10step_ is now known as step
07:23:23kiskaLogBot joins
07:24:04nertzy_ joins
07:26:13godane joins
07:26:30nertzy quits [Ping timeout: 264 seconds]
07:38:33deni quits [Read error: Connection timed out]
07:38:33JSharp quits [Read error: Connection timed out]
07:38:33justcool393 quits [Read error: Connection timed out]
07:38:33Ctrl-S quits [Read error: Connection timed out]
07:38:33revi quits [Read error: Connection timed out]
07:38:33deni_ is now known as deni
07:38:33JSharp_ is now known as JSharp
07:38:33justcool393_ is now known as justcool393
07:38:33revi_ is now known as revi
07:38:33Ctrl-S_ is now known as Ctrl-S
07:38:37devsnek quits [Read error: Connection timed out]
07:38:37devsnek_ is now known as devsnek
07:50:36<Zopolis4>is there a tool to automatically download all the .torrent files from a site? i have tried scraping the site through wget, and i havent found an acceptable sitemap, so i was wondering if anyone knew of a tool that did this
07:51:23<Zopolis4>seeing as there are indexers for sites, I assume it would be possible to access the indexed links and scrape those through weget
08:03:20HP_Archivist quits [Read error: Connection reset by peer]
08:03:46HP_Archivist (HP_Archivist) joins
08:39:15Sylirana quits [Ping timeout: 244 seconds]
08:43:56<Zopolis4>nvm i found an alternate solution
08:50:39BlueMaxima quits [Read error: Connection reset by peer]
08:59:23hooway joins
09:00:19britmob2 quits [Quit: britmob2]
09:05:38Sylirana (Sylirana) joins
09:24:11Arcorann joins
09:27:18Sylirana quits [Ping timeout: 244 seconds]
09:28:07Sylirana (Sylirana) joins
10:44:10<Dallas>ty mgrandi that account did get pulled unsurprisingly https://twitter.com/nyancrimew
10:45:04<Dallas>I didn't realize socialbot didn't need voice I thought it was just the command to grab on page you could use un-voiced oops
11:14:30jazza quits [Ping timeout: 264 seconds]
11:16:14jazza joins
11:16:19nertzy_ quits [Read error: Connection reset by peer]
11:32:15HackMii quits [Remote host closed the connection]
11:34:25HackMii (hacktheplanet) joins
11:55:20HP_Archivist quits [Read error: Connection reset by peer]
11:55:47HP_Archivist (HP_Archivist) joins
12:31:20Arcorann quits [Remote host closed the connection]
12:31:37Arcorann joins
12:47:52icedice joins
13:51:41britmob25 joins
14:33:49<@EggplantN>okay checking deathwatch here
14:33:49<@EggplantN>- webs - WIP
14:33:49<@EggplantN>- nico - WIP
14:33:49<@EggplantN>- Tesla forums - Done JAA
14:33:49<@EggplantN>- ge.tt - done-ish website fucked
14:33:49<@EggplantN>- demi.fi - Unsure
14:33:50<@EggplantN>- Instructables - Unsure
14:33:50<@EggplantN>- periscope - awaiting arkiver
14:34:04<@EggplantN>anyone fill me in of demi/instructables and we're about done for March
14:34:18Arcorann quits [Ping timeout: 264 seconds]
14:44:37<Aoede>EggplantN: demi - I got an incomplete list of threads and users. I don't believe anyone has archived it yet.
14:45:17<Aoede>and the site is JS hell, I don't know how to do it myself
14:53:29<@arkiver>Aoede: how many URLs?
14:53:35<@arkiver>or well just the list, how large is it
14:54:07<@arkiver>the instructables forum may be small enough for AB
15:09:21<Aoede>arkiver: 150k threads ans 36k users
15:09:25<Aoede>https://transfer.notkiska.pw/9xiqA/demi_threads.txt.zst
15:09:35<Aoede>https://transfer.notkiska.pw/hUhwd/demi_users.txt.zst
15:12:56<Aoede>750k threads total? https://logs.kiska.pw/archiveteam-bs/2021-02-08#l2f4b7865
15:15:22atphoenix quits [Remote host closed the connection]
15:16:03atphoenix (atphoenix) joins
15:22:52LeighR (LeighR) joins
15:30:00LeighR quits [Ping timeout: 244 seconds]
15:50:35Mateon2 joins
15:52:36Mateon1 quits [Ping timeout: 250 seconds]
15:52:36Mateon2 is now known as Mateon1
16:10:51<atphoenix>I think we did some stuff Re:Instructables a few months back but JS was getting in the way?
16:11:04<atphoenix>i.e. javascript
16:18:53<mgrandi>@Dallas: yeah , you can do it without voice, and especially for twitter accounts with low amounts of tweets, you can throw that in there ez pz
16:19:10<mgrandi>https://web.archive.org/web/*/https://twitter.com/nyancrimew/* is all of the tweets
16:22:28<Dallas>Oh sweet, ty mgrandi does socialbot grab media too ? Because I thought socialbot was just snscrape which didn't
16:23:13<mgrandi>It uses snscrape which crawls the urls for a twitter / other accounts and then feeds that to AB
16:23:33<mgrandi>Which should grab what the web browser sees at least, I'm not sure about video, pictures def
16:23:35<Dallas>Ah okay cool cool, ty :)
17:44:27HackMii quits [Remote host closed the connection]
17:45:31HackMii (hacktheplanet) joins
17:45:47<mgrandi>It might get twitter videos, I'm not sure
17:46:17<mgrandi>I'd it does it wouldnt be playable in the browser though since the videos use javascript and weird manifest things to play
17:47:52mirsal quits [Ping timeout: 250 seconds]
18:20:47<Barto>how much data did we lose with ovh burning down? Is there an estimation of what went in ashes yet?
18:40:39<@JAA>Barto: So far, nobody here has reported losing anything as far as I've seen.
18:58:38ragu quits [Read error: Connection reset by peer]
18:58:57ragu joins
18:59:52<atphoenix>on data losses: https://www.bleepingcomputer.com/news/technology/ovh-data-center-burns-down-knocking-major-sites-offline/ says "The list of impacted clients includes cyber threat intelligence company Bad Packets, provider of free chess server Lichess.org, videogame maker Rust, cryptocurrency exchange Deribit's blog and docs sites, telecom company AFR-IX, encryption utility VeraCrypt, news outlet eeNews Europe, the art building
18:59:52<atphoenix>complex Centre Pompidou, and many others."
19:02:37<ThreeHeadedMonkey>Guess we'll find out who had working backups over the next days/weeks
19:06:04etnguyen03 (etnguyen03) joins
19:15:42ragu_ joins
19:19:18ragu quits [Ping timeout: 264 seconds]
19:32:25rsn quits [Quit: Leaving]
19:57:07Zopolis4 quits [Ping timeout: 244 seconds]
20:16:21lennier2 joins
20:19:18lennier1 quits [Ping timeout: 264 seconds]
20:19:21lennier2 is now known as lennier1
20:24:14LeGoupil joins
20:34:12godane1 joins
20:36:52godane quits [Ping timeout: 250 seconds]
20:42:36rolll quits []
20:49:20DogsRNice (Webuser299) joins
21:09:57LeGoupil quits [Client Quit]
21:47:31AlsoHP_Archivist joins
21:48:48HP_Archivist quits [Ping timeout: 250 seconds]
22:31:34BlueMaxima joins
22:41:59@Fusl_ quits []
22:42:13Fusl_ (Fusl) joins
22:42:13@ChanServ sets mode: +o Fusl_
22:51:36Arcorann joins
22:55:46britm0b joins
22:58:34etnguyen03 quits [Ping timeout: 250 seconds]
22:58:34britmob quits [Ping timeout: 250 seconds]
22:58:54etnguyen03 (etnguyen03) joins
23:06:13Sylirana quits [Ping timeout: 244 seconds]
23:11:35Sylirana (Sylirana) joins
23:23:48hooway quits [Client Quit]
23:44:16godane2 joins
23:46:40godane1 quits [Ping timeout: 250 seconds]
23:47:04rsn joins

HomeSearchPrevious dayNext day