HomeSearchPrevious dayNext day

00:13:41burnmjd quits [Client Quit]
00:36:04rsn_ joins
00:37:23rsn_ quits [Client Quit]
00:48:59XXLuigiMario quits [Remote host closed the connection]
02:00:01Dallas quits [Client Quit]
02:03:46Dallas (Dallas) joins
02:43:12<@kiska>Freshlive packing final pack 20210106034231_f273eef3 then will turn off factory
02:53:24<@kiska>Freshlive is drained
03:50:30holbrooke_ joins
03:56:42HP_Archivist (HP_Archivist) joins
04:18:39<katocala>!a https://trumpmarch.com/ --igset blogs --explain "large march tomorrow"
04:19:05<katocala>oops
04:30:22qw3rty_ joins
04:33:52qw3rty__ quits [Ping timeout: 252 seconds]
05:01:24tzt quits [Ping timeout: 240 seconds]
05:05:13tzt joins
05:20:22DogsRNice quits [Read error: Connection reset by peer]
05:29:29HackMii quits [Remote host closed the connection]
05:29:50HackMii (hacktheplanet) joins
05:31:19godane (godane) joins
07:29:34godane quits [Client Quit]
07:41:35burnmjd joins
07:51:26HackMii_ (hacktheplanet) joins
07:51:44HackMii quits [Ping timeout: 240 seconds]
07:52:22HackMii_ is now known as HackMii
07:58:01Ruthalas quits [Remote host closed the connection]
08:27:34jlu5 is now known as jlu5`
09:00:17britmob2 quits [Quit: britmob2]
09:01:57<Ryz>Hmm, concerns of Chinese websites being more inaccessible for those outside of China from this comment: https://old.reddit.com/r/Games/comments/kqfq9j/apple_removes_39000_games_from_china_store_in/gi4ifj1/
09:02:05<Ryz>More focus on archiving Chinese websites?
11:23:57<Lord_Nightmare>btw when is the last time we did a full sweep of archiving every size of every twitch emote from the CDN servers? I think it was in 2017 or 2018
13:08:44<katocala>I've grabbed thousands of Chinese sites (government). Still have more Chinese Academy of Sciences library sites, but they require heavy ignores if run through AB to avoid running on forever.
13:15:13britmob2 joins
13:54:19Arcorann quits [Ping timeout: 252 seconds]
16:49:16<HP_Archivist>WBM down or just me?
16:51:00LeGoupil joins
17:02:45<Aoede>archived pages load fine, but calendar doesn't seem to work
17:05:29Barto quits [Ping timeout: 265 seconds]
17:11:26Barto (Barto) joins
17:32:45<HP_Archivist>It was down for me earlier Aoede
17:32:49<HP_Archivist>Seems to be up now on my end
17:36:38VonGuard joins
17:36:46<VonGuard>ok
17:37:01<VonGuard>anyone interested in helping Digibarn move their data from a dying server to a working one over the internet
17:44:14<kpcyrd>VonGuard: just talking how through the upload forms or doing data rescue too? Like broken disks?
17:45:07<VonGuard>honestly, i only have what he's told me. He thinks the server is up and just needs to be "telnet'd to" as ftp is down. I think he means ssh... Then, once the data is out, it needs to go to another host.
17:45:15<VonGuard>should be simple, but you know how these things go
17:45:33<VonGuard>talk an old unix head through moving a dir from one computer to another
17:46:20<kpcyrd>with a description that vague people are going to be hesitant
17:46:27<VonGuard>yeah i'm sure
17:46:32<VonGuard>this is not the only place i haev asked
17:46:37<VonGuard>the key here is that this is digibarn
17:46:44<VonGuard>they have all the original apple papers etc.
17:47:11<VonGuard>i'd show you their website but .... you know ... it's down
17:47:21<VonGuard>SketchTheCow knows who i am talking about here
17:48:25<kpcyrd>VonGuard: if only there'd be a website that allows browsing historic snapshots :)
17:48:35<VonGuard>hehehe. i do have moe info, btw
17:48:40<VonGuard>an email of info i can forward
17:48:52<VonGuard>https://archive.org/details/DigiBarn
17:49:11<VonGuard>they have their own section of the archive
17:54:09<atphoenix>most recent WBM snapshot of homepage https://web.archive.org/web/20201230204823/http://www.digibarn.com/ prominently thanks IA
18:15:27<VonGuard>thanks!
18:46:34<atphoenix>that doesn't mean there is a complete copy. Just means there is at least some stuff.
19:12:24Barto quits [Ping timeout: 240 seconds]
19:13:43Barto (Barto) joins
19:29:54LeGoupil quits [Client Quit]
20:19:47Doranwen quits [Ping timeout: 265 seconds]
20:21:14Doranwen joins
20:25:28Doran joins
20:26:04Doranwen quits [Ping timeout: 240 seconds]
21:18:47Doran is now known as Doranwen
21:19:48Doranwen quits [Client Quit]
21:19:59Doranwen joins
21:51:39<mgrandi>https://twitter.com/ElijahSchaffer this guy might try and purge his account since he basically probably committed Infinite felonies for breaking into the capitol and looking at probably classified data
21:58:49<jodizzle>That account is being run in AB
22:02:12<mgrandi>Cool, thanks
22:28:26<wessel1512>can somebody grap some twitter hashtags with socialbot with min_retweets:100
22:28:32<HP_Archivist>I'm curious if anyone is thinking about how other countries are or will be reporting this. Can we focus on grabbing international reports/headlines from other countries, preferably non-English speaking countries?
22:30:27<wessel1512>#WashingtonDC #Trump #whiteprivilege
22:31:19<Craigle>I'm working on some now
22:31:35<HP_Archivist>I suppose my point was sort of akin to 'how the world watches America' right now, as this unfolds ^
22:31:48<wessel1512>Tanks
22:31:52<Craigle>Anyone (JAA?) know if I can stack "min_retweets" and "since"
22:31:57<jodizzle>Yes
22:32:04<wessel1512>https://www.nu.nl/verkiezingen-vs/6100473/evacuatie-capitool-bezig-avondklok-ingesteld-in-washington.html
22:32:05<jodizzle>use `twitter-search`
22:32:42<Craigle>socialbot: snscrape twitter-search #whiteprivilege%20min_retweets:100%20since2021-01-05
22:32:50<Craigle>jodizzle: Like that^
22:33:12<jodizzle>Oh, I don't know if that will work on socialbot anymore. You might have to do it with snscrape separately
22:33:24<wessel1512>%20 dus not work all the time
22:33:38<jodizzle>I can do it on my machine
22:33:44<Craigle>Good call. Let me try to run that through and see if it gives me good results
22:34:08<@JAA>Yes, don't use that %20 hack anymore, run snscrape locally.
22:34:21<Craigle>Gotcha, will do
22:34:35<jodizzle>Also make sure to grab outlinks via `--format`
22:34:41<HP_Archivist>wessel1512: That's exactly what I meant, yes, good example with the nu.nl link
22:40:02<HP_Archivist>I think it'd be healthy to archive more headlines from non English speaking countries in addition to the usual sources since we seem to be at a low point. It might be useful for the historical record to have the added aspect of other countries' reporting/interpretations
22:43:18<wessel1512>i had a idea of building a bot that via rss filters news articles to a specific topic
22:44:17<wessel1512>most news websites still use rss
22:45:23<wessel1512>so compatibility isn't a problem
22:45:43AlsoHP_Archivist joins
22:49:04HP_Archivist quits [Ping timeout: 240 seconds]
22:51:11<AlsoHP_Archivist>wessel1512: whatever works/easiest to grab the most amount of content etc
22:52:11<Dallas>Whats the AB command to grab just 1 tweet?
22:52:26<jodizzle>Dallas: Use !ao on the tweet
22:52:43<wessel1512>im manually grabbing bbc world wide nu.nl nos.nl
22:53:03<Dallas>ty jodizzle
23:06:13<Dallas>Does anyone like record and archive news channels during stuff like this ? I've been watching CNN for like 4 hours and just realized I could've been recording it
23:08:31<wessel1512>i thinks that the internet archive records live tv
23:08:40<wessel1512>not sure tho
23:09:22<@JAA>Yes, IA records (some) TV stations.
23:10:04<@JAA>https://archive.org/details/tvarchive
23:12:16<Dallas>oh wow brilliant
23:17:21Matthww quits [Quit: Ping timeout (120 seconds)]
23:17:39Matthww joins
23:26:33<Dallas>oh JAA sorry btw I had a pita december and hadn't looked at pr's at all. I updated this one just wanna know what meta you want from the insta vids https://github.com/JustAnotherArchivist/snscrape/pull/159#discussion_r552976153
23:27:58burnmjd quits [Client Quit]
23:29:03<OrIdow6>AlsoHP_Archivist: I know you're talking shorter-term, but one of the intentions for #// that ark iver mentioned, but which I haven't heard anything about being implemented, is sending links from news RSS feeds there, as newsgrabber used to do (I think, that was before my time)
23:29:06<OrIdow6>CC wessel1512
23:31:39<AlsoHP_Archivist>OrIdow6: Yeah and not only that I was only thinking about manually searching newspaper/news outlet sites in other countries and grabbing URLS that way. RSS is far more efficient. Newsgrabber is before my time as well
23:32:20<AlsoHP_Archivist>I just wanted to throw that out there since the usual USA networks/outlets will likely be crawled
23:33:01<OrIdow6>With news, unlike social media posts, we have the advantage that that they're unlikely (or at least much less likely) to be deleted/removed from public view in the short term
23:33:18<OrIdow6>But yeah, I see what you mean
23:33:23<wessel1512> Newsgrabber 2.0
23:34:07<OrIdow6>The advantage of RSS is that you can only get new content - if we were to crawl Le Monde or whatever once a month, that'd be a huge amount of redundant data
23:34:15<OrIdow6>Obviously there are more obscure newspaper\
23:34:53<maxfan8>Continuing from #archiveteam-bs, does anyone know where the maga people actually coordinate their stuff?
23:35:26<maxfan8>It seems like parler is a major place
23:35:48William joins
23:35:51<maxfan8>Twitter less so (or maybe this is just because of where I live)
23:36:08<AlsoHP_Archivist>OrIdow6: Like I said a little while ago, I think this is yet another new low point for us here in the States. This has never happened before. I immediately, after watching some of the livestream from cnn, thought about how instead of people of the future watching this reported from within the US, what could people learn in the future of how it's reported from other people, in other countries.
23:36:37<Dallas>maxfan8 I keep hearing a lot of it is in private facebook groups too, which obvs we can't grab
23:36:46<maxfan8>Hmm ok
23:36:56<AlsoHP_Archivist>It's strange. I don't place any value on buildings or objects, though we of course archive/preservation/conserve those things as vessels that shape ideas. But really, it's the ideas which a place like the Capitol represent.
23:37:09<maxfan8>Agh but how do people hear about these groups?
23:37:54<AlsoHP_Archivist>And seeing people storm the Capitol like that is just so depressing because we're better than that. Anyway. These are my thoughts.
23:38:08<Dallas>I wonder how much of the younger ones are cording via discord as well
23:38:08<@JAA>Please keep that stuff in -ot or elsewhere.
23:38:20<AlsoHP_Archivist>JAA: Will do
23:38:34<@JAA>As for reviving newsgrabber, it's been mentioned a couple times, but nothing's immediately planned at the moment.
23:39:21<maxfan8>Somewhat off-topic, but I've got a few college applications to write so I'll be somewhat distracted/not able to focus completely on archiving the coup today. If somebody could help out on the doc (https://pad.riseup.net/p/couparchive-whpciu3-keep) and help archive the coup, that'd be great
23:39:45William leaves
23:42:00<OrIdow6>I'm going to push this now before it has too much inertia: the Etherpad should be moved to kis ka's instance
23:44:18<@JAA>++
23:44:40<maxfan8>Why?
23:44:46<maxfan8>Any particular reason?
23:45:06<maxfan8>I'm totally open to it
23:48:03<OrIdow6>More flexibility (ability to add plugins we want), faster response if it goes down, ability to grab a backup from the /export/etherpad endpoint every minute without annoying riseup.net
23:50:03<Craigle>Is it reasonable that that snscrape job is still running? It doesn't seem like it should be taking this long
23:50:17<maxfan8>Where is kiska's site located?
23:50:23<maxfan8>I'll switch over now before it grows to big then
23:50:27<maxfan8>*too
23:50:38<maxfan8>systwi: is this ok with you?
23:50:50<OrIdow6>pad.notkiska.pw
23:50:53<jodizzle>Craigle: Which snscrape job?
23:51:01<OrIdow6>You can export then import an Etherpad file
23:51:20<Craigle>The one I started locally for #whiteprivilege
23:51:39<Craigle>It's been running for about an hour now
23:51:51<jodizzle>What "since:" did you set?
23:52:06<Craigle>snscrape twitter-search query #whiteprivilege --max-results 1 --min_retweets 100 --since 2021-01-05 --format outlinks > wp.txt
23:52:14<Craigle>That is the full string I ran
23:52:27<maxfan8>systwi: if it's ok with you, I'll copy it over to kiska's etherpad instance and replace the text in the riseup one with a deprecation notice
23:52:34<maxfan8>Sounds good?
23:52:56thuban quits [Ping timeout: 265 seconds]
23:53:04<@JAA>Craigle: That's not how it works.
23:53:34<Craigle>Oh wait, that max-results shouldn't be there. I was testing something else
23:54:00<@JAA>You want something like this: snscrape twitter-search '#whiteprivilege min_retweets:100 since:2021-01-05'
23:54:19<@JAA>Also, the format option has to come before twitter-search, and that value doesn't do what you think it does.
23:54:52<@JAA>Check the socialbot source code for the correct one, and then you'll have to post-process the output.
23:54:58<maxfan8>Ok, JAA OrIdow6 et al. I'm deprecating in favor of https://pad.notkiska.pw/p/couparchive
23:56:59<jodizzle>Craigle: This is the --format call socialbot uses: `--format '{url} {tcooutlinksss} {outlinksss}'`. That produces space-separated links on each line
23:58:05<Ryz>Any Parler jobs running outside of AB?
23:58:15<Ryz>Or any fullness?
23:58:47<maxfan8>Lol bellingcat is saying:
23:58:49<maxfan8>> For those who are able to: please try to scrape and save any videos and livestreams of the Capitol storming and occupation. Just like after Charlottesville in 2017, many of those who are streaming will delete their streams once they realize how incriminating the footage is.
23:58:57<maxfan8>(on twitter)
23:59:30<maxfan8>Gotta archive the archivers lol

HomeSearchPrevious dayNext day