00:06:38SpikedColaWasTaken quits [Read error: Connection reset by peer]
00:17:14<@JAA>Aoede: Let's take this to -dev.
00:17:45DogsRNice (Webuser299) joins
01:30:57onetruth joins
01:43:05postpwnk quits [Client Quit]
02:08:27sec^nd quits [Ping timeout: 240 seconds]
02:08:28Larsenv quits [Quit: ZNC 1.8.0 - https://znc.in]
02:09:12sec^nd (second) joins
03:41:56Mineroboter_ joins
03:43:46Mineroboter quits [Ping timeout: 250 seconds]
03:55:36Larsenv (Larsenv) joins
04:11:00<OrIdow6>So AFAICT (it might just not like the TLD) there are no WBM captures whatsoever for clevr.photos
04:11:54maxfan8_ quits [Quit: WeeChat 1.9.1]
04:12:09maxfan8 (maxfan8) joins
04:13:23<OrIdow6>It looks like there are less than 43k photos, e.g. https://www.clevr.photos/pano/42000 - think it is doable in AB
04:14:12<OrIdow6>Maybe an initial run from the homepage and then an ao for IDs not captured in that one
04:16:14<OrIdow6>If one of you wants to do the first, I can generate the second
04:33:27qw3rty_ joins
04:37:18qw3rty__ quits [Ping timeout: 264 seconds]
05:07:31etnguyen03 quits [Client Quit]
05:08:09Arcorann quits [Remote host closed the connection]
05:08:30Arcorann joins
05:11:41ranma joins
05:37:43DogsRNice quits [Read error: Connection reset by peer]
06:18:37Sylirana quits [Read error: Connection reset by peer]
06:19:35Sylirana (Sylirana) joins
07:25:34hooway joins
09:24:37Zopolis4 joins
09:38:02godane joins
09:41:40<Zopolis4>i have the url for the sitemap rss of a website (https://tlz.digital/rss.xml) , but i dont know how to get the other ones (it only coveres a handful of urls)
10:22:05BlueMaxima quits [Client Quit]
10:47:30britmob quits [Ping timeout: 264 seconds]
10:50:04Ryz quits [Remote host closed the connection]
12:00:31sliccricc quits [Remote host closed the connection]
12:09:23godane1 joins
12:11:38godane quits [Ping timeout: 250 seconds]
12:12:14godane2 joins
12:15:06godane1 quits [Ping timeout: 264 seconds]
12:32:16godane1 joins
12:34:36godane2 quits [Ping timeout: 250 seconds]
13:21:23britmob joins
13:23:59LeGoupil joins
14:15:26sonick quits [Remote host closed the connection]
14:36:06sonick joins
14:55:18Mineroboter_ quits [Ping timeout: 264 seconds]
14:56:24Mineroboter joins
15:18:42Mineroboter_ joins
15:19:18Mineroboter quits [Ping timeout: 264 seconds]
15:23:49Mineroboter joins
15:25:20Mineroboter_ quits [Ping timeout: 250 seconds]
15:25:54Arcorann quits [Ping timeout: 264 seconds]
15:33:45etnguyen03 (etnguyen03) joins
16:33:02HP_Archivist quits [Client Quit]
16:47:51DogsRNice (Webuser299) joins
17:17:27Ryz (Ryz) joins
18:39:31<AK>https://www.cbc.ca/news/business/huffpost-canada-closing-1.5942533
19:46:42HP_Archivist (HP_Archivist) joins
20:05:36lennier2 joins
20:08:31lennier1 quits [Ping timeout: 264 seconds]
20:08:37lennier2 is now known as lennier1
21:38:44LeGoupil quits [Client Quit]
21:56:26BlueMaxima joins
22:01:40<tech234a>https://www.morrisbroadband.com/ is a smaller ISP which was recently acquired by Altice USA, might be worth running the website in AB
22:01:59<tech234a>Before the site gets rebranded
22:13:18tzt quits [Ping timeout: 264 seconds]
22:23:44<Dallas>Can someone queue a full grab of this twitter account in case it gets pulled https://twitter.com/nyancrimew
22:23:55<Dallas>pls & ty
22:35:27tzt joins
22:35:35<SCSi>yeah thats going to get yanked
22:50:34<SCSi>archivebox doesnt like to pull shit from twitter
22:50:46<SCSi>anyone know of a good twitter account archiver?
23:01:40<atphoenix>SCSi, archivebot can do it. chromebot can do single tweets.
23:08:51sonick quits [Ping timeout: 244 seconds]
23:09:17teej quits [Quit: Connection closed for inactivity]
23:10:55hooway quits [Client Quit]
23:15:17teej (teej) joins
23:17:29Arcorann joins
23:31:58Arcorann quits [Ping timeout: 250 seconds]
23:38:37HackMii_ (hacktheplanet) joins
23:39:07HackMii quits [Ping timeout: 264 seconds]
23:39:45HackMii_ is now known as HackMii
23:39:55<thuban>this is what socialscrape is for
23:47:28<SCSi>sweeeeet thx
23:47:39<@JAA>Aka socialbot in #archivebot
23:47:46<SCSi>atphoenix: i tried archivebox on the whole account, but twitter didnt like it
23:48:01<SCSi>im gonna try socialscrape just for my own curiosity/learning
23:49:04<SCSi>i sorta have a downloading problem
23:50:08<thuban>JAA: are there docs for the socialbot interface anywhere?
23:50:41<@JAA>Only what's in the readme on GitHub.
23:51:13<@JAA>SCSi: You'll probably want to run snscrape directly instead of using socialscrape/socialbot.
23:51:30<@JAA>The latter's just an IRC wrapper around the former, basically.
23:55:58<thuban>nothing other than https://github.com/ArchiveTeam/snscrape#usage ?
23:56:21<thuban>if you give me an example or two of socialbot usage i will add it to the wiki
23:57:40<@JAA>That's the only thing that exists for snscrape, and socialbot is at https://github.com/JustAnotherArchivist/socialscrape-bot
23:58:29<thuban>aha!
23:59:57<SCSi>oh sweet, snscrape, thx