00:16:39<jodizzle>Someone having trouble finding all Trump tweets in the WBM: https://twitter.com/edsu/status/1347942046988951553
00:29:49<@JAA>Hmm, yeah, I get 18808 unique tweet IDs through the timemap API.
00:30:03Arcorann_ joins
00:33:29<@JAA>Doesn't make sense though. The two AB jobs in April and August 2018 alone contain ~35k unique IDs.
00:34:47<jodizzle>Hasn't there been some discussion of the APIs being broken before?
00:35:10<@JAA>Yeah
00:36:48<@JAA>Definitely broken. Various tweets never show up in the timemap.
00:36:57<@JAA>E.g. https://web.archive.org/web/2020*/twitter.com/realDonaldTrump/status/316612796068528129
00:37:14<@JAA>To be clear, this was my API call: https://web.archive.org/web/timemap?url=https%3A%2F%2Ftwitter.com%2FrealDonaldTrump%2Fstatus%2F&matchType=prefix&collapse=urlkey&output=json&fl=original%2Cmimetype%2Ctimestamp%2Cendtimestamp%2Cgroupcount%2Cuniqcount&filter=!statuscode%3A%5B45%5D..&limit=1000000&_=1610237897990
00:37:34<@JAA>That's what /web/*/URL does, just with a bumped limit.
00:38:18<@JAA>That returns 848721 records, by the way.
00:38:29<@JAA>(Including different languages and stuff.)
00:53:01<@JAA>Trying the CDX API.
00:59:34<@JAA>Still running, but I've already found way more.
01:08:24<@JAA>63043 unique IDs from that...
01:14:08<@JAA>https://transfer.notkiska.pw/D6nqG/realDonaldTrump-tweet-ids-cdx
01:14:44<@JAA>From https://web.archive.org/cdx/search/cdx?url=https%3A%2F%2Ftwitter.com%2FrealDonaldTrump%2Fstatus%2F&collapse=urlkey&fl=original&matchType=prefix&filter=original:^https?://twitter\.com/realDonaldTrump/status/[0-9]*$ (with showPageNum and pagination) + grep -Po '/status/\K\d+' trump-wbm | uniqify
01:24:42Arcorann_ quits [Remote host closed the connection]
01:25:08Arcorann_ joins
04:25:35qw3rty_ joins
04:29:26qw3rty__ quits [Ping timeout: 265 seconds]
08:56:55Doran is now known as Doranwen
10:20:59Arcorann (Arcorann) joins
10:23:59Arcorann_ quits [Ping timeout: 244 seconds]
15:34:59Arcorann quits [Ping timeout: 265 seconds]
16:51:06HP_Archivist (HP_Archivist) joins
17:12:31EggplantN_ joins
18:09:04DogsRNice (Webuser299) joins
19:43:03Ryz quits [Remote host closed the connection]
19:43:59Ryz (Ryz) joins
20:17:46HP_Archivist quits [Client Quit]
22:21:50<@JAA>What is going on with the WBM calendars? https://web.archive.org/web/*/https://archiveteam.org/index.php?title=Running_Archive_Team_Projects_with_Docker vs https://web.archive.org/web/20210109221813/https://archiveteam.org/index.php?title=Running_Archive_Team_Projects_with_Docker
22:22:23<@JAA>3 captures on the latter, 'not archived' on the former...
23:55:55Arcorann (Arcorann) joins