00:04:56Arcorann (Arcorann) joins
00:15:55Jonimus quits [*.net *.split]
00:15:56kallsyms quits [*.net *.split]
00:15:56HotSwap quits [*.net *.split]
00:28:16Jonimus (Jonimus) joins
00:28:16kallsyms joins
00:28:16HotSwap joins
00:28:27noteness quits [Remote host closed the connection]
00:28:44noteness (noteness) joins
00:59:16<@OrIdow6>So most of the functionality of Wikidot, save for basic page viewing (which does look like it will play back), goes through a single POST endpoint called ajax-module-connector.php
01:01:26qwertyasdfuiopghjkl joins
01:02:57dm4v_ joins
01:03:15dm4v quits [Ping timeout: 258 seconds]
01:03:15dm4v_ is now known as dm4v
01:03:15dm4v quits [Changing host]
01:03:15dm4v (dm4v) joins
01:03:39<thuban>gross
01:20:45<marked>do you want to access the cookie from python or lua or either?
01:30:32Atom joins
01:35:04HP_Archivist quits [Ping timeout: 258 seconds]
02:21:27onetruth joins
03:02:19qw3rty__ joins
03:05:55qw3rty_ quits [Ping timeout: 258 seconds]
03:50:04rsn quits [Remote host closed the connection]
03:50:24rsn joins
04:02:41noteness quits [Remote host closed the connection]
04:03:28noteness (noteness) joins
04:07:54vela quits [Quit: vela]
04:09:51vela (vela) joins
04:19:07DogsRNice_ quits [Read error: Connection reset by peer]
04:21:42Lord_Nightmare quits [Client Quit]
04:24:24Lord_Nightmare (Lord_Nightmare) joins
05:18:44tzt_ joins
05:33:30EdSavoie quits [Remote host closed the connection]
05:46:10HP_Archivist (HP_Archivist) joins
05:51:59AlsoHP_Archivist joins
05:51:59HP_Archivist quits [Read error: Connection reset by peer]
07:58:08ftl joins
08:51:07qwertyasdfuiopghjkl quits [Remote host closed the connection]
09:58:23AlsoHP_Archivist quits [Ping timeout: 258 seconds]
10:29:20BlueMaxima quits [Client Quit]
11:11:53Webuser492 joins
12:11:30Ryz quits [Remote host closed the connection]
12:12:03Ryz (Ryz) joins
13:17:46ftl quits [Client Quit]
13:23:00daalekz (daalekz) joins
13:23:24daalekz quits [Remote host closed the connection]
13:54:13<@arkiver>OrIdow6: if everything goes through that single endpoint basically nothing will playback well in the wayback machine
13:54:40<@arkiver>also no, i believe we currently cant see the headers, I plan to add support for viewing the raw request/response headers in the Lua hoks
13:54:43<@arkiver>hooks*
14:17:07Craigle quits [Quit: Ping timeout (120 seconds)]
14:17:18Craigle (Craigle) joins
14:17:31AK quits [Remote host closed the connection]
14:17:55AK (AK) joins
14:29:27Craigle quits [Read error: Connection reset by peer]
14:29:29Craigle (Craigle) joins
15:20:17EdSavoie joins
15:38:04noteness quits [Remote host closed the connection]
15:38:20noteness (noteness) joins
16:12:08Arcorann quits [Ping timeout: 258 seconds]
17:28:33Webuser492 quits [Remote host closed the connection]
17:35:54<marked>arkiver: is this valid when put into a separate task in pipeline.py? https://gist.github.com/marked/78d5419062dbb5fefa4e2f5d5f9edfdd
18:33:35DogsRNice (Webuser299) joins
18:38:34DogsRNice quits [Ping timeout: 258 seconds]
18:41:18DogsRNice (Webuser299) joins
19:23:50ftl joins
19:24:25<@arkiver>marked: what is this for, what are you working on?
19:24:51<@arkiver>if this is in response to OrIdow6 - getting the cookie through some extra request is not the problem here, it's from getting it from requests made in the crawl with Wget-AT
19:27:47<@arkiver>wikidot seems interesting
19:28:23<@arkiver>looking at Top Sites on http://community.wikidot.com/whatishot and their number of changes, it seems like it's not very large wikis
19:46:46not-joepie91 quits [Remote host closed the connection]
20:31:40AlsoHP_Archivist joins
20:46:11<marked>yeah, I meant this for wikidot.com. I only see one cookie (wikidot_token7) getting POST-ed in a form, but obviously haven't researched it as much as Orldow6
20:59:09<@OrIdow6>marked: Yes, that's what I was already considering (albeit with something simpler than Tornado), I was asking if there was a simpler way
21:02:17<@OrIdow6>arkiver: Yeah, but again, the core of the site (i.e. looking at pages) should work, even if it ends up being one of those sites where you have to disable JS to get it to play back
21:07:30<@OrIdow6>And going by the page version number of a recent change, there are about 1.37 total revisions in Wikidot's history
21:07:40driib (driib) joins
21:08:08<@OrIdow6>But I haven't checked if that goes to 0, and there are a huge number of spam sites anyhow
21:08:33<@OrIdow6>*1.37 billion
21:09:13DopefishJustin quits [Ping timeout: 258 seconds]
21:09:49driib quits [Client Quit]
21:09:56driib (driib) joins
21:09:57DopefishJustin joins
21:35:40nerdguy1138 quits [Ping timeout: 258 seconds]
21:41:06Craigle quits [Read error: Connection reset by peer]
21:41:11Craigle6 (Craigle) joins
21:51:41nerdguy1138 (nerdguy1138) joins
22:21:03AlsoHP_Archivist quits [Read error: Connection reset by peer]
22:21:30AlsoHP_Archivist joins
22:26:56rbraun quits [Client Quit]
23:08:03noteness quits [Ping timeout: 258 seconds]
23:08:55noteness (noteness) joins
23:53:48BlueMaxima joins