HomeSearchPrevious dayNext day

00:13:32lunik1 quits [Ping timeout: 265 seconds]
00:16:19lunik1 joins
00:20:50DopefishJustin joins
00:27:19lunik1 quits [Client Quit]
00:38:31lunik1 joins
00:55:51qwertyasdfuiopghjkl joins
01:01:15dm4v quits [Read error: Connection reset by peer]
01:02:24dm4v joins
01:02:24dm4v quits [Changing host]
01:02:24dm4v (dm4v) joins
01:10:23sec^nd quits [Ping timeout: 252 seconds]
01:12:11sec^nd (second) joins
01:45:02<bonga> redfin offers 3d tours of homes which are periodically deleted
01:45:10<bonga>and 3d tours are amazing value for historians
01:45:17<bonga>https://www.hometakes.com/faq/can-i-download-my-3d-tour-my-ipad-or-iphone
01:45:26<bonga>it requires a phone
01:45:42<bonga>https://www.redfin.com/blog/3d-home-walkthrough-redfin/
01:45:54<bonga>https://www.google.com/search?q=redfin+3d+scan&rlz=1CARLJX_enUS968&biw=500&bih=205&sxsrf=AOaemvIFtiCIrT4aioWYxk11elSpq36g_g%3A1638816289360&ei=IVquYdOgFcSnqtsPxre4gAs&oq=redfin+3d+&gs_lcp=Cgdnd3Mtd2l6EAMYAjIFCAAQgAQyBggAEAcQHjIFCAAQgAQyBggAEAUQHjIGCAAQCBAeMgYIABAIEB46BAgAEEc6CwguEIAEELEDEIMBOg0ILhCxAxDHARDRAxBDOggILhCxAxCDAToECAAQQzoLCC4QgAQQxwEQow
01:46:54<bonga>Also it is a good thing to archive mobile exclusive 3d scanning services like polycam for example
01:47:11<bonga>because 3d scanns show amazing value for future historians and aliens
01:47:36<bonga>Matterport offers the scans.
01:58:28pmmemoney (pmmemoney) joins
01:59:45<bonga>And 3d walkthrough requires iOS or Android device
02:00:36<bonga>We are definitely going for Android because you can root
02:00:41<bonga>Or use a emulator
02:00:43<achivarin>The Cloudflare captcha on https://www.hkcnews.com is probably due to the large influx of traffic because of the shutdown announcement. I'm not getting the captcha anymore at the moment.
02:01:51<@JAA>achivarin: Still getting it from CA, DE, and FR.
02:02:11<bonga>redfin offers 3d models of homes which are periodically deleted
02:02:30<bonga>3d tours are amazing value for historians
02:02:47<bonga>Please check above for the links.
02:03:24<bonga>You need an iOS or Android device to access it.
02:03:30<@JAA>You already said that.
02:03:46<bonga>Thaks. Now we needt deveope
02:03:52<@JAA>Have fun.
02:03:55<bonga>An emulator
02:04:04<bonga>Or reverseengubeer
02:04:17dm4v quits [Ping timeout: 252 seconds]
02:04:20<bonga>I am having a badday wit my keyboard
02:05:24dm4v joins
02:05:26dm4v quits [Changing host]
02:05:26dm4v (dm4v) joins
02:05:40<bonga>My keyboard should be working
02:05:44<bonga>Yay it works
02:06:31<achivarin> @ JAA: Yeah you're right I just checked with a VPN. I'll try again later and give you an update.
02:09:02pmmemoney quits [Client Quit]
02:28:31<achivarin>Since I'm not getting captcha, I want to start crawling myself for insurance. Would brozzler be a good choice?
02:29:16<achivarin>if my goal is handing over the result to you guys
03:44:51march_happy (march_happy) joins
04:08:38<jodizzle>achivarin: I encourage you to get whatever you can from the site, using whatever methods. Getting in WARCs is preferred if you can. I don't know anything about brozzler personally.
04:10:05qw3rty_ joins
04:10:12<jodizzle>Keep in mind, though, if you don't already know, that getting it yourself doesn't mean it gets into the Wayback Machine. For that, it would have to be done by Archivebot (technically other options, but that's the main one)
04:11:04<jodizzle>Also not necessary to hand it over to us. You could just upload what you get to IA yourself.
04:12:37qw3rty__ quits [Ping timeout: 252 seconds]
04:26:58<achivarin>jodizzle : Thanks for your answer. Which crawler that saves in WARC would you recommend? I'd like to get the WARCs into Wayback Machine, but like you said a random user can't upload to it. What would be the best way to go about it?
04:31:22<jodizzle>grab-site is a good choice in general: https://github.com/ArchiveTeam/grab-site. But unlike brozzler, it doesn't simulate javascript.
04:33:39<jodizzle>Anyone can upload stuff to IA, including WARCs. But most user's WARCs don't get into the WBM.
04:39:20tbc1887 quits [Remote host closed the connection]
04:43:49<@OrIdow6>bonga: Matterport is something I've been watching for a while, but for those other things we only have so many resources and so much willpower, especially for proactive stuff
04:44:04<achivarin>No javascript is a problem, because Citizen News loads much of its content with infinite scroll... Any other choices?
04:47:57<thuban>achivarin: if you want an automated-browser option like brozzler, but don't want to work with its rethinkdb setup, you can use warcprox with a browser driver of your choice (like selenium)
04:49:32<thuban>the disadvantage of this is that you would have to write your own spidering code
04:50:24<thuban>(you can also use warcprox with manual browsing, for what that's worth)
04:57:20<achivarin>I can't code to save my life... I'll try both grab-site and brozzler for now. Thanks for your advice
05:08:22AnotherIki quits [Ping timeout: 265 seconds]
05:32:01march_happy quits [Remote host closed the connection]
05:38:21march_happy (march_happy) joins
06:03:10bonga quits [Remote host closed the connection]
06:06:45DogsRNice quits [Read error: Connection reset by peer]
06:07:51tbc1887 (tbc1887) joins
06:26:49Arcorann (Arcorann) joins
06:27:07Arcorann quits [Remote host closed the connection]
06:28:14Arcorann (Arcorann) joins
06:28:36Arcorann quits [Remote host closed the connection]
06:29:44Arcorann (Arcorann) joins
06:30:07Arcorann quits [Remote host closed the connection]
06:31:14Arcorann (Arcorann) joins
06:31:36Arcorann quits [Remote host closed the connection]
06:32:44Arcorann (Arcorann) joins
06:33:07Arcorann quits [Remote host closed the connection]
06:34:14Arcorann (Arcorann) joins
06:34:36Arcorann quits [Remote host closed the connection]
06:35:44Arcorann (Arcorann) joins
06:36:07Arcorann quits [Remote host closed the connection]
06:37:14Arcorann (Arcorann) joins
06:37:36Arcorann quits [Remote host closed the connection]
06:38:44Arcorann (Arcorann) joins
06:39:07Arcorann quits [Remote host closed the connection]
06:40:14Arcorann (Arcorann) joins
06:40:36Arcorann quits [Remote host closed the connection]
06:41:44Arcorann (Arcorann) joins
06:42:07Arcorann quits [Remote host closed the connection]
06:43:14Arcorann (Arcorann) joins
06:43:36Arcorann quits [Remote host closed the connection]
06:44:44Arcorann (Arcorann) joins
06:45:07Arcorann quits [Remote host closed the connection]
06:46:14Arcorann (Arcorann) joins
06:46:36Arcorann quits [Remote host closed the connection]
06:47:44Arcorann (Arcorann) joins
06:48:07Arcorann quits [Remote host closed the connection]
06:49:14Arcorann (Arcorann) joins
06:49:36Arcorann quits [Remote host closed the connection]
06:50:44Arcorann (Arcorann) joins
06:51:07Arcorann quits [Remote host closed the connection]
06:52:14Arcorann (Arcorann) joins
06:52:33shoghicp quits [Read error: Connection reset by peer]
06:52:36Arcorann quits [Remote host closed the connection]
06:53:44Arcorann (Arcorann) joins
06:54:07Arcorann quits [Remote host closed the connection]
06:54:57tbc1887 quits [Remote host closed the connection]
06:55:14Arcorann (Arcorann) joins
06:55:36Arcorann quits [Remote host closed the connection]
06:55:55Arcorann (Arcorann) joins
06:56:59tbc1887 (tbc1887) joins
06:57:40shoghicp (shoghicp) joins
07:08:16spirit joins
07:32:39invasi0n joins
07:32:56<invasi0n>Hey folks, how can I propose a site to be archived?
07:35:15invasi0n quits [Remote host closed the connection]
07:38:42invasi0n joins
07:41:59march_happy quits [Ping timeout: 252 seconds]
07:50:20<achivarin>I can't get either grab-site or brozzler to work for the life of me. Anyways, Citizen News is now accessible from CA, FR, DE without captcha after a 5 second Cloudflare redirect page.
09:00:57BlueMaxima quits [Client Quit]
09:02:36xkey quits [Client Quit]
09:02:47xkey joins
09:05:12xkey quits [Changing host]
09:05:12xkey (xkey) joins
10:10:27cpina quits [Read error: Connection reset by peer]
10:11:28cpina joins
10:33:10tbc1887 quits [Read error: Connection reset by peer]
11:02:23jonboy3452 joins
11:06:13Jonboy3451 quits [Ping timeout: 252 seconds]
11:24:48qwertyasdfuiopghjkl quits [Remote host closed the connection]
12:10:13<achivarin>I can't get anything beyond 403 and 503 even from IPs in Hong Kong. I'm a noob at my wit's end here.
12:34:58Hackerpcs quits [Ping timeout: 265 seconds]
12:39:21Hackerpcs (Hackerpcs) joins
12:49:44ragu quits [Client Quit]
13:19:51HackMii_ quits [Remote host closed the connection]
13:21:24HackMii_ (hacktheplanet) joins
13:22:53HackMii_ quits [Remote host closed the connection]
13:24:07HackMii_ (hacktheplanet) joins
13:24:50<achivarin>If it's possible, I'd like some help on how to get past Cloudflare 403s. Or another attempt with archivebot. The site is reachable from CA DE FR, albeit after a long Cloudflare redirect page. Sorry if I'm talking too much. Time is running out and I'm very anxious
13:27:29Hackerpcs quits [Client Quit]
13:30:04Mateon1 quits [Ping timeout: 265 seconds]
13:30:45Mateon1 joins
13:34:25Arcorann quits [Ping timeout: 265 seconds]
13:34:31Hackerpcs (Hackerpcs) joins
14:16:36<pabs>invasi0n: just say "please archive example.org because reason" or similar
14:25:29Megame (Megame) joins
14:27:06Jake quits [Ping timeout: 265 seconds]
14:37:25sembiance quits [Remote host closed the connection]
14:50:15AnotherIki joins
15:00:36AnotherIki quits [Client Quit]
15:09:28Iki joins
15:12:09Jake (Jake) joins
15:19:13Jake quits [Ping timeout: 252 seconds]
15:19:18Jake2 (Jake) joins
15:26:53<@HCross>Today I’ve stumbled across: car burglary tiktok
15:49:40air joins
15:54:04Megame quits [Client Quit]
16:06:09air leaves
16:06:50<@JAA>achivarin: Unfortunately, we can't automatically bypass the Buttflare JS challenge either currently. :-/ But exporting cookies from a browser after passing that challenge and using those along with the browser's UA in grab-site might work.
16:14:04Jake2 quits [Read error: Connection reset by peer]
16:14:27Jake28 (Jake) joins
16:15:43mpeter|m joins
16:15:54Ajay joins
16:15:54tech234a|m joins
16:15:54igneousx (igneousx) joins
16:15:54Sanqui|m joins
16:15:54britmob|m joins
16:38:05Jake28 is now known as Jake
16:49:47Jake quits [Ping timeout: 252 seconds]
16:50:10britmob25636477 quits [Ping timeout: 265 seconds]
17:08:55spirit quits [Client Quit]
17:10:16britmob25636477 joins
17:22:43Terbium quits [Quit: http://quassel-irc.org - Chat comfortably. Anywhere.]
17:23:15Terbium joins
17:44:47britmob25636477 quits [Ping timeout: 252 seconds]
18:11:37LeGoupil joins
18:18:18DogsRNice (Webuser299) joins
18:18:45DogsRNice quits [Remote host closed the connection]
18:19:53DogsRNice (Webuser299) joins
18:20:16DogsRNice quits [Remote host closed the connection]
18:21:23DogsRNice (Webuser299) joins
18:21:46DogsRNice quits [Remote host closed the connection]
18:22:31DogsRNice (Webuser299) joins
18:34:13britmob25636477 joins
18:41:41spirit joins
19:06:49eroc1990 quits [Quit: Ping timeout (120 seconds)]
19:07:59igloo22225 quits [Quit: The Lounge - https://thelounge.chat]
19:08:56igloo22225 (igloo22225) joins
19:10:08eroc1990 (eroc1990) joins
19:49:01Z3R01 joins
20:05:21pmmemoney (pmmemoney) joins
20:10:29<jodizzle>I think I've done that approach before with grab-site, but from what I remember, the cookies unfortunately need to be refreshed at some point
20:13:10wolfin_ quits [Ping timeout: 265 seconds]
20:14:46ArcticCircleSystem joins
20:16:49ArcticCircleSystem quits [Remote host closed the connection]
20:27:05<@JAA>Yeah, that's true, and in the past, they expired randomly. Sometimes, you'd immediately get a challenge again. It's definitely only a poor partial workaround.
20:27:57Wayward quits [Ping timeout: 252 seconds]
20:43:24pmmemoney quits [Client Quit]
20:56:08qwertyasdfuiopghjkl joins
21:00:50Z3R01 quits [Client Quit]
21:07:58spirit quits [Client Quit]
21:09:27<DopefishJustin>another gamejolt source https://twitter.com/ldreamfeel/status/1478065400286007304
21:19:31LeGoupil quits [Client Quit]
21:42:41<@arkiver>please add it to the deathwatch page!
21:45:29wolfin (wolfin) joins
21:49:14qwertyasdfuiopghjkl quits [Remote host closed the connection]
21:50:26qwertyasdfuiopghjkl joins
21:55:53Arcorann (Arcorann) joins
22:20:22march_happy (march_happy) joins
22:23:30march_happy quits [Remote host closed the connection]
22:35:31march_happy (march_happy) joins
22:40:06lennier1 quits [Ping timeout: 265 seconds]
22:41:12bonga joins
22:41:15lennier1 (lennier1) joins
23:01:22yawkat quits [Ping timeout: 265 seconds]
23:01:45nixx joins
23:03:28<h2ibot>TheTechRobo edited Deathwatch (+51, royalflare): https://wiki.archiveteam.org/?diff=48079&oldid=48074
23:04:29<h2ibot>Arkiver edited Deathwatch (+276, Merge edit by…): https://wiki.archiveteam.org/?diff=48080&oldid=48079
23:04:54BlueMaxima joins
23:05:02yawkat (yawkat) joins
23:06:31nixx quits [Remote host closed the connection]
23:14:37<@arkiver>hkcnews.com should turn off the cloudflare protection for a short while in order for it to be archived well
23:15:03<@arkiver>JAA: i remember cloudflare stuff was brought up recently, do we have a good way at the moment to handle that on hkcnews.com ?
23:16:23<@JAA>arkiver: Nope, neither the captcha (which I'm getting again) nor the challenge. More details above in the past couple days.
23:16:44<@arkiver>yeah thought so :/
23:17:33<@JAA>(To clarify, I always got the captcha since I first mentioned it here, although others said they only got the challenge.)
23:18:49qw3rty_ quits [Ping timeout: 252 seconds]
23:27:02Jake (Jake) joins
23:35:41march_happy quits [Ping timeout: 252 seconds]
23:35:44Jake quits [Client Quit]

HomeSearchPrevious dayNext day