HomeSearchPrevious dayNext day

00:34:34imer5 (imer) joins
00:37:55Island joins
00:38:11imer quits [Ping timeout: 258 seconds]
00:38:11imer5 is now known as imer
00:49:11etnguyen03 quits [Ping timeout: 252 seconds]
00:50:17qwertyasdfuiopghjkl (qwertyasdfuiopghjkl) joins
00:51:23AmAnd0A quits [Ping timeout: 252 seconds]
00:51:57AmAnd0A joins
00:58:46BigBrain quits [Ping timeout: 245 seconds]
00:59:10BigBrain (bigbrain) joins
01:04:58etnguyen03 (etnguyen03) joins
01:09:08BlueMaxima joins
02:24:07nicolas17 quits [Client Quit]
02:31:29etnguyen03 quits [Ping timeout: 252 seconds]
02:51:31etnguyen03 (etnguyen03) joins
03:06:09Shjosan quits [Client Quit]
03:06:47Shjosan (Shjosan) joins
03:06:49dumbgoy joins
03:36:55Dango360_ (Dango360) joins
03:40:47Dango360 quits [Ping timeout: 252 seconds]
03:45:24_Dango360 (Dango360) joins
03:49:05Dango360_ quits [Ping timeout: 258 seconds]
03:53:06lennier2 joins
03:53:08immibis quits [Quit: https://quassel-irc.org - Chat comfortably. Anywhere.]
03:54:37Island quits [Read error: Connection reset by peer]
03:55:36railen69 quits [Remote host closed the connection]
03:55:38lennier1 quits [Ping timeout: 252 seconds]
03:55:47lennier2 is now known as lennier1
03:55:51railen69 joins
04:03:57Aoede quits [Quit: ZNC - https://znc.in]
04:04:44Aoede (Aoede) joins
04:06:24Aoede quits [Read error: Connection reset by peer]
04:07:42Aoede (Aoede) joins
04:09:55Aoede quits [Read error: Connection reset by peer]
04:10:11Aoede (Aoede) joins
04:14:21railen69 quits [Remote host closed the connection]
04:14:35railen69 joins
04:22:12Aoede quits [Client Quit]
04:22:28Aoede (Aoede) joins
04:42:33Miori quits [Remote host closed the connection]
04:44:08imer1 (imer) joins
04:46:12etnguyen03 quits [Ping timeout: 258 seconds]
04:47:44imer quits [Ping timeout: 258 seconds]
04:47:44imer1 is now known as imer
04:48:39etnguyen03 (etnguyen03) joins
04:57:58BearFortress_ joins
04:57:59BearFortress_ quits [Max SendQ exceeded]
04:58:08dumbgoy_ joins
04:58:08BearFortress_ joins
04:58:15DLoader_ joins
04:58:38railen64 joins
04:58:42fuzzy8021 quits [Read error: Connection reset by peer]
04:58:42qwertyasdfuiopghjkl quits [Remote host closed the connection]
04:58:42railen69 quits [Read error: Connection reset by peer]
04:58:45lennier2 joins
05:00:09dumbgoy_ quits [Read error: Connection reset by peer]
05:01:36lennier1 quits [Ping timeout: 287 seconds]
05:01:36dumbgoy quits [Ping timeout: 287 seconds]
05:01:36DLoader quits [Ping timeout: 287 seconds]
05:01:36rubberduckie quits [Ping timeout: 287 seconds]
05:01:37lennier2 is now known as lennier1
05:01:37DLoader_ is now known as DLoader
05:02:00rubberduckie joins
05:02:37fuzzy8021 (fuzzy8021) joins
05:03:39BearFortress quits [Ping timeout: 243 seconds]
05:16:02etnguyen03 quits [Client Quit]
05:21:46_Dango360 quits [Client Quit]
05:22:09Dango360 (Dango360) joins
05:46:23tertu2 quits [Ping timeout: 258 seconds]
05:58:28le0n quits [Quit: see you later, alligator]
05:59:12le0n (le0n) joins
06:07:32tertu (tertu) joins
06:18:33hitgrr8 joins
07:02:40AmAnd0A quits [Read error: Connection reset by peer]
07:02:49AmAnd0A joins
07:05:03Unholy236131 quits [Remote host closed the connection]
07:07:12Unholy236131 (Unholy2361) joins
07:13:25lukash joins
07:46:38msrn_ quits [Ping timeout: 252 seconds]
07:53:50bilboed quits [Quit: The Lounge - https://thelounge.chat]
07:54:09bilboed joins
08:47:10BlueMaxima quits [Read error: Connection reset by peer]
08:47:41qw3rty quits [Ping timeout: 252 seconds]
08:48:23qw3rty joins
08:59:04lukash9 joins
08:59:26IDK_ quits [Client Quit]
08:59:26lukash quits [Client Quit]
08:59:26leo60228 quits [Client Quit]
08:59:26lukash9 is now known as lukash
08:59:29IDK_ joins
08:59:43leo60228 (leo60228) joins
09:05:17mikael joins
09:10:23msrn_ joins
09:10:35fangfufu_ joins
09:10:54IDK_ quits [Client Quit]
09:10:54mikael quits [Client Quit]
09:10:54fangfufu quits [Remote host closed the connection]
09:10:54fuzzy8021 quits [Read error: Connection reset by peer]
09:10:54leo60228 quits [Client Quit]
09:10:59IDK_ joins
09:11:06leo60228- (leo60228) joins
09:11:26fuzzy8021 (fuzzy8021) joins
09:18:07kiryu joins
09:33:31Minkafighter52 quits [Quit: The Lounge - https://thelounge.chat]
09:33:43Minkafighter52 joins
09:49:44driib quits [Quit: The Lounge - https://thelounge.chat]
09:50:08driib (driib) joins
10:00:01railen64 quits [Remote host closed the connection]
10:00:17railen64 joins
11:00:01Ryz9 (Ryz) joins
11:00:14@dxrt quits [Ping timeout: 252 seconds]
11:00:33dxrt joins
11:00:35dxrt quits [Changing host]
11:00:35dxrt (dxrt) joins
11:00:35@ChanServ sets mode: +o dxrt
11:01:20Ryz quits [Ping timeout: 252 seconds]
11:01:21Ryz9 is now known as Ryz
11:15:45qwertyasdfuiopghjkl (qwertyasdfuiopghjkl) joins
12:14:18pabs quits [Ping timeout: 265 seconds]
12:15:56iCaotix quits [Read error: Connection reset by peer]
12:16:16iCaotix joins
12:35:50imer8 (imer) joins
12:39:14imer quits [Ping timeout: 252 seconds]
12:39:14imer8 is now known as imer
12:51:54etnguyen03 (etnguyen03) joins
12:54:57AmAnd0A quits [Ping timeout: 258 seconds]
12:55:37AmAnd0A joins
13:00:33driib quits [Client Quit]
13:03:27Minkafighter52 quits [Client Quit]
13:03:33Minkafighter52 joins
13:17:13LeGoupil joins
13:18:16driib (driib) joins
13:32:55LeGoupil quits [Client Quit]
13:49:12nicolas17 joins
14:51:27dumbgoy joins
15:01:30Island joins
15:07:40pabs (pabs) joins
15:12:02<cm>I find that firefox can display this article, but if I use wget with the same user agent I get 403: https://www.axios.com/2023/07/21/zients-biden-ai-authority
15:12:18<cm>how might they be detecting that it's wget? any workaround short of running a browser?
15:21:52emberquill quits [Quit: The Lounge - https://thelounge.chat]
15:22:05emberquill (emberquill) joins
15:34:58<nicolas17>this loads in Firefox
15:35:08<nicolas17>if I open the developer tools, Network tab, I can "copy as cURL"
15:36:20<nicolas17>which usually works, and then I can start trimming headers until it stops working
15:36:22<nicolas17>oh
15:36:34<nicolas17>cm: they have cloudflare protection, you're screwed
15:37:59Arcorann quits [Ping timeout: 252 seconds]
15:38:23<nicolas17>opaque server-side checks, if they get suspicious of you, you get complex javascript which tries to see if it's a legit browser, if *that* fails you get a captcha
15:38:50<nicolas17>so even "running a browser" may not be enough
15:38:51<cm>nicolas17: but with cloudflare protection I would have thought wget would give me a cloudflare page?
15:38:55<cm>rather than 403
15:39:14<nicolas17>I'm getting a cloudflare page
15:39:23<nicolas17><title>Just a moment...</title>
15:39:24<nicolas17> <span id="challenge-error-text">
15:39:26<nicolas17> Enable JavaScript and cookies to continue
15:39:27<nicolas17> </span>
15:39:40<cm>what is your wget command?
15:39:54nicolas17 starts trimming headers
15:39:56<cm>just plain wget with no special user agent?
15:41:00<nicolas17>ah seems the cloudflare challenge page is a 403
15:41:27<nicolas17>use wget --content-on-error if you really want it :P
15:41:32<dumbgoy>doubting this would work for your usecase but what about flaresolverr? any way to integrate wget with that?
15:41:38<cm>ah I see
15:41:49<cm>--content-on-error is how you got the "Just a moment..." page?
15:42:25<nicolas17>well I was using curl instead of wget, which basically behaves like --content-on-error by default
15:42:33<cm>ah ok
15:42:36<nicolas17>but yes, with wget --content-on-error I get the "Just a moment" page saved into a file
15:45:10<cm>you sure this is cloudflare? doesn't mention them on the page
15:46:26<nicolas17>__cf in many places
15:46:28<nicolas17>:)
15:46:57<nicolas17>also headers:
15:46:58<nicolas17>< cf-mitigated: challenge
15:47:00<nicolas17>< server: cloudflare
15:47:01<nicolas17>< cf-ray: 7ea492992c1d08ed-EZE
15:47:53rageear quits [Ping timeout: 252 seconds]
15:49:21h3ndr1k quits [Ping timeout: 258 seconds]
15:49:52<fireonlive>ahh cloudflare. both a protector and the bane of our existence :p
15:52:21<cm>cool cool
15:52:33<cm>thanks this has been really helpful
15:52:47<cm>that copy-as-curl trick is good to know
15:59:47h3ndr1k (h3ndr1k) joins
16:20:45nulldata quits [Quit: The Lounge - https://thelounge.chat]
16:21:00nulldata (nulldata) joins
16:59:51parfait (kdqep) joins
17:00:44parfait quits [Client Quit]
17:21:18eroc1990 quits [Quit: The Lounge - https://thelounge.chat]
17:32:49etnguyen03 quits [Ping timeout: 265 seconds]
17:33:15eroc1990 (eroc1990) joins
17:48:01rageear joins
18:11:57dumbgoy quits [Ping timeout: 258 seconds]
18:29:38ShakespeareFan00 joins
18:38:58ShakespeareFan00 quits [Remote host closed the connection]
18:44:42etnguyen03 (etnguyen03) joins
19:12:22fishingforsoup_ joins
19:12:29fishingforsoup quits [Ping timeout: 252 seconds]
19:12:54fishingforsoup__ joins
19:13:40rageear quits [Ping timeout: 258 seconds]
19:16:53fishingforsoup_ quits [Ping timeout: 252 seconds]
19:19:36rageear joins
19:41:20inventatorul1 leaves [Error from remote client]
19:47:06BigBrain quits [Ping timeout: 245 seconds]
19:49:03BigBrain (bigbrain) joins
20:03:49dumbgoy joins
20:06:50Island quits [Remote host closed the connection]
20:06:50Island joins
20:07:22yts98 leaves
20:07:24yts98 joins
20:11:47Island quits [Remote host closed the connection]
20:11:47emberquill quits [Client Quit]
20:11:55Island joins
20:12:03emberquill (emberquill) joins
20:26:49nicolas17 quits [Ping timeout: 265 seconds]
21:00:10dumbgoy quits [Read error: Connection reset by peer]
21:01:26Unholy236131 quits [Client Quit]
21:01:28dumbgoy joins
21:01:51Unholy236131 (Unholy2361) joins
21:11:44rageear quits [Ping timeout: 258 seconds]
21:52:58BlueMaxima joins
22:02:51AmAnd0A quits [Read error: Connection reset by peer]
22:03:06AmAnd0A joins
22:09:10Minkafighter525 joins
22:11:10Minkafighter52 quits [Ping timeout: 258 seconds]
22:11:10Minkafighter525 is now known as Minkafighter52
22:13:27iCaotix quits [Read error: Connection reset by peer]
22:15:04iCaotix joins
22:26:27hitgrr8 quits [Client Quit]
22:37:19etnguyen03 quits [Ping timeout: 265 seconds]
23:11:11etnguyen03 (etnguyen03) joins
23:18:32<h2ibot>JustAnotherArchivist edited Current Projects (-89, Shuffle recruiting section, add donation link): https://wiki.archiveteam.org/?diff=50274&oldid=50254
23:20:33<h2ibot>JustAnotherArchivist edited Frequently Asked Questions (+12, Add donation page link): https://wiki.archiveteam.org/?diff=50275&oldid=49477
23:37:52Arcorann (Arcorann) joins

HomeSearchPrevious dayNext day