00:00:42Chris5010 (Chris5010) joins
00:06:59pseudorizer quits [Ping timeout: 265 seconds]
00:08:42<@JAA>FOIAonline progress has picked up significantly since I added those extra processes. :-)
00:09:29etnguyen03 quits [Ping timeout: 252 seconds]
00:22:31etnguyen03 (etnguyen03) joins
00:29:57pseudorizer (pseudorizer) joins
00:36:59etnguyen03 quits [Ping timeout: 252 seconds]
00:38:09<fireonlive>:)
00:45:49HP_Archivist quits [Read error: Connection reset by peer]
00:46:06Mateon2 joins
00:46:26HP_Archivist (HP_Archivist) joins
00:47:26Mateon1 quits [Ping timeout: 252 seconds]
00:47:26Mateon2 is now known as Mateon1
00:49:40etnguyen03 (etnguyen03) joins
00:50:55xarph quits [Client Quit]
00:57:53shinji257 quits [Quit: https://quassel-irc.org - Chat comfortably. Anywhere.]
00:58:02shinji257 (shinji257) joins
01:02:56sec^nd quits [Ping timeout: 245 seconds]
01:08:06sec^nd (second) joins
01:09:21railen69 quits [Remote host closed the connection]
01:09:26etnguyen03 quits [Ping timeout: 252 seconds]
01:13:12railen63 joins
01:17:22dumbgoy_ joins
01:19:51appledash joins
01:20:27dumbgoy quits [Ping timeout: 265 seconds]
01:31:39xarph joins
01:32:48icedice quits [Client Quit]
01:39:23JohnnyJ joins
01:45:32<fireonlive>trouble at Kick? https://old.reddit.com/r/OutOfTheLoop/comments/16rj0g8/whats_going_on_with_the_streaming_platform_kick/
01:52:12<joepie91|m>jesus christ
01:57:27etnguyen03 (etnguyen03) joins
02:20:56cascode quits [Ping timeout: 252 seconds]
02:22:58cascode joins
02:26:03Exorcism8 (exorcism) joins
02:27:16Wohlstand (Wohlstand) joins
02:28:01Exorcism quits [Read error: Connection reset by peer]
02:28:01Exorcism8 is now known as Exorcism
02:37:04justaseacow joins
02:43:35rohvani quits [Ping timeout: 265 seconds]
02:51:11etnguyen03 quits [Ping timeout: 252 seconds]
03:02:21etnguyen03 (etnguyen03) joins
03:06:49justaseacow quits [Remote host closed the connection]
03:09:49nic quits [Quit: The Lounge - https://thelounge.chat]
03:11:19nic (nic) joins
03:16:56dumbgoy_ quits [Ping timeout: 265 seconds]
03:20:07Peroniko joins
03:22:15RetiredTurtle quits [Ping timeout: 265 seconds]
04:08:44le0n quits [Ping timeout: 252 seconds]
04:18:38etnguyen03 quits [Ping timeout: 252 seconds]
04:22:44etnguyen03 (etnguyen03) joins
04:22:57le0n (le0n) joins
04:33:44DogsRNice quits [Read error: Connection reset by peer]
04:34:02Island quits [Read error: Connection reset by peer]
04:51:15etnguyen03 quits [Client Quit]
04:55:32JayEmbee quits [Ping timeout: 265 seconds]
05:25:11Wohlstand quits [Client Quit]
05:35:38Wohlstand (Wohlstand) joins
05:58:11Perk quits [Ping timeout: 252 seconds]
06:03:41JohnnyJ quits [Ping timeout: 265 seconds]
06:05:39Perk joins
06:12:34JayEmbee (JayEmbee) joins
06:19:45cascode quits [Read error: Connection reset by peer]
06:20:04cascode joins
06:27:53project10 quits [Ping timeout: 252 seconds]
06:29:17project10 (project10) joins
06:32:31Muad_Dib quits [Quit: ZNC - http://znc.in]
06:36:08datechnoman quits [Quit: The Lounge - https://thelounge.chat]
06:37:04datechnoman (datechnoman) joins
06:38:29flashfire42 quits [Client Quit]
06:38:29kiska quits [Client Quit]
06:38:29Ryz263 quits [Client Quit]
06:38:29s-crypt2 quits [Client Quit]
06:38:46Muad-Dib joins
06:40:04Ryz263 (Ryz) joins
06:40:05s-crypt2 (s-crypt) joins
06:40:12flashfire42 joins
06:41:48kiska (kiska) joins
06:45:06Dango360 quits [Read error: Connection reset by peer]
06:50:38Wohlstand quits [Client Quit]
06:50:55Perk1 joins
06:52:01Perk quits [Ping timeout: 265 seconds]
06:52:01Perk1 is now known as Perk
07:00:37Arcorann (Arcorann) joins
07:05:03Unholy23613166180851599 quits [Remote host closed the connection]
07:06:46Unholy23613166180851599 (Unholy2361) joins
07:19:08BlueMaxima quits [Read error: Connection reset by peer]
07:31:39parfait_ quits [Ping timeout: 265 seconds]
07:43:31yert joins
07:54:47JayEmbee quits [Ping timeout: 252 seconds]
08:14:09JayEmbee (JayEmbee) joins
08:56:43cascode quits [Ping timeout: 265 seconds]
09:11:58Babsalom joins
09:13:26Earendil7 quits [Ping timeout: 252 seconds]
09:16:37Earendil7 (Earendil7) joins
09:25:10<yert>I'm getting "Error response from daemon: Container ... is not running" (with a long alphanumeric string in place of ...)
09:27:36cascode joins
09:39:33Naruyoko5 joins
09:40:42Naruyoko quits [Ping timeout: 265 seconds]
09:44:34Babsalom quits [Ping timeout: 265 seconds]
09:48:50<imer>yert: any context for what you're doing and what you're expecting to see?
09:56:00<yert>@imer I last set the warrior (some time ago) to work on the Telegram project, but now when I switch it on and it gets just part the 'checking for updates' part, it starts printing that error over and over and the browser interface isn't accessible
09:56:47<yert>sometimes prints 'seesaw kit did not successfully boot up and update'
09:58:56<imer>oh, warrior stuff. not quite sure there. #warrior would be the channel for that. I see someone asked a similar question there.. so might not be on your end?
09:59:20<imer>Could try "reinstalling" it from scratch, see if it got corrupted somehow
09:59:23<yert>oh yeah that was me, but I didn't get a response there
09:59:29<imer>ah
10:00:01railen63 quits [Remote host closed the connection]
10:00:17railen63 joins
10:00:32<yert>Full set of errors I'm getting:
10:00:33<yert>Please wait while the Warrior checks for updates...
10:00:36<yert>over again
10:01:49<flashfire42>Ok telegram is switched off
10:02:12<flashfire42>I dunno what the other issue is but we are hella clogged and telegram is paused
10:08:01Babsalom joins
10:13:41railen64 joins
10:17:26Babsalom quits [Ping timeout: 265 seconds]
10:17:26railen63 quits [Ping timeout: 265 seconds]
10:18:58Babsalom joins
10:20:10Carnildo_again joins
10:20:44Carnildo quits [Read error: Connection reset by peer]
10:55:42Babsalom quits [Client Quit]
11:20:16Stiletto quits [Ping timeout: 265 seconds]
11:29:37IRC2DC joins
11:44:14Exorcism quits [Remote host closed the connection]
11:45:05Exorcism (exorcism) joins
12:03:19ave quits [Client Quit]
12:03:19lun4 quits [Client Quit]
12:03:51ave (ave) joins
12:03:55lun4 (lun4) joins
12:07:44yert quits [Remote host closed the connection]
12:12:21ave quits [Client Quit]
12:12:22lun4 quits [Client Quit]
12:17:55VerifiedJ quits [Client Quit]
12:18:23VerifiedJ (VerifiedJ) joins
12:18:56icedice (icedice) joins
12:33:09ave (ave) joins
12:33:14lun4 (lun4) joins
12:41:28AmAnd0A quits [Ping timeout: 265 seconds]
12:42:01AmAnd0A joins
12:45:41Peronikola joins
12:48:29Peroniko quits [Ping timeout: 252 seconds]
12:50:27etnguyen03 (etnguyen03) joins
13:40:31graham quits [Client Quit]
14:25:50benjinsmi quits [Ping timeout: 252 seconds]
14:26:23Arcorann quits [Ping timeout: 252 seconds]
14:35:01Darken (Darken) joins
14:35:05<Darken>Hello, so I got some info on Discord's CDN which is going to prevent permenant CDN links - https://i.imgur.com/lqgDQbB.png this hasn't been announced publicly yet but they have already rolled out the parameters, you will notice if you copy a new cdn link from inside the DIscord app
14:35:06<Darken>(https://cdn.discordapp.com/attachments/1046131690621378560/1156235969419288656/image.png?ex=65143c28...) currently you can still view the link without the parameters but this will soon change
14:35:27treora quits [Remote host closed the connection]
14:35:28treora joins
14:46:17Darken29 (Darken) joins
14:46:47Darken29 quits [Remote host closed the connection]
14:50:31Darken quits [Ping timeout: 265 seconds]
14:57:17Island joins
14:59:32<pabs>https://techcrunch.com/2023/09/26/google-podcasts-to-shut-down-in-2024-with-listeners-migrated-to-youtube-music/
15:04:32datechnoman quits [Ping timeout: 265 seconds]
15:12:12juniornet joins
15:12:25juniornet quits [Remote host closed the connection]
15:17:59<nstrom|m>HP_Archivist: re #archiveteam looks like yes yesterday https://archive.fart.website/archivebot/viewer/job/2023092513511565kk7
15:19:46kiryu quits [Client Quit]
15:19:50<nstrom|m>job still running but looks close to done
15:27:29datechnoman (datechnoman) joins
15:34:13Peronikola is now known as Peroniko
15:52:44etnguyen03 quits [Ping timeout: 252 seconds]
15:55:21dumbgoy_ joins
16:09:18<HP_Archivist>nstrom|m: Ah, very good. Thanks!
16:12:52<fireonlive>interesting re: discord, guess they want to lower their cdn bills or something?
16:15:07<Peroniko>I suspect it's because of all the malware that is hosted on their CDN. Discord's links are legitimate, and are often not blocked by antiviruses and browsers
16:18:06<fireonlive>oh are they quite liberal with what they let you upload?
16:18:41<Peroniko>I think anything can be uploaded
16:18:54<Peroniko>I don't know the size limit though
16:20:41<fireonlive>ahh
16:20:56<fireonlive>would make sense then
16:26:50benjinsmi joins
16:30:31parfait_ joins
16:48:54<imer>I'm not surprised in the slightest, was gonna happen sooner or later
16:49:45<imer>also upload size limit is 25 / 50 / 500 MB for free / paid basic / paid pro
16:56:31<audrooku|m>Is there any better priced service than webshare for a lot of shared DC IPV4 proxies with an ok amount of bandwidth? 500 @ 1TB with the high concurrency option costs about $35/mo, but I need more like 1000-200 IPs, ideally, though the "reputation" doesnt matter really at all, I'm making a dump of a service that uses 2^32 random ids and with 600 IPs my eta is about 6 months, which would be fine if these proxies I already have werent going to
16:56:31<audrooku|m>expire
17:05:06<audrooku|m>1000-2000*
17:16:58cascode quits [Ping timeout: 265 seconds]
17:17:48cascode joins
17:21:38Peronikola joins
17:24:02Peroniko quits [Ping timeout: 252 seconds]
17:29:30kiska quits [Client Quit]
17:29:30s-crypt2 quits [Client Quit]
17:29:30Ryz263 quits [Client Quit]
17:29:30flashfire42 quits [Client Quit]
17:30:35JohnnyJ joins
17:32:15Ryz263 (Ryz) joins
17:32:15s-crypt2 (s-crypt) joins
17:32:22flashfire42 joins
17:33:57kiska (kiska) joins
17:36:22Carnildo_again is now known as Carnildo
17:42:08Dango360 (Dango360) joins
17:53:11cascode quits [Ping timeout: 252 seconds]
18:18:28etnguyen03 (etnguyen03) joins
18:40:52PredatorIWD quits [Quit: Leaving]
18:52:44cascode joins
19:01:40treora quits [Remote host closed the connection]
19:01:41treora joins
19:03:27Exorcism quits [Remote host closed the connection]
19:03:52Exorcism (exorcism) joins
19:20:30Exorcism quits [Remote host closed the connection]
19:22:38Exorcism (exorcism) joins
19:25:02etnguyen03 quits [Ping timeout: 252 seconds]
19:32:54AmAnd0A quits [Read error: Connection reset by peer]
19:33:09AmAnd0A joins
19:37:31Wohlstand (Wohlstand) joins
19:48:58cascode quits [Read error: Connection reset by peer]
19:49:14cascode joins
20:05:10etnguyen03 (etnguyen03) joins
20:05:45railen69 joins
20:09:02railen64 quits [Ping timeout: 265 seconds]
20:10:30AmAnd0A quits [Ping timeout: 265 seconds]
20:11:02AmAnd0A joins
20:18:42etnguyen03 quits [Ping timeout: 265 seconds]
20:25:12<@arkiver>Telegram is going to be paused for some time.
20:28:11<@arkiver>YouTube will also be paused for some time
20:34:05Exorcism quits [Remote host closed the connection]
20:34:39Exorcism (exorcism) joins
20:38:14<fireonlive>thanks arkiver
20:39:20AmAnd0A quits [Read error: Connection reset by peer]
20:39:58AmAnd0A joins
20:42:45<@arkiver>Reddit backlog will be moved away, starting with only new stuff.
20:42:58<@arkiver>URLs backlog will also be moved away, we're going to focus on only news.
20:43:40<@arkiver>Reddit will remain paused while in move items around
20:45:08<Peronikola>What is a good project to archive at the moment, because I an getting either rate limited or the items won't upload (reddit). I am doing urlteam2, because it's the only one that works
20:46:29Peronikola is now known as Peroniko
20:46:31<@arkiver>Peronikola: i hope to have more on this soon - i'm cutting in what we archive at the moment and am moving data around
20:51:32Exorcism quits [Remote host closed the connection]
20:52:42Exorcism (exorcism) joins
20:53:44kdqep__ joins
20:57:51parfait_ quits [Ping timeout: 265 seconds]
21:04:17<@arkiver>JAA: what is the latest on the FOIA stuff?
21:04:54<@arkiver>if we know the possible years and codes we can somewhat easily enumerate all FOIAs
21:05:03<@arkiver>(FOIAs the right word? i don't know)
21:05:49<@arkiver>ah actually you're getting it i read :)
21:07:27<@JAA>arkiver: Yes, two thirds done now.
21:07:39<@arkiver>did you also enumerate all those that may not have been returned by search results?
21:07:46<@JAA>ETA: 33 hours
21:07:57<@JAA>No, I only did the search.
21:08:13<@JAA>You have to also know the type of the FOIA request, not only its ID.
21:08:15<@arkiver>and - sorry just to confirm - you're also making that request that gives the actual info and PDFs attached to a FOIA right?
21:08:33<@arkiver>JAA: yeah, but if we know the year and type, we can enumerate all lower than those returned by search results
21:08:49<@arkiver>i started a derive task for your first FOIA item with WARCs
21:09:14<@JAA>I'm fetching the page, the API request for request details, the API request for attachments + referenced files (if applicable via flag in request details response), the API requests for the records list, and the records files.
21:09:28<@arkiver>alright!
21:09:41<@JAA>Please don't derive yet.
21:09:45<@arkiver>oh
21:09:46<@arkiver>no?
21:09:50<@arkiver>oops i can abort it
21:10:00<@JAA>I'm still uploading.
21:10:10<@arkiver>is that a problem?
21:10:42<@JAA>part0 and part1 is probably fine to derive.
21:10:51<@JAA>part2 would pile up archive.php tasks until uploads get rejected, too.
21:10:53<@arkiver>i'm doing part0
21:11:17<@JAA>I don't expect to have to change anything on parts 0 and 1.
21:11:23<pokechu22>arkiver: the orange stuff is stressing me a little bit since the AB job has gotten banned twice since the site came back up it seems (with it still running at a delay of 1000ms-2000ms, so for something distributed we probably want to do it even slower), and we're on borrowed time still since the site officially went down a while back; it's only up again because of a special
21:11:26<pokechu22>plea to customer support
21:11:37<@JAA>But I usually doublecheck that the uploads were fine and only then issue the derive.
21:12:29<@arkiver>JAA: would it be easy for you to also queue IDs into your setup for IDs that we might find through the sequential IDs check? or are you confident search results returned everything?
21:12:31<@arkiver>pokechu22: yeah
21:12:43<@arkiver>pokechu22: hold on
21:13:19<@JAA>arkiver: It's a gov system. Can't be confident in anything at all. But yes, I can do that when this primary retrieval finishes.
21:13:52<@JAA>Might need to add some more checks for things that don't exist, but not a big deal.
21:14:01<@arkiver>alright
21:14:14<@arkiver>let's see how playback is in the Wayback Machine :P
21:14:27<@JAA>Record list retrieval is via POST...
21:14:38<@arkiver>i dont remember - where these POST requests to a generic URLs, or was the URL still clearly tied to a FOIA submission?
21:15:00<@JAA>The latter, but the body is necessary for pagination.
21:15:20<@arkiver>right
21:23:52katocala quits [Remote host closed the connection]
21:24:33chessnoob280 quits [Quit: ZNC 1.8.2 - https://znc.in]
21:46:00<fireonlive>"Anthony Rota resigns as Speaker after honouring Ukrainian veteran who fought with Nazi unit" https://www.cbc.ca/news/politics/speaker-anthony-rota-resignation-1.6978422
21:46:36<fireonlive>https://anthonyrota.libparl.ca and https://lop.parl.ca/sites/ParlInfo/default/en_CA/People/Profile?personId=9445 (i'll ask #archivebot) but might be other 'official canada' resources that should be archived
21:57:10etnguyen03 (etnguyen03) joins
21:58:05<pabs>HP_Archivist: re the c64 link on #archiveteam, I did gamebase64 related URLs in #archivebot already. only remaining jobs are the open directories, need to process WARCs and find them
21:58:46Naruyoko joins
21:58:48ectweak joins
22:00:53<pabs>HP_Archivist: there were 4 jobs www/domain for gamebase64.com and gb64.com, also b22.com and some related sourceforge bits
22:01:10Naruyoko5 quits [Ping timeout: 265 seconds]
22:12:44lunik173 quits [Remote host closed the connection]
22:13:07lunik173 joins
22:17:25Wohlstand quits [Remote host closed the connection]
22:27:28qwertyasdfuiopghjkl quits [Remote host closed the connection]
22:29:23Wohlstand (Wohlstand) joins
22:53:20katocala joins
22:55:41Peroniko quits [Ping timeout: 252 seconds]
22:59:05BlueMaxima joins
23:02:19Peroniko joins
23:04:29etnguyen03 quits [Ping timeout: 252 seconds]
23:04:50fangfufu quits [Remote host closed the connection]
23:10:40Wohlstand quits [Client Quit]
23:19:32<HP_Archivist>pabs: Thanks for the update. Glad all the affiliated domains are being captured, too
23:29:49etnguyen03 (etnguyen03) joins
23:30:14fangfufu joins
23:35:35lunik173 quits [Remote host closed the connection]
23:35:55lunik173 joins
23:40:02Hackerpcs quits [Quit: Hackerpcs]
23:42:08Hackerpcs (Hackerpcs) joins
23:56:12cascode quits [Ping timeout: 265 seconds]
23:56:27cascode joins
23:58:23etnguyen03 quits [Ping timeout: 252 seconds]