00:00:42 | | Chris5010 (Chris5010) joins |
00:06:59 | | pseudorizer quits [Ping timeout: 265 seconds] |
00:08:42 | <@JAA> | FOIAonline progress has picked up significantly since I added those extra processes. :-) |
00:09:29 | | etnguyen03 quits [Ping timeout: 252 seconds] |
00:22:31 | | etnguyen03 (etnguyen03) joins |
00:29:57 | | pseudorizer (pseudorizer) joins |
00:36:59 | | etnguyen03 quits [Ping timeout: 252 seconds] |
00:38:09 | <fireonlive> | :) |
00:45:49 | | HP_Archivist quits [Read error: Connection reset by peer] |
00:46:06 | | Mateon2 joins |
00:46:26 | | HP_Archivist (HP_Archivist) joins |
00:47:26 | | Mateon1 quits [Ping timeout: 252 seconds] |
00:47:26 | | Mateon2 is now known as Mateon1 |
00:49:40 | | etnguyen03 (etnguyen03) joins |
00:50:55 | | xarph quits [Client Quit] |
00:57:53 | | shinji257 quits [Quit: https://quassel-irc.org - Chat comfortably. Anywhere.] |
00:58:02 | | shinji257 (shinji257) joins |
01:02:56 | | sec^nd quits [Ping timeout: 245 seconds] |
01:08:06 | | sec^nd (second) joins |
01:09:21 | | railen69 quits [Remote host closed the connection] |
01:09:26 | | etnguyen03 quits [Ping timeout: 252 seconds] |
01:13:12 | | railen63 joins |
01:17:22 | | dumbgoy_ joins |
01:19:51 | | appledash joins |
01:20:27 | | dumbgoy quits [Ping timeout: 265 seconds] |
01:31:39 | | xarph joins |
01:32:48 | | icedice quits [Client Quit] |
01:39:23 | | JohnnyJ joins |
01:45:32 | <fireonlive> | trouble at Kick? https://old.reddit.com/r/OutOfTheLoop/comments/16rj0g8/whats_going_on_with_the_streaming_platform_kick/ |
01:52:12 | <joepie91|m> | jesus christ |
01:57:27 | | etnguyen03 (etnguyen03) joins |
02:20:56 | | cascode quits [Ping timeout: 252 seconds] |
02:22:58 | | cascode joins |
02:26:03 | | Exorcism8 (exorcism) joins |
02:27:16 | | Wohlstand (Wohlstand) joins |
02:28:01 | | Exorcism quits [Read error: Connection reset by peer] |
02:28:01 | | Exorcism8 is now known as Exorcism |
02:37:04 | | justaseacow joins |
02:43:35 | | rohvani quits [Ping timeout: 265 seconds] |
02:51:11 | | etnguyen03 quits [Ping timeout: 252 seconds] |
03:02:21 | | etnguyen03 (etnguyen03) joins |
03:06:49 | | justaseacow quits [Remote host closed the connection] |
03:09:49 | | nic quits [Quit: The Lounge - https://thelounge.chat] |
03:11:19 | | nic (nic) joins |
03:16:56 | | dumbgoy_ quits [Ping timeout: 265 seconds] |
03:20:07 | | Peroniko joins |
03:20:12 | | Peroniko is now authenticated as Peroniko |
03:22:15 | | RetiredTurtle quits [Ping timeout: 265 seconds] |
04:08:44 | | le0n quits [Ping timeout: 252 seconds] |
04:18:38 | | etnguyen03 quits [Ping timeout: 252 seconds] |
04:22:44 | | etnguyen03 (etnguyen03) joins |
04:22:57 | | le0n (le0n) joins |
04:33:44 | | DogsRNice quits [Read error: Connection reset by peer] |
04:34:02 | | Island quits [Read error: Connection reset by peer] |
04:51:15 | | etnguyen03 quits [Client Quit] |
04:55:32 | | JayEmbee quits [Ping timeout: 265 seconds] |
05:25:11 | | Wohlstand quits [Client Quit] |
05:35:38 | | Wohlstand (Wohlstand) joins |
05:58:11 | | Perk quits [Ping timeout: 252 seconds] |
06:03:41 | | JohnnyJ quits [Ping timeout: 265 seconds] |
06:05:39 | | Perk joins |
06:12:34 | | JayEmbee (JayEmbee) joins |
06:19:45 | | cascode quits [Read error: Connection reset by peer] |
06:20:04 | | cascode joins |
06:27:53 | | project10 quits [Ping timeout: 252 seconds] |
06:29:17 | | project10 (project10) joins |
06:32:31 | | Muad_Dib quits [Quit: ZNC - http://znc.in] |
06:36:08 | | datechnoman quits [Quit: The Lounge - https://thelounge.chat] |
06:37:04 | | datechnoman (datechnoman) joins |
06:38:29 | | flashfire42 quits [Client Quit] |
06:38:29 | | kiska quits [Client Quit] |
06:38:29 | | Ryz263 quits [Client Quit] |
06:38:29 | | s-crypt2 quits [Client Quit] |
06:38:46 | | Muad-Dib joins |
06:40:04 | | Ryz263 (Ryz) joins |
06:40:05 | | s-crypt2 (s-crypt) joins |
06:40:12 | | flashfire42 joins |
06:41:48 | | kiska (kiska) joins |
06:45:06 | | Dango360 quits [Read error: Connection reset by peer] |
06:50:38 | | Wohlstand quits [Client Quit] |
06:50:55 | | Perk1 joins |
06:52:01 | | Perk quits [Ping timeout: 265 seconds] |
06:52:01 | | Perk1 is now known as Perk |
07:00:37 | | Arcorann (Arcorann) joins |
07:00:45 | | flashfire42 is now authenticated as flashfire42 |
07:05:03 | | Unholy23613166180851599 quits [Remote host closed the connection] |
07:06:46 | | Unholy23613166180851599 (Unholy2361) joins |
07:19:08 | | BlueMaxima quits [Read error: Connection reset by peer] |
07:31:39 | | parfait_ quits [Ping timeout: 265 seconds] |
07:43:31 | | yert joins |
07:54:47 | | JayEmbee quits [Ping timeout: 252 seconds] |
08:14:09 | | JayEmbee (JayEmbee) joins |
08:56:43 | | cascode quits [Ping timeout: 265 seconds] |
09:11:58 | | Babsalom joins |
09:13:26 | | Earendil7 quits [Ping timeout: 252 seconds] |
09:16:37 | | Earendil7 (Earendil7) joins |
09:25:10 | <yert> | I'm getting "Error response from daemon: Container ... is not running" (with a long alphanumeric string in place of ...) |
09:27:36 | | cascode joins |
09:39:33 | | Naruyoko5 joins |
09:40:42 | | Naruyoko quits [Ping timeout: 265 seconds] |
09:44:34 | | Babsalom quits [Ping timeout: 265 seconds] |
09:48:50 | <imer> | yert: any context for what you're doing and what you're expecting to see? |
09:56:00 | <yert> | @imer I last set the warrior (some time ago) to work on the Telegram project, but now when I switch it on and it gets just part the 'checking for updates' part, it starts printing that error over and over and the browser interface isn't accessible |
09:56:47 | <yert> | sometimes prints 'seesaw kit did not successfully boot up and update' |
09:58:56 | <imer> | oh, warrior stuff. not quite sure there. #warrior would be the channel for that. I see someone asked a similar question there.. so might not be on your end? |
09:59:20 | <imer> | Could try "reinstalling" it from scratch, see if it got corrupted somehow |
09:59:23 | <yert> | oh yeah that was me, but I didn't get a response there |
09:59:29 | <imer> | ah |
10:00:01 | | railen63 quits [Remote host closed the connection] |
10:00:17 | | railen63 joins |
10:00:32 | <yert> | Full set of errors I'm getting: |
10:00:33 | <yert> | Please wait while the Warrior checks for updates... |
10:00:36 | <yert> | over again |
10:01:49 | <flashfire42> | Ok telegram is switched off |
10:02:12 | <flashfire42> | I dunno what the other issue is but we are hella clogged and telegram is paused |
10:08:01 | | Babsalom joins |
10:13:41 | | railen64 joins |
10:17:26 | | Babsalom quits [Ping timeout: 265 seconds] |
10:17:26 | | railen63 quits [Ping timeout: 265 seconds] |
10:18:58 | | Babsalom joins |
10:20:10 | | Carnildo_again joins |
10:20:44 | | Carnildo quits [Read error: Connection reset by peer] |
10:55:42 | | Babsalom quits [Client Quit] |
11:20:16 | | Stiletto quits [Ping timeout: 265 seconds] |
11:29:37 | | IRC2DC joins |
11:44:14 | | Exorcism quits [Remote host closed the connection] |
11:45:05 | | Exorcism (exorcism) joins |
12:03:19 | | ave quits [Client Quit] |
12:03:19 | | lun4 quits [Client Quit] |
12:03:51 | | ave (ave) joins |
12:03:55 | | lun4 (lun4) joins |
12:07:44 | | yert quits [Remote host closed the connection] |
12:12:21 | | ave quits [Client Quit] |
12:12:22 | | lun4 quits [Client Quit] |
12:17:55 | | VerifiedJ quits [Client Quit] |
12:18:23 | | VerifiedJ (VerifiedJ) joins |
12:18:56 | | icedice (icedice) joins |
12:33:09 | | ave (ave) joins |
12:33:14 | | lun4 (lun4) joins |
12:41:28 | | AmAnd0A quits [Ping timeout: 265 seconds] |
12:42:01 | | AmAnd0A joins |
12:45:41 | | Peronikola joins |
12:48:29 | | Peroniko quits [Ping timeout: 252 seconds] |
12:50:27 | | etnguyen03 (etnguyen03) joins |
13:40:31 | | graham quits [Client Quit] |
14:25:50 | | benjinsmi quits [Ping timeout: 252 seconds] |
14:26:23 | | Arcorann quits [Ping timeout: 252 seconds] |
14:35:01 | | Darken (Darken) joins |
14:35:05 | <Darken> | Hello, so I got some info on Discord's CDN which is going to prevent permenant CDN links - https://i.imgur.com/lqgDQbB.png this hasn't been announced publicly yet but they have already rolled out the parameters, you will notice if you copy a new cdn link from inside the DIscord app |
14:35:06 | <Darken> | (https://cdn.discordapp.com/attachments/1046131690621378560/1156235969419288656/image.png?ex=65143c28...) currently you can still view the link without the parameters but this will soon change |
14:35:27 | | treora quits [Remote host closed the connection] |
14:35:28 | | treora joins |
14:46:17 | | Darken29 (Darken) joins |
14:46:47 | | Darken29 quits [Remote host closed the connection] |
14:50:31 | | Darken quits [Ping timeout: 265 seconds] |
14:57:17 | | Island joins |
14:59:32 | <pabs> | https://techcrunch.com/2023/09/26/google-podcasts-to-shut-down-in-2024-with-listeners-migrated-to-youtube-music/ |
15:04:32 | | datechnoman quits [Ping timeout: 265 seconds] |
15:12:12 | | juniornet joins |
15:12:25 | | juniornet quits [Remote host closed the connection] |
15:17:59 | <nstrom|m> | HP_Archivist: re #archiveteam looks like yes yesterday https://archive.fart.website/archivebot/viewer/job/2023092513511565kk7 |
15:19:46 | | kiryu quits [Client Quit] |
15:19:50 | <nstrom|m> | job still running but looks close to done |
15:27:29 | | datechnoman (datechnoman) joins |
15:34:09 | | Peronikola is now authenticated as Peroniko |
15:34:13 | | Peronikola is now known as Peroniko |
15:52:44 | | etnguyen03 quits [Ping timeout: 252 seconds] |
15:55:21 | | dumbgoy_ joins |
16:09:18 | <HP_Archivist> | nstrom|m: Ah, very good. Thanks! |
16:12:52 | <fireonlive> | interesting re: discord, guess they want to lower their cdn bills or something? |
16:15:07 | <Peroniko> | I suspect it's because of all the malware that is hosted on their CDN. Discord's links are legitimate, and are often not blocked by antiviruses and browsers |
16:18:06 | <fireonlive> | oh are they quite liberal with what they let you upload? |
16:18:41 | <Peroniko> | I think anything can be uploaded |
16:18:54 | <Peroniko> | I don't know the size limit though |
16:20:41 | <fireonlive> | ahh |
16:20:56 | <fireonlive> | would make sense then |
16:26:50 | | benjinsmi joins |
16:30:31 | | parfait_ joins |
16:48:54 | <imer> | I'm not surprised in the slightest, was gonna happen sooner or later |
16:49:45 | <imer> | also upload size limit is 25 / 50 / 500 MB for free / paid basic / paid pro |
16:56:31 | <audrooku|m> | Is there any better priced service than webshare for a lot of shared DC IPV4 proxies with an ok amount of bandwidth? 500 @ 1TB with the high concurrency option costs about $35/mo, but I need more like 1000-200 IPs, ideally, though the "reputation" doesnt matter really at all, I'm making a dump of a service that uses 2^32 random ids and with 600 IPs my eta is about 6 months, which would be fine if these proxies I already have werent going to |
16:56:31 | <audrooku|m> | expire |
17:05:06 | <audrooku|m> | 1000-2000* |
17:16:58 | | cascode quits [Ping timeout: 265 seconds] |
17:17:48 | | cascode joins |
17:21:38 | | Peronikola joins |
17:21:48 | | Peronikola is now authenticated as Peroniko |
17:24:02 | | Peroniko quits [Ping timeout: 252 seconds] |
17:29:30 | | kiska quits [Client Quit] |
17:29:30 | | s-crypt2 quits [Client Quit] |
17:29:30 | | Ryz263 quits [Client Quit] |
17:29:30 | | flashfire42 quits [Client Quit] |
17:30:35 | | JohnnyJ joins |
17:32:15 | | Ryz263 (Ryz) joins |
17:32:15 | | s-crypt2 (s-crypt) joins |
17:32:22 | | flashfire42 joins |
17:33:57 | | kiska (kiska) joins |
17:36:22 | | Carnildo_again is now known as Carnildo |
17:42:08 | | Dango360 (Dango360) joins |
17:53:11 | | cascode quits [Ping timeout: 252 seconds] |
18:18:28 | | etnguyen03 (etnguyen03) joins |
18:40:52 | | PredatorIWD quits [Quit: Leaving] |
18:52:44 | | cascode joins |
19:01:40 | | treora quits [Remote host closed the connection] |
19:01:41 | | treora joins |
19:03:27 | | Exorcism quits [Remote host closed the connection] |
19:03:52 | | Exorcism (exorcism) joins |
19:20:30 | | Exorcism quits [Remote host closed the connection] |
19:22:38 | | Exorcism (exorcism) joins |
19:25:02 | | etnguyen03 quits [Ping timeout: 252 seconds] |
19:32:54 | | AmAnd0A quits [Read error: Connection reset by peer] |
19:33:09 | | AmAnd0A joins |
19:37:31 | | Wohlstand (Wohlstand) joins |
19:48:58 | | cascode quits [Read error: Connection reset by peer] |
19:49:14 | | cascode joins |
20:05:10 | | etnguyen03 (etnguyen03) joins |
20:05:45 | | railen69 joins |
20:09:02 | | railen64 quits [Ping timeout: 265 seconds] |
20:10:30 | | AmAnd0A quits [Ping timeout: 265 seconds] |
20:11:02 | | AmAnd0A joins |
20:18:42 | | etnguyen03 quits [Ping timeout: 265 seconds] |
20:25:12 | <@arkiver> | Telegram is going to be paused for some time. |
20:28:11 | <@arkiver> | YouTube will also be paused for some time |
20:34:05 | | Exorcism quits [Remote host closed the connection] |
20:34:39 | | Exorcism (exorcism) joins |
20:38:14 | <fireonlive> | thanks arkiver |
20:39:20 | | AmAnd0A quits [Read error: Connection reset by peer] |
20:39:58 | | AmAnd0A joins |
20:42:45 | <@arkiver> | Reddit backlog will be moved away, starting with only new stuff. |
20:42:58 | <@arkiver> | URLs backlog will also be moved away, we're going to focus on only news. |
20:43:40 | <@arkiver> | Reddit will remain paused while in move items around |
20:45:08 | <Peronikola> | What is a good project to archive at the moment, because I an getting either rate limited or the items won't upload (reddit). I am doing urlteam2, because it's the only one that works |
20:46:29 | | Peronikola is now known as Peroniko |
20:46:31 | <@arkiver> | Peronikola: i hope to have more on this soon - i'm cutting in what we archive at the moment and am moving data around |
20:51:32 | | Exorcism quits [Remote host closed the connection] |
20:52:42 | | Exorcism (exorcism) joins |
20:53:44 | | kdqep__ joins |
20:57:51 | | parfait_ quits [Ping timeout: 265 seconds] |
21:04:17 | <@arkiver> | JAA: what is the latest on the FOIA stuff? |
21:04:54 | <@arkiver> | if we know the possible years and codes we can somewhat easily enumerate all FOIAs |
21:05:03 | <@arkiver> | (FOIAs the right word? i don't know) |
21:05:49 | <@arkiver> | ah actually you're getting it i read :) |
21:07:27 | <@JAA> | arkiver: Yes, two thirds done now. |
21:07:39 | <@arkiver> | did you also enumerate all those that may not have been returned by search results? |
21:07:46 | <@JAA> | ETA: 33 hours |
21:07:57 | <@JAA> | No, I only did the search. |
21:08:13 | <@JAA> | You have to also know the type of the FOIA request, not only its ID. |
21:08:15 | <@arkiver> | and - sorry just to confirm - you're also making that request that gives the actual info and PDFs attached to a FOIA right? |
21:08:33 | <@arkiver> | JAA: yeah, but if we know the year and type, we can enumerate all lower than those returned by search results |
21:08:49 | <@arkiver> | i started a derive task for your first FOIA item with WARCs |
21:09:14 | <@JAA> | I'm fetching the page, the API request for request details, the API request for attachments + referenced files (if applicable via flag in request details response), the API requests for the records list, and the records files. |
21:09:28 | <@arkiver> | alright! |
21:09:41 | <@JAA> | Please don't derive yet. |
21:09:45 | <@arkiver> | oh |
21:09:46 | <@arkiver> | no? |
21:09:50 | <@arkiver> | oops i can abort it |
21:10:00 | <@JAA> | I'm still uploading. |
21:10:10 | <@arkiver> | is that a problem? |
21:10:42 | <@JAA> | part0 and part1 is probably fine to derive. |
21:10:51 | <@JAA> | part2 would pile up archive.php tasks until uploads get rejected, too. |
21:10:53 | <@arkiver> | i'm doing part0 |
21:11:17 | <@JAA> | I don't expect to have to change anything on parts 0 and 1. |
21:11:23 | <pokechu22> | arkiver: the orange stuff is stressing me a little bit since the AB job has gotten banned twice since the site came back up it seems (with it still running at a delay of 1000ms-2000ms, so for something distributed we probably want to do it even slower), and we're on borrowed time still since the site officially went down a while back; it's only up again because of a special |
21:11:26 | <pokechu22> | plea to customer support |
21:11:37 | <@JAA> | But I usually doublecheck that the uploads were fine and only then issue the derive. |
21:12:29 | <@arkiver> | JAA: would it be easy for you to also queue IDs into your setup for IDs that we might find through the sequential IDs check? or are you confident search results returned everything? |
21:12:31 | <@arkiver> | pokechu22: yeah |
21:12:43 | <@arkiver> | pokechu22: hold on |
21:13:19 | <@JAA> | arkiver: It's a gov system. Can't be confident in anything at all. But yes, I can do that when this primary retrieval finishes. |
21:13:52 | <@JAA> | Might need to add some more checks for things that don't exist, but not a big deal. |
21:14:01 | <@arkiver> | alright |
21:14:14 | <@arkiver> | let's see how playback is in the Wayback Machine :P |
21:14:27 | <@JAA> | Record list retrieval is via POST... |
21:14:38 | <@arkiver> | i dont remember - where these POST requests to a generic URLs, or was the URL still clearly tied to a FOIA submission? |
21:15:00 | <@JAA> | The latter, but the body is necessary for pagination. |
21:15:20 | <@arkiver> | right |
21:23:52 | | katocala quits [Remote host closed the connection] |
21:24:33 | | chessnoob280 quits [Quit: ZNC 1.8.2 - https://znc.in] |
21:46:00 | <fireonlive> | "Anthony Rota resigns as Speaker after honouring Ukrainian veteran who fought with Nazi unit" https://www.cbc.ca/news/politics/speaker-anthony-rota-resignation-1.6978422 |
21:46:36 | <fireonlive> | https://anthonyrota.libparl.ca and https://lop.parl.ca/sites/ParlInfo/default/en_CA/People/Profile?personId=9445 (i'll ask #archivebot) but might be other 'official canada' resources that should be archived |
21:57:10 | | etnguyen03 (etnguyen03) joins |
21:58:05 | <pabs> | HP_Archivist: re the c64 link on #archiveteam, I did gamebase64 related URLs in #archivebot already. only remaining jobs are the open directories, need to process WARCs and find them |
21:58:46 | | Naruyoko joins |
21:58:48 | | ectweak joins |
22:00:53 | <pabs> | HP_Archivist: there were 4 jobs www/domain for gamebase64.com and gb64.com, also b22.com and some related sourceforge bits |
22:01:10 | | Naruyoko5 quits [Ping timeout: 265 seconds] |
22:12:44 | | lunik173 quits [Remote host closed the connection] |
22:13:07 | | lunik173 joins |
22:17:25 | | Wohlstand quits [Remote host closed the connection] |
22:27:28 | | qwertyasdfuiopghjkl quits [Remote host closed the connection] |
22:29:23 | | Wohlstand (Wohlstand) joins |
22:53:20 | | katocala joins |
22:53:56 | | katocala is now authenticated as katocala |
22:55:41 | | Peroniko quits [Ping timeout: 252 seconds] |
22:59:05 | | BlueMaxima joins |
23:02:19 | | Peroniko joins |
23:02:31 | | Peroniko is now authenticated as Peroniko |
23:04:29 | | etnguyen03 quits [Ping timeout: 252 seconds] |
23:04:50 | | fangfufu quits [Remote host closed the connection] |
23:10:40 | | Wohlstand quits [Client Quit] |
23:19:32 | <HP_Archivist> | pabs: Thanks for the update. Glad all the affiliated domains are being captured, too |
23:29:49 | | etnguyen03 (etnguyen03) joins |
23:30:14 | | fangfufu joins |
23:30:32 | | fangfufu is now authenticated as fangfufu |
23:35:35 | | lunik173 quits [Remote host closed the connection] |
23:35:55 | | lunik173 joins |
23:40:02 | | Hackerpcs quits [Quit: Hackerpcs] |
23:42:08 | | Hackerpcs (Hackerpcs) joins |
23:56:12 | | cascode quits [Ping timeout: 265 seconds] |
23:56:27 | | cascode joins |
23:58:23 | | etnguyen03 quits [Ping timeout: 252 seconds] |