00:08:17Arcorann (Arcorann) joins
00:30:28Zopolis4 joins
00:31:52Zopolis4 leaves
00:34:07Zopolis4 joins
00:48:23<@JAA>Peetz0r: The past videos are covered, the live stream is being captured along with the chat.
01:33:44godane1 quits [Remote host closed the connection]
01:36:17Zerote quits [Read error: Connection reset by peer]
01:36:37godane (godane) joins
01:37:53Zerote joins
02:39:15teej quits [Client Quit]
03:07:29Zopolis4 quits [Ping timeout: 244 seconds]
03:17:24lennier1 quits [Ping timeout: 240 seconds]
03:17:27lennier1 (lennier1) joins
03:27:59godane1 joins
03:30:34godane quits [Ping timeout: 252 seconds]
03:31:25lennier2 joins
03:32:44lennier1 quits [Ping timeout: 240 seconds]
03:32:45lennier2 is now known as lennier1
03:33:01godane2 joins
03:35:24godane1 quits [Ping timeout: 240 seconds]
03:35:53lennier2 joins
03:37:04lennier1 quits [Ping timeout: 240 seconds]
03:37:13lennier2 is now known as lennier1
03:48:49lennier2 joins
03:50:23lennier1 quits [Ping timeout: 252 seconds]
03:50:29lennier2 is now known as lennier1
04:37:32<@JAA>Ryz: That's the old design shutting down I assume? mobile.twtiter.com has been showing the redesign for me for a long time.
04:38:18<@JAA>snscrape already uses the redesign. But if AB gets it as well, that'll be the end of Twitter archival through AB.
04:41:57<Ryz>From my POV, I see the website as this: https://transfer.notkiska.pw/N8j0V/waterfox_2020-11-13_20-41-01.png
04:42:19<@JAA>Ah, that one, right.
04:42:42<@JAA>Well, no, that shouldn't affect things I guess.
04:44:20<Ryz>"Unsure why that is in this channel." - to respond to that, from my experience, the responses have been between none and limited when posting some stuff in #archiveteam
04:50:28<nico_32>i think #archiveteam is just for project announce
04:51:02<@JAA>Yeah, and major shutdowns etc.
04:52:47<SketchTheCow>Accurate
04:52:57<SketchTheCow>It's OK, people usually forget that
04:53:04<SketchTheCow>Here's a way to think of it
04:53:13<SketchTheCow>#archivetam - THE HOUSE IS BURNING
04:53:22qw3rty__ joins
04:53:23<SketchTheCow>#archiveteam-bs - WE SHOULD GET A BETTER FIRETRUCK
04:53:38<SketchTheCow>#archiveteam-ot I HATE CORD DOGS
04:55:28<Ryz>We still have yet to get GameSpot and Giant Bomb and other companies/properities to Red Ventures as far as I know
04:55:34<Ryz>As per https://twitter.com/textfiles/status/1314641063068471296
04:55:39<SketchTheCow>That's good -bs
04:56:56qw3rty_ quits [Ping timeout: 252 seconds]
05:14:28Zopolis4 joins
05:36:25<nico_32>anyways
05:36:46<nico_32>does anyone know a software to redact a warc?
05:37:18<nico_32>and should I bite the bullet and hack something around warcio?
05:37:41<@JAA>'Redact' in what sense?
05:38:47<nico_32>remove a cookie & 2-3 pages
05:39:23<nico_32>that contains personal infos
05:39:39<@JAA>If that implies modifying record contents: don't, ever.
05:40:12<@JAA>Removing entire records is suboptimal but acceptable, I guess.
05:40:20<@JAA>But removing HTTP headers or similar: just don't.
05:41:07<nico_32>i want to get rid of the Cookie part of the request
05:41:52<@JAA>I suppose you can remove the request records entirely without directly affecting playback, although it would be awkward.
05:42:00<nico_32>because the value of ys-authentication-window-username is sensible
05:43:25Arcorann quits [Remote host closed the connection]
05:43:26<nico_32>and removing two url because one contains the account username & password
05:43:30benjins quits [Remote host closed the connection]
05:43:36godane1 joins
05:43:42<nico_32>and the second one lot of personnal info about the account holder
05:43:49Arcorann (Arcorann) joins
05:44:08godane2 quits [Read error: Connection reset by peer]
05:44:14<@JAA>Does the cookie also appear in Set-Cookie headers?
05:44:43benjins joins
05:45:05<nico_32>no
05:45:31<@JAA>Ok, well, then removing all request records and the two sensitive response records might be acceptable.
05:46:00<nico_32>yes, i am happy that the site doesn't put the username on every page
05:46:48<@JAA>You might want to put those in a separate file, possibly even with sensitive data stripped, but then use something other than WARC for storing that because it isn't true WARC anymore.
05:47:30<nico_32>look like I already need to rewrite the warc with warcio recompres
05:47:46<nico_32>pywb is not happy with the warc generated by warcprox
06:16:17<SketchTheCow>Feel free but if I know about it, it's not going in the wayback
06:23:11<nico_32>it is not done yet
06:25:42<nico_32>hum look like i can grab (some of) the content without auth
06:46:34Sylirana (Sylirana) joins
07:34:00<HP_Archivist>For when urgent-only subsides... I have a request, Ryz https://datomatic.no-intro.org/
07:35:04<HP_Archivist>It's ROM dump metadata resources for game preservation
07:35:05<Ryz>Oh? What's up?
07:35:20<flashfire42>Oh I am familair with that that is no intro lol
07:35:57<HP_Archivist>Oh okay, heh. Well I'm not sure if it's been crawled fully before, do you know?
07:36:36<flashfire42>I am not certain but I have contributed to it before and its not going anywhere
07:38:08<HP_Archivist>That's my concern considering how active certain entities have been (N) at take down requests
07:39:06<HP_Archivist>Regardless, if it hasn't been crawled fully in the past I want to when ab an take non-urgent things again
07:39:12<HP_Archivist>can*
07:50:10Sylirana quits [Ping timeout: 252 seconds]
07:52:35Sylirana (Sylirana) joins
08:21:03Sylirana quits [Client Quit]
08:25:30godane2 joins
08:26:25HP_Archivist quits [Client Quit]
08:27:56godane1 quits [Ping timeout: 252 seconds]
10:04:48mutantmonkey quits [Remote host closed the connection]
10:05:13mutantmonkey (mutantmonkey) joins
10:32:51Zopolis4 quits [Ping timeout: 244 seconds]
10:45:15mutantmonkey quits [Remote host closed the connection]
10:45:37mutantmonkey (mutantmonkey) joins
11:12:21VADemon joins
11:30:49cadence (cadence) joins
14:26:25<nico_32>okay
14:26:47<nico_32>so I am going to download every firmware from mystormshield.eu
14:26:56<nico_32>and put this into the MyStormshield items
14:27:19<nico_32>(the warc is going in another item and darked)
14:27:33Ryz quits [Remote host closed the connection]
14:28:11Ryz (Ryz) joins
14:58:05Arcorann quits [Ping timeout: 252 seconds]
15:29:40vitzli (vitzli) joins
15:34:01<nico_32>https://archive.org/download/MyStormshield
15:34:04<nico_32>:)
16:14:17<nico_32>https://archive.org/details/update1.netasq.com-2020-11-14
16:16:45<nico_32>if Stormshield close tomorrow; that should be enough to update their firewall to the lastest firmware + definitions files
16:19:03vitzli quits [Client Quit]
18:59:59VADemon quits [Read error: Connection reset by peer]
20:03:28Zopolis4 joins
20:07:37<OrIdow6>Does anyone know of any porn sites blocked in China, which are not eporner.com or pornhub.com?
20:08:13<OrIdow6>(As for how this could be of relevance here, I'm trying to write a more comprehensive "your warrior isn't behind a filtered Internet connection" checker)
20:09:40<@JAA>Not sure how up-to-date it is, but this has a couple more: https://www.dailydot.com/debug/china-great-firewall-banned-sites/
20:10:23<OrIdow6>Thanks
20:17:34godane1 joins
20:18:06godane2 quits [Read error: Connection reset by peer]
21:26:43wessel1512 quits [Quit: Ping timeout (120 seconds)]
21:27:08wessel1512 joins
22:13:51Zopolis4 quits [Remote host closed the connection]
23:03:38Arcorann (Arcorann) joins