HomeSearchPrevious dayNext day

00:07:36lunik1 quits [Ping timeout: 258 seconds]
00:10:24<@OrIdow6>jodizzle: Because when we are concerned about "faking DNS", we are concerned about producing unrepresentative warcs, not because we have some religious objection to overriding DNS resolution in software
00:10:33<@OrIdow6>*it's because we
00:11:13<@OrIdow6>IDK: Try clearing your cookies, unlikely you've been "banned" that way, I think. Also #internetarchive
00:12:13<@OrIdow6>JAA: Do the server problems imply that there's no use setting up something else?
00:22:29lunik1 joins
00:42:04<jodizzle>OrIdow6: Maybe I don't understand. How would the resulting WARC be different with the Python trick in that SO post vs. changing /etc/hosts on the machine?
00:46:09<@OrIdow6>jodizzle: Because this is in the context of keeping it in a custom resource record type instead of regular request/response
00:48:43<@OrIdow6>So there is no need to worry about the accuracy of those
00:50:32<@OrIdow6>Since any reader would have to be consciously aware that they are not in the normal format, which would mean that even if someone did play them back "normally" they'd have to make an explicit decision to fake output at playback time
01:00:02dm4v quits [Client Quit]
01:00:08<jodizzle>Ah okay. Thanks.
01:00:57<jodizzle>In other news, it looks like my test scrape generated stuff for a while but seems to now be permabanned.
01:01:33dm4v joins
01:01:35dm4v quits [Changing host]
01:01:35dm4v (dm4v) joins
01:03:44<jodizzle>Here's the result of searching for profile names with snscrape: https://transfer.archivete.am/U2PDp/twitter-curiouscat-search-profile-names.txt. snscrape crashed at one point (expected, it was a big search), so by no means comprehensive.
01:04:40<jodizzle>One thing I did to thin the search a bit was set a 'min_faves:1' condition.
01:10:37<@OrIdow6>Nice
01:24:14<@OrIdow6>I really would like comments on whether this is the best way to do this with WARC. The 1.1 spec gives the following examples for resource: "a file directly retrieved from a locally accessible repository or the result of a networked retrieval where the protocol information has been discarded", and this seems to fit, but I haven't really done that much with low-level warc besides reading them
01:27:00<@OrIdow6>Thinking of having the target-URIs be the URL of the retrieved, with DNS falsification, but with the scheme replaced with "curiouscat" - so e.g. "curiouscat://curiouscat.qa/abcd"; and of having the content be the whole protocol response, as would normally go in a response record
01:27:46<@OrIdow6>But even if this is technically correct I would like to know whether it is "kosher" or advisable
02:02:35dm4v_ joins
02:03:07dm4v quits [Ping timeout: 265 seconds]
02:03:07dm4v_ is now known as dm4v
02:03:08dm4v quits [Changing host]
02:03:08dm4v (dm4v) joins
02:05:47ragu joins
02:09:01HackMii_ (hacktheplanet) joins
02:10:16HackMii quits [Ping timeout: 258 seconds]
02:27:31tzt quits [Ping timeout: 258 seconds]
02:53:38<@JAA>FWIW, I have previously produced WARCs with DNS overrides, and I don't think there's anything fundamentally wrong with that as long as it's very clearly documented in the WARC headers. Whether it can go into the WBM or not is a completely different matter, of course.
02:54:39<@JAA>A custom scheme seems terrible, and also IA ignores the scheme entirely when indexing WARCs.
02:56:05<@JAA>These *are* HTTP requests/responses against the server specified in WARC-Target-IP. While it's generally best to use the IP from the authoritative DNS server for the domain, that's simply not always possible, and we shouldn't outright rule it out but rather figure out how to deal with it responsibly.
02:59:51tzt (tzt) joins
03:07:09<@JAA>OrIdow6: Not sure re ShoutEngine. It seems to hold up at 6 concurrency in AB now. Definitely not the most stable site, but whether it's us causing it I don't know.
03:33:09march_happy (march_happy) joins
03:33:17<@OrIdow6>arkiver: Will DNS faking be acceptable if it doesn't go into the WBM?
03:33:40<@OrIdow6>Thank you JAA
03:46:41HackMii_ quits [Remote host closed the connection]
03:46:55ragu quits [Remote host closed the connection]
03:47:33ragu joins
03:47:38HackMii_ (hacktheplanet) joins
03:47:57<Ryz>Has there anyone working on getting LG stuff in relation to smartphone stuff? Any updates? https://www.gsmarena.com/lg_is_shutting_down_its_developer_website_last_chance_to_unlock_your_bootloader-news-52152.php
03:54:44<@JAA>Ryz: Why is this not on Deathwatch?
04:10:10<Ryz>I mentioned this in the middle of the final weeks of the semester
04:14:27<h2ibot>JustAnotherArchivist edited Win-Raid Forum (+386, Add migration announcement): https://wiki.archiveteam.org/?diff=48042&oldid=47894
04:22:16r000t quits [Remote host closed the connection]
04:22:53qw3rty__ joins
04:26:44qw3rty_ quits [Ping timeout: 258 seconds]
04:30:30<@JAA>Ryz: Ah right. Would you add it please?
04:38:17Jake quits [Client Quit]
04:39:01Jake (Jake) joins
04:45:22DogsRNice quits [Read error: Connection reset by peer]
04:56:33Jake quits [Client Quit]
04:56:54Jake (Jake) joins
05:00:48Jake quits [Client Quit]
05:04:04Jake (Jake) joins
05:04:22Jake quits [Client Quit]
05:06:18Jake (Jake) joins
05:53:46BlueMaxima quits [Read error: Connection reset by peer]
06:03:41HackMii_ quits [Remote host closed the connection]
06:04:03HackMii_ (hacktheplanet) joins
06:41:13HackMii_ quits [Remote host closed the connection]
06:41:31HackMii_ (hacktheplanet) joins
07:06:57<h2ibot>Ryz edited Deathwatch (+205, /* 2021 */ Add LG mobile developer website): https://wiki.archiveteam.org/?diff=48043&oldid=48020
07:07:03<Ryz>JAA ^
08:19:46qwertyasdfuiopghjkl quits [Remote host closed the connection]
08:26:42appledash quits [Ping timeout: 258 seconds]
08:27:43march_happy quits [Remote host closed the connection]
08:40:39appledash (appledash) joins
08:43:20march_happy (march_happy) joins
09:14:05HackMii_ quits [*.net *.split]
09:14:05ragu quits [*.net *.split]
09:14:05tzt quits [*.net *.split]
09:14:05dm4v quits [*.net *.split]
09:14:05mutantmnky quits [*.net *.split]
09:14:05sonick quits [*.net *.split]
09:14:05lukash7 quits [*.net *.split]
09:14:05monoxane4 quits [*.net *.split]
09:14:05fangfufu quits [*.net *.split]
09:14:05Lord_Nightmare quits [*.net *.split]
09:14:05wyatt8740 quits [*.net *.split]
09:14:05Myself quits [*.net *.split]
09:14:05Stiletto quits [*.net *.split]
09:14:05jspiros quits [*.net *.split]
09:14:05omni quits [*.net *.split]
09:14:05Ruthalas quits [*.net *.split]
09:14:05jonboy3452 quits [*.net *.split]
09:14:05Mateon1 quits [*.net *.split]
09:14:05shoghicp quits [*.net *.split]
09:14:05lennier1 quits [*.net *.split]
09:14:05sec^nd quits [*.net *.split]
09:14:05Doranwen quits [*.net *.split]
09:14:05yano quits [*.net *.split]
09:14:05IDK quits [*.net *.split]
09:14:05kiskaLogBot quits [*.net *.split]
09:14:05Barto quits [*.net *.split]
09:14:05Terbium quits [*.net *.split]
09:14:05wizards quits [*.net *.split]
09:14:05adamus1red quits [*.net *.split]
09:14:05laser quits [*.net *.split]
09:14:05superkuh quits [*.net *.split]
09:14:05Minkafighter quits [*.net *.split]
09:14:05pabs quits [*.net *.split]
09:14:05thuban quits [*.net *.split]
09:14:05Nulo quits [*.net *.split]
09:14:05duce1337 quits [*.net *.split]
09:14:05benjins quits [*.net *.split]
09:14:05Atom quits [*.net *.split]
09:14:05themadpro quits [*.net *.split]
09:14:05balrog quits [*.net *.split]
09:14:05vukky quits [*.net *.split]
09:14:05mrHedgehog0 quits [*.net *.split]
09:14:05knecht420 quits [*.net *.split]
09:14:05treora quits [*.net *.split]
09:14:05adia quits [*.net *.split]
09:14:05@rewby quits [*.net *.split]
09:14:05Zerote_ quits [*.net *.split]
09:14:05sembiance quits [*.net *.split]
09:14:05nico_32 quits [*.net *.split]
09:14:05simon816 quits [*.net *.split]
09:14:05HugsNotDrugs quits [*.net *.split]
09:14:05tech234a quits [*.net *.split]
09:14:05mikael quits [*.net *.split]
09:14:05@EggplantN3 quits [*.net *.split]
09:14:05@HCross quits [*.net *.split]
09:14:05JSharp quits [*.net *.split]
09:14:05kpcyrd quits [*.net *.split]
09:14:05starship_8601 quits [*.net *.split]
09:14:05Daloader quits [*.net *.split]
09:14:05Aoede quits [*.net *.split]
09:14:05luckcolors quits [*.net *.split]
09:14:05MrRadar quits [*.net *.split]
09:14:06meowe quits [*.net *.split]
09:14:06celestial_ quits [*.net *.split]
09:14:06notbasetwo quits [*.net *.split]
09:14:06@JAA quits [*.net *.split]
09:14:06Zeklyn quits [*.net *.split]
09:14:06aarchi quits [*.net *.split]
09:14:06Gaelan quits [*.net *.split]
09:14:06aismallard quits [*.net *.split]
09:14:06Dragnog quits [*.net *.split]
09:14:06asie quits [*.net *.split]
09:14:06nimaje quits [*.net *.split]
09:14:06ats quits [*.net *.split]
09:14:06jonty quits [*.net *.split]
09:14:06mgrandi quits [*.net *.split]
09:14:06murmur quits [*.net *.split]
09:14:06jodizzle quits [*.net *.split]
09:14:06phuzion quits [*.net *.split]
09:14:06holbrooke quits [*.net *.split]
09:14:06Jonimus quits [*.net *.split]
09:14:06justcool393 quits [*.net *.split]
09:14:06NotEggplant quits [*.net *.split]
09:14:06ghuntley quits [*.net *.split]
09:18:40HackMii_ (hacktheplanet) joins
09:18:40ragu joins
09:18:40tzt (tzt) joins
09:18:40dm4v (dm4v) joins
09:18:40mutantmnky (mutantmonkey) joins
09:18:40sonick (sonick) joins
09:18:40lukash7 joins
09:18:40monoxane4 (monoxane) joins
09:18:40fangfufu (fangfufu) joins
09:18:40Lord_Nightmare (Lord_Nightmare) joins
09:18:40wyatt8740 joins
09:18:40Myself (myself) joins
09:18:40Stiletto joins
09:18:40jspiros (jspiros) joins
09:18:40omni joins
09:18:40Ruthalas (Ruthalas) joins
09:18:40jonboy3452 joins
09:18:40Mateon1 joins
09:18:40shoghicp (shoghicp) joins
09:18:40lennier1 (lennier1) joins
09:18:40sec^nd (second) joins
09:18:40Doranwen (Doranwen) joins
09:18:40yano (yano) joins
09:18:40IDK (IDK) joins
09:18:40kiskaLogBot joins
09:18:40Barto (Barto) joins
09:18:40Terbium joins
09:18:40wizards joins
09:18:40adamus1red (adamus1red) joins
09:18:40laser joins
09:18:40superkuh joins
09:18:40Minkafighter joins
09:18:40pabs (pabs) joins
09:18:40thuban joins
09:18:40Nulo joins
09:18:40duce1337 (duce1337) joins
09:18:40benjins (benjins) joins
09:18:40Atom joins
09:18:40themadpro (themadpro) joins
09:18:40balrog (balrog) joins
09:18:40vukky (Vukky) joins
09:18:40mrHedgehog0 (mrHedgehog0) joins
09:18:40knecht420 (knecht420) joins
09:18:40treora joins
09:18:40adia (adia) joins
09:18:40rewby (rewby) joins
09:18:40chaostal.hackint.org sets mode: +o rewby
09:18:40Zerote_ joins
09:18:40sembiance (sembiance) joins
09:18:40nico_32 (nico) joins
09:18:40simon816 (simon816) joins
09:18:40HugsNotDrugs joins
09:18:40tech234a (tech234a) joins
09:18:40mikael joins
09:18:40EggplantN3 (EggplantN) joins
09:18:40HCross (HCross) joins
09:18:40JSharp (JSharp) joins
09:18:40kpcyrd (kpcyrd) joins
09:18:40starship_8601 (starship_8601) joins
09:18:40Daloader (Daloader_) joins
09:18:40Aoede (Aoede) joins
09:18:40luckcolors (luckcolors) joins
09:18:40MrRadar (MrRadar) joins
09:18:40meowe (meowe) joins
09:18:40celestial_ joins
09:18:40notbasetwo joins
09:18:40JAA (JAA) joins
09:18:40Zeklyn joins
09:18:40aarchi (aarchi) joins
09:18:40Gaelan (Gaelan) joins
09:18:40aismallard joins
09:18:40Dragnog joins
09:18:40asie joins
09:18:40nimaje joins
09:18:40mgrandi (mgrandi) joins
09:18:40ats (ats) joins
09:18:40jonty (jonty) joins
09:18:40murmur joins
09:18:40jodizzle (jodizzle) joins
09:18:40phuzion (phuzion) joins
09:18:40holbrooke joins
09:18:40NotEggplant joins
09:18:40justcool393 (justcool393) joins
09:18:40Jonimus joins
09:18:40ghuntley joins
09:18:40chaostal.hackint.org sets mode: +ooo EggplantN3 HCross JAA
09:28:16appledash quits [Ping timeout: 265 seconds]
09:40:03appledash (appledash) joins
09:47:59Eighty quits [Remote host closed the connection]
09:56:10G4te_Keep3r joins
10:30:16driib79894 (driib) joins
10:33:08Megame (Megame) joins
10:33:54lennier2 joins
10:35:07lennier1 quits [Ping timeout: 258 seconds]
10:35:15lennier2 is now known as lennier1
10:37:23march_happy quits [Ping timeout: 265 seconds]
10:58:18march_happy (march_happy) joins
11:01:26march_happy quits [Read error: Connection reset by peer]
11:03:29Doranwen quits [Ping timeout: 258 seconds]
11:17:18Doranwen (Doranwen) joins
11:31:25Sluggs quits [Ping timeout: 244 seconds]
11:39:59Eighty (Eighty) joins
11:45:33Sluggs joins
11:50:01Sluggs quits [Ping timeout: 244 seconds]
11:50:30Sluggs joins
12:03:37wizards_ joins
12:06:44wizards quits [Ping timeout: 258 seconds]
12:08:06jonboy3452 quits [Read error: Connection reset by peer]
12:22:51Jonboy345 joins
12:23:36Sluggs quits [Ping timeout: 244 seconds]
12:25:13Sluggs joins
12:35:29Sluggs quits [Ping timeout: 244 seconds]
12:37:03Sluggs joins
12:42:12Sluggs quits [Ping timeout: 244 seconds]
12:42:39Sluggs joins
12:48:55Sluggs quits [Ping timeout: 244 seconds]
12:49:39Sluggs joins
13:10:59knecht420 quits [Quit: The Lounge - https://thelounge.chat]
13:16:11knecht420 (knecht420) joins
13:24:19<@OrIdow6>AWS issues https://news.ycombinator.com/item?id=29648286
13:25:06Arcorann quits [Ping timeout: 265 seconds]
13:28:33qwertyasdfuiopghjkl joins
13:50:57random82 joins
13:52:12random82 quits [Remote host closed the connection]
13:59:11Sluggs quits [Client Quit]
14:00:47<Jon>does anyone know of a tool to manage periodically checking archive.org items you've uploaded / are otherwise interested in to make sure they're still there? when mine disappear it's normally chance that I notice. Would like to automate checking. ta!
14:01:17<Jon>I can throw something together but imagined someone had done this already
14:18:35dm4v quits [Client Quit]
14:19:36<@arkiver>OrIdow6: yeah i guess so
14:19:56<@arkiver>but it will be in mediatype data item, and not be in the wayback machine
14:24:11dm4v joins
14:24:13dm4v quits [Changing host]
14:24:13dm4v (dm4v) joins
14:36:14dm4v quits [Ping timeout: 258 seconds]
14:38:37ragu quits [Client Quit]
14:40:39dm4v joins
14:40:41dm4v quits [Changing host]
14:40:41dm4v (dm4v) joins
15:07:13<@OrIdow6>Ok
15:26:54lunik1 quits [Ping timeout: 265 seconds]
15:33:39lunik1 joins
15:39:12Megame quits [Client Quit]
15:41:24lunik1 quits [Ping timeout: 258 seconds]
15:46:06lunik1 joins
15:55:54lunik1 quits [Ping timeout: 265 seconds]
15:56:52leo60228 quits [Ping timeout: 265 seconds]
15:56:54leo60228- (leo60228) joins
16:50:43lunik1 joins
16:55:59sec^nd quits [Remote host closed the connection]
16:56:18sec^nd (second) joins
17:06:20HackMii_ quits [Remote host closed the connection]
17:07:33HackMii_ (hacktheplanet) joins
17:12:56mutantmnky quits [Remote host closed the connection]
17:13:16mutantmnky (mutantmonkey) joins
17:18:43mutantmnky quits [Remote host closed the connection]
17:19:00mutantmnky (mutantmonkey) joins
18:11:41eroc1990 quits [Client Quit]
18:11:50vukky quits [Quit: Konversation terminated!]
18:13:59vukky (Vukky) joins
18:19:42qwertyasdfuiopghjkl quits [Client Quit]
18:22:00qwertyasdfuiopghjkl joins
18:25:58eroc1990 (eroc1990) joins
18:40:32wyatt8750 joins
18:41:34wyatt8740 quits [Ping timeout: 258 seconds]
19:36:34spirit quits [Client Quit]
19:54:02Hackerpcs quits [Client Quit]
19:58:06Hackerpcs (Hackerpcs) joins
20:15:46systwi_ (systwi) joins
20:15:56systwi quits [Ping timeout: 265 seconds]
20:25:44Hackerpcs quits [Client Quit]
20:27:11Hackerpcs (Hackerpcs) joins
21:19:07spirit joins
22:03:30BlueMaxima joins
22:48:16Arcorann (Arcorann) joins
23:07:13tzt quits [Ping timeout: 258 seconds]
23:19:57tzt (tzt) joins
23:36:48<endrift>So I'm planning to upload an archive of savegames to IA, but I'm really not sure how to categorize them, since they're not the games themselves and thus not software
23:36:56<endrift>I'm also not sure what tags I should give it
23:37:32<endrift>Can this all be changed later if necessary?
23:37:37<endrift>the metadata that is
23:40:10Sluggs joins
23:53:06<@JAA>endrift: All normal metadata fields except mediatype and collection can be edited later by the uploader, including subjects, which I guess is what you mean by 'tags'.
23:53:27<endrift>oh, yes, it calls it subject tags
23:53:30<endrift>in the uploader
23:53:33<endrift>I guess I cut off the wrong word
23:53:49<@JAA>Ah, never used that, CLI all the way. :-)
23:53:57<endrift>the uploader also seems to conflate mediatype and collection
23:54:00<endrift>maybe?
23:54:24<endrift>it just says "collection" but the options are "Community software", "Community audio", etc
23:55:45<@JAA>My 'can be edited' also refers to the CLI, by the way. I have no idea what the web interface lets you do, but I could easily imagine it's more restricted.
23:56:25<endrift>No idea what I should do for collection then since apparently that's immutable, and the options are...very select
23:57:22<endrift>I guess between "software" and "data" the mediatype might not matter too much
23:58:33<endrift>Maybe I'll just wait for Sanqui to wake up since I was talking about it with them last night already :P
23:59:25<@JAA>data sounds most appropriate to me, but I'm not an expert on this, and my own items' metadata sucks, so you probably shouldn't listen to me. :-)

HomeSearchPrevious dayNext day