HomeSearchPrevious dayNext day

00:10:23User quits [Remote host closed the connection]
00:12:16<nicolas17>JAA: https://developer.apple.com/support/terms/apple-developer-program-license-agreement/ this was just updated (and WBM's last snapshot is being very useful for diffing), can you AB this new version?
00:13:14<fireonlive>nicolas17: no recursion?
00:13:44<nicolas17>nah, recursion there could go nuts
00:14:00<fireonlive>added
00:15:36<fireonlive>(to AB)
00:21:12<Pedrosso>tech234a: Finally lol
00:23:49<fireonlive>ikr?
00:29:36aninternettroll (aninternettroll) joins
00:31:19<tech234a>nicolas17: yeah I just saw that on RSS
00:32:29<Pedrosso>About bsky, https://bskyreader.xyz/ could prove a point of archival of these early days until bsky opens up their browsing as well, right?
01:01:17<@JAA>ETA for OneHallyu is 2023-12-25 23:00 now. Still a bit short, although the rate went up slightly to about 6.5k/h.
01:48:18<nicolas17>interesting change in the apple developer agreement
01:48:49<nicolas17>"Any litigation or other dispute resolution between You and Apple (other than a challenge to a patent right before a patent office) arising out of or relating to this Agreement, the Apple Software, or Your relationship with Apple will take place in the Northern District of California"
01:48:51<nicolas17>the part between parentheses was added today
01:51:32<pabs>https://nextcloud.com/blog/kiteworks-acquires-owncloud-dracoon/
01:54:53tzt quits [Ping timeout: 272 seconds]
01:55:40tzt (tzt) joins
02:07:07<@JAA>2023-12-22 07:40:17.228Z INFO None topic:32 done: 8812 requests, 2113734 tx, 4296426806 rx
02:07:13<@JAA>This is part of why this is taking so long.
02:07:34<@JAA>Yes, that's 4 GiB of HTML for a single topic.
02:08:13<@JAA>It's the largest one completed so far, but there are others with even more pages.
02:17:36<project10>potato server working up a sweat
04:12:47sec^nd quits [Ping timeout: 250 seconds]
04:17:36pabs quits [Remote host closed the connection]
04:20:09pabs (pabs) joins
04:20:57sec^nd (second) joins
04:29:31<tech234a>nicolas17: perhaps relating to the Apple Watch patent thing?
04:34:14qwertyasdfuiopghjkl quits [Remote host closed the connection]
04:52:13sec^nd quits [Ping timeout: 250 seconds]
04:54:49miana_ joins
04:57:24sec^nd (second) joins
04:57:43Jens quits [Ping timeout: 258 seconds]
04:57:57Jens (JensRex) joins
05:02:06miana quits [Ping timeout: 620 seconds]
05:02:06miana_ is now known as miana
05:18:37icedice (icedice) joins
05:21:08icedice quits [Client Quit]
05:26:10M--mlv|m quits [*.net *.split]
05:26:12that_lurker|m quits [*.net *.split]
05:26:12hillow596|m quits [*.net *.split]
05:26:12username675f|m quits [*.net *.split]
05:26:12AntoninDelFabbro|m quits [*.net *.split]
05:26:12Peetz0r|m quits [*.net *.split]
05:26:12kaz__|m quits [*.net *.split]
05:26:12EvanBoehs|m quits [*.net *.split]
05:26:13yetanotherarchiver|m quits [*.net *.split]
05:26:13Maakuth|m quits [*.net *.split]
05:26:13superusercode quits [*.net *.split]
05:26:13nyuuzyou quits [*.net *.split]
05:26:14JC|m quits [*.net *.split]
05:26:14pannekoek11|m quits [*.net *.split]
05:26:14jwoglom|m quits [*.net *.split]
05:26:14jevinskie quits [*.net *.split]
05:26:15hlgs|m quits [*.net *.split]
05:26:15Ruk8 quits [*.net *.split]
05:26:15vexr quits [*.net *.split]
05:26:15Video quits [*.net *.split]
05:26:16saouroun|m quits [*.net *.split]
05:26:16supermariofan67|m quits [*.net *.split]
05:26:16bogsen quits [*.net *.split]
05:26:16marius851000 quits [*.net *.split]
05:26:16Nulo|m quits [*.net *.split]
05:26:16iCesenberk|m quits [*.net *.split]
05:26:16qyxojzh|m quits [*.net *.split]
05:26:16sonst-was|m quits [*.net *.split]
05:26:16alexshpilkin quits [*.net *.split]
05:26:16qq44|m quits [*.net *.split]
05:26:16coro quits [*.net *.split]
05:26:16Misty|m quits [*.net *.split]
05:26:16gungagungagunga|m quits [*.net *.split]
05:26:16Roki_100|m quits [*.net *.split]
05:26:16nosamu|m quits [*.net *.split]
05:26:16Cydog|m quits [*.net *.split]
05:26:16trumad|m quits [*.net *.split]
05:26:16wrangle|m quits [*.net *.split]
05:26:16noobirc|m quits [*.net *.split]
05:26:16moe-a-m|m quits [*.net *.split]
05:26:16will|m quits [*.net *.split]
05:26:16mikolaj|m quits [*.net *.split]
05:26:16gwetchen|m quits [*.net *.split]
05:26:16voltagex|m quits [*.net *.split]
05:26:16lasdkfj|m quits [*.net *.split]
05:26:16GRBaset quits [*.net *.split]
05:26:16finalti|m quits [*.net *.split]
05:26:16masterx244|m quits [*.net *.split]
05:26:16akaibu|m quits [*.net *.split]
05:26:16octylFractal|m quits [*.net *.split]
05:26:16NickS|m quits [*.net *.split]
05:26:16tech234a|m quits [*.net *.split]
05:26:16schwarzkatz|m quits [*.net *.split]
05:26:16jackt1365|m quits [*.net *.split]
05:26:16t3chler|m quits [*.net *.split]
05:26:16EmeraldSnorlax|m quits [*.net *.split]
05:26:16haha-whered-it-go|m quits [*.net *.split]
05:26:16madpro|m quits [*.net *.split]
05:26:16thermospheric quits [*.net *.split]
05:26:16noxious quits [*.net *.split]
05:26:16joepie91|m quits [*.net *.split]
05:26:16ram|m quits [*.net *.split]
05:26:16Passiing|m quits [*.net *.split]
05:26:16MaxG quits [*.net *.split]
05:26:16Minkafighter|m quits [*.net *.split]
05:26:16yzqzss quits [*.net *.split]
05:26:16x9fff00 quits [*.net *.split]
05:26:16Exorcism quits [*.net *.split]
05:26:16phaeton quits [*.net *.split]
05:26:16Tom|m1 quits [*.net *.split]
05:26:16Froxcey|m quits [*.net *.split]
05:26:16manu|m quits [*.net *.split]
05:26:16CrispyAlice2 quits [*.net *.split]
05:26:16s-crypt|m|m quits [*.net *.split]
05:26:16Fletcher quits [*.net *.split]
05:26:16flashfire42|m quits [*.net *.split]
05:26:16ragu|m quits [*.net *.split]
05:26:16MinePlayersPEMyNey|m quits [*.net *.split]
05:26:16Thibaultmol quits [*.net *.split]
05:26:16nstrom|m quits [*.net *.split]
05:26:16Hans5958 quits [*.net *.split]
05:26:16theblazehen|m quits [*.net *.split]
05:26:16mpeter|m quits [*.net *.split]
05:26:16tomodachi94 quits [*.net *.split]
05:26:17Vokun quits [*.net *.split]
05:26:17audrooku|m quits [*.net *.split]
05:26:17britmob|m quits [*.net *.split]
05:26:17xxia|m quits [*.net *.split]
05:26:17cmostracker|m quits [*.net *.split]
05:26:17andrewvieyra|m quits [*.net *.split]
05:26:17mind_combatant quits [*.net *.split]
05:26:17DigitalDragon quits [*.net *.split]
05:26:17@Sanqui|m quits [*.net *.split]
05:26:17rewby|m quits [*.net *.split]
05:26:17igneousx quits [*.net *.split]
05:26:17Ajay quits [*.net *.split]
05:34:10missaustraliana joins
05:35:02<missaustraliana>is there a tool to pull a file from ftp and then upload it to the archive?
05:35:27<pokechu22>https://web.archive.org/save/ can theoretically do FTP, but FTP is a bit jank in general so it doesn't always work
05:40:57<missaustraliana>got it, but i would like to upload it onto a user account. theres this weather ftp server with current information and i would like to mirror that and upload it
05:41:20<missaustraliana>it updates daily so i would like to run it daily
05:48:50<pokechu22>I'm not sure about that unfortuantely
05:54:12<missaustraliana>i think i will create it myself. but i need help with metadata on ia. is there any documentation on how i should format the file so it reads it correctly and sets the description and tags and stuff?
06:02:55rewby|m joins
06:05:37Passiing|m joins
06:05:37joepie91|m joins
06:05:37ram|m joins
06:05:37pannekoek11|m joins
06:05:37thermospheric (Thermospheric) joins
06:05:37Sanqui|m (Sanqui) joins
06:05:37tech234a|m joins
06:05:37@ChanServ sets mode: +o Sanqui|m
06:05:38MinePlayersPEMyNey|m joins
06:05:38Ruk8 (Ruk8) joins
06:05:38noxious joins
06:05:38mikolaj|m joins
06:05:38mpeter|m joins
06:05:38hlgs|m joins
06:05:38xxia|m joins
06:05:38DigitalDragon (DigitalDragon) joins
06:05:39andrewvieyra|m joins
06:05:39nstrom|m joins
06:05:39theblazehen|m joins
06:05:39mind_combatant joins
06:05:39EmeraldSnorlax|m joins
06:05:39saouroun|m joins
06:05:39haha-whered-it-go|m joins
06:05:39t3chler|m joins
06:05:39schwarzkatz|m joins
06:05:39jackt1365|m joins
06:05:39x9fff00 (x9fff00) joins
06:05:39madpro|m joins
06:05:39ragu|m joins
06:05:39britmob|m joins
06:05:39audrooku|m joins
06:05:39Ajay joins
06:05:39igneousx (igneousx) joins
06:05:39NickS|m joins
06:05:39akaibu|m joins
06:05:39Froxcey|m joins
06:05:39masterx244|m joins
06:05:39GRBaset (GRBaset) joins
06:05:39Minkafighter|m joins
06:05:39finalti|m joins
06:05:39lasdkfj|m joins
06:05:39Thibaultmol joins
06:05:39manu|m joins
06:05:39tomodachi94 (tomodachi94) joins
06:05:39Fletcher (Fletcher) joins
06:05:39gwetchen|m joins
06:05:39voltagex|m joins
06:05:39yzqzss (yzqzss) joins
06:05:39CrispyAlice2 (CrispyAlice2) joins
06:05:39jevinskie (jevinskie) joins
06:05:39will|m joins
06:05:39Hans5958 (Hans5958) joins
06:05:39moe-a-m|m joins
06:05:39wrangle|m joins
06:05:39superusercode (superusercode) joins
06:05:39vexr joins
06:05:39nyuuzyou (nyuuzyou) joins
06:05:39MaxG joins
06:05:39jwoglom|m joins
06:05:39Cydog|m joins
06:05:39nosamu|m joins
06:05:39Roki_100|m joins
06:05:39trumad|m joins
06:05:39Tom|m1 joins
06:05:39gungagungagunga|m joins
06:05:39cmostracker|m joins
06:05:40noobirc|m joins
06:05:40Misty|m joins
06:05:40yetanotherarchiver|m joins
06:05:40Video joins
06:05:40Vokun (Vokun) joins
06:05:40phaeton (phaeton) joins
06:05:40coro joins
06:05:40alexshpilkin joins
06:05:40qq44|m joins
06:05:40flashfire42|m (flashfire42) joins
06:05:40octylFractal|m joins
06:05:40qyxojzh|m joins
06:05:40iCesenberk|m joins
06:05:40sonst-was|m joins
06:05:40s-crypt|m|m joins
06:05:40JC|m joins
06:05:40Nulo|m joins
06:05:40Exorcism (exorcism) joins
06:05:40marius851000 joins
06:05:40bogsen (bogsen) joins
06:05:40supermariofan67|m joins
06:05:44kaz__|m joins
06:05:45Maakuth|m joins
06:05:46Peetz0r|m joins
06:05:46AntoninDelFabbro|m joins
06:05:47username675f|m joins
06:05:48EvanBoehs|m joins
06:05:48hillow596|m joins
06:05:49that_lurker|m joins
06:11:42<DigitalDragons>IA item metadata is set separately/manually as part of the uploading process
06:11:43M--mlv|m joins
06:12:22<DigitalDragons>if you're using the CLI it's done like this: https://archive.org/developers/internetarchive/cli.html#upload
06:14:42Megame (Megame) joins
06:23:23missaustraliana quits [Client Quit]
06:51:33qwertyasdfuiopghjkl (qwertyasdfuiopghjkl) joins
06:56:54missaustraliana joins
07:31:03DogsRNice quits [Read error: Connection reset by peer]
07:40:57<h2ibot>Monika edited YouTube (+271, Add information about TubeStats): https://wiki.archiveteam.org/?diff=51409&oldid=51215
07:40:58<h2ibot>JustAnotherArchivist changed the user rights of User:Monika
08:10:02<h2ibot>Monika edited List of largest ArchiveTeam projects (+2, Project sizes as of Dec 2023): https://wiki.archiveteam.org/?diff=51410&oldid=49754
08:27:14eroc1990 (eroc1990) joins
08:31:06<h2ibot>Monika edited YouTube (+69, Update largest AT project and IA storage capacity): https://wiki.archiveteam.org/?diff=51411&oldid=51409
08:50:31BlueMaxima quits [Read error: Connection reset by peer]
08:57:02missaustraliana quits [Client Quit]
08:58:44Island quits [Read error: Connection reset by peer]
09:59:53atphoenix quits [Remote host closed the connection]
10:00:02Bleo18260 quits [Client Quit]
10:00:36atphoenix (atphoenix) joins
10:01:18Bleo18260 joins
10:07:49missaustraliana joins
10:32:51missaustraliana1 joins
10:34:34<h2ibot>Nemo bis edited YouTube (-3, add tubestats, remove random video): https://wiki.archiveteam.org/?diff=51412&oldid=51411
10:36:45missaustraliana quits [Ping timeout: 272 seconds]
10:56:45missaustraliana1 quits [Client Quit]
11:05:23parfait quits [Remote host closed the connection]
11:05:46parfait (kdqep) joins
11:10:57parfait quits [Ping timeout: 272 seconds]
11:48:33<Pedrosso>I'm getting anxious about copyright law again. Could I be referred to how archival of copyrighted services (such as YT videos) is okay under such laws?
12:00:10missaustraliana joins
12:04:19missaustraliana quits [Client Quit]
12:37:58<h2ibot>Nemo bis edited YouTube (-1, fix typo): https://wiki.archiveteam.org/?diff=51413&oldid=51412
12:44:47Megame quits [Client Quit]
13:14:20Arcorann quits [Ping timeout: 240 seconds]
14:11:49jacksonchen666 quits [Client Quit]
14:46:55ymgve quits [Ping timeout: 272 seconds]
14:48:27<Pedrosso>After having read the wiki, I'll clarify I'm not saying "but copyright" to any of AT's archival projects, only my own.
15:06:07RealPerson joins
15:07:12ymgve joins
15:20:00RealPerson leaves
15:42:14RealPerson joins
15:45:50Church quits [Ping timeout: 240 seconds]
15:56:15katocala joins
16:12:42RealPerson leaves
16:25:29RealPerson joins
16:58:01nicolas17 quits [Ping timeout: 272 seconds]
17:01:47nicolas17 joins
17:21:51RealPerson leaves
17:29:06<@JAA>OneHallyu sped up a little since last night, and the ETA is now ~10:30 on the 25th (using the average over the last 3 hours). So maybe there's a chance it'll work out.
17:29:52<fireonlive>🤞🏻
17:32:01<@JAA>Pedrosso: In many jurisdictions, there are copyright exemptions for preservation. Distribution is a different topic.
17:33:29<Pedrosso>Awesome about the OneHallyu grab. As for copyright, I find it a shame that (as far as I know) you can't upload things to IA privately, waiting until the copyright runs out
17:33:58<@JAA>See ya in a hundred years or so. :-|
17:35:13<@JAA>Uploading it for preservation purposes is likely also covered by those copyright exemptions. Public distribution is restricted, and that's why IA may have to take things down if they receive a complaint from the rightful copyright owner.
17:35:38<@JAA>Hence darked items, WBM exclusions, and so on.
17:36:19<@JAA>You can upload access-restricted items if necessary. It's rarely necessary.
17:40:17<Pedrosso>darked items?
17:40:39<nicolas17>items can be "darked" which removes them from public view, yet still exist in IA servers, so they can be restored in the future
17:40:58<nicolas17>but the feature could use improvements
17:41:13<@JAA>Even you as an uploader can't access it.
17:41:38<nicolas17>for a while I thought, it would be nice if I could hide an item and set a date where it would automatically un-hide, which could be copyright expiration or could be something closer
17:42:10<nicolas17>then I realized if I dark an item, I can't un-dark it even manually, I have to email IA to do it
17:42:13<nicolas17>-.-
17:42:31<Pedrosso>You can manually dark an item?
17:42:38<Pedrosso>like, as the uploader
17:43:24<nicolas17>I requested creation of a collection, I think that gave me extra permissions for items inside the collection but also some limited extra permissions over all items I upload
17:44:41<nicolas17>Pedrosso: https://transfer.archivete.am/inline/ccJu6/item-manager.png
17:45:28RealPerson joins
17:46:09<nicolas17>and all this "As an admin," and "You are a trusted admin of the Archive! You may click the checkbox on a task row or rows below to perform an admin function on it." stuff made me think I had incorrectly gotten global admin permissions
17:46:17<nicolas17>but it's not global, it's just my items
17:46:54<Pedrosso>Interesting. So as for grabs which are more likely to be copyright or get claims such as #down-the-tube, AT's idea is upload and if issues come up it just gets indefinitely darkened?
17:47:18<nicolas17>I *think* so
17:47:48<Pedrosso>Sounds good. So, if I were to follow those same steps I would personally probably not be in legal trouble?
17:47:49<nicolas17>there's other stuff like commercial music CDs from the big record labels where IIRC Jason Scott said "do NOT upload that"
17:47:55<@JAA>Usually not darkened but WBM-excluded and possibly access-restricted (which is not the same as darked).
17:48:52<Pedrosso>nicolas17: Haha. Well, thanks for the info. Is there any comprehensive list like that, or just random statements?
17:49:52<nicolas17>I think IA has a lot of commercial music archived for preservation but not publicly accessible, because the RIAA and the big labels are not to be messed with, yet it's important to preserve
17:50:31<nicolas17>IIRC one time a music store closed down and IA bought their entire inventory?
17:50:51<fireonlive>nice
17:51:42RealPerson leaves
17:54:17<Pedrosso>nice
18:07:59RealPerson joins
18:42:27Church (Church) joins
18:52:22<fireonlive>overnight test: https://dl.fireon.live/irc/4d688082dd47872c/image.png
18:54:55<fireonlive>(957 crawls, refreshed: 227)
19:12:20Earendil7 quits [Quit: Leaving]
19:13:56Earendil7 (Earendil7) joins
19:48:00c3manu (c3manu) joins
20:11:38BlueMaxima joins
20:40:00c3manu quits [Client Quit]
20:45:34parfait (kdqep) joins
20:51:05parfait quits [Ping timeout: 272 seconds]
21:14:08BearFortress quits [Client Quit]
21:21:07BearFortress joins
22:17:02lennier2_ quits [Read error: Connection reset by peer]
22:17:20lennier2_ joins
22:18:30<TheTechRobo>Would be interesting to compare it with the old version of the dashboard (pre i.van's changes)
22:58:54Island joins
23:05:06ScenarioPlanet (ScenarioPlanet) joins
23:06:37<ScenarioPlanet>Hello. May I ask, is there some unified tool that can be used to save POST requests (including formdata) into .WARCs?
23:14:54<@JAA>wget(-at), wpull, qwarc can all do it. warcprox + the HTTP client of your choice, too. I guess there are more.
23:16:56<fireonlive>i think that's about it :p
23:18:00<@JAA>It's plausible that Heritrix can be convinced into doing it, but it might be painful.
23:19:35<TheTechRobo>warcio can probably do it too but don't use it
23:19:41TheTechRobo braces for the trout
23:20:22fireonlive slaps TheTechRobo around a bit with a large WARC standard
23:21:19<TheTechRobo>I didn't brace for that one, ow...
23:21:27<@JAA>:-)
23:23:51<TheTechRobo>Wget-AT would probably be the least painful
23:24:28<fireonlive>:d
23:24:31<@JAA>Yeah
23:24:34<@JAA>Wget-AT++
23:24:35<eggdrop>[karma] 'Wget-AT' now has 3 karma!
23:25:00<fireonlive>:D
23:25:03<TheTechRobo>Wpull requires dark magic to install and chants to use, qwarc is an opaque box, and warcio is... well, warcio
23:25:10<TheTechRobo>Not sure about heritrix
23:26:01<TheTechRobo>warcio--
23:26:02<eggdrop>[karma] 'warcio' now has -1 karma!
23:26:12<fireonlive>webrecorder--
23:26:12<eggdrop>[karma] 'webrecorder' now has -3 karma!
23:26:14<TheTechRobo>Is karma bot case sensitive?
23:26:31<fireonlive>hm
23:26:37<fireonlive>i think so yeah
23:26:43<fireonlive>!kfind A
23:26:43<eggdrop>[karma] 33 matches for 'A'. top 10 matches: JAA: 10 arkiver: 7 A: 4 nulldata: 3 Wget-AT: 3 that_lurker: 2 Gooshka: 2 kiska: 2 nicolas17: 2 mojibake: 1
23:26:46<TheTechRobo>Webrecorder--
23:26:47<eggdrop>[karma] 'Webrecorder' now has -4 karma!
23:26:51<TheTechRobo>nope
23:26:52<fireonlive>oh i guess not
23:27:00<fireonlive>https://github.com/internetarchive/heritrix3
23:27:32<TheTechRobo>Er, i hope that clients dont treat NOTICEs as pings
23:27:55<TheTechRobo>Otherwise you just pinged 7 people :P
23:28:04<fireonlive>(hi everybody!)
23:28:09<TheTechRobo>s/treat/check/
23:28:21<@JAA>Some clients have options to not get pinged if more than N nicknames appear in the same message.
23:28:25<fireonlive>https://dl.fireon.live/irc/bd74f363a0838b55/hieverybody.gif
23:28:35<TheTechRobo>JAA: did you get pinged?
23:28:42<TheTechRobo>(Apart from now :P)
23:29:01<@JAA>Nope
23:29:35<@JAA>At least I don't think so.
23:29:46<@JAA>I had the window open anyway, so...
23:30:14<@JAA>Nope, doesn't ping me.
23:31:39<nulldata>*raises hand*
23:31:55<fireonlive>oop
23:35:53<nicolas17>it didn't ping me / highlight the window as having notifications
23:36:08<nicolas17>but *when* I opened the window, it showed this channel as having notifications
23:37:18<TheTechRobo>Interesting
23:42:34<fireonlive>weird

HomeSearchPrevious dayNext day