00:00:37 | <thuban> | friends, considering that google drive is also at risk from google's inactive account purge, is #googlecrash functional enough to be revived on a submitted-items basis? |
00:01:44 | <thuban> | (alternatively, can archivebot be made to work with google drive links? i thought not--but some remarks on the wiki suggest otherwise--but they're old) |
00:04:41 | <@JAA> | AB can sort of grab individual files but not their metadata and I believe WBM playback sucks. Also, it doesn't work for some files, e.g. large ones that trigger a prompt due to Google not running a malware scan on them. |
00:04:56 | <@JAA> | But yeah, getting #googlecrash back running would be great. |
00:10:23 | | mossssss joins |
00:16:23 | | Megame1_ quits [Client Quit] |
00:18:30 | <pokechu22> | AB does work fine for larger files, I'm pretty sure |
00:19:32 | <pokechu22> | but on the other hand, I've seen AB get rate-limited once when downloading too many files (I don't remember the exact parameters that led to it though - I think it was related to the learnwithportals.com AB job?) |
00:20:04 | | mossssss quits [Remote host closed the connection] |
00:22:17 | <pokechu22> | For larger files the uc URL does show a prompt, but it's a link to another URL with a query parameter and AB handles that properly (I remember save page now having issues with that in the past though). I think you previously said it was implemented differently in the past and didn't work then though |
00:22:46 | <pokechu22> | but I've definitely done files on the order of a few hundred megabytes which definitely give that scanning prompt and they successfully save (which can be seen in the size on the AB dashboard) |
00:22:52 | <Vokun> | I'll sort through my urls again. I know Google drive creates drive.google.com, docs.google.com, and sites.google.com links. Are there any others? |
00:24:20 | <Vokun> | jamboard.google.com, script.google.com |
00:25:01 | <pokechu22> | What I'm talking about is only for files on drive.google.com - docs.google.com is different and much more scripty, and I don't know how it can be handled; sites.google.com is static and is perfectly fine for AB. I don't know anything about the other two |
00:25:31 | <@JAA> | pokechu22: Ah, but you need to know the verification token to find it again in the WBM, I guess. |
00:25:57 | <thuban> | docs is discussed at https://wiki.archiveteam.org/index.php/Google#Google_Docs_Editors but i have no idea how much of that information is still accurate |
00:25:58 | <pokechu22> | No, I'm pretty sure you can use the original uc URL to get the link to the new URL... will dig up an example |
00:26:11 | <@JAA> | Here's a random one: https://drive.google.com/uc?id=0B8zhxvoYK3WTVHNpTjNMUzRtTWM&export=download |
00:26:40 | <@JAA> | There's a random UUID in the prompt confirmation URL. |
00:27:12 | <pokechu22> | Right, but the link to that random UUID will be saved in an archivebot job for that URL |
00:27:30 | <pokechu22> | so you can follow that link on web.archive.org just as you would on the original site |
00:28:02 | <@JAA> | Right, if it stays alive long enough to wait for the WARC appearing on IA and extract the URL there, that'd work, I guess. |
00:28:27 | <@JAA> | Oh, or an !a would work, right. |
00:28:33 | <pokechu22> | Yeah |
00:28:44 | <@JAA> | I was thinking !ao the whole time. :-) |
00:29:24 | <pokechu22> | I *think* at one point there was a button that used a script to generate the confirmation link, in which case an !a wouldn't work, but it hasn't been that way for a few years |
00:31:35 | <pokechu22> | And the other thing about doing an !a is that it loads the sitemap and starts loading a bunch of other junk (there's also an infinite loop where it keeps adding share_facebook or something like that to the URL) |
00:32:05 | <@JAA> | Yeah, I was going to say, probably needs some ignores to make it not go nuts. |
00:32:14 | <pokechu22> | ok, here's an example: https://web.archive.org/web/20230617223758/https://drive.google.com/uc?id=10wcVXgR8t64kWrrpbNHRDx2M8X-zOF-y&export=download |
00:32:51 | <pokechu22> | The easiest approach is just to add ^ as an ignore once it's downloaded a large-looking file so that everything at that point gets ignored |
00:35:46 | | etnguyen03 (etnguyen03) joins |
00:36:33 | <@JAA> | Heh, yeah, that works. Unless the download fails, at least. |
00:40:15 | <kitonthenet> | For the blogger job, how many warrior jobs should/can/is useful to run? |
00:40:23 | <@JAA> | → #frogger |
00:44:04 | <Naruyoko5> | https://twitter.com/kogekidogso/status/1726622453424906649 Came across randomly, will stop operation on 12/3 and be deleted some time in the future. I don't know if this has anything worth saving or if its just ordinary personal account |
00:44:04 | <eggdrop> | nitter: https://nitter.net/kogekidogso/status/1726622453424906649 |
00:48:26 | <Pedrosso> | is it just this one twitter account? |
00:59:01 | <Naruyoko5> | In the post, they say the account's goal was to tell the situations of soccer rules and refereeing |
01:00:46 | <Naruyoko5> | There's also them answering various questions which you can find through the tag # querie_kogekidogso and separately from https://querie.me/user/r1OYTzyfrTY0Fn4ZIBXI4nEJPs63/recent |
01:01:28 | <Naruyoko5> | They have a link to their note account (https://note.com/goodcall_dogso/), but it seems defunct and unarchived so I don't know what that could have been |
01:03:18 | <Naruyoko5> | I don't know this person, so I don't know the situation |
01:04:47 | | nicolas17 quits [Ping timeout: 272 seconds] |
01:06:22 | <Naruyoko5> | Same name https://www.youtube.com/@user-ym7rm6vy4l/featured |
01:07:18 | <Naruyoko5> | Ah, they are also a writer of this newsletter https://die-acht.theletter.jp/ |
01:08:39 | | nicolas17 joins |
01:09:13 | | icedice quits [Client Quit] |
01:09:46 | | Wohlstand (Wohlstand) joins |
01:11:02 | <Naruyoko5> | Another Q&A site they seem to be on https://peing.net/ja/18kogekisoccer |
01:20:17 | | mossssss joins |
01:25:41 | | sarge quits [Ping timeout: 272 seconds] |
01:27:11 | | mossssss quits [Remote host closed the connection] |
01:28:23 | <fireonlive> | rewby: some stuff in #frogger for ya (|backup isn’t there) |
01:28:27 | | kitonthenet is now authenticated as kitonthenet |
01:32:55 | | mr_sarge (sarge) joins |
01:34:15 | | HP_Archivist (HP_Archivist) joins |
01:37:40 | | kitonthenet quits [Ping timeout: 265 seconds] |
01:38:21 | | AlsoHP_Archivist joins |
01:40:53 | | HP_Archivist quits [Ping timeout: 272 seconds] |
01:44:41 | | xarph quits [Ping timeout: 272 seconds] |
01:49:01 | | kitonthe1et joins |
01:58:14 | | emberquill08 quits [Quit: The Lounge - https://thelounge.chat] |
01:58:59 | | emberquill08 (emberquill) joins |
02:07:29 | | riku quits [Ping timeout: 272 seconds] |
02:14:27 | | etnguyen03 quits [Ping timeout: 272 seconds] |
02:29:50 | | etnguyen03 (etnguyen03) joins |
02:58:23 | | etnguyen03 quits [Ping timeout: 265 seconds] |
03:01:29 | <@JAA> | Naruyoko5: Are you sure it will stay online for some time after they 'stop operation'? |
03:09:22 | | etnguyen03 (etnguyen03) joins |
03:14:52 | | nic90 quits [Quit: The Lounge - https://thelounge.chat] |
03:15:00 | | ymgve joins |
03:15:50 | | nic90 (nic) joins |
04:02:45 | | nicolas17 quits [Ping timeout: 272 seconds] |
04:05:52 | | nicolas17 joins |
04:10:23 | <rktk> | Is Miraheze dying? |
04:10:38 | <rktk> | Their static content subdomain seems to be... failing? |
04:12:41 | | BlueMaxima quits [Client Quit] |
04:14:39 | <rktk> | 502 bad Gateway... |
05:00:52 | <h2ibot> | JAABot edited CurrentWarriorProject (+2): https://wiki.archiveteam.org/?diff=51177&oldid=51172 |
05:07:21 | | dumbgoy quits [Ping timeout: 272 seconds] |
05:07:42 | | ThetaDev quits [Client Quit] |
05:13:39 | | nicolas17 quits [Read error: Connection reset by peer] |
05:16:52 | | nicolas17 joins |
05:42:11 | | kitonthe1et quits [Ping timeout: 272 seconds] |
05:54:26 | | kitonthe1et joins |
06:01:34 | | kitonthe1et quits [Ping timeout: 265 seconds] |
06:03:15 | | Arcorann (Arcorann) joins |
06:04:48 | | etnguyen03 quits [Client Quit] |
06:12:27 | | kitonthenet joins |
06:15:26 | | c3manu (c3manu) joins |
06:19:33 | | kitonthenet quits [Ping timeout: 272 seconds] |
06:27:47 | | Jake quits [Ping timeout: 272 seconds] |
06:30:47 | | kitonthenet joins |
06:31:36 | | Jake (Jake) joins |
06:39:11 | | kitonthenet quits [Ping timeout: 272 seconds] |
06:40:38 | | datechnoman quits [Quit: The Lounge - https://thelounge.chat] |
06:41:27 | | datechnoman (datechnoman) joins |
06:42:18 | | negge_ quits [Remote host closed the connection] |
06:50:58 | | kitonthenet joins |
06:58:11 | | kitonthenet quits [Ping timeout: 272 seconds] |
07:04:13 | | Island quits [Read error: Connection reset by peer] |
07:09:56 | | kitonthenet joins |
07:17:11 | | kitonthenet quits [Ping timeout: 272 seconds] |
07:29:22 | | kitonthenet joins |
07:32:42 | | c3manu quits [Remote host closed the connection] |
07:39:21 | | kitonthenet quits [Ping timeout: 272 seconds] |
07:52:40 | | kitonthenet joins |
08:40:17 | | parfait (kdqep) joins |
08:47:21 | | kitonthenet quits [Ping timeout: 265 seconds] |
09:13:08 | | kiryu_ quits [Read error: Connection reset by peer] |
09:13:52 | | kiryu_ joins |
09:19:36 | | kitonthenet joins |
09:20:41 | | Dango360 quits [Ping timeout: 272 seconds] |
09:39:24 | | parfait quits [Remote host closed the connection] |
09:39:24 | | AlsoHP_Archivist quits [Remote host closed the connection] |
09:39:24 | | Wohlstand quits [Remote host closed the connection] |
09:39:30 | | Wohlstand (Wohlstand) joins |
09:39:31 | | AlsoHP_Archivist joins |
09:39:32 | | parfait (kdqep) joins |
09:49:54 | | Wohlstand quits [Client Quit] |
09:54:15 | | kitonthenet quits [Ping timeout: 272 seconds] |
09:55:04 | | kitonthe1et joins |
09:59:57 | | kitonthe1et quits [Ping timeout: 272 seconds] |
10:00:01 | | Bleo182 quits [Client Quit] |
10:01:18 | | Bleo182 joins |
10:11:43 | | kitonthe1et joins |
10:14:18 | | bf_ quits [Remote host closed the connection] |
10:15:29 | | AlsoHP_Archivist quits [Read error: Connection reset by peer] |
10:15:29 | | atphoenix_ quits [Read error: Connection reset by peer] |
10:15:30 | | BearFortress quits [Read error: Connection reset by peer] |
10:15:41 | | BearFortress joins |
10:15:47 | | fuzzy8021 quits [Read error: Connection reset by peer] |
10:15:54 | | Naruyoko5 quits [Read error: Connection reset by peer] |
10:16:10 | | atphoenix_ (atphoenix) joins |
10:16:11 | | Naruyoko5 joins |
10:16:16 | | AlsoHP_Archivist joins |
10:16:17 | | fuzzy8021 (fuzzy8021) joins |
10:18:38 | | Earendil7 quits [Client Quit] |
10:18:54 | | Earendil7 (Earendil7) joins |
10:18:57 | | kitonthe1et quits [Ping timeout: 272 seconds] |
10:19:55 | | aninternettroll_ (aninternettroll) joins |
10:19:55 | | aninternettroll quits [Read error: Connection reset by peer] |
10:20:04 | | aninternettroll_ is now known as aninternettroll |
10:30:05 | | kitonthenet joins |
10:37:50 | | riku (riku) joins |
10:38:35 | | kitonthenet quits [Ping timeout: 272 seconds] |
10:50:28 | | kitonthe1et joins |
10:55:41 | | riku quits [Ping timeout: 272 seconds] |
10:56:33 | | bf_ joins |
10:57:18 | | riku (riku) joins |
10:58:51 | | kitonthe1et quits [Ping timeout: 272 seconds] |
10:59:12 | | bf_ quits [Remote host closed the connection] |
11:00:20 | | kitonthenet joins |
11:12:15 | | Megame (Megame) joins |
11:32:45 | | parfait quits [Remote host closed the connection] |
11:32:45 | | Naruyoko5 quits [Remote host closed the connection] |
11:32:45 | | AlsoHP_Archivist quits [Remote host closed the connection] |
11:32:45 | | atphoenix_ quits [Remote host closed the connection] |
11:32:45 | | Megame quits [Remote host closed the connection] |
11:32:52 | | Naruyoko5 joins |
11:32:55 | | Megame (Megame) joins |
11:32:58 | | parfait (kdqep) joins |
11:33:02 | | AlsoHP_Archivist joins |
11:33:21 | | atphoenix_ (atphoenix) joins |
11:47:41 | | ThetaDev joins |
11:50:09 | | kitonthenet quits [Ping timeout: 272 seconds] |
12:01:36 | | kitonthe1et joins |
12:12:46 | | kitonthe1et quits [Ping timeout: 265 seconds] |
12:19:48 | | bf_ joins |
12:28:08 | | kitonthenet joins |
12:41:27 | | Arcorann quits [Ping timeout: 272 seconds] |
12:43:00 | | bogsen joins |
12:48:03 | | bogsen quits [Changing host] |
12:48:03 | | bogsen joins |
12:57:14 | | parfait quits [Ping timeout: 265 seconds] |
12:58:24 | | mattx433 (mattx433) joins |
12:59:04 | | bogsen is now authenticated as bogsen |
13:01:04 | | bf_ quits [Remote host closed the connection] |
13:23:55 | | Peroniko (Peroniko) joins |
13:23:55 | | Peroniko quits [Max SendQ exceeded] |
13:24:34 | | Peroniko (Peroniko) joins |
13:24:34 | | Peroniko quits [Max SendQ exceeded] |
13:25:01 | | Peroniko (Peroniko) joins |
13:35:49 | | eroc1990 quits [Quit: The Lounge - https://thelounge.chat] |
13:36:15 | | eroc1990 (eroc1990) joins |
13:40:59 | | itachi1706 quits [Ping timeout: 272 seconds] |
13:41:13 | | kitonthenet quits [Ping timeout: 265 seconds] |
13:47:47 | | itachi1706 (itachi1706) joins |
13:49:33 | | kitonthenet joins |
13:51:13 | | ScenarioPlanet (ScenarioPlanet) joins |
14:01:54 | | etnguyen03 (etnguyen03) joins |
14:05:27 | | Peroniko quits [Client Quit] |
14:07:19 | | kitonthenet quits [Ping timeout: 265 seconds] |
14:08:51 | | itachi1706 quits [Ping timeout: 272 seconds] |
14:10:40 | | itachi1706 (itachi1706) joins |
14:17:32 | | kitonthenet joins |
14:40:27 | | VerifiedJ quits [Remote host closed the connection] |
14:40:59 | | VerifiedJ (VerifiedJ) joins |
15:00:58 | <h2ibot> | JAABot edited CurrentWarriorProject (-2): https://wiki.archiveteam.org/?diff=51178&oldid=51177 |
15:19:54 | | kitonthenet quits [Read error: Connection reset by peer] |
15:19:59 | | kitonthe2et joins |
15:37:42 | | kitonthe2et quits [Ping timeout: 265 seconds] |
15:44:02 | | kitonthe1et joins |
16:00:57 | | kitonthe1et quits [Ping timeout: 272 seconds] |
16:08:41 | | jonty_ is now known as jonty |
16:26:27 | | Nulo|m joins |
16:45:13 | | JensRex is now known as Jens |
16:56:03 | | etnguyen03 quits [Ping timeout: 272 seconds] |
16:56:30 | | dumbgoy joins |
16:57:43 | | Island joins |
17:05:58 | | kitonthenet joins |
17:24:33 | | kitonthenet quits [Ping timeout: 272 seconds] |
17:34:26 | | c3manu (c3manu) joins |
17:45:27 | | tzt quits [Ping timeout: 272 seconds] |
17:46:55 | | Megame quits [Client Quit] |
17:52:13 | | tzt (tzt) joins |
18:11:25 | | useretail quits [Ping timeout: 272 seconds] |
18:14:08 | | Wohlstand (Wohlstand) joins |
18:18:22 | | lennier2_ joins |
18:21:33 | | lennier2 quits [Ping timeout: 272 seconds] |
18:30:40 | | Dango360 (Dango360) joins |
18:30:50 | <fireonlive> | +rss- Binance Founder Changpeng Zhao Agrees to Step Down, Plead Guilty: https://www.wsj.com/finance/currencies/binance-ceo-changpeng-zhao-step-down-plead-guilty-01f72a40 https://news.ycombinator.com/item?id=38366729 |
18:39:13 | | etnguyen03 (etnguyen03) joins |
18:45:47 | | kitonthe1et joins |
18:54:47 | | DogsRNice joins |
19:18:17 | | Craigle quits [Quit: The Lounge - https://thelounge.chat] |
19:18:51 | | Craigle (Craigle) joins |
19:31:21 | | Megame (Megame) joins |
19:43:37 | | Barto quits [Read error: Connection reset by peer] |
19:43:42 | | Barto_ (Barto) joins |
19:45:02 | | Barto_ is now known as Barto |
20:05:49 | <nicolas17> | JAA: did you fix grab-site-docker yet? |
20:06:41 | | Megame quits [Ping timeout: 272 seconds] |
20:10:18 | | etnguyen03 quits [Ping timeout: 265 seconds] |
20:11:01 | <@JAA> | nicolas17: No, got stuck last night and was getting tired. I might just do a stupid fix and include the `pip freeze` output from my working image as a requirements.txt for the time being. |
20:11:14 | <@JAA> | But I'd like to fix this 'properly'. |
20:57:20 | | ScenarioPlanet quits [Remote host closed the connection] |
20:57:21 | | atphoenix_ quits [Remote host closed the connection] |
20:57:21 | | DogsRNice quits [Remote host closed the connection] |
20:57:21 | | Wohlstand quits [Remote host closed the connection] |
20:57:28 | | DogsRNice joins |
20:57:29 | | Wohlstand (Wohlstand) joins |
20:57:31 | | ScenarioPlanet (ScenarioPlanet) joins |
20:57:50 | | atphoenix_ (atphoenix) joins |
21:12:50 | <that_lurker> | Could someone grab https://neil-gaiman.tumblr.com/ at somepoint |
21:18:27 | <that_lurker> | Mainly for the sake of archival, but he did also do the thing you don't currently do and commented on the israel sizuation, but that is most likely not going to cause anything but a small uproar in the comments |
21:45:19 | | BlueMaxima joins |
22:21:57 | | Megame (Megame) joins |
22:43:26 | | kitonthe3et joins |
22:43:26 | | kitonthe1et quits [Read error: Connection reset by peer] |
22:45:23 | | c3manu quits [Remote host closed the connection] |
22:52:49 | | etnguyen03 (etnguyen03) joins |
22:53:55 | | Wohlstand quits [Remote host closed the connection] |
22:53:55 | | DogsRNice quits [Remote host closed the connection] |
22:54:00 | | DogsRNice joins |
22:54:02 | | Wohlstand (Wohlstand) joins |
22:58:52 | <fireonlive> | that'd be igset singletumblr yeah? |
22:59:18 | <fireonlive> | it was! |
23:00:21 | | datechnoman quits [Client Quit] |
23:01:40 | | ell (ell) joins |
23:02:02 | | datechnoman (datechnoman) joins |
23:26:49 | | etnguyen03 quits [Ping timeout: 272 seconds] |
23:32:20 | | itachi1706 quits [Ping timeout: 265 seconds] |
23:33:31 | | itachi1706 (itachi1706) joins |
23:33:53 | | BlueMaxima quits [Read error: Connection reset by peer] |
23:36:14 | | mossssss joins |
23:39:38 | | etnguyen03 (etnguyen03) joins |