HomeSearchPrevious dayNext day

00:07:02nepeat quits [Client Quit]
00:07:42etnguyen03 (etnguyen03) joins
00:09:40nepeat (nepeat) joins
00:27:38<pabs>arkiver JAA - whats the status of #// and AB Tor onion services support?
00:29:55<@JAA>pabs: #// has a (technically separate) project for Tor stuff.
00:30:51<@JAA>AB supports it in principle, but we don't have such a pipeline currently.
00:31:16StarletCharlotte quits [Ping timeout: 255 seconds]
00:32:16<pabs>ok. I'm now monitoring the AB websocket to stash the URLs AB is finding
00:32:23<@JAA>('AB supports it' is perhaps a bit simplistic, but it can be made to work, and we've had such pipelines before.)
00:32:39<pabs>currently only got gopher:// gemini:// URLs stashed tho :)
00:33:09<@JAA>Are those even reported on the WebSocket?
00:33:59Mateon2 joins
00:34:14StarletCharlotte joins
00:34:57<pabs>no, I got them from the portal.mozz.us http/html proxy to gopher/etc
00:35:15<@JAA>Ah yeah.
00:35:16<pabs>well, I don't know TBH, but IIRC no
00:35:19Mateon1 quits [Ping timeout: 255 seconds]
00:35:19Mateon2 is now known as Mateon1
00:35:41<@JAA>Yeah, I don't think so.
00:35:54<@JAA>They might appear in the log file, but not sure about that either.
00:36:55<pabs>I think mailto does but others don't or something like that
00:40:45etnguyen03 quits [Client Quit]
01:02:21<h2ibot>PaulWise edited SmolNet (+275, some more site lists): https://wiki.archiveteam.org/?diff=53273&oldid=53271
01:12:31BlueMaxima quits [Read error: Connection reset by peer]
01:24:18etnguyen03 (etnguyen03) joins
01:31:03nws quits [Remote host closed the connection]
01:31:22nws (nws) joins
01:33:22StarletCharlotte quits [Ping timeout: 255 seconds]
01:35:31e joins
01:36:19e quits [Client Quit]
01:54:56nickofnicks quits [Remote host closed the connection]
02:01:39etnguyen03 quits [Client Quit]
02:02:48etnguyen03 (etnguyen03) joins
02:09:23newnew2 joins
02:09:38newnew2 quits [Client Quit]
02:26:33StarletCharlotte joins
02:48:18etnguyen03 quits [Remote host closed the connection]
03:03:20wyatt8750 joins
03:04:16wyatt8740 quits [Ping timeout: 255 seconds]
03:15:17<Ryz>Urgent? YouTube channels to automatically have metadata text be translated, can only be out-opt: https://github.com/iv-org/invidious/issues/4811
03:17:39nickofnicks (nickofnicks) joins
03:30:48DLoader quits [Changing host]
03:30:48DLoader (DLoader) joins
03:41:47Guest54 quits [Client Quit]
03:46:07Wohlstand quits [Ping timeout: 255 seconds]
03:57:16Larsenv quits [Excess Flood]
03:57:40Larsenv (Larsenv) joins
04:10:12Island quits [Read error: Connection reset by peer]
04:15:02nickofnicks quits [Remote host closed the connection]
04:18:31rktk quits [Ping timeout: 255 seconds]
04:20:38rktk (rktk) joins
04:38:47nickofnicks (nickofnicks) joins
05:34:07nicolas17 quits [Ping timeout: 255 seconds]
05:43:34nickofnicks quits [Ping timeout: 255 seconds]
05:44:01Macsteel quits [Remote host closed the connection]
05:47:55nickofnicks (nickofnicks) joins
06:05:37rktk quits [Ping timeout: 255 seconds]
06:11:01rktk (rktk) joins
06:20:55nickofnicks quits [Ping timeout: 255 seconds]
06:30:29Blu__ joins
06:49:03nickofnicks (nickofnicks) joins
06:50:22<@arkiver>an AB Tor pipeline would be awesome though
06:59:55JaffaCakes118 (JaffaCakes118) joins
07:05:49<that_lurker>Does WB show Tor addresses
08:09:49igloo22225 quits [Ping timeout: 255 seconds]
08:14:05beastbg8_ quits [Read error: Connection reset by peer]
08:15:36za3k quits [Quit: ZNC 1.8.2+deb3.1 - https://znc.in]
08:24:02Kinille quits []
08:35:48za3k joins
08:41:13za3k quits [Client Quit]
08:41:29za3k joins
08:43:34Blu__ quits [Ping timeout: 255 seconds]
08:55:25za3k quits [Client Quit]
09:00:04Bleo1826007227196 quits [Client Quit]
09:01:30Bleo1826007227196 joins
09:09:02za3k joins
09:15:03za3k quits [Client Quit]
09:22:03za3k joins
09:25:12Radzig quits [Remote host closed the connection]
09:30:19za3k quits [Client Quit]
09:32:49<@arkiver>that_lurker: yes
09:35:30za3k joins
09:35:48<that_lurker>\o/
09:39:22nickofnicks quits [Ping timeout: 255 seconds]
09:41:34Radzig joins
09:45:03nickofnicks (nickofnicks) joins
09:47:26za3k quits [Client Quit]
09:57:49Radzig quits [Ping timeout: 255 seconds]
10:00:31nickofnicks quits [Ping timeout: 255 seconds]
10:06:30qwertyasdfuiopghjkl_ joins
10:07:43qwertyasdfuiopghjkl quits [Ping timeout: 255 seconds]
10:08:21qwertyasdfuiopghjkl_ is now known as qwertyasdfuiopghjkl
10:10:37za3k joins
10:15:05nickofnicks (nickofnicks) joins
10:32:28nickofnicks quits [Ping timeout: 255 seconds]
10:35:48Kinille (Kinille) joins
10:42:16Shjosan quits [Quit: Am sleepy (-, – )…zzzZZZ]
10:43:37Shjosan (Shjosan) joins
10:53:10yawkat quits [Ping timeout: 255 seconds]
10:59:58yawkat (yawkat) joins
11:00:00Bleo1826007227196 quits [Client Quit]
11:01:24Bleo1826007227196 joins
11:11:20nickofnicks (nickofnicks) joins
11:12:24Radzig joins
11:35:52Blu__ joins
11:51:01Blu__ quits [Read error: Connection reset by peer]
11:55:07SkilledAlpaca quits [Client Quit]
11:56:25SkilledAlpaca4 joins
13:11:37Perk72 quits [Client Quit]
13:19:05hexa- quits [Quit: WeeChat 4.2.2]
13:23:10Perk72 joins
13:27:09hexa- (hexa-) joins
13:43:49HP_Archivist (HP_Archivist) joins
13:54:50AlsoHP_Archivist joins
13:57:40HP_Archivist quits [Ping timeout: 255 seconds]
14:14:17knecht4 joins
14:28:49<knecht4>hey, i built a small tool to archive new comments on a public website as the mods are a bit trigger happy with the delete button. currently i'm using https://github.com/overcast07/wayback-machine-spn-scripts to throw the links into SPN, however i hit daily limit of 5 captures if there are multiple comments on the same post.
14:28:59<knecht4>any ideas of what to do? maybe use another archive website? i want them to be publicly accessible
14:36:39AlsoHP_Archivist quits [Client Quit]
14:40:02nicolas17 joins
14:43:34yawkat quits [Ping timeout: 255 seconds]
14:54:17Guest54 joins
15:02:05BearFortress joins
15:04:43BearFortress_ quits [Ping timeout: 255 seconds]
15:43:52nickofnicks quits [Ping timeout: 255 seconds]
15:44:26nickofnicks (nickofnicks) joins
15:53:25Island joins
16:05:01nickofnicks quits [Ping timeout: 255 seconds]
16:07:31nickofnicks (nickofnicks) joins
16:41:12<Exorcism>for #archivebot, I don't know if this has been archived or not or if it will be possible to archive this: https://storage.googleapis.com/pi100t/index.html 👀
16:43:05<Ryz>Hmm, time for archiving user reviews on Steam too? o: https://store.steampowered.com/news/app/593110/view/4326355263805583415
16:43:13<Ryz>140 million Steam user reviews, whooooa oO;
16:43:42<Ryz>Basically they'll be hiding less useful reviews and show more useful reviews on app pages through a variety of systems
16:44:22<Ryz>...Which means the way the content is shown and curated will change how they're viewed starting right now compared to before
16:44:39<Ryz>The problem is, need help on trying to extract how to get the reviews
16:44:54<Ryz>Even though it's numerical, uhh, there's some stuff that's in the way
17:04:29<nicolas17>Exorcism: technically it seems straightforward to archive, but it also seems kind of useless? :P
17:05:37<@JAA>Yeah, let's not.
17:23:48yawkat (yawkat) joins
17:24:05<Ryz>Would anyone be willing to help me extract Steam user reviews in some way?
17:31:25yawkat quits [Ping timeout: 255 seconds]
17:36:18yawkat (yawkat) joins
17:47:57shgaqnyrjp_ is now known as shgaqnyrjp
18:09:32Island quits [Read error: Connection reset by peer]
18:15:04yawkat quits [Ping timeout: 255 seconds]
18:15:15Island joins
18:23:36yawkat (yawkat) joins
19:23:10StarletCharlotte quits [Remote host closed the connection]
19:25:16HP_Archivist (HP_Archivist) joins
19:25:31StarletCharlotte joins
19:52:43HP_Archivist quits [Ping timeout: 255 seconds]
20:02:05qwertyasdfuiopghjkl quits [Client Quit]
20:02:31qwertyasdfuiopghjkl (qwertyasdfuiopghjkl) joins
20:11:23<thuban>knecht4: if it's safe to batch them, you could use spn's bulk interface at savepagenow@archive.org (or request the lists in #archivebot, but that requires manual handling by someone with privileges).
20:11:30<thuban>but it sounds like you're concerned about the speed of deletion, so perhaps request in #// that a feed be added to urls-sources? (we do something similar for hacker news: https://github.com/ArchiveTeam/urls-sources/blob/master/60_tech_link_forums.txt)
20:17:10<knecht4>Thanks for the reply. It would indeed be more of a real time thing, new comments get announced in an IRC channel and I'd like to capture them asap to preserve them.
20:17:21<knecht4>So I don't have a list of comments in that sense.
20:20:37<thuban>you could adapt your current automation setup to publish one. (that said afaik we haven't done any such 'third-party' feeds before)
20:23:50<knecht4>Hm yeah the site sadly doesn't offer a "new comments" feed
20:24:03<knecht4>It does list the recent comments in the front page though
20:26:22<thuban>that _might_ work, given deduplication--but you should post the link and ask in #//
20:28:13<thuban>Ryz: i am willing to do some scripting if you have an idea of what you're looking for (but i don't know much about steam or have an account)
20:33:05<knecht4>Thanks thuban I'll try that!
20:33:05celestial_ quits [Client Quit]
20:41:46StarletCharlotte quits [Ping timeout: 255 seconds]
20:43:16celestial joins
21:06:13etnguyen03 (etnguyen03) joins
21:09:10HP_Archivist (HP_Archivist) joins
21:12:11HP_Archivist quits [Client Quit]
21:28:03hackbug quits [Remote host closed the connection]
21:35:12nws quits [Remote host closed the connection]
21:35:33nws (nws) joins
21:35:34BlueMaxima joins
22:28:18BlueMaxima quits [Read error: Connection reset by peer]
23:15:44etnguyen03 quits [Client Quit]
23:31:07etnguyen03 (etnguyen03) joins
23:41:40simon8162 quits [Client Quit]
23:50:51simon816 (simon816) joins
23:55:41<thuban>we may want to contact staff at forums.thesims.com, as it's now blocking archivebot
23:57:53<@JAA>> The intent is to provide ArchiveBot with a sense of pride and accomplishment for triggering rate limits.
23:58:30<thuban>:<
23:59:19<thuban>(the "community lead" said of the read-only transition "This is an operation carried out by the forum host and not by EA staff", so that probably also goes for the shutdown--but i think it makes more sense to go through ea than to try to ask vanilla directly)
23:59:31<pokechu22>That's been an issue with other vanilla sites too; their rate limiting is weird
23:59:38<thuban>oh?

HomeSearchPrevious dayNext day