| 00:09:25 | | hooway quits [Client Quit] |
| 01:26:00 | <hexa-> | so, I'm looking to doing private archiving of links if want to be able to reference again. Like pocket/pinboard/wallabag. I have a wallabag running, but it doesn't really that well maintained. |
| 01:26:16 | <hexa-> | I'm currently looking into ArchiveBox. Is it somewhat decent? |
| 01:27:20 | <hexa-> | Like I'm pretty sure wallabag was fine for the tagging and read-it-later use case, but it failed quite often at properly capturing the object in question. |
| 01:30:19 | <hexa-> | Or is there something else that you guys can recommend? |
| 02:00:01 | | Dallas quits [Client Quit] |
| 02:03:57 | | Dallas (Dallas) joins |
| 03:22:36 | | Stiletto joins |
| 03:23:24 | | Stilett0 quits [Ping timeout: 240 seconds] |
| 03:28:10 | <atphoenix> | hexa-, one option may be to use the IA browser extension that has an auto-submit feature for pages that aren't already saved in IA |
| 03:28:23 | <atphoenix> | that feature requires an IA account |
| 03:28:54 | <thuban> | atphoenix, link? |
| 03:29:43 | <@JAA> | I figured hexa- wants to run something on own hardware without relying on external services. |
| 03:30:40 | <thuban> | yeah, unfortunately i still haven't found a satisfactory option for that. |
| 03:31:26 | <atphoenix> | https://github.com/internetarchive/wayback-machine-webextension |
| 03:31:38 | <atphoenix> | "Save Page Now - Instantly save the page you are currently viewing in the Wayback Machine. Turn on Auto Save Page in settings to save pages that have not previously been saved. Must be logged in to use." |
| 03:31:54 | <atphoenix> | and "Bulk Save - Archive a list of URLs that you provide, or retrieve from bookmarks." |
| 03:32:06 | <atphoenix> | thuban^ |
| 03:32:49 | <thuban> | oh no, webex. |
| 03:33:12 | <thuban> | i guess i could dig around in the code and port it to pale moon, but. |
| 03:35:44 | <hexa-> | yeah, the purpose would be knowledge archival |
| 03:36:05 | <hexa-> | reading something, being able to reference it again, keeping thing together |
| 03:36:31 | <hexa-> | so putting stuff on IA is fine, but it lacks a tagging option for me |
| 03:36:53 | <atphoenix> | part of that is still being able to find the content itself if the site goes offline or changes, which the IA extension helps with |
| 03:36:58 | <hexa-> | also yeah, selfhosted is a key point of that |
| 03:37:07 | <atphoenix> | the tracking of what URLs you care about is a different problem |
| 03:37:30 | <atphoenix> | I'd also like a local option, but also don't have a good solution there |
| 03:37:36 | <hexa-> | fine, I'd be okay with both. Poking IA, but I want to store stuff that is dear to me local |
| 03:38:06 | <hexa-> | https://github.com/ArchiveBox/ArchiveBox https://archivebox.io/ |
| 03:38:10 | <hexa-> | this is what I'm currently looking at |
| 03:38:20 | <atphoenix> | I mean I guess you could create local WARCs and work with those |
| 03:38:36 | <hexa-> | what put me over the edge with wallabag was its handling of PDF |
| 03:39:51 | <atphoenix> | you could also use something like https://github.com/webrecorder/webrecorder-desktop |
| 03:40:36 | <atphoenix> | "The Webrecorder Desktop App is a complete packaging of Webrecorder hosted service as an Electron application, with an integrated Chromium browser." |
| 03:40:53 | <hexa-> | yikes |
| 03:41:23 | <hexa-> | I'd like some distance to Electron apps in general :D |
| 03:42:14 | <atphoenix> | is that a resource-reqs reason? |
| 03:42:39 | <hexa-> | that is a "I have a distate for the particular technology" reason |
| 03:43:40 | <hexa-> | Reasons against Electron are plentyful, I'd rather not go into them. They're well documented. |
| 03:46:29 | <hexa-> | Basically I wanted a hosted service on my private network, to which my browser or my smartphone can send requests to grab that |
| 03:46:48 | <hexa-> | I'm pretty happy with the integration wallabag offers in that regard |
| 03:47:06 | <hexa-> | On Android it simply offers a share intent |
| 03:47:23 | <hexa-> | and on Firefox I have an addon that allows me to grab and tag stuff |
| 03:49:08 | <atphoenix> | I'd like a solution that can run via a proxy (either explicitly configured, or transparent) that I point my browsers to. I don't have such a solution at present. |
| 03:55:48 | <hexa-> | they surely exist |
| 03:55:53 | <thuban> | ultimately i passed on archivebox because (a) i found it too opinionated about its output, (b) by relying on chrome/chromium for js-tolerant archival (and therefore preventing me from supplying my non-chrome cookies without PITA handwritten shimming) it for me loses most of its advantage over wpull, and (c) https://github.com/ArchiveBox/ArchiveBox/issues/239 (!!) |
| 03:55:59 | <hexa-> | https://github.com/internetarchive/warcprox comes to mind |
| 03:56:31 | <hexa-> | hah, 239 is a tough one :D |
| 03:57:52 | <anelki> | thuban: thanks for flagging that |
| 03:58:03 | <anelki> | i'd been meaning to look at archive box again for a while |
| 03:58:11 | <hexa-> | how could you avoid that without a) stripping js b) serving everything from different domains? |
| 03:58:29 | <hexa-> | because only domains separate XSS contexts ig |
| 03:58:31 | <@JAA> | IA has the same issue and doesn't care. |
| 03:58:40 | <hexa-> | ah ok |
| 03:59:09 | <anelki> | there's also the archival accounts on pinboard |
| 03:59:14 | <hexa-> | but from my POV IA is append-only, while archive box probably isn't |
| 03:59:14 | <@JAA> | Login works on archive.org, WBM is on web.archive.org, I'll let you figure out the rest. |
| 03:59:27 | <hexa-> | so since the admin interface and the content are on the same domain … RIP |
| 03:59:31 | <@JAA> | It's been reported to IA years ago, and nothing happened. |
| 04:02:35 | <@JAA> | Yeah, IA is effectively append-only, although your own account's data would still be at risk, and that includes 'saving snapshots to your account', whatever that actually means internally. |
| 04:02:55 | <thuban> | atphoenix: sounds like you want warcprox? |
| 04:03:09 | <@JAA> | The data would still be in the WBM, but you'd lose the list of favourites/bookmarks/whatever you want to call them. |
| 04:03:17 | <@JAA> | Not unsolvable, but ugh. |
| 04:03:23 | <hexa-> | yeah |
| 04:03:26 | <@JAA> | And of course, if your account has any actual data uploads... |
| 04:05:57 | | sec^nd quits [Ping timeout: 240 seconds] |
| 04:10:50 | | sec^nd (second) joins |
| 04:10:54 | <atphoenix> | thuban, thanks, I will look at that. |
| 04:44:49 | | qw3rty__ joins |
| 04:48:04 | | qw3rty_ quits [Ping timeout: 240 seconds] |
| 05:34:03 | | sec^nd quits [Remote host closed the connection] |
| 05:34:21 | | sec^nd (second) joins |
| 05:52:36 | | wickedplayer494 quits [Ping timeout: 252 seconds] |
| 07:36:52 | | wickedplayer494 (wickedplayer494) joins |
| 07:44:04 | | wessel1512 quits [Ping timeout: 252 seconds] |
| 07:52:04 | | wessel1512 joins |
| 08:06:55 | | VADemon joins |
| 08:09:22 | | wessel1512 quits [Ping timeout: 252 seconds] |
| 08:14:15 | | wessel1512 joins |
| 08:17:48 | | wessel1512 quits [Read error: Connection reset by peer] |
| 08:17:56 | | wessel1512 joins |
| 08:31:39 | | fieugh (fieugh) joins |
| 08:31:55 | <fieugh> | i can read instructions |
| 09:00:22 | | britmob2 quits [Quit: britmob2] |
| 09:50:36 | | hooway joins |
| 10:00:51 | <Matthww> | Are the statistics of every project saved? Or do they get removed after a project ended? |
| 10:08:01 | <@kiska> | The tracker stays forever or until redis decides to not function |
| 10:18:16 | <Matthww> | Do you know the tracker link for google+? |
| 10:20:22 | <Jake> | https://tracker.archiveteam.org/googleplus/ |
| 10:20:31 | <Matthww> | thanks |
| 10:20:58 | <Jake> | no problem! |
| 13:09:08 | | wessel1512 is now authenticated as wessel1512 |
| 13:50:33 | | britmob2 joins |
| 14:23:08 | | VADemon quits [Client Quit] |
| 14:32:16 | <@JAA> | themadpro: Stop posting random shit in #archiveteam. That channel should only be used for important announcements. Project-specific stuff, discussions, etc. never belong there. |
| 14:32:38 | <themadpro> | ok |
| 14:34:20 | <themadpro> | I'm sorry, just thought since it was directly related to the above message it wouldn't have been out of place to say the site was seemingly blocking traffic and that the people outside of #scrapevoat might want to take a look |
| 14:35:16 | <themadpro> | The good news is that it kind was resolved on its own, but fine |
| 14:35:24 | | themadpro agrees to respect the authority |
| 14:51:53 | | hooway quits [Client Quit] |
| 14:52:32 | | Arcorann_ quits [Ping timeout: 252 seconds] |
| 14:59:42 | | hooway joins |
| 15:44:50 | <sembiance> | How very odd. Searching google for this term yields exactly 0 results: solr uninvertiable |
| 15:45:03 | <sembiance> | guess I'll have to use duckduckgo :) |
| 15:49:50 | | VADemon joins |
| 17:46:44 | <themadpro> | Hey, this is a bit off-topic so I'm asking here |
| 17:46:51 | | Ajay quits [Remote host closed the connection] |
| 17:47:14 | <themadpro> | I can't seem to build `get-wget-lua.sh`. |
| 17:50:02 | <atphoenix> | themadpro, neither could I, on Ubuntu 20.04. I was able to get the docker image working, though. |
| 17:50:32 | <themadpro> | I have lua installed but I think there's something wrong with my CPPFlags? https://www.irccloud.com/pastebin/PJl7R44q/ |
| 17:50:52 | <atphoenix> | thus might be a #warrior topic, though |
| 17:50:54 | <themadpro> | atphoenix, yeah I'll probably docker image next time as well |
| 17:51:04 | <atphoenix> | this* |
| 17:58:23 | <@Kaz> | no idea what it looks for these days |
| 17:58:35 | <@Kaz> | the docker containers will work (and be much more reliable, too) |
| 18:33:04 | | VADemon quits [Ping timeout: 252 seconds] |
| 19:08:01 | <@kiska> | I think to get a good build, you need to |
| 19:08:01 | <@kiska> | apt-get update && apt-get install -y git-core libgnutls28-dev lua5.1 liblua5.1-0 liblua5.1-0-dev screen python-is-python2 bzip2 zlib1g-dev flex autoconf autopoint texinfo gperf python3 python3-pip lua-socket nload automake m4 pkg-config gcc g++ python3-setuptools zstd libzstd-dev libzstd1 |
| 19:14:21 | <@JAA> | Fusl has a Dockerfile for building wget-at somewhere. |
| 19:15:20 | <@JAA> | Can't find it in my logs because the filenames on xor.meo.ws are useless. |
| 19:20:04 | <@kiska> | :D |
| 19:20:28 | <@kiska> | Yeah how I feel when I tried to find the telegraf install script |
| 19:44:27 | <yano> | https://dtinth.github.io/comic-mono-font/ |
| 19:53:56 | | Ajay joins |
| 20:16:01 | | Mateon1 joins |
| 20:25:20 | <Mateon1> | Hey, I've heard that Mediafire will start removing inactive accounts and all they uploaded starting January 2021 |
| 20:25:28 | <Mateon1> | Source: https://twitter.com/textfiles/status/1339625133363912706 |
| 20:25:59 | <@JAA> | #mediaonfire |
| 20:26:01 | <Mateon1> | Let's say I have 8000+ mediafire links I'd like archived (extremely crude estimate), how would I go about archiving them |
| 20:26:27 | <Mateon1> | Should I re-ask there? |
| 20:26:48 | <@JAA> | Yeah |
| 20:32:10 | | Hackerpcs quits [Client Quit] |
| 20:33:57 | | Hackerpcs (Hackerpcs) joins |
| 23:04:30 | | godane (godane) joins |
| 23:12:27 | | Arcorann (Arcorann) joins |
| 23:12:37 | | Matthww8 joins |
| 23:12:37 | | Matthww quits [Read error: Connection reset by peer] |
| 23:12:37 | | Matthww8 is now known as Matthww |