HomeSearchPrevious dayNext day

00:51:14<tomodachi94>Does anyone know what came of the archivebot job for https://transfer.archivete.am/KlnAM/urls.txt? I can't seem to find it in the online job viewer.
00:55:45<pokechu22>I only see an !ao job for that (which had ID 43d2nngn5drxu6lnhvn6nipx8), not an !ao < list job, so looks like nobody's done anything with it yet. I'll do so now
00:58:13<tomodachi94>@pokechu22: Judging from logs in #archivebot, looks like it already finished. Thanks for checking though!
00:59:30<pokechu22>The !ao on it already finished, but that's only saving the file itself and not the links from it
01:00:19<tomodachi94>Ah, hmm.
01:02:02<tomodachi94>Actually wait @pokechu22, I've just identified some issues with the URL list. I used regex to parse it instead of a proper JSON parser + regex. I'll fix that and have a new one in 5-10 minutes.
01:02:20<pokechu22>alright, I'll abort the old one in the mean time
01:05:20leo60228 quits [Client Quit]
01:05:42leo60228 (leo60228) joins
01:16:49BlueMaxima joins
01:29:18<tomodachi94>@pokechu22 here's the new one: https://transfer.archivete.am/Afd7n/urls.txt.bak.1
01:29:57<tomodachi94>It's related to #robloxd (the group was acquired; see https://wiki.archiveteam.org/index.php/Roblox#Group_sales)
01:31:12<pokechu22>running it now
01:56:25icedice quits [Client Quit]
02:07:35Hackerpcs quits [Quit: Hackerpcs]
02:09:40Hackerpcs (Hackerpcs) joins
02:19:15BigBrain quits [Remote host closed the connection]
02:45:00Aoede quits [Quit: ZNC - https://znc.in]
02:45:22Aoede (Aoede) joins
03:29:19dumbgoy_ quits [Ping timeout: 265 seconds]
03:38:58<h2ibot>JustAnotherArchivist edited Deathwatch (+107, /* 2023 */ Update SoylentNews): https://wiki.archiveteam.org/?diff=49858&oldid=49847
03:41:59<h2ibot>Knot126 edited FurAffinity (+355, More forum closure info): https://wiki.archiveteam.org/?diff=49859&oldid=49260
04:02:58<tomodachi94>@pokechu22: Thanks, much appreciated.
05:05:55Island quits [Read error: Connection reset by peer]
05:07:21railen63 quits [Remote host closed the connection]
05:07:36railen63 joins
05:10:22<pabs>bit.io acquired: https://www.databricks.com/blog/welcoming-bit-io-databricks-investing-developer-experience https://news.ycombinator.com/item?id=36127230
05:11:03<pabs>"bit.io is sunsetting on June 29"
05:15:11hackbug quits [Quit: Lost terminal]
05:17:09hackbug (hackbug) joins
05:17:28<nicolas17>"bit.io has distinguished itself by offering a remarkably user-friendly interface, a frictionless sign-up experience, and straightforward workflows, so we're shutting it down, screw you all"
05:29:45<fireonlive>xD
05:30:11<fireonlive>i love tech but holy fuck i hate it so much at the same
05:30:18<fireonlive>..time
06:10:32Doomahol1 quits [Ping timeout: 252 seconds]
06:17:03bf_ joins
06:37:04<tomodachi94>@TheTechRobo this is really random, but do you have any tools for getting URL lists from Discord servers? I noticed there was a note about it on https://wiki.archiveteam.org/index.php/URLs .
06:49:58<fireonlive>i've been using https://github.com/Tyrrrz/DiscordChatExporter but if there's something better i'm allllllll ears
06:50:19<fireonlive>literally microphone man
06:50:39<tomodachi94>fireonlive: I've been using "discord history tracker" combined with some hacky regexes. I don't think DCE works on Linux unfortunately :(
06:50:53<tomodachi94>I was wondering if there was a AT tool :)
07:01:39<fireonlive>oh neat i'll check it out
07:01:47<fireonlive>and it does work on the linux
07:01:59<fireonlive>i ue the CLI version with docker mainly
07:02:13<fireonlive>oh the GUI is windows only it seems
07:02:19<fireonlive>CLI is more portable
07:12:52<tomodachi94><fireonlive> "i ue the CLI version with docker..." <- I couldn't get the CLI to work on Linux, might try again tomorrow
07:13:12<fireonlive>hm it's been a little while for me
07:13:20<fireonlive>i might have to try again
07:13:30<fireonlive>it was this year though
07:13:35Ivan226 quits [Ping timeout: 265 seconds]
07:21:39Ivan226 joins
07:25:46BlueMaxima quits [Read error: Connection reset by peer]
07:36:30mrg joins
07:40:14mrg quits [Remote host closed the connection]
07:47:56Arcorann (Arcorann) joins
07:53:41Doomahol1 joins
07:54:51Indo joins
08:00:58Chris50102 (Chris5010) joins
08:02:56Chris5010 quits [Ping timeout: 252 seconds]
08:02:56Chris50102 is now known as Chris5010
08:03:39Indo quits [Remote host closed the connection]
08:04:48Indo joins
08:29:57@rewby quits [Ping timeout: 265 seconds]
08:58:32<that_lurker>https://www.techradar.com/news/apple-shuts-my-photo-stream-on-july-26-so-make-sure-you-dont-lose-your-photos
09:00:33Indo quits [Remote host closed the connection]
09:00:56<h2ibot>JAABot edited CurrentWarriorProject (-4): https://wiki.archiveteam.org/?diff=49860&oldid=49820
09:22:20Ruthalas5 quits [Client Quit]
09:22:40Ruthalas5 (Ruthalas) joins
09:35:12icedice (icedice) joins
09:40:53Chris50105 (Chris5010) joins
09:42:56Chris5010 quits [Ping timeout: 265 seconds]
09:42:56Chris50105 is now known as Chris5010
09:51:46AmAnd0A quits [Remote host closed the connection]
09:51:58AmAnd0A joins
10:00:06<h2ibot>JAABot edited CurrentWarriorProject (+4): https://wiki.archiveteam.org/?diff=49861&oldid=49860
10:03:24sdsds joins
10:03:44sdsds quits [Remote host closed the connection]
10:39:29Ruthalas5 quits [Ping timeout: 252 seconds]
11:01:36Ruthalas5 (Ruthalas) joins
11:07:02Ruthalas5 quits [Ping timeout: 265 seconds]
11:24:21Ruthalas5 (Ruthalas) joins
11:34:45decky_e quits [Remote host closed the connection]
11:35:52rewby (rewby) joins
11:35:52@ChanServ sets mode: +o rewby
11:57:02G4te_Keep3r3492 quits [Ping timeout: 252 seconds]
12:00:44Icyelut (Icyelut) joins
12:04:59G4te_Keep3r3492 joins
12:13:00<TheTechRobo>tomodachi94: Used to use DHT, but DCE is a lot better because you don't need a browser. I used to use discard2 for its high fidelity archives, but it's currently borked.
12:13:11<TheTechRobo>Then I extract urls with https://github.com/TheTechRobo/discord-urls-extractor .
12:17:57VerifiedJ quits [Remote host closed the connection]
12:18:31VerifiedJ (VerifiedJ) joins
12:42:15PredatorIWD joins
12:42:29PredatorIWD quits [Remote host closed the connection]
12:43:13Nulo quits [Ping timeout: 265 seconds]
12:45:26sonick quits [Client Quit]
12:48:12AmAnd0A quits [Ping timeout: 252 seconds]
12:48:36AmAnd0A joins
13:31:46<h2ibot>PaulWise edited CVE References (+65, AB job was completed): https://wiki.archiveteam.org/?diff=49862&oldid=49807
13:32:16<pabs>todb, anarcat: the CVE refs AB job finally completed. lots of data WARCs uploaded, but the meta WARC with the log of all requests isn't yet
13:32:24<pabs>this is the AB job: https://archive.fart.website/archivebot/viewer/job/10p5i
13:32:29e joins
13:32:35pabs updated the wiki to point at it too
13:32:47e quits [Remote host closed the connection]
13:35:02<pabs>JAA: for the twitter links in the CVE refs, could we use queueh2ibot to feed socialbot snscrape twitter-profile commands?
13:35:26<anarcat>pabs: nice
13:35:49<pabs>since we can't archive the individual URLs in the twitter refs list, I figure archiving users is the next best option https://transfer.archivete.am/EZdNi/cve-twitter-refs.txt
13:37:10railen63 quits [Remote host closed the connection]
13:40:41railen63 joins
13:41:36railen63 quits [Remote host closed the connection]
13:41:51railen63 joins
13:45:09hitgrr8 joins
13:46:29Arcorann quits [Ping timeout: 252 seconds]
13:46:31<pabs>https://torrentfreak.com/iconic-torrent-site-rarbg-shuts-down-all-content-releases-stop-230531/
14:10:00BigBrain (bigbrain) joins
14:14:03sonick (sonick) joins
14:37:18Island joins
14:37:28AmAnd0A quits [Read error: Connection reset by peer]
14:37:42AmAnd0A joins
14:50:08<tomodachi94><TheTechRobo> "Then I extract urls with https:/..." <- Oh nice, I'll definitely use this tool in the future!
15:02:52imer quits [Client Quit]
15:05:08AmAnd0A quits [Ping timeout: 252 seconds]
15:05:27AmAnd0A joins
15:09:39AmAnd0A quits [Read error: Connection reset by peer]
15:09:53AmAnd0A joins
15:36:49imer (imer) joins
15:39:19decky_e (decky_e) joins
15:41:45<@arkiver>icedice: there is always the site itself that could be archived
15:41:53<@arkiver>but they took it down immediately :/
15:42:00<icedice>Yup
15:42:17<icedice>The torrents are rehosted on other sites and tagged
15:42:29<icedice>So the torrent files could probably be grabbed
15:43:55<icedice>https://github.com/2004content/2004content.github.io
15:44:09<icedice>^ Magnet links for a lot of RARBG releases
15:44:22<icedice>Possibly everything posted to RARBG
15:48:26<icedice>inb4 someone posts it to Reddit and gets the GitHub repo DMCA'd
15:49:37gullah joins
15:50:47decky_e quits [Ping timeout: 252 seconds]
15:51:10decky_e (decky_e) joins
15:59:45c3manu (c3manu) joins
16:09:37gullah quits [Remote host closed the connection]
16:25:34<ThreeHM>They have a bunch of mirrors that are still working: https://rarbg.tw/
16:36:28<icedice>I haven't seen that one before
16:36:39<icedice>Is it a new one or a third-party mirror?
16:40:02<ThreeHM>No idea, seems to just be a page with links to other mirrors
17:00:01HiccupJul (HiccupJul) joins
17:00:23<h2ibot>JAABot edited CurrentWarriorProject (-4): https://wiki.archiveteam.org/?diff=49863&oldid=49861
17:01:18<HiccupJul>the grab-site readme suggests using ReplayWeb.page to browse the produced WARC files, but its very slow to load the (~50GB) warc. is there something faster?
17:10:59nicolas17 quits [Ping timeout: 265 seconds]
17:15:04nicolas17 joins
17:16:47nicolas17 quits [Read error: Connection reset by peer]
17:17:23nicolas17 joins
17:19:53<masterX244>web version is slow, get the electron app, that is faster for some reason
17:20:28<masterX244>(had to use it recently, too to check some WARCs from a crawl, had to understand something for preparing another sweep run)
17:20:59<fireonlive>rarbg's message: https://rarbg.to/index80.php
17:21:37MetaNova quits [Ping timeout: 265 seconds]
17:22:14<fireonlive>oh torrentfreak reposted it
17:22:28<fireonlive>but there's the mouth of the horse, so to speak
17:24:04Pingerfowder quits [Quit: ZNC - https://znc.in]
17:24:55Pingerfowder (Pingerfowder) joins
17:50:42dragon joins
17:57:35dragon quits [Remote host closed the connection]
18:02:26MetaNova (MetaNova) joins
18:02:26nicolas17 quits [Read error: Connection reset by peer]
18:03:41nicolas17 joins
18:10:54lukash quits [Quit: The Lounge - https://thelounge.chat]
18:16:49lukash joins
18:26:23railen63 quits [Ping timeout: 265 seconds]
18:29:38yano1 quits [Client Quit]
18:32:57icedice quits [Read error: Connection reset by peer]
18:33:40yano (yano) joins
18:34:19Dango360 (Dango360) joins
18:35:14_Dango360 quits [Ping timeout: 252 seconds]
18:47:25Void0 (Void0) joins
18:48:18<Void0>Anyone manage to backup rarbg before it shut down (sadly there was no announcement ahead of time)?
18:50:04decky_e quits [Ping timeout: 265 seconds]
18:50:33decky_e (decky_e) joins
18:55:35systwi quits [Ping timeout: 252 seconds]
19:02:41<@JAA>pabs, that_lurker: Please add those things to Deathwatch.
19:02:54JohnnyJ joins
19:03:08<@JAA>(Re bit.io and that Apple stuff)
19:03:23<@JAA>pabs: How many accounts are we talking there?
19:03:52<@JAA>queueh2ibot is really designed for AB, not socialbot.
19:05:08<fireonlive>is h2ibot opensource?
19:05:25<fireonlive>if not i'm just wondering how it 'listens to itself' in terms of telling itself !a
19:16:30<@JAA>fireonlive: h2ibot is an instance of http2irc, which is open-source, yes. It relays the messages sent via POST directly to GET listeners. No IRC roundtrip.
19:18:09<fireonlive>oh that sounds super interesting
19:18:12<fireonlive>thanks! i'll check it out
19:19:11<@JAA>If hackint supported echo-message, it could be done that way, which I would actually prefer, because it would also confirm successful message delivery.
19:19:37<fireonlive>is that a new IRCv3 thing?
19:19:44<@JAA>Alas, it doesn't, so instead, there's a regular PING to confirm that the connection's still alive, and then messages sent prior to that ping are considered successfully sent.
19:19:48<@JAA>Yeah
19:19:51<fireonlive>ahh
19:19:57<@JAA>Well, not very new, but not implemented in Charybdis.
19:20:06<fireonlive>ah man i remember charybdis
19:20:24<fireonlive>and atheme :)
19:20:30<@JAA>A migration to Solanum has been on the wishlist for a while now.
19:20:35<@JAA>That would also have echo-message.
19:20:52<fireonlive>echo-message sounds quite useful in bot cases
19:21:34<@JAA>Not just bots. You can also give a normal user an indication that their message was delivered.
19:21:45<@JAA>E.g. display it in grey until confirmed or whatever.
19:21:45<fireonlive>ah, very true
19:22:08<fireonlive>im glad the modernization of IRC is something that's happening
19:22:13<@JAA>Plus, with server-time, you also get the 'true' time of when the message was sent.
19:23:39<fireonlive>oh yeah i see that in the spec
19:23:44<fireonlive>huh; yeah that's nice
19:23:49<fireonlive>makes ordering etc easier
19:24:56<fireonlive>a lot of my teens was just IRC fun; bots/servers/bots that pretended to be servers/etc. it's cool to come back to it later :)
19:25:49<fireonlive>and still see it in use/thriving for things! such as apparently Google's SRE uses it because it's just.. better/easier/quicker lol
19:42:36lexikiq joins
19:49:40icedice (icedice) joins
19:53:42icedice quits [Client Quit]
19:53:54Void0 quits [Client Quit]
19:55:19Nulo joins
19:58:34<masterX244>dangit... need to get a referer set on a grab-site listcrawl to get past a fuckyou-redirect
20:04:46Void0 (Void0) joins
20:09:35decky_e quits [Remote host closed the connection]
20:24:37Webuser549 joins
20:29:25Webuser549 is now known as CA101
20:29:58icedice (icedice) joins
20:35:23<icedice>Seems like it was probably legal trouble on the horizon that made RARBG shut down, a newly passed law in Bulgaria where RARBG is based criminalizes piracy site operators with up to six years in prison: https://old.reddit.com/r/trackers/comments/13wvi3y/rarbg_shut_down_after_bulgaria_passed_a_law/
20:46:45CA101 quits [Remote host closed the connection]
21:05:27c3manu quits [Client Quit]
21:07:42hitgrr8 quits [Client Quit]
21:08:03<HiccupJul>masterX244: i'm afraid the electron version of savepage.now was too slow too.
21:08:14<HiccupJul>replayweb.page i mean
21:18:35<masterX244>odd...
21:19:26<@JAA>Electron being slow? No way...
21:20:13<fireonlive>can't be!
21:20:24<fireonlive>i mean 99% of companies wouldn't use it if it was slow right
21:20:46<@JAA><for_the_better_right.png>
21:21:36<fireonlive>totes
21:52:35decky_e (decky_e) joins
21:56:21dumbgoy_ joins
21:59:08<HiccupJul>is there a good tool that isn't replayweb.page?
21:59:16<HiccupJul>i assume there must be
22:00:56<@JAA>pywb is decent.
22:04:47decky_e quits [Ping timeout: 252 seconds]
22:05:15decky_e (decky_e) joins
22:07:12<HiccupJul>thanks, i'll try that
22:07:43spirit joins
22:09:41decky_e quits [Read error: Connection reset by peer]
22:10:09decky_e (decky_e) joins
22:12:20decky_e quits [Remote host closed the connection]
22:22:39<@OrIdow6>Anyone looked into Egloos (on DW, June 16)?
22:27:03siinus quits [Quit: rage quit]
22:30:14<flashfire42>A toast to our fallen comrade RARBG
22:31:33<joepie91|m>:(
22:32:41<@arkiver>OrIdow6: a bit, not much yet
22:51:13<@OrIdow6>arkiver: I may try doing it myself then
22:51:55<@OrIdow6>May end up just being a #Y affair or similar
22:53:32<icedice>TorrentGalaxy seems like a great site
22:53:38<icedice>They just need more users
22:53:55<icedice>This should give them a boost
22:54:17<icedice>Hopefully they can scale up with more uploads eventually fill some of the void
22:54:33decky_e (decky_e) joins
23:00:53AmAnd0A quits [Ping timeout: 252 seconds]
23:01:06<@arkiver>OrIdow6: alright sounds good!
23:01:53AmAnd0A joins
23:03:03AmAnd0A quits [Read error: Connection reset by peer]
23:03:23AmAnd0A joins
23:04:47@rewby quits [Ping timeout: 265 seconds]
23:14:17Larsenv quits [Quit: ZNC 1.8.2+deb2build5 - https://znc.in]
23:15:29HiccupJul quits [Client Quit]
23:18:28Larsenv (Larsenv) joins
23:38:03<pabs>JAA: 277 twitter accounts in the cve-twitter-refs.txt file
23:42:07Larsenv quits [Client Quit]
23:45:52Larsenv (Larsenv) joins
23:49:27yts98 leaves
23:49:34yts98 joins
23:49:35<h2ibot>PaulWise edited Deathwatch (+250, add bit.io): https://wiki.archiveteam.org/?diff=49864&oldid=49858
23:51:34yts98 leaves
23:51:37yts98 joins
23:55:44<tomodachi94>Do Imgur URLs from #archivebot get sent to h2ibot?
23:59:34yts98 leaves
23:59:37yts98 joins

HomeSearchPrevious dayNext day