00:01:27Meli quits [Remote host closed the connection]
00:31:43HP_Archivist (HP_Archivist) joins
01:02:34dm4v_ joins
01:03:18dm4v quits [Ping timeout: 265 seconds]
01:03:18dm4v_ is now known as dm4v
01:03:19dm4v quits [Changing host]
01:03:19dm4v (dm4v) joins
01:10:49qwertyasdfuiopghjkl joins
01:43:25Stiletto quits [Ping timeout: 265 seconds]
02:04:25<pabs>https://www.adriancooney.ie/blog/web-scraping-via-javascript-heap-snapshots https://news.ycombinator.com/item?id=31205139
02:13:15HackMii quits [Remote host closed the connection]
02:14:31HackMii (hacktheplanet) joins
02:15:15AlsoHP_Archivist joins
02:19:21HP_Archivist quits [Ping timeout: 252 seconds]
02:27:11AlsoHP_Archivist quits [Client Quit]
02:56:41<@JAA>There are now consistently servers at Hetzner's SB for less than 1 EUR per TB per month. Neat.
02:57:08<@JAA>Not sure when that started, but when I checked a few months ago, I think it was hovering at a bit over 1 EUR.
02:58:18<@JAA>Unfortunately, the cheapest ones only have 4 disks, which is a bit meh for RAID.
03:01:01Arcorann (Arcorann) joins
03:32:40HackMii quits [Remote host closed the connection]
03:33:53HackMii (hacktheplanet) joins
04:00:56qwertyasdfuiopghjkl quits [Client Quit]
04:17:18qwertyasdfuiopghjkl joins
04:55:24BlueMaxima quits [Read error: Connection reset by peer]
04:56:31BlueMaxima joins
05:40:11<atphoenix>TheTechRobo, rewby, Try over 2k browser tabs. Thank goodness for the tab sleep feature on recent browsers. Chromium based Edge previously could handle that but something broke huge tab counts in Edge with an Windows update, where Explorer ends up hanging hard. Chrome and Brave seem mostly fine in the tab stratosphere. I haven't been able to get a Linux build that can handle anywhere close to as many tabs. Tab Manager Plus is my friend.
05:44:17Doranwen feels right at home with her multiple browsers with hundreds of tabs each XD
05:54:30<atphoenix>:D
05:56:21<atphoenix>I saw Free Guy last night. Have any of you seen it? It turned out to be better than I expected.
06:02:28DiscantX joins
06:04:01HackMii quits [Remote host closed the connection]
06:23:37<systwi>Ohhohoh, I'm too embarrassed to mention how many tabs I have open, spanned across multiple devices.
06:24:46<systwi>I also have a problem where I need an empty browser window for a different topic, so I end up with a lot of those, too.
06:34:05Mateon1 quits [Remote host closed the connection]
06:35:02Mateon1 joins
06:38:01<Ryz>This is why I just save all the links into text files in general instead of a ton of tabs >.>;
06:38:50<Ryz>Can use an extension to quickly scoop up all the tabs' URLs too
06:39:08<Ryz>!delay 19axqp84uezxme0w5b5r7o7tc 0 200
06:39:10<Ryz>Oops
06:39:21<pabs>systwi: I try to do that too, but I note that in Firefox at least, 10 windows of 10 tabs is cheaper memory wise than 100 windows of one tab
06:39:23<systwi>Ryz: Inter-request delay for job 19axqp84uezxme0w5b5r7o7tc set to [0, 200] ms.
06:39:28HackMii (hacktheplanet) joins
06:39:29<systwi>:-)
06:39:35<Ryz>lol
06:40:05<systwi>I can't help myself, I need to figure _some_ system out.
06:40:28<systwi>I never used to open windows like mad, some time between 2018 and now I started doing that.
06:40:59<systwi>Here's a real world example:
06:41:13<systwi>Oh, that song that just popped into my head, let's pull it up! New window!
06:41:26<systwi>Sidebar videos also look nice, open those in new tabs.
06:42:05<systwi>Okay, need to add these to a download list, I'll spend the next 1.5 hrs. copy+pasting URLs from the sidebar into a document.
06:42:13<systwi>(goes down a YT rabbit hole)
06:42:16<Ryz>xD
06:42:28<systwi>This channel, need to save these videos!
06:42:45<systwi>In the span of a day, that one-tab window now has 120 tabs.
06:43:06<systwi>And my RAM cries for mercy. ;_;
06:43:30<Ryz>The only time I would open a lot of tabs is if I accidentally use a tool from an extension that opens all of it at once x_x;
06:43:36<systwi>I think that's how I burned out one of my boot SSDs, the RAMdisk was constantly 60+GB on a 16GB system.
06:43:48<Ryz>*shudders* Accidentally opening all of the links from the dashboard (beta or stable)
06:44:00<systwi>Ohhhohohoh, yikes
06:44:12<atphoenix>systwi, story of my browsing experience. 'Oh that looks interesting...open tab' rinse and repeat until I need to go sleep, then continue the next day...
06:44:16<Ryz>It currently occurred only thrice~
06:45:09<systwi>atphoenix: Yes, yes, exactly!
06:45:35<Ryz>To clarify further on the text files technique, when it comes of links, I toss 'em in for me to archive via WBM SPN or ArchiveBot and then check it out later for an unspecific amount of time~ <.<;
06:46:06<atphoenix>and of course the next day I *try* to work down the backlog, but then there is more interesting stuff to check out. Or new issues at home that need research...and that leads to new tabs on said new topic.
06:46:08<systwi>And then you get to a point where you're afraid to open a specific browser because of how many windows/tabs are open in it, then you download a fresh, new browser and inevitably repeat the same mistakes.
06:46:50<atphoenix>I know all about the multiple browser, multiple device, mounds of tabs open in each, problem
06:46:51<systwi>Ryz: That's a good idea, I've returned to many tabs where the content is long gone. :-(
06:47:14<atphoenix>I like that submit-tab-links-to-AB thing...
06:47:27<Ryz>Heh, systwi, I came into ArchiveTeam, specifically ArchiveBot for that reason in the first place <#>;
06:47:30<atphoenix>if they were interesting to me, maybe someone else would find them interesting too
06:48:01<systwi>Yep, yep, and for me, you can also throw school and work and housework into that list -- things that interrupt my workflow and cause more tab hell.
06:48:23<atphoenix>I have text docs with lists of links of interesting stuff I previously had in tabs (before browsers could tolerate crazy tab counts)
06:49:00<atphoenix>same, systwi. work/home/school/anything that makes me turn my head 'SQUIRREL'
06:49:20<Ryz>Here's a sampling of my workflow when it comes to text files, specifically with the use of Notepad++ - https://transfer.archivete.am/kQHU9/notepad++_2022-04-29_23-46-41.png
06:49:35<systwi>:-)
06:50:38<atphoenix>I love Notepad++. Especially love it's autosave.
06:51:07<systwi>I like it, Ryz. At least you have it broken down into categories!
06:51:26<Ryz>Yeah, some of them are messy and huuuuuuuuuge though ><;
06:51:30<systwi>Looks like my NP++, also littered with half-saved, still-open documents from two, three years ago.
06:51:37<Ryz>Some by design, some I really really need to tackle more and more
06:52:17<systwi>atphoenix: I love its autosave and also the record-playback macros.
06:52:38<atphoenix>nice to see you have ready-to-go AB command strings
06:53:13<Ryz>Mhm, that's so I can reduce me having to manually all it out <#>;
06:53:52<systwi>Do you two also run out of disk space all the time, adding fuel to the fire?
06:53:52<Ryz>Just more or less prepare the websites or links to be archived
06:54:22<systwi>"Cool torrent pack!"
06:54:33<systwi>"Hey, what happened to that 2.5TB free space I had?"
06:54:38<atphoenix>systwi, what do you use the record/playback macros thing for?
06:55:03<atphoenix>yes I tend to burn disk
06:55:19<atphoenix>at least i did for a while
06:55:20<systwi>Text replacement, inserting lines every n lines, things like that.
06:56:15<atphoenix>things haven't been so bad recently, but I could easily change that if I stepped up private archiving
06:56:35<systwi>Or, a common one, take this string, prefix some text here, copy it and paste it here, append this, change foo to bar, and Bob's your uncle.
06:56:45<atphoenix>14 TB drives have helped a lot
06:57:26<systwi>I'm undergoing the process of managing it all in an SQL database that's, well, quite tough for me to automate.
06:57:46<systwi>I can add records for everything fine by hand, but expect 30 mins for one drive.
06:58:12<systwi>With a lot of back-and-forth between computers, and room for human error.
06:59:01<atphoenix>for various text manipulations, I tend to turn to Excel or Calc or Sheets, as writing formulas to do manipulations is second nature for me
06:59:31<atphoenix>restringing, destringing, matching, filtering
07:00:10<systwi>Ah, didn't think to try that. The NP++ macros have worked fine for most of my cases. I just record myself doing one step, then stop the recording and run it for the rest of the file.
07:00:35<systwi>*replay it for the rest of the file
07:02:23<Ryz>I tend to use some of the time saving techniques withe Notepad++ - like holding Alt while dragging the mouse cursor to select text content in a box, and macro recordings for me to space out links for progress pacing reasons
07:02:53<Ryz>I also like how when using the Find function, it lists all of the instances in a window~
07:03:01<Ryz>Either in one document or all of 'em
07:03:14<systwi>The regex find/replace is also really nice. :-)
07:04:15<systwi>(I'm sure `sed' would work fine for some of it, which I do use, depending on what OS I'm using at the time)
07:07:39<atphoenix>search in all notepad++ windows is a lifesaver
07:07:57<atphoenix>and it incentivizes me to not close tabs in there either
07:14:19<audrooku|m>If you need to search more quickly i find that emeditor can "find in files" for hundreds of gigs of tect
07:14:28<audrooku|m>Text*
07:14:28<audrooku|m>If you dont mind waiting 40 minutes
07:14:54<audrooku|m>Notepad++ will crash if you go amywhere near that big
07:15:18<systwi>Now I have to open a tab to look up 'emeditor'... <_>;
07:15:42<systwi>NP++ does have a BigFiles plugin you can download. I just found out about it earlier this week.
07:16:47<audrooku|m>Oh interesting, I was not aware, I had just read that at some point it would be very difficult for notepad++ to read a file without loading the ebtire thing into ram
07:16:50<audrooku|m>Entire *
07:18:32<systwi>From the description:
07:18:36<systwi>Reads very large files. It does this by only showing a small buffer of the file and let the user move back and forth in the page.
07:18:38<systwi>This is useful when you want to preview very large text files. Opening is done separately from Notepad++ and there is no option to save.
07:19:37<systwi>So, best for _reading_ files and not necessarily writing changes to them. Maybe that's just because my version of NP++ is a bit old? Maybe newer versions support newer versions of this plugin.
07:19:57<systwi>which in-turn support writing capabilities.
07:28:05<atphoenix>my tab count has just gone up by +2 thanks to you guys
07:28:27<systwi>Hehe, sorry.
07:28:45<systwi>If it helps, you don't have to download the plugin from a browser.
07:28:48<systwi>*web browser
07:29:06<systwi>Plugins > Plugins Admin > Available
07:29:22<systwi>Select it in the list and install.
08:05:43BlueMaxima quits [Client Quit]
08:43:35pabs quits [Client Quit]
08:45:51pabs (pabs) joins
09:48:31T31M quits [Quit: ZNC - https://znc.in]
09:49:19T31M joins
12:16:59<TheTechRobo>atphoenix: Hm. I've got a "Restore session" in Chromium with about six windows. Also another Firefox profile with something like 20 windows; got too much for me to handle so I've got another Firefox profile with 7 windows
13:27:25HP_Archivist (HP_Archivist) joins
13:34:40<Terbium>Hello my fellow tab hoarders. I have found my people. (I have 7000 tabs some ranging back to 2015 across Firefox, Firefox Dev, and Firefox Nightly)
13:36:32<Terbium>I was ostracized by my OCD coworker for my 7 windows of Chrome with 30 tabs each. :(
13:37:40<Terbium>I nightly recommend backing up your browser sessions regularly, ive had several close calls where I nearly lose all my tabs for data loss, accidental overwrites, etc)
13:37:47<Terbium>Highly*
13:38:22<Terbium>Also Tree Style Tab is a godsend on Firefox, let's you manage tabs in a tree structure
13:40:05<Terbium>For the advanced folks, there's tabfs which let's you treat your tabs as a database (mounts your tabs as a filesystem using FUSE, yes you read that correctly) and query/insert/process tabs in batch
13:41:38<Terbium>You can do crazy stuff like extract all the text for a queries list of tabs (query/filter using Linux tools like "find") to a text file
13:43:33sec^nd quits [Ping timeout: 252 seconds]
13:49:51<@JAA>Never heard of that before, but I love it. Everything is a file, after all. :-)
13:49:54sec^nd (second) joins
13:50:18<@JAA>But 7k tabs, damn...
13:50:42Iki1 quits [Ping timeout: 252 seconds]
13:51:29AlsoHP_Archivist joins
13:53:44HP_Archivist quits [Ping timeout: 265 seconds]
14:04:51DiscantX quits [Ping timeout: 265 seconds]
14:41:52<spirit>any idea how i can see the number of tabs i have open in firefox?
14:42:02<spirit>my tree scrolls quite a while :|
14:46:49Arcorann quits [Ping timeout: 252 seconds]
15:34:34Iki joins
15:40:49Meli (Meli) joins
15:51:22<Terbium>i use an extension to keep track (adds a number at the top right for the window)
15:51:44<Terbium>I also use duplicate tabs closer extension (i often get duplicate tabs just due to the sheer number)
15:52:29<Terbium>i reached 11k tabs last year before i forced myself to do spring cleaning (had like 300 tabs just full for websites to be archived that i forgot about and probably some are already dead lol)
16:02:07AlsoHP_Archivist quits [Client Quit]
16:02:16onetruth quits [Read error: Connection reset by peer]
16:11:42spirit quits [Quit: Leaving]
16:57:18<@JAA>I used to do that, keep tabs open for stuff I want to archive. Then I moved it to a messy text file. Then I moved it to Taskwarrior. It's still just as much of a mess though.
17:03:38spirit joins
17:31:43Chris5010 quits [Ping timeout: 265 seconds]
17:39:24<cptcobalt>hey, I'm struggling a tiny bit to open a particular archive team archived warc, curious if anybody has tips: I used `wget` and `gzip -d` to grab and download this file: `http://archive.org/download/archiveteam-mobileme-hero-2607x/archiveteam-mobileme-hero-2607x-26071.tar/.%2Fa%2Fan%2Fand%2Fandrey_kaplunenko%2Fpublic.me.com%2Fpublic.me.com-andrey_kaplunenko.warc.gz` and getting unexpected end of file
17:40:23<cptcobalt>(a friend and I are spelunking the MobileMe archive to see if we can find any old apple ads or marketing collateral that aren't *generally* available on the internet anymore, we've found *some* poking around here)
17:40:32<cptcobalt>any tips for this file though?
17:43:30<@JAA>That's on-topic and better suited for -bs.
17:53:54immibis quits [Remote host closed the connection]
17:53:54superkuh_ quits [Remote host closed the connection]
17:54:05superkuh_ joins
17:55:00immibis (immibis) joins
17:55:18immibis quits [Remote host closed the connection]
17:56:30immibis (immibis) joins
17:56:48immibis quits [Remote host closed the connection]
17:57:14immibis (immibis) joins
17:58:38<cptcobalt>sure!
18:08:06tzt quits [Ping timeout: 252 seconds]
18:09:45tzt (tzt) joins
19:08:41Stiletto joins
19:40:34spirit quits [Client Quit]
19:45:31DiscantX joins
20:00:56tzt quits [Ping timeout: 265 seconds]
20:27:10DiscantX quits [Ping timeout: 265 seconds]
20:47:52onetruth joins
22:27:34HackMii quits [Remote host closed the connection]
22:28:57HackMii (hacktheplanet) joins
22:40:28jess (jess) joins
23:06:09onetruth quits [Remote host closed the connection]
23:06:09@Fusl quits [Excess Flood]
23:06:09immibis quits [Remote host closed the connection]
23:06:09gazorpazorp quits [Remote host closed the connection]
23:06:10onetruth joins
23:06:14user_ (gazorpazorp) joins
23:06:15immibis (immibis) joins
23:06:51Fusl (Fusl) joins
23:06:51@ChanServ sets mode: +o Fusl
23:34:53HackMii quits [Remote host closed the connection]
23:36:53HackMii (hacktheplanet) joins
23:52:50tzt (tzt) joins