| 02:46:00 | <instence_> | I'm setting up slack in vmware, obviously for archiving. Would reiser be a better option than ext4? |
| 02:47:00 | <instence_> | due to smaller files, and number of files |
| 02:50:00 | <chronomex> | for large files it usually doesn't matter |
| 02:50:00 | <chronomex> | reiser tends to win at many teeny files |
| 02:54:00 | <instence_> | yea this is going to be for website archiving specifically, so I guess I will go with reiser |
| 02:54:00 | <instence_> | I wasn't aware ext3 had a files/folder limitation of 5,000 without htrees |
| 02:55:00 | <instence_> | Have been reading this overview guide, which is great: |
| 02:55:00 | <instence_> | http://www.serverfocus.org/reiserfs-vs-ext4-vs-xfs-vs-zfs-vs-btrfs |
| 02:55:00 | <chronomex> | I usually build my boxes with jfs |
| 02:55:00 | <chronomex> | solid as a rock, not fancy performance but it's consistent |
| 02:56:00 | <instence_> | ah, cool, yea slack supports it |
| 02:58:00 | <instence_> | I used to do website archiving in windows, and for the past year or more a lot of the tasks on my plate have been non-recurssive in nature. Static targetted grabs. |
| 02:58:00 | <instence_> | However with windows wget being stuck on 1.11.4, without css parsing, I have to get something setup in linux to take advantage of newer wget builds |
| 02:59:00 | <instence_> | There have been "experimental" wget builds of newer versions but I don't trust them |
| 03:00:00 | <instence_> | I think I will test out reiser for now, and keep IBM's jfs in mind for a future test run |
| 03:01:00 | <chronomex> | jfs has never let me down |
| 03:01:00 | <chronomex> | reiser has weirded on me once, but I was not treating it nicely |
| 03:01:00 | <chronomex> | zfs totally fucked me over |
| 03:02:00 | <chronomex> | ext4 hasn't weirded on me but its performance isn't great |
| 03:02:00 | <instence_> | if I run into any issues with reiser, i will switch to jfs |
| 03:03:00 | <instence_> | what are some things to watch out for with reiser shitting the bed? |
| 03:04:00 | <instence_> | I'm basically going to be doing a process of archive a single site, tar it, pulling it down from FTP over local network to another box for link checking and post processing. |
| 03:04:00 | <SketchCow> | ....kills your wife |
| 03:04:00 | <instence_> | lol |
| 03:04:00 | <chronomex> | I never had actual reportable shit with reiser |
| 03:04:00 | <chronomex> | it was just a bit tricky to manage |
| 03:04:00 | <chronomex> | iirc |
| 03:04:00 | <chronomex> | this was years ago and I was in high school |
| 03:04:00 | <instence_> | ah |
| 03:22:00 | <Aranje> | If you figure smaller files and large numbers of files, probably. Does it matter? not really. |
| 03:22:00 | <Aranje> | cause the latest 3.x's have data loss issues. issue boiled up in ext4 that hasn't been fixed yet |
| 03:22:00 | <Aranje> | literally. the issue is triggered when the ext4 journal isn't written out on reboot or something. |
| 03:22:00 | <Aranje> | not an issue if you don't reboot every 10 seconds |
| 03:22:00 | <Aranje> | though... what kernel? |
| 03:22:00 | <Aranje> | seems legit |
| 03:22:00 | <Aranje> | chronomex:) what issues did you have with zfs? |
| 03:23:00 | <chronomex> | zfs-fuse transmuted a large number of symlinks, but not all of them, into regular files with size 0 and permissions 0000 |
| 03:31:00 | <Aranje> | I uh what |
| 03:31:00 | <Aranje> | yeah that sucks |
| 03:31:00 | <Aranje> | we use zfs on our fbsd servers |
| 03:31:00 | <Aranje> | cause it does something Sue likes |
| 06:30:00 | <ersi> | haha, website archiving from windows |
| 06:43:00 | <Sue> | use the native zfs module instead |
| 06:43:00 | <Sue> | it's much more stable |
| 06:44:00 | <Sue> | haven't checked it in a while, dedup w/ large pages and snapshots hopefully have been added |
| 08:59:00 | <SmileyG> | zfs on linux chronomex ? |
| 08:59:00 | <SmileyG> | Oh, zfs-fuse |
| 09:48:00 | <Frigolit> | SmileyG: there's a kernel patch for ZFS as well |
| 09:48:00 | <SmileyG> | Frigolit: I know. |
| 09:48:00 | <SmileyG> | I know the guy whos doing it :D |
| 09:48:00 | <Frigolit> | ah :3 |
| 09:48:00 | <SmileyG> | Thats why I was asking, hes doing quite well tbh (I do love to rib him over it as he proper evangalises over ZFS) |
| 09:48:00 | <Frigolit> | hehe |
| 09:49:00 | <SmileyG> | He's in NY tho, he lost power on his ipad after the storm and hasn't yet reappeared. I'm pretty sure he's fine though |
| 09:49:00 | <Frigolit> | :| |
| 09:49:00 | <Frigolit> | yea let's hope so |
| 09:49:00 | <SmileyG> | I do wonder about americas infrastructure tho |
| 09:50:00 | <SmileyG> | Does seem so very fragile. |
| 09:50:00 | <Frigolit> | indeed |
| 09:50:00 | <Frigolit> | speaking of zfs though, i'm not sure i'd use in-kernel zfs either at this point, seems about as stable as america's infrastructure |
| 09:51:00 | <Frigolit> | for now i'd rather go for fbsd |
| 09:51:00 | <Frigolit> | could go for solaris but... no... NO! |
| 09:59:00 | <SketchCow> | Is this -bs? |
| 09:59:00 | <Frigolit> | it is not! |
| 09:59:00 | | Frigolit walks over there |
| 10:00:00 | <SketchCow> | I'll answer this one thing, though. |
| 10:00:00 | <SketchCow> | America's infrastructure: Not Fragile |
| 10:00:00 | <SketchCow> | The issue is: |
| 10:00:00 | <SketchCow> | America's Infrastructure - We're a huge-ass fucking country |
| 10:00:00 | <SmileyG> | Well yeah that too |
| 10:00:00 | <Frigolit> | true |
| 10:01:00 | <SmileyG> | I think I suddenly realised what happens |
| 10:01:00 | <SmileyG> | due to being a realtively young country. |
| 10:02:00 | <SmileyG> | Do you ever demolish stuff over there? Like "en mass" ? |
| 10:02:00 | <Frigolit> | less OT, anyone knows how well btrfs works? i'm trying to figure out the best setup for a future fileserver |
| 10:02:00 | | SmileyG goes to -bs |
| 20:05:00 | <SketchCow> | --------------------------------------------- |
| 20:05:00 | <SketchCow> | So, we're looking at doing an Archive Team Kickstarter |
| 20:06:00 | <SketchCow> | Would love suggestions for rewards |
| 20:06:00 | <SketchCow> | --------------------------------------------- |
| 20:06:00 | <mistym> | Ooh. I need to try to think of smth |
| 20:15:00 | <deathy> | what's the goal of the kickstarter? |
| 20:15:00 | <deathy> | also.. |
| 20:15:00 | <deathy> | Jason's hat |
| 20:15:00 | <deathy> | hat that looks like Jason's hat |
| 20:16:00 | <deathy> | old HDDs used for important projects (like WOW server auction :) ) |
| 20:18:00 | <mistym> | That's a good idea. |
| 20:18:00 | <mistym> | Some high reward tier should be the obligatory "archive team dinner" with SketchCow, etc. |
| 20:29:00 | <DFJustin> | http://archiveteam.org/index.php?title=Kickstarter_Prizes |
| 20:54:00 | <SketchCow> | Thanks for reminding me of that, DF |
| 21:05:00 | <flaushy> | SketchCow: pins :) |
| 21:06:00 | <soultcer> | Will this be a real kickstarter at kickstarter.com? |
| 21:06:00 | <flaushy> | is the logo from the wiki the "official" archiveteam logo? |
| 21:08:00 | <alard> | Expert archiving by the Archive Team of a website of your choice? |
| 21:11:00 | <mistym> | flaushy: It ought to be. |
| 21:11:00 | <mistym> | I'd stick a high-res poster of that on my office wall. |
| 21:13:00 | <mistym> | Though I'd probably be forced to cover up the right-hand corner with another poster or smth |
| 22:03:00 | <Dark_Star> | I don't get it. Kickstarter? what for? |
| 22:21:00 | <Coderjoe> | Dark_Star: we put a lot of stuff up on archive.org, and they don't run on happy thoughts and fairy dust. |
| 22:44:00 | <SketchCow> | This willbe a real kickstarter. |
| 22:53:00 | <soultcer> | Nice |
| 22:57:00 | <bsmith094> | SketchCow: what is that pic on twitter? |
| 22:57:00 | <bsmith094> | http://t.co/z0c62yMF |
| 23:19:00 | <SketchCow> | My editing box. |
| 23:19:00 | <SketchCow> | The one I'm on now (although all my IRC is through a different server) |