The new forums will be named Coin Return (based on the most recent vote)! You can check on the status and timeline of the transition to the new forums here.
The Guiding Principles and New Rules document is now in effect.

Filesystems!

electricitylikesmeelectricitylikesme Registered User regular
So I have recently learned a painful lesson: just because data is replaceable, doesn't mean you actually want to replace it if things go bad. Needless to say I will keep backups, but I'm done with my whacky ZFS-Virtual Box with physical disks file server setup (and am in the process of recovering what didn't get corrupted right now).

But I have a new conumdrum: what do I replace it with?

This is a home server, with no UPS, so I'd like to start with the assumption that at some point there will be a power failure.

The plan is to run software RAID6, on 8 1.5TB drives, under Ubuntu. But I don't know what filesystem to replace it with. The internet suggests ext3, XFS and ZFS. ZFS is out since I can't run OpenSolaris natively, and well, there seem to be some pretty nasty failure modes there.

So I'm wondering what the current thing with XFS seems to be (ext3 being the fallback). The internet suggests its reliable, but I see sporadic reports of it going down under heavy NFS loads and the like (but that's 2006 stuff).

Does anyone have any experiences or recommendations? I'm looking for the minimum of hassle.

electricitylikesme on

Posts

  • zeenyzeeny Registered User regular
    edited July 2010
    I can't find the resource, but I've had a friend suffer frequent data loss on recent files on (unfortunately also frequent) power failures with an XFS raid. I remember he initially assumed there is a problem with his setup and he looked for a solution before finding out it's an XFS limitation. He switched to ext3.
    I'd ask for his source and post again later.

    zeeny on
  • edited July 2010
    This content has been removed.

  • -Loki--Loki- Don't pee in my mouth and tell me it's raining. Registered User regular
    edited July 2010
    12tb of data for a home system. What... What the... What the hell are you storing? I've got a single 1tb drive, and with all my games, music, some movies, I've about filled it half way.

    -Loki- on
  • AridholAridhol Daddliest Catch Registered User regular
    edited July 2010
    ext3 has been plenty reliable and really unless there is a NEED for something else, why make the effort?
    Also I would imagine the resources available for things that do go wrong are fairly extensive.

    Aridhol on
  • GdiguyGdiguy San Diego, CARegistered User regular
    edited July 2010
    So can I ask... why is this not on a UPS?

    I mean, I can understand why many home PC's don't really want to bother... but a UPS that would cover the server would cost about as much as one of those 1.5 TB drives, and would avoid the entire frequent power loss problem

    Gdiguy on
  • edited July 2010
    This content has been removed.

  • PhyphorPhyphor Building Planet Busters Tasting FruitRegistered User regular
    edited July 2010
    Ext3 is a safe choice. I also like JFS

    Phyphor on
  • TincheTinche No dog food for Victor tonight. Registered User regular
    edited July 2010
    I'd say live a little and go with Btrfs, but according to Wikipedia RAID6-like parity based striping is still filed under "planned features". Maybe something to keep an eye on in the future.

    Also I remember reading somewhere native ZFS was available for Linux if you're willing to build it yourself. Don't know how mature or useful it is though.

    Tinche on
    We're marooned on a small island, in an endless sea,
    Confined to a tiny spit of sand, unable to escape,
    But tonight, it's heavy stuff.
  • PhyphorPhyphor Building Planet Busters Tasting FruitRegistered User regular
    edited July 2010
    Btrfs performance is currently not up to scratch, at least it wasn't a couple months ago

    Phyphor on
  • Monkey Ball WarriorMonkey Ball Warrior A collection of mediocre hats Seattle, WARegistered User regular
    edited July 2010
    Ext4 is pretty good. Just don't use an old kernel.

    You can also just use ext3, it's almost the same thing. You can always convert it to ext4 later.

    Monkey Ball Warrior on
    "I resent the entire notion of a body as an ante and then raise you a generalized dissatisfaction with physicality itself" -- Tycho
  • edited July 2010
    This content has been removed.

  • JaninJanin Registered User regular
    edited July 2010
    Ext4 isn't going to change the on-disk format; it's as stable as ext3 is.

    XFS and ext4 both have rumours of "data loss", which stem from the same source: ext3. Some Linux developers got used to a particular quirk of ext2/ext3 called "ordered data writes", and wrote their applications to depend on it, instead of using fsync(). Of course, more modern filesystems don't use ordered writes, so un-synced files written by broken applications were often corrupted during sudden power loss.

    Anybody who ran into this problem using XFS blamed the FS, since it's somewhat obscure, and went back to ext3. When ext4 was released and had the same problem, the app devs were mostly forced to fix their shit. Unless you're using old versions of low-quality applications, you probably don't have to worry about data loss in either XFS or ext4.

    Also: I tried XFS a year or so ago, and was happy enough with the FS itself, but tool support is poor. It's an unusual FS choice, so many utility developers don't bother testing with it. I ended up completely stymied trying to resize some XFS partitions, gave up, and went back to ext(3/4).

    Janin on
    [SIGPIC][/SIGPIC]
  • GrimReaperGrimReaper Registered User regular
    edited July 2010
    Most modern filesystems will do fine, ext3 etc are perfectly fine. If you're wanting reliability then yes, RAID6 is the way to go.

    I've heard lots of good things about FreeNAS. If you're wanting the minimum of hassle then freenas is definitely the way to go, I've only played about with it in a vm since the only raids I've set up recently were for high end servers with lots of fancy hardware. It seemed dirt easy to setup and maintain.

    GrimReaper on
    PSN | Steam
    ---
    I've got a spare copy of Portal, if anyone wants it message me.
  • edited July 2010
    This content has been removed.

Sign In or Register to comment.