The new forums will be named Coin Return (based on the most recent vote)! You can check on the status and timeline of the transition to the new forums here.
The Guiding Principles and New Rules document is now in effect.

USB Flash drive RAID

NubsauceNubsauce Registered User regular
edited August 2007 in Games and Technology
Yup. I'm gonna do it. I'd like to do it with windows XP... but so far have had no luck.

Anyone who's tried this before will tell you "you can't make a removable drive dynamic" which is the first step to making a drive part of a RAID in windows. A buddy and I are currently working on rewriting the drivers for a Sony Microvault 2GB thumb drive, so that windows sees it as a normal magnetic hard drive, but its slow going. Anyone have any other ideas for making this work in windows?

Also, yeah, I know it's easier to do in Linux (we're trying to get it going with Kubuntu at present) but unfortunately, neither of us are all that great with Linux. We're kinda' grasping at straws (so to speak) when it comes to the actual terminal. If you know of a good guide on how to go about raiding removable drives (or any drives) in Kubuntu, please post a link to it. :)

Cheers!

[SIGPIC][/SIGPIC]
Nubsauce on

Posts

  • dispatch.odispatch.o Registered User regular
    edited August 2007
    Why?

    dispatch.o on
  • HAKdragonHAKdragon Registered User regular
    edited August 2007
    Do you know what's more pointless than Flash Drive RAID? Floppy Drive RAID

    HAKdragon on
    hakdragon.png
  • redfenixredfenix Aka'd as rfix Registered User regular
    edited August 2007
    noob question. How do you write/edit drivers, anyway?
    What programming is it in?

    It just seems like some kind of deep magic that governs the proper implementation hardware.

    redfenix on
  • RohaqRohaq UKRegistered User regular
    edited August 2007
    HAKdragon wrote: »
    Do you know what's more pointless than Flash Drive RAID? Floppy Drive RAID
    He also did Sony Memory Stick RAID too :D

    Rohaq on
  • NubsauceNubsauce Registered User regular
    edited August 2007
    dispatch.o wrote: »
    Why?

    I own/operate a Technical Consulting company, and we're working on creating a more stable way to store images of our customer's computers (for backup service we provide). Solid state is more stable and reliable than magnetic storage (hard drives), so we want to raid as many solid state drives as we can to store the images.
    redfenix wrote: »
    noob question. How do you write/edit drivers, anyway?
    What programming is it in?

    It just seems like some kind of deep magic that governs the proper implementation hardware.

    We were editing a C based driver, and editing the .inf file that controlled the device tags that utilized the compiled C driver.

    In other words, yes, deep magic.

    Nubsauce on
    [SIGPIC][/SIGPIC]
  • JerikTelorianJerikTelorian Registered User regular
    edited August 2007
    Nubsauce wrote: »
    dispatch.o wrote: »
    Why?

    I own/operate a Technical Consulting company, and we're working on creating a more stable way to store images of our customer's computers (for backup service we provide). Solid state is more stable and reliable than magnetic storage (hard drives), so we want to raid as many solid state drives as we can to store the images.
    redfenix wrote: »
    noob question. How do you write/edit drivers, anyway?
    What programming is it in?

    It just seems like some kind of deep magic that governs the proper implementation hardware.

    We were editing a C based driver, and editing the .inf file that controlled the device tags that utilized the compiled C driver.

    In other words, yes, deep magic.

    While I see your point about solid state being more reliable, and I believe faster, isn't this painfully cost inefficient? I mean, magnetic storage price-per-gig can go well below $1, but flash memory runs at $10/gig and higher.

    I mean, for the same cost as making a 1tb flash RAID, you could make a 10tb magnetic RAID, or 10 1tb RAIDs, giving you up to 10x backup. I mean, hard rives fail, but 10 drives all at the same time? It's pretty unlikely.

    JerikTelorian on
    SteamID -- JerikTelorian
    XBL: LiquidSnake2061
    Shade wrote: »
    Anyone notice how some things (mattresses and the copy machines in Highrise) are totally impenetrable? A steel wall, yeah that makes sense, but bullets should obliterate copy machines.

    I don't know about you, but I always buy a bullet proof printer. Its a lot more expensive, but I think the advantages are apparent.
  • NubsauceNubsauce Registered User regular
    edited August 2007
    Nubsauce wrote: »
    dispatch.o wrote: »
    Why?

    I own/operate a Technical Consulting company, and we're working on creating a more stable way to store images of our customer's computers (for backup service we provide). Solid state is more stable and reliable than magnetic storage (hard drives), so we want to raid as many solid state drives as we can to store the images.
    redfenix wrote: »
    noob question. How do you write/edit drivers, anyway?
    What programming is it in?

    It just seems like some kind of deep magic that governs the proper implementation hardware.

    We were editing a C based driver, and editing the .inf file that controlled the device tags that utilized the compiled C driver.

    In other words, yes, deep magic.

    While I see your point about solid state being more reliable, and I believe faster, isn't this painfully cost inefficient? I mean, magnetic storage price-per-gig can go well below $1, but flash memory runs at $10/gig and higher.

    I mean, for the same cost as making a 1tb flash RAID, you could make a 10tb magnetic RAID, or 10 1tb RAIDs, giving you up to 10x backup. I mean, hard rives fail, but 10 drives all at the same time? It's pretty unlikely.


    while you make a good point sir, It's not just about stability, its also to see if we can do it. It may cost a lot, but its kinda fun just to see what we can do with it... not to mention that the price of flash memory is plummeting. Don't you remember when 4GB drives were $150? thats a lot more than $10/gig.

    Nubsauce on
    [SIGPIC][/SIGPIC]
  • JerikTelorianJerikTelorian Registered User regular
    edited August 2007
    Well, I think the esoteric angle is a good one, so keep it up, if only for that.

    And yeah, the price is falling, but I'd still be wary to use the them as a primary storage medium, at least for now.

    JerikTelorian on
    SteamID -- JerikTelorian
    XBL: LiquidSnake2061
    Shade wrote: »
    Anyone notice how some things (mattresses and the copy machines in Highrise) are totally impenetrable? A steel wall, yeah that makes sense, but bullets should obliterate copy machines.

    I don't know about you, but I always buy a bullet proof printer. Its a lot more expensive, but I think the advantages are apparent.
  • jackaljackal Fuck Yes. That is an orderly anal warehouse. Registered User regular
    edited August 2007
    I could see the use for a low-cost super-fast raid flash drive. If a company could make something along the lines of a 5 gig drive that transfers 50 MB/s it would be huge time saver for people who have to save huge (but not HD video huge) files often but who cannot afford all the usual HD RAID stuff.

    jackal on
  • DeusfauxDeusfaux Registered User regular
    edited August 2007
    jsut look for the article where they did that with 5 ipod shuffles

    Deusfaux on
  • SushisourceSushisource Registered User regular
    edited August 2007
    This is way super cool. If you ever consider making the project open source I'd love to know.

    Sushisource on
    Some drugee on Kavinsky's 1986
    kavinskysig.gif
  • tarnoktarnok Registered User regular
    edited August 2007
    If you just want flash drives for reliability you can buy solid state IDE drives here. They're pricey though. A little searching may find you a better deal.

    If, on the other hand, you really want to get the USB RAID working, that won't be much help. As far as linux is concerned, Ubuntu's forums are a great place to check. Chances are someone can help you if not actually link you to a walkthrough of how to do it.

    tarnok on
    Wii Code:
    0431-6094-6446-7088
  • HAKdragonHAKdragon Registered User regular
    edited August 2007
    Deusfaux wrote: »
    jsut look for the article where they did that with 5 ipod shuffles

    The iPod Shuffle raid was done on OSX, the OP is doing this on Windows. I would have linked to the Shuffle Raid, but all of the pictures seem to be down so it's not as interesting. Link for those interested in it anyway.

    HAKdragon on
    hakdragon.png
  • NubsauceNubsauce Registered User regular
    edited August 2007
    Deusfaux wrote: »
    jsut look for the article where they did that with 5 ipod shuffles


    Unfortunately, already seen it and it's a different game... but thanks anyways :D

    Nubsauce on
    [SIGPIC][/SIGPIC]
  • NubsauceNubsauce Registered User regular
    edited August 2007
    Success! we did it in Kubuntu. Still workin on Windows XP though... Pain in the arse is what it is...

    Nubsauce on
    [SIGPIC][/SIGPIC]
  • GrimReaperGrimReaper Registered User regular
    edited August 2007
    Erm...

    You're going to hit a couple of walls..

    * USB speed, the bus can only transfer so much data and frankly it is nowhere near the speed of of a SCSI or SATA bus. (with lots of flash drives connected via usb you'll have severe performance problems)
    * Flash drives have a limited number of writes and with RAID you're looking at above the normal for writes
    * Speed of the flash drives, while in general they offer initial speed burst general speed is much lower than that of any hard drive

    GrimReaper on
    PSN | Steam
    ---
    I've got a spare copy of Portal, if anyone wants it message me.
  • RohaqRohaq UKRegistered User regular
    edited August 2007
    GrimReaper wrote: »
    Erm...

    You're going to hit a couple of walls..

    * USB speed, the bus can only transfer so much data and frankly it is nowhere near the speed of of a SCSI or SATA bus. (with lots of flash drives connected via usb you'll have severe performance problems)
    He could set up multiple USB cards in order to have a controller for each one.

    Rohaq on
  • NubsauceNubsauce Registered User regular
    edited August 2007
    Rohaq wrote: »
    GrimReaper wrote: »
    Erm...

    You're going to hit a couple of walls..

    * USB speed, the bus can only transfer so much data and frankly it is nowhere near the speed of of a SCSI or SATA bus. (with lots of flash drives connected via usb you'll have severe performance problems)
    He could set up multiple USB cards in order to have a controller for each one.

    took the words right outta my mouth.

    and again, we're doing it for stability, not as much for performance. Not to mention just to see if we can... and we did, so no worries ;)

    Nubsauce on
    [SIGPIC][/SIGPIC]
  • RohaqRohaq UKRegistered User regular
    edited August 2007
    Nubsauce wrote: »
    Rohaq wrote: »
    GrimReaper wrote: »
    Erm...

    You're going to hit a couple of walls..

    * USB speed, the bus can only transfer so much data and frankly it is nowhere near the speed of of a SCSI or SATA bus. (with lots of flash drives connected via usb you'll have severe performance problems)
    He could set up multiple USB cards in order to have a controller for each one.

    took the words right outta my mouth.

    and again, we're doing it for stability, not as much for performance. Not to mention just to see if we can... and we did, so no worries ;)
    It didn't have any bottlenecks on the PCI/whatever you're using controller bus?

    Well, great :D

    So how did it turn out?

    Rohaq on
  • tsmvengytsmvengy Registered User regular
    edited August 2007
    http://phoenix.cc.edu/MegaFloppy.htm

    More floppy drive RAID goodness with video (at the bottom!)

    tsmvengy on
    steam_sig.png
Sign In or Register to comment.