The new forums will be named Coin Return (based on the most recent vote)! You can check on the status and timeline of the transition to the new forums here.
The Guiding Principles and New Rules document is now in effect.

Long time Archive Solutions?

SniperGuySniperGuy SniperGuyGamingRegistered User regular
edited July 2007 in Games and Technology
So my dad's looking into making an archive for some files, notably some old Vinyls he's ripping, old files, home movies, etc. He can get it all digital easily enough, but CDs decay rather quickly, and putting it on a harddrive to rest inside a safe...well, I don't know if that's a good idea or not.

Any ideas as to what the best idea for storing a large amount of data for a lasting time?

SniperGuy on

Posts

  • MordrackMordrack Registered User regular
    edited June 2007
    Optic media lasts longer than magnetic. All you can really do is make redundant backups every few years, regardless of media.

    Mordrack on
    steam_sig.png
  • FencingsaxFencingsax It is difficult to get a man to understand, when his salary depends upon his not understanding GNU Terry PratchettRegistered User regular
    edited June 2007
    SniperGuy wrote: »
    So my dad's looking into making an archive for some files, notably some old Vinyls he's ripping, old files, home movies, etc. He can get it all digital easily enough, but CDs decay rather quickly, and putting it on a harddrive to rest inside a safe...well, I don't know if that's a good idea or not.

    Any ideas as to what the best idea for storing a large amount of data for a lasting time?
    What exactly is going to be on this drive that it would need to be in a safe, and CDs corrode too quickly to be a viable option?

    Fencingsax on
  • EgoEgo Registered User regular
    edited June 2007
    Fencingsax wrote: »
    What exactly is going to be on this drive that it would need to be in a safe, and CDs corrode too quickly to be a viable option?

    Valuable things? I presume he simply means a fireproof safe or safety deposit box.

    Go with optical storage. Burn two sets of the data on decent quality CD's or DVD's. If your climate is humid, seal them. In dry conditions, optical storage will last you decades.

    Ego on
    Erik
  • SniperGuySniperGuy SniperGuyGaming Registered User regular
    edited June 2007
    Optical burnt CDs last like 15 years or less. This is something we'd like to possible retain for years and years. It's nothing like serious data, but CDs do degrade. Other than making backups every few years, is there any other way? Would a harddrive be safer? It's like 200 gig of files, so CDs are kinda out.

    SniperGuy on
  • djklaydjklay Registered User regular
    edited June 2007
    If you want to invest there is always tape backup, DLTs are supposed to last like 30 years. The drives are upwards of $1000 though. However 15 years is a LONG time in computer lingo, that would be like having files from '92. I can't think of any files I'd want that long that I wouldn't be using at some point in between and I'm trying to remember if my computer even had a CD-ROM in '92.

    djklay on
  • tehmarkentehmarken BrooklynRegistered User regular
    edited June 2007
    SniperGuy wrote: »
    Optical burnt CDs last like 15 years or less. This is something we'd like to possible retain for years and years. It's nothing like serious data, but CDs do degrade. Other than making backups every few years, is there any other way? Would a harddrive be safer? It's like 200 gig of files, so CDs are kinda out.

    Do burnt DVDs last as long as CDs? Because iirc, standard DVD-Rs hold 4GB, which is only 50 DVDs. I can't imagine any valuable data that you would keep and NOT check/update/re-organize every decade, so optical storage seems ideal.

    tehmarken on
  • SniperGuySniperGuy SniperGuyGaming Registered User regular
    edited June 2007
    50 dvds is just silly huge. Assuming we boot it up and switch it around every few years, is an external harddrive in a safe gonna work just fine?

    SniperGuy on
  • Lucky CynicLucky Cynic Registered User regular
    edited June 2007
    SniperGuy wrote: »
    50 dvds is just silly huge. Assuming we boot it up and switch it around every few years, is an external harddrive in a safe gonna work just fine?

    If properly maintained, I do not see why not, at least for a handful of years.

    EDIT: Also, it may be kind of fucked up to say something like this, but in a few years, maybe if the market shifts enough, swap to 5 or 6 Blu-ray or HD-DVD discs instead?

    Lucky Cynic on
  • RaereRaere Registered User regular
    edited June 2007
    I'd say buy 2 or even 3 external hard drives, each having the same thing. They go for about $90 a pop. Also, keep the power cords with the drives. If you lose them, in 15 years, you might not be able to find a replacement.

    Raere on
    Raere.png
  • zanetheinsanezanetheinsane Registered User regular
    edited June 2007
    For a ridiculously large amount of data, I am in the corner of two identical hard drives. It's cheaper than a normally commercial solution (DLTs etc) and relatively safe. I still have hard drives that work from 10 years ago that have been dropped, etc.

    EDIT: Alot of modern DLTs can store 100's of gigabytes.

    zanetheinsane on
  • EgoEgo Registered User regular
    edited June 2007
    SniperGuy wrote: »
    Optical burnt CDs last like 15 years or less. This is something we'd like to possible retain for years and years. It's nothing like serious data, but CDs do degrade. Other than making backups every few years, is there any other way? Would a harddrive be safer? It's like 200 gig of files, so CDs are kinda out.

    15 years or less? Ask a librarian or archivist. Optical storage is pretty much the most durable and long lasting form of storage you're going to find, much better and more reliable than magnetic storage on either a hard drive or a tape (tape storage is good for data backup because it's cheap, not because it lasts a particularly long time). If you don't expose CD's or DVD's to humidity they'll last you decades.

    If it's a matter of convenience (I remember backing up hard drives onto 50 floppies, backing up onto 50 dvd's wouldn't be much more enjoyable) then definitely go with some big hard drives, but if the data is important and you really do want it to last, go optical.

    If you went dual-layer, it'd only be 25 dvd's :).

    Ego on
    Erik
  • ZackSchillingZackSchilling Registered User regular
    edited June 2007
    Someone really should invent a stable plastic microfilm-like medium for digital data with reasonable data density and cost. It would be perfect for a use like this and last pretty much forever. I'd like it for stuff like my digital photo library, which I'd love to keep safe my entire life and beyond.

    ZackSchilling on
    ghost-robot.jpg
  • Lave IILave II Registered User regular
    edited June 2007
    About 15 years ago I was using a Risc PC or an Acorn with 5" floppy dirve.

    Then an Amiga with a 3.5" 800K single density floppy drive.

    Accessing that data now is hard no matter how well the floppy disk has survived.

    It fifteen years you may have swapped from Windows, and windows then will have as much compatability as it does now to Windows 95. You may be using Linux. Or Macs.

    Their is only one way to keep data alive and that is to bring it with you. Put it on a Hard drive and DVDs as an extra back up. But one day they will be as 5" floppies are now. But then to keep it alive keep a copy on all the machines you own.

    You upgrade, you bring it with you. You convert the music to new formats. The text to new formats. Keep it modern.

    Many copies keeps things safe.

    For long term access to files, you may want to start running Linux. Ogg vorbis, will always be available to access your audio. Text files will always be able to be read.

    For example some of the fortran code I run for my PhD on linux has comments from the 70's stuck in there. I find that a lot harder to believe would happen in Windows and OS X.

    Lave II on
  • MalkorMalkor Registered User regular
    edited June 2007
    Jive Turkey. There are some services that promise to store data on their servers and through others means and keep it accessible for as long as you can keep paying. Unfortunately there's no guarantee that they won't go under, taking the stuff along with them. Actually it looks like it's mostly aimed at other companies.

    http://www.emc.com/index.jsp

    Malkor on
    14271f3c-c765-4e74-92b1-49d7612675f2.jpg
  • SniperGuySniperGuy SniperGuyGaming Registered User regular
    edited June 2007
    Lave, linux is currently getting sued by microsoft for like 130 patent infringements, which wouldn't matter except Ubuntu and someone else were like "Really? Well shit, our bad. lets make a deal!" So I fail to see how Linux will be our savior. But thanks for the advice. And I like .ogg, but really, what's to say it won't go the way of the dodo too?

    And there's a difference between burnt optical media and pressed optical media. The latter will last FAR longer. I suppose as long as we're making backups that'd work, but still, convience matters. Would a flash drive last longer for just standard degrading than a magnetic hard disk?

    SniperGuy on
  • Mr_GrinchMr_Grinch Registered User regular
    edited June 2007
    I vote for the Harddrive option. I have a harddrive from 1995ish that was connected to my CD32 (through SX-1 expansion). I can still boot up the CD32 and all the data on said harddrive is fine (accesible through Workbench no less!). It's nothing valuable, if it were then I'd probably back it up to a Harddrive and (in your case) a couple of Blu-Ray discs as well. Check each every few years and you should be fine.

    Bloody hell, I've just realised how old my cd32 is!

    Mr_Grinch on
    Steam: Sir_Grinch
    PSN: SirGrinchX
    Oculus Rift: Sir_Grinch
  • ShurakaiShurakai Registered User regular
    edited June 2007
    SniperGuy wrote: »
    Would a flash drive last longer for just standard degrading than a magnetic hard disk?

    No!

    Flash drives can easily become corrupt after even a year or so if you leave the same data on them.

    My suggestion is to Buy an external hard drive, write everything once and then store it in a cool dry place. Hard drives don't wear out if you don't use them, to the best of my knowledge.

    Shurakai on
  • Lave IILave II Registered User regular
    edited June 2007
    SniperGuy wrote: »
    Lave, linux is currently getting sued by microsoft for like 130 patent infringements, which wouldn't matter except Ubuntu and someone else were like "Really? Well shit, our bad. lets make a deal!" So I fail to see how Linux will be our savior. But thanks for the advice. And I like .ogg, but really, what's to say it won't go the way of the dodo too?

    And there's a difference between burnt optical media and pressed optical media. The latter will last FAR longer. I suppose as long as we're making backups that'd work, but still, convience matters. Would a flash drive last longer for just standard degrading than a magnetic hard disk?

    Just like it got sued before by SCO. It makes no difference. I don't believe Ubuntu has made a deal at all. And corp's like IBM will protect linux again as they did with SCO.

    And even if it is was. Any code found conflicting would be changed within hours so that there was no longer a problem. And as no one owns Linux even if Microsoft drove every distro bust - new ones could leaglly spring up over night.

    The entire Astronomical community is dependent on Linux. Do you know the Rovers on Mars? They run Linux. Most web servers run linux.

    It might not be the solution for you - but I promise you - Linux will offer much better long term access to data than corperate OS's.

    It probably isn't best for you. But you can't dismiss Linux.

    Lave II on
  • MashalotMashalot Registered User regular
    edited June 2007
    Ego wrote: »
    SniperGuy wrote: »
    Optical burnt CDs last like 15 years or less. This is something we'd like to possible retain for years and years. It's nothing like serious data, but CDs do degrade. Other than making backups every few years, is there any other way? Would a harddrive be safer? It's like 200 gig of files, so CDs are kinda out.

    15 years or less? Ask a librarian or archivist. Optical storage is pretty much the most durable and long lasting form of storage you're going to find, much better and more reliable than magnetic storage on either a hard drive or a tape (tape storage is good for data backup because it's cheap, not because it lasts a particularly long time). If you don't expose CD's or DVD's to humidity they'll last you decades.

    If it's a matter of convenience (I remember backing up hard drives onto 50 floppies, backing up onto 50 dvd's wouldn't be much more enjoyable) then definitely go with some big hard drives, but if the data is important and you really do want it to last, go optical.

    If you went dual-layer, it'd only be 25 dvd's :).
    Oh heeeecccckk no. Pressed DVDs and CDs have a decent lifespan, 'recordable' DVDs and CDs (CDR, DVDRs) are an entirely different media despite being readable in basically the same hardware and degrade extremely quickly. Back when CDRs were just starting to get affordable, mid 90's I guess, I archived stuff to hundreds and hundreds of CDRs... they were all carefully kept and are all quite fucked now. Different brands lasted longer than others, the majority started coming up with major errors within 5 years, one brand didn't even last 1.

    I heard a local media specialist talk recently, a guy whose main job is basically transferring film & video for one format to another for major clients (film conversion to digital for post & back for instance). According to him the manufacturers' official expected lifespan of commercial, pressed DVDs hits about 20yrs vs the roughly 100yrs for CDs. That surprised me, but is apparently at least partially due to how much more compact the data is on the surface.

    Multiple HD backups (or tape) in multiple locations would be the way to go. It sounds weird but a few recording engineers I've talked to swear that to preserve HD backups they need to be powered on every year or so (which is being generous, could go much longer)... not all HDs are subject to this, just the tech in your common ATA drive or whatever. The technical reasons were explained to me once but it was a few years ago. I'll try and dig it up. edit: These are guys keeping backups for major clients including major labels, they're inveseted in keeping the data around.

    Un-shown film in a temperature and humidity controlled environment is most archival for images, unplayed vinyl is most archival for sound. When a motion picture is 'restored' generally a new film print is actually the end result, maybe a hi-def video master is made for home video release later down the line.

    If the trend of contemporary archivists is really to archive to CDR and DVDR they're in for a hell of a shock.

    The short answer is that everything fades & everything dies, regularly backup your backups no matter what you do, and keep multiples.

    Mashalot on
  • ArcSynArcSyn Registered User regular
    edited June 2007
    Your best bet right now for long-term storage while still remaining fairly inexpensive is DVDs. Granted, they won't keep for 100 years, but they're inexpensive and you can rely on them for 10+ years which by that point in time I'm sure a better storage medium will have been developed.

    If you want a bit better storage, then DVD-RAM is your better bet. The discs hold 2x a DVDR, and last much longer. They are also rewritable if you need to add or change something on them later. The drive and media are going to cost you a bit more though.

    Also, if you go optical with DVDR or DVD-RAM - store them where they aren't touching each other or plastic. Don't put them in a CD binder or spindle where they could melt together or eventually bond with the surface next to them. Store them in hard cases or in a storage system that separates them slightly.
    Mashalot wrote: »
    Oh heeeecccckk no. Pressed DVDs and CDs have a decent lifespan, 'recordable' DVDs and CDs (CDR, DVDRs) are an entirely different media despite being readable in basically the same hardware and degrade extremely quickly. Back when CDRs were just starting to get affordable, mid 90's I guess, I archived stuff to hundreds and hundreds of CDRs... they were all carefully kept and are all quite fucked now. Different brands lasted longer than others, the majority started coming up with major errors within 5 years, one brand didn't even last 1.

    The original gold-tint CDRs had a archive lifetime of 25-50 years depending on brand and quality. Pre-recorded CDs are much higher (as you stated, up to 100 years or so). Today's CDRs use the cheap tint and thus have hardly any archive lifespan because they are mass-produced to be cheap. Gold-tint was NOT cheap.

    ArcSyn on
    4dm3dwuxq302.png
  • StregoneStregone VA, USARegistered User regular
    edited July 2007
    For the ultimate in archival uuencode it and print it on archival quality paper and ink. In a couple thousand years it will be the next dead sea scrolls :D

    Stregone on
Sign In or Register to comment.