Whichcommodityhasforthepastseveraldecades,consistentlyimprovedinqualitywhilesubstantiallydeclininginprice?

Ifyouanswered?

harddisk?

storage,you’recorrect。

Storageonharddrivestodayismuchlessexpensivethanitoncewas,anditperformsmuchbetter。

Thismeansthatifyourstoragestrategydatesfromadecadeago,itmaybetimetorethinkit。

Allowmetoreminisceabit。

Myfirstcomputer,anIBMPS/2thatmygrandparentsgavemecirca1992,camewithaharddiskthatsported256megabytes–yes,megabytes–ofstorage。

AfteracoupleofyearsoffillingupthatdiskwithDOSfreewaregames,Iranoutofspace。

So,Idiligentlysavedmybirthdaymoneyandboughtanew,500-megabyteharddisk。

Itcostabout$200,whicheasilymadeitthebiggestpurchaseofmylife。

Fastforwardtothepresentandthatmoneywouldeasilygetyou5terabytesofstorage?

–which,forthoseofyoukeepingtrackathome,isone?

million?

timesasmuchstorageasIhadintheheydayofmyPS/2。

Andthat’snotevenadjustingforinflation!

Disk?

StorageisCheaperthanEver?

–andIt’sGettingCheaperStill

Myexperiencewasnotananomaly。

Diskstoragehassteadilyanddramaticallydecreasedincostoverthepastseveraldecades。

Ifyouwanttoseejusthowmuch,checkout?

thisfascinatingpage。

Itnotesthatdatacostabout$193,000pergigabyteintheearly1990s,comparedto$0。

07in2009。

That’saprettystunningdecline。

Ifonlythepriceofothercommodities–likeoil,foodandgold–hadfollowedthesamepattern,we’dallbefeelingprettyrichtoday。

DiskStorageisAlsoBetter

Andthat’snotall。

Inadditiontodecliningincost,datastoragehasalsobecomemuchbetter,nomatterhowyoumeasureit。

Read/writerateshaveimproveddramatically。

Datalossandfilesystemcorruptionarenolongercommonproblems(OK,thatimprovementhasmoretodowithbettersoftwarethanbetterhardware,butthehardwarehelps)。

Innovationslikesolid-statedisksmakeitpossibletotossyourlaptopoutawindow,whilestreamingdatatodisk,withadecentlygoodchancethatyourfilesandharddrivewillallcomeoutOK(fortherecord,Ideclineallresponsibilityshouldyouchoosetotestthis)。

AccordingtoWikipedia,modernharddriveslastabout11timesaslongastheydidwhentheywerefirstintroduced。

Related:ArchivingYourDataforRegulatoryCompliancewithHadoopandDMX-h

MakingtheMostofModernStorage

Unlessyouliveunderarock,youprobablyarealreadyawareofeverythingIhavenotedabove。

Youmaythereforebewonderingwhythisisrelevant。

Thereasonisthatit’sareminderthatifyouarestillclingingtolegacydatastoragemedialiketapearchives,it’shightimeyoulookedintoreplacingthemwithharddisks。

Yes,tapedriveshadtheiruses。

Theyprovidedanaffordableformofhigh-volumedatastorageatatimewhenlargeharddiskswerejustoutofreachformostpeople。

TheirlegacywillalwaysliveoninthevenerableUnix?

tar?

command。

Buttoday,tapedrivesnolongercutitinmostrespectswhencomparedtoharddrives。

Drive-for-drive,the?

storagecapacityoftapesandharddisksisaboutthesame。

Harddisks’lifeexpectancyisatleastasgood。

Theoneplacewhereharddrives?

comeupabitshort?

whencomparedtotapeisread/writespeed。

Tapesgenerallydobetteronthisfront?

–butsolid-statedisksareclosingthegap。

Andnomatterhowyousliceit,harddisksaremuchcheapergigabyte-for-gigabyte。

That’sthebiggestkicker。

ModernizingYourStoragewithSyncsort

Atthispoint,youmaybethinking,“Harddiskssoundgreat,buthowdoIactuallymovemydatafromtapetoharddisk?



That’safairquestiontoask。

Movingdatafromtapetodiskisnottypicallyadrag-and-dropaffair。

Youhavetorunabunchofarcanecommands(liketheonesIBMsummarizes?

here)。

Andthetransferwilltakealongtimeifyouhavealotofdata。

Abetterapproachistotakeadvantageofautomateddatamigrationsolutionslike?

Syncsort’s。

ProductslikeDMX-hhandlethedirtyworkoftape-to-disktransferforyou。

Theyallowyoutoingestdataautomatically,inrealtime,frommainframetapestoragetoaHadoopenvironmentrunningondisk。

WithsolutionslikeDMX-h,there’sreallynoexcuse?

not?

tomigratetoharddisksthesedays。

Harddisksaresmaller,morereliableandcheaper–andSyncsortmakesthedatamigrationassimpleasdoinganyotherkindofdatatransfer。

Takethetimetobrowse?

Syncsort’savailableproducts。

Letsblockads!

(Why?

)

Syncsortblog