hi ya

On Sat, 8 Mar 2003, Juhan Kundla wrote:

> 
> I have a task to set up a file server. I have very small budget but
> quite high demands for data integrity. I must do everything possible to
> ensure, that i can recover data after hardware or user failures.
> The performance of the computer is not very important.

does "data integrity" means that the server cannot go down or that
you cannot lose data, even if the server is offline for a day or two

if the server cannot go down, you will need to be using mirroring (raid1
or raid5 )

if you just want to be able to recover data ( not lose a single file ) ...
        - implement a "good" backup scheme ..

        - you will have restrictions, can people afford to lose a days
        work ??  ( if not, run backups during the workday too )

        - you wil lose data, unless you have saved multiple copies of
        it at the time the file was created ...

        - paranoid way to prevent data loss, write the "transaction"
        to your servers in SF, LA, NYC, Chicago 

> There is no way i could buy expensive hardware (SCSI and tape drives are
> really not an option). I think i can afford two or three IDE disks. So
> here is my plan.

if data reliability is important... i would NOT use scsi..
        ( all my dead drives are scsi drivers ( runns too hot )
        ( all my bad ide disks are ibm deskstars  ...
 
> I buy two smaller (and cheaper) IDE disks and use them in RAID-1 array.
> I hope that this gives me good protection against hardware failures. If
> one disk fails, then other will still have my data intact, right? The
> main question is, that how good is the software RAID, when one drive is
> not lost completely, but it starts to have more and more bad blocks?
> Will the RAID-1 protect me from data corruption in that case? Any
> comments?

good...  for knowing backups is needed

> I know, i still have to take backups, because the RAID and mirroring
> won't protect me against other types of failures. I was thinking about
> using a separate much bigger IDE disk for backups. If the backup drive
> would be 7 times bigger than those smaller disks, then i could take a
> full backup every weekday and have seven copies of my data, every copy
> taken in different time. This gives me maximum one week to react to data
> loss or corruption and if i accidently deleted wrong files, i would
> could restore them from backup, that is not older than 24 hours.

given disk space is limited .. and limited budgets ...
a. you should only backup data from last full backup that was performed
        - if you're paranoid, since 2 full-backups ago 

        - if you do weekly full backups, than do daily incremental backups
        of the last 22 days... 
 
-- assume that your full backups will fail regularly... 
        - backup disk will be too full 
        - network will be down regularly... for whatever reason
          which renders your daily incrementals worthless unless you
          can recover the missing day's worth of incremental backups

-- a missing day or missing file due to poor full backups or poor daily
   incremental backup scheme renders all subsequent incremental backups
   useless
        - make sure incremental backups are performed across several
        full backups  ( how ever often  you do full backups )

-- only backup user data .... and server config ...
        ( no point to backup system files like /usr/X11R6 for example )

-- if your main data disk is 40GB ...
        - a 2nd 40GB disk will give you about a months worth of backups
        ( depending on if you have 40GB of ascii docs or 40GB of mpegfiles )

        - a 3rd 40GB disk is good .. just in case a backup failed

-- test the backups is working on a regular basis...
        -- insert a test file ... 
        -- some time next week seethat when a fresh disk is restored,
        that your "test files" exists
        
backup scripts
        http://wwww.Linux-Backup.net

raid stuff
        http://www.1U-Raid5.net 
        
c ya
alvin


-- 
To UNSUBSCRIBE, email to [EMAIL PROTECTED] 
with a subject of "unsubscribe". Trouble? Contact [EMAIL PROTECTED]

Reply via email to