Friday, July 20, 2007

Debian Software RAID Setup

The Problem

Over the past few years space on my server would increase based on the deals found on sites like Slickdeals. After some time this lead to a mishmash of two PATAs and one SATA at 120Gb, 160Gb, and 200Gb respectively on my personal media server. Glad as I was to have all this space it started to become disk management issue since I wanted the bulk of the space consolidated for media. Filling up one drive would require me to move data to another with more space, causing organization and software issues (NFS would not single export multiple mounts).

Remedy

Last week this all became moot when Fry's advertised a 500Gb SATAII Maxtor drive for 90$. My EPoX motherboard was capable for RAID-0 and RAID-1 so I figured it was time to upgrade to a terabyte and bought two.

The initial plan was to create a RAID-0 array (striping for performance), re-install Debian, copy all data, and remove the older drives for noise and heat reasons. With two of them PATA drives, they could stay in the system easily copy straight to the new array. The older SATA drive had the OS and I wanted to keep it around for config reference when I was re-setting up the server. Both of the SATA ports would be used for the new array, not allowing this SATA to remain in the system, this was solved by purchasing a Masscool PATA/SATA external USB enclosure and copying the data from there.

Issues

Once everything was hooked up I ran the RAID BIOS config, set the new SATAs for RAID-0, and booted up the Debian Netinst CD. Surprisingly the installer showed both 500Gb drives as /dev/sda and /dev/sdb, completely ignoring the BIOS set RAID array. After doing a bit of research online for the RAID chipset (VIA VT6420) I found that it wasn't capable for true hardware RAID and instead relied on drivers in the OS to function properly, aka "fakeraid". These drivers only really existed for Windows and not Linux. Eventually I did find ones for Linux, but they were binary only and didn't look too friendly.

I thought about using them, but then remembered that Linux can do software RAID. Having briefly heard about software RAID before I was suspicious until I read a few articles explaining it's virtues. After tracking down a how-to Software RAID for Debian before I knew it I had a software RAID-0 array running on /dev/md0. For screen shots check out this Ubuntu Server Install guide.

Debian Config

The biggest choice while running the install was which file system to us. I gave ext3 a try first, with formatted space coming up to around 870Gb. XFS came out to 932Gb which was better, but after reading XFS's disadvantages (no journaling for data blocks) I decided it wasn't the best choice. JFS was last, which I was running on one of the drives I was replacing. It had worked flawlessly for the past couple of years, proving itself in the type of setup I would use. Overall JFS was the best option, giving a total of 932Gb of formatted space, For comparisons sake, a friend with the same setup ended up with 840Gb using NTFS on Windows.

I started the OS install, designating the entire drive as /, but hit a bump when it came to installing GRUB, which said it couldn't install to the MBR. I tried a few partition schemes to no avail, getting "unable to create partition" messages for everything, including swap. After a bit of frustration I split the OS and data onto separate drives; a spare 80Gb PATA for the OS and the RAID for data. I created a basic partition scheme (600Mb for /boot, 70Gb for /, and 5Gb for swap) on the OS drive and then mounted the RAID on /home, since this is where the bulk of the data would go anyway.

Results

Debian finished the install without a hitch and soon I was booting into my new clean system. A few cp -pfr and hours later I had successfully moved my server to the new drive and array. Below are some technical details:

micheal@jezebel:~$ df -h
Filesystem Size Used Avail Use% Mounted on
/dev/hda3 70G 4.5G 62G 7% /
tmpfs 502M 0 502M 0% /lib/init/rw
udev 10M 60K 10M 1% /dev
tmpfs 502M 0 502M 0% /dev/shm
/dev/hda1 564M 37M 499M 7% /boot
/dev/md0 932G 385G 547G 42% /home

micheal@jezebel:~$ cat /proc/mdstat
Personalities : [raid0]
md0 : active raid0 sda1[0] sdb1[1]
976767872 blocks 64k chunks

unused devices: none
micheal@jezebel:~$ sudo hdparm -tT /dev/md0
/dev/md0:
Timing cached reads: 1210 MB in 2.00 seconds = 604.80 MB/sec
Timing buffered disk reads: 442 MB in 3.01 seconds = 147.07 MB/sec
Particularly impressive are results of 147 MB/sec on hdparm, which is leagues beyond the 60MB/sec seen on the original SATA drive. A few config changes over the next few days and the server was up and running normally.

Conclusion

Overall Linux's software RAID capabilities are impressive, not only can it do 0 and 1, but when re-compiling the kernel it has just as may options, if not more, than a traditional hardware card. Performance is outstanding, without being limited by the RAID hardware it mostly depends on bus and CPU speed, which are easier to upgrade than a RAID card. After this experience with software RAID I would not only recommenced it for personal use but enterprise also, proving itself in configuration, ease of use, and performance.

9 comments:

anne said...

La gran ventaja de los sistemas raid, pasa por la redundancia manteniendo los tiempos de transferencia, por eso los niveles 0 de raid no son los mas efectivos. Pero ojo, que a veces los raid fallan y la recuperación de sus datos se puede convertir en una pesadilla. Si en un momento dado necesitais recuperar datos de varios discos duros en raid os recomiendo las siguiente web : http://www.lineared.com/es/recuperar/raid-discos-duros.htm

lla said...

ed hardy clothes Highlights of the composition and color-rich design, simple lines so that ed hardy t-shirts has become a pleasure to look at, but the Ed Hardy-rich products, such as, ed hardy clothing people ed hardy sunglasses and look forward to the next ed hardy shirts changing the color of the years. ED HARDY personality patterns in order to attract the ed hardy mens and ed hardy womens .
babolat aeropro drive
wilson k factor
babolat tennis racket

lla said...

Womens Handbags is one of most popular designer bags brand all over the world. The following line is available in different nice looking and charming colors, also in favorable price. These knock off designer handbags are designed to cater for fashion and elegant ladies. I very much like the cheap purses, but it is very cheap handbags. Made of high-grade leather, light weight. Wholesale Handbags are the words the overall appearance of the color brown.
ralph lauren polo
burberry polo shirt

lla said...

What prince-o3-tour would be bettre in my opinion would be to remove the wrist straps and the skin, and instead make it a 2 babolat pure drive, 2 stereing wheels, 1 baseball bat and 1 golf club. Still, this package is great value for your money. When my wife informed me that Emporio Armani was now pushing its own signature wilson k six, the EA7, I’ve got to admit, I was intrigued. Italian designres producing tennis rackets? How fashion forward of thstrong. I love it. Head microgel is style and preformance at cheap tennis racquets best. Haute couture meets the hard courts.

lla said...

Anothre set of ralph lauren polo in three colors. Burbrery Polo Shirts come with a graduation of colors on the chest. The new shiki Cheap polo shirts logo is on the chest. Comes in all layres and can be worned tucked in or out wholesale polo shirts.
Also comes with sculpted collar and arm cuffs.Flat knit collar, Contrast placket and half moon, Mothre-of-pearl buttons and tennis tail, Soft double knit piqué,100% cotton ralph lauren polo shirts. If you lend your embroidrere a sample cheap ralph lauren polos that will help you get the closest match to the original embroidreed design. The artwork you provide will sreve as a template for your embroidrey set-up but discount ralph lauren polos can't be used to identify some stitch types, give precise sizing of embroidreed elements and show thread polo clothing colors.

Anonymous said...

gucci replica handbags
men gucci shoes
Gucci men sneakers
Gucci men moccasins
gucci women sneakers
gucci women boots
Gucci men boots
Gucci
Gucci shop
Gucci bags
Gucci shoes
Replica GUCCI SHOES
wholesale gucci shoes
cheap Gucci handbags
Gucci ON sale
Gucci Belts
Gucci small accessories
Gucci hats & scarves
Gucci wallets
Gucci Handbags
Women Gucci shoes
Men Gucci shoes
discount gucci shoes
cheap Gucci shoes

kobeli said...

Christian Louboutin Pumps
michael jordan shoes
Mens Polo Shirts
Mlb Jerseys

Manolo blahnik shoes
jordan basketball shoes
Lacoste Polo Shirts
Nba jerseys

Christian Louboutin Shoes Sale
jordan shoes sale
Wholesale Polo Shirts
Authentic Nhl jerseys
Discount Christian Louboutin
Ugg Boots
ugg boots
Christian Louboutin Shoes
discount ugg boots
discount ugg boots
Christian Louboutin Manolo Blahnik
ugg boots sale
ugg boots sale
Christian Louboutin Boots
cheap ugg boots
cheap ugg boots
Christian Louboutin Pumps
ugg winter boots
ugg winter boots

louis said...

The most popular replica handbags in the market are high replica handbags without doubt.


aaa replica handbags are associated with high quality, beautiful styles and elegant temperaments.

Best replica handbags gain popularity no matter in the markets or online. Still replicas, but there are difference.

But not only Louis Vuitton, but also Chanel and Hermes are the most popular brands that designer replica bag comes out.

aiya said...

Office 2010
Microsoft Office 2010
Microsoft word
Office 2007
Microsoft Office
Microsoft Office 2007
Office 2007 key
Office 2007 download
Office 2007 Professional
Outlook 2010
Microsoft outlook
Microsoft outlook 2010
Windows 7