Tuesday, July 04, 2006

MySQL sysbench benchmarking - iSCSI

Our company, RightMedia is in the process of evaluating a storage subsystem for our ever growing MySQL databases. It seems that our data is growing at an alarming rate (this is a good thing) and our internal SCSI disks aren't handling the load of massive inserts, plus large queries. So the time is now to evaluate a storage subsystem that will grow with us and scale for our performance needs.

I was really reluctant when I first heard iSCSI proposed as a potential solution. I am familiar with large storage subsystems all hooked in through fibre channel. It's an expensive solution, but performance is great. There are a few iSCSI vendors, and we had lots of problems with kernel version & driver version. But, we perservered, and have systems where we can benchmark the performance of iSCSI.

Now before I get to the actual numbers, let me give you the environment for the testing. I have tried to use as much identical hardware as possible for testing. All of the tests were done with Gentoo Linux, kernel version 2.6.16. The machines have at least 8GB memory (one has 16GB of memory), and all have 2 dual core Opteron CPUS. MySQL version 5.0.21 was used for testing, and InnoDB used as the storage engine. The following types of drives were used for benchmarking: 1) Single 7200 RPM 200GB SATA drive 2) 3 15,000 RPM 73GB SCSI drives in a RAID-0 configuration (128k stripe size) 3) 4 disk RAID-10 configuration on an iSCSI volume (actually using 8 disks) 4) 8 disk RAID-10 configuration on an iSCSI volume (16 disks,, 1M stripe size)

Without further ado, here is a chart of the results:



Shocking isn't it? The iSCSI disk outperforms even a local SCSI array? I found this hard to believe myself, but it gives me more hope that this might be a viable solution. I am still conducting lots of tests on teh device to make sure that the machine scales, and I'll be posting results soon.

36 comments:

Peter Zaitsev said...

Hi

I've commented on this in my blog
http://www.mysqlperformanceblog.com/2006/07/06/sysbench-evaluation-of-iscsi-performance/

If you need any help with benchmarks let me know. I would be very interesting to have something like this published.

Anonymous said...

Hi,
what a really interested question in accordance with your result is: how many CPU cycles were spended on one IO? (because iSCSI should has hiest CPU utilization). It could be huge problem for CPU-intensive InnoDB engine.
-
regards
Vitaly

Partha Dutta said...

Vitaly,

With the dual-core opterons, iSCSI CPU utilization is fairly negligible. If the innodb_thread_concurrency variable is set to 4, we can avoid a lot of thread thrashing, and fairly spread load accross the CPUs. In fact, during the 16 thread benchmark, I observed the User CPU utilization reach 30%, but on only one of the cores. The first core was still idle and had a utilization of only 20%. Most of the work is offloaded to the network card, and the actual iSCSI controllers themselves.

Partha

Jeremy Cole said...

Could you specify what sysbench commands you used for these tests?

Partha Dutta said...

Jeremy,

Take a look at Benchmark details. It has all of the details of the sysbench test.

Partha

Anonymous said...

Hello , Partha I want to make system in which , I have to handle 300Gb database using mysql 5.0 , can u tell me what should be best hardware configration, we are going to use Kernal Virsion:- 2.4.20-30.9
OS. :- Red Hat Linux release 9 i686 please can u help us to make this system. your ideas and suggestion will be most useful for us thanks in advance , Please give me suggestion at eluminous007@yahoo.co.in

Thank You
sandeep patil

Anonymous said...

Hello, Partha.
Thanks for comments, it was very impressive (about innodb_thread_concurrency), but more clear and deterministic result may be achieved with step-by-step and head-to-head comparison. For example:
1) Local RAID-0(16-disks) vs ISCSI RAID-0(16-disks) for different IO patterns (scattered,sequential,direct,async...) simulated by iozone or dt.
2) Combine best solution from step 1 with InnoDB and tune it.
Otherwise community will be concerned about comparison of apples and oranges again ;).
I'm afraid it couldn't be said better than:
"http://www.tpc.org/tpcc/faq.asp", look at "Q: How can I tell if one of the TPC-C benchmarks is relevant to my application and environment?
"
regards
Vitaly

wow gold said...

Treats wow gold for Greatfather wow goldWinter: This buy wow goldquest is buy wow goldavailable at cheap wow goldlevel 10 and cheap wow goldis just a simple wow power levelingcooking quest. wow power levelingThe recipe power levelingrequired for the power leveling tickles your wow goldfancy. It is buy wow goldcertainly importantcheap wow goldthey wanted to.

mmoga said...

wow gold
buy wow gold
wow levelservice
wow account
wow gold
buy wow gold
wow levelservice
wow account
wow gold
buy wow gold
wow levelservice
wow account

yiwu china said...

Let us go to Yiwu city to buy China wholesale products at lowest wholesale price.Browse Alphabetically: A,B,C,D,E,F,G,H,I,J,K,L,M,N,O,P,Q,R,S,T,U,V,W,X,Y,Z,0-9

wow-xu said...

We offer WoW Gold, World of Warcraft Gold and WoW Power Leveling on all WoW servers, and start to sell Warhammer Gold (Warhammer Online Gold) at lowest price, we can deliver WoW Gold and WoW Power Leveling at a moment's notice. We promise you the lowest price of World of Warcraft Gold everyday. GameVive is the one for you to buy Cheap WoW Gold!www.gamevive.com , Cheap WoW Gold
Airnk.com always update lots of air jordans photos, pictures and news here! Come on, join us for the wonderful basketball shoes and air jordan shoes revel now! Full your collection of jordan shoes from grabbing the right one at airnk.com. We have very fashionable basketball shoes basketball shoes and Air Jordan Shoes that will go well with any of you clothes.Tiffany & Co Silver Jewelry | Tiffany Jewelry | Tiffany Rings | Tiffany Earrings | Ttiffany Necklaces | Tiffany Bracelet | tiffany | cheap wow gold

Anonymous said...

WoW shares many wow gold of its features with previously launched games. Essentially, you battle with Cheapest wow gold monsters and traverse the countryside, by yourself or as a buy cheap wow gold team, find challenging tasks, and go on to higher Cheap Wow Gold levels as you gain skill and experience. In the course of your journey, you will be gaining new powers that are increased as your skill rating goes up. All the same, in terms of its features and quality, that is a ture stroy for this.WoW is far ahead of all other games of the genre the wow power leveling game undoubtedly is in a league of its own and cheapest wow gold playing it is another experience altogether.
Even though WoW is a wow gold cheap rather complicated game, the controls and interface are done in buy warhammer gold such a way that you don't feel the complexity. A good feature of the game is that it buy wow items does not put off people with lengthy manuals. The instructions cannot be simpler and the pop up tips can help you start playing the game World Of Warcraft Gold immediately. If on the other hand, you need a detailed manual, the instructions are there for you to access. Buy wow gold in this site,good for you ,WoW Gold, BUY WOW GOLD.

Anonymous said...

看房子,買房子,建商自售,自售,台北新成屋,台北豪宅,新成屋,豪宅,美髮儀器,美髮,儀器,髮型,EMBA,MBA,學位,EMBA,專業認證,認證課程,博士學位,DBA,PHD,在職進修,碩士學位,推廣教育,DBA,進修課程,碩士學位,網路廣告,關鍵字廣告,關鍵字,廣告,課程介紹,學分班,文憑,牛樟芝,段木,牛樟菇,日式料理, 台北居酒屋,燒肉,結婚,婚宴場地,推車飲茶,港式點心,尾牙春酒,台北住宿,國內訂房,台北HOTEL,台北婚宴,飯店優惠,台北結婚,婚宴場地,推車飲茶,港式點心,尾牙春酒,住宿,訂房,HOTEL,飯店,造型系列,學位,牛樟芝,腦磷脂,磷脂絲胺酸,SEO,婚宴,捷運,學區,美髮,儀器,髮型,牛樟芝,腦磷脂,磷脂絲胺酸,看房子,買房子,建商自售,自售,房子,捷運,學區,台北新成屋,台北豪宅,新成屋,豪宅,學位,碩士學位,進修,在職進修, 課程,教育,學位,證照,mba,文憑,學分班,網路廣告,關鍵字廣告,關鍵字,SEO,关键词,网络广告,关键词广告,SEO,关键词,网络广告,关键词广告,SEO,台北住宿,國內訂房,台北HOTEL,台北婚宴,飯店優惠,住宿,訂房,HOTEL,飯店,婚宴,台北住宿,國內訂房,台北HOTEL,台北婚宴,飯店優惠,住宿,訂房,HOTEL,飯店,婚宴,台北住宿,國內訂房,台北HOTEL,台北婚宴,飯店優惠,住宿,訂房,HOTEL,飯店,婚宴,結婚,婚宴場地,推車飲茶,港式點心,尾牙春酒,台北結婚,婚宴場地,推車飲茶,港式點心,尾牙春酒,結婚,婚宴場地,推車飲茶,港式點心,尾牙春酒,台北結婚,婚宴場地,推車飲茶,港式點心,尾牙春酒,結婚,婚宴場地,推車飲茶,港式點心,尾牙春酒,台北結婚,婚宴場地,推車飲茶,港式點心,尾牙春酒,居酒屋,燒烤,美髮,儀器,髮型,美髮,儀器,髮型,美髮,儀器,髮型,美髮,儀器,髮型,小套房,小套房,進修,在職進修,留學,證照,MBA,EMBA,留學,MBA,EMBA,留學,進修,在職進修,牛樟芝,段木,牛樟菇,住宿,民宿,飯宿,旅遊,住宿,民宿,飯宿,旅遊,住宿,民宿,飯宿,旅遊,住宿,民宿,飯宿,旅遊,住宿,民宿,飯宿,旅遊,住宿,民宿,飯宿,旅遊,住宿,民宿,飯宿,旅遊,美容,美髮,整形,造型,美容,美髮,整形,造型,美容,美髮,整形,造型,美容,美髮,整形,造型,美容,美髮,整形,造型,美容,美髮,整形,造型,美容,美髮,整形,造型,設計,室內設計,裝潢,房地產,設計,室內設計,裝潢,房地產,設計,室內設計,裝潢,房地產,設計,室內設計,裝潢,房地產,設計,室內設計,裝潢,房地產,設計,室內設計,裝潢,房地產,設計,室內設計,裝潢,房地產,設計,室內設計,裝潢,房地產,進修,在職進修,MBA,EMBA,進修,在職進修,MBA,EMBA,進修,在職進修,MBA,EMBA,進修,在職進修,MBA,EMBA,進修,在職進修,MBA,EMBA,進修,在職進修,MBA,EMBA,進修,在職進修,MBA,EMBA,住宿,民宿,飯店,旅遊,美容,美髮,整形,造型,設計,室內設計,裝潢,房地產,進修,在職進修,MBA,EMBA,關鍵字排名,網路行銷,关键词排名,网络营销,網路行銷,關鍵字排名,关键词排名,网络营销,羅志祥,周杰倫,五月天,蔡依林,林志玲,羅志祥,周杰倫,五月天,蔡依林,林志玲,PMP,在職專班,研究所在職專班,碩士在職專班,PMP,證照,在職專班,研究所在職專班,碩士在職專班

runescape gold said...

runescape
runescape gold
runescape money
runescape powerleveling
runescape power leveling
runescape
runescape gold
runescape money
runescape powerleveling
runescape power leveling
runescape
runescape gold
runescape money
lotro
lotro gold
lotro powerleveling
lotro power leveling
lotro money
lotro
lotro gold
lotro money
lotro powerleveling
lotro power leveling
world of warcraft money
world of warcraft gold
wow gold
wow money
maplestory mesos
maple story mesos
maplestory mesos
maple story mesos
runescape
runescape gold
runescape money
runescape
runescape gold
runescape money

coco0610 said...

wholesale jewelry
handmade jewelry
jewelry wholesale
fashion jewelry
costume jewelry
wholesale costume jewelry
wholesale fashion jewelry
wholesale pearl
wholesale crystal
discount jewelry
cheap jewelry
wholesale gemstone
wholesale swarovski
wholesale shell
wholesale coral
wholesale turquoise
china jewelry wholesaler
wholesale china jewelry
wholesale handmade jewelry
handcrafted jewelry
wholesale jewellery

wowgold said...

It is what we buy cheap wow gold call 'the syndrome of the passive patient'. Basically we can't have anything with nothing and we know that if the client does not implicate himself cheap wow gold or herself a little bit financially then he or she won't make the effort later on and make
biodegradable cutlery the changes which are truly necessary. This is why it is essential for me that the wow gold people I help implicate themselves and sell cheap wow gold why I do not work for free. It is very important for me to know that I am not working pointlessly on an individual's analysis, wow gold producing a reading that wow gold 5000 will not be fully read or assimilated while all I really want to do is to pass on the valuable information which SRO gold. is going to so radically wow gold 10000
change your life Isis. Experience has shown me that the only means for me to be absolutely certain that the person who requests my work Get free WOW gold is going wow gold sale to make the effort and implicate himself or herself to bring about real change is to ask for a small financial participation. Isis, you will understand that if you don't want pulp egg tray to spend a few dollars to ask me to produce this full reading for you whilst I have already spent over
food container 10 hours on your file without asking you for anything at all in return (once again please understand
SRO gold

wowgoldme said...

cheep wow gold,buy wow goldworld of warcrft gold.

Anonymous said...

China Highlights
China Highlights
China Tours
China Hotels
China Attractions
Beijing China Travel
Shanghai China Travel
Xi'an China Travel
Guilin China Travel
Yangshuo China Travel

mmoga said...

wow gold
buy wow gold
wow levelservice
wow account
wow gold
buy wow gold
wow levelservice
wow account
wow gold
buy wow gold
wow levelservice
wow account
wow gold
buy wow gold
wow levelservice
wow account
wow gold
buy wow gold
wow levelservice
wow account

Anonymous said...

Do you know the warhammer gold, In here you can buy the warhammer Online gold, Do you know that the warhammer money in the game is very important, If you had more cheap warhammer Online gold . I think you can get the tall level, quickly come here to buy warhammer gold.

Welcome to the 2moons dil, In here you can buy the 2moons gold, Do you know that the 2moon dil in the game is very important, If you had more cheap 2moons gold. I think you can get the tall level, quickly come here to buy 2moons dil.

huangtiao said...

You do not need any skills and more necessary rohan crone for a regular attack, but it still looks like you are using a skill. The armors and weapons which we can use our own rohan gold to buy our favorite is looking very nice. In some places you can not understand what you are doing and sometimes you did not know why and where need to spend the expensive and more rohan online crone. You can bring your own rohan money to buy Still Scroll from shop and use it on someone who you think might use bots in game. If he is confirmed to use bots later, you will get 3 equipments and some rohan online gold from him.
You need to go through long distances sometimes, making you buy a lot of Teleport scrolls with your Rose zuly just to go to the cities. The quests are OK and have a good storyline so far, and you will gain a good amount of experience by grinding and rose zulie too. Something I liked in this game was the nice design of the clothes can have from rose online zuly. There also armor also can gain from rose online zulie sets that can be wore by any class. Another nice thing that I would like to talk about, is that you can have nice Arua ROSE zuly in ROSE Online.

Anonymous said...

The devaluation of the fiesta Gold grows faster than we think of it. I hope it is reflects to the management department about the question of the fiesta money.
It is caused by the continuous influx of fiesta online gold market currencies. On the other hand, buy fiesta Gold is one of these questions. The fiesta online money is one of the causes.
So to have a good attack, you should level your skill in cabal online alz. Also, get the highest level jewelry that you can equip in thecabal alz. This step depends on your skill rank, for lower magic ranks get 4 fast notice arrow skills and your cabal gold. Of course, if you have more cabal money, you can get more in the game. By the way, you can buy pet from other players in buy cabal alz.

belrion said...

buy wow gold

buy wow gold

buy wow account

buy wow gold

xxmy said...

Weekends to people ig2tmean that they can have a two-day wowgold4europe good rest. For example, people [url=http://www.gameusd.org]gameusd[/url]can go out to enjoy themselves or get meinwowgold together with relatives and friends to talk with each storeingame other or watch interesting video tapes with the speebie whole family.
Everyone spends agamegold weekends in his ownmmofly way. Within two days, some people can relax themselves by listening to music, reading novels, or watching ogeworld films. Others perhaps are more active by playing basketball, wimming or mmorpgvip dancing. Different people have different gamesavor relaxations.
I often spend weekends withoggsale my family or my friends. Sometimes my parents take me on a visit to their old friends. Sometimesgamersell I go to the library to study or borrow some books to mmovirtex gain much knowledge. I also go to see various exhibition to broaden rpg trader my vision. An excursion to seashore or mountain resorts is my favorite way of spending weekends. Weekends are always enjoyable for me.

Anonymous said...

Have you heared about the game which you need use priston tale Gold to play, and you can also borrow priston tale Money from other players? But you can buy priston tale Gold, or you will lose the choice if you do not have cheap priston tale Gold. If you get it, you can continue this game.
Have you heared about 9Dragons which you need use 9Dragons gold to play, and you can also borrow 9 Dragons gold from other players? But you can buy 9 Dragons gold, or you will lose the choice if you do not have cheap 9Dragons gold. If you get 9Dragons money, you can continue this game.

said...

You know ,I have some Entropiauniverse ped, and my friend also has some
Entropia Universe Gold, do you kouw they have the same meaning,Both of them can be called
Entropia Universe Money,I just want to
Buy Entropia Universe Gold, because there are many
cheap Entropiauniverse ped.
You know ,I have some Atlantica online Gold, and my friend also has some
Atlantica Gold, do you kouw they have the same meaning,Both of them can be called
Atlantica online money,I just want to
buy Atlantica online Gold, because there are many
cheap Atlantica online Gold.

Anonymous said...

silkroad gold in the silkroad you may or may not notice. I know vitality is very tempting in sro gold. You may be feeling intelligence in silk road gold. You are going to be getting crab pincers which like silkroad online gold, depending on which server you are on. cheap silkroad gold can help you get a high level in short time.
Sword of the New World Vis in which world have one feature. First of all, realize the Sword of the New World Gold is useful to the each new player. You only play with others and buy vis can get happy from the game. You may found the cheap snw vis. However, Sword of the New World money can also save a lot your time.

Anonymous said...

It is the LOTRO Gold which make me very happy these days, my brother says Lord Of The Rings Gold is his favorite games gold he likes, he usually buy some buy LOTRO Gold to start his game and most of the time he will win the cheap Lord Of The Rings Gold</a back

Anonymous said...

It is a very nice game silkroad gold, I like sro gold. You can play it silkroad online gold, you can buy the cheap silk road gold. You smart and buy cheap silkroad gold.
I want give they happy time, twelve sky Gold, I work here with 12sky gold. Though, I can not make much money, twelvesky Gold, But I want to Exercise myself, 12Sky Silver Coins, I get up early 12 sky gold

Anonymous said...

Remembered the first time I played the game and bought wonderland Gold , it is about two years. Since the first day I bought wonderland online Gold , we should know that the day will come sooner or later. And I will not leave my wonderland money . My friends forever, even though I will leave you one day, I will remember you forever. At that time, I was a naive; I must used money to buy wonderland Gold , as that I would not depend on myself. But I was not regret to buy cheap wonderland online Gold . It is just a way bring me to the success.

To buy shaiya gold , it is not the aim of the shaiya. It is the game which brings a lot of happiness to me. We buy the shaiya money together. The beautiful story, we can not be forgotten, buy shaiya gold . You will not regret to have cheap shaiya gold . So I will continue to have shaiya online gold , it is a beautiful fairy tale, it looks like my life.

lanzi said...

I can get ro zeny cheaply,
Yesterday i want to buy ragnarok zenyfor my brother.
i hope him like it. i will buy iro zeny for him
as birthday present. i like the ragnarok online zeny very much.
I usually buy cheap zeny and keep it in my store.
I can get Metin2 gold cheaply,
Yesterday i want to buy Metin2 yangfor my brother.
i hope him like it. i willBuy metin2 gold for him
as birthday present. i like theCheap metin2 gold very much.
I usually buy Cheap metin2 yang and keep it in my store.

Anonymous said...

Do you want to know the magic of online games, and here you can get more angels gold. Do you want to have a try? Come on and angels online gold can make you happy. You can change a lot buy angels gold for play games. And you can use the cheap angels online gold do what you want to do in the online game.
Do you want to know the magic of online games, and here you can get more Rose zuly. Do you want to have a try? Come on and rose zulie can make you happy.You can change a lot rose online zuly for play games. Playing online games can make much rose online zulie. And you can Arua ROSE zuly do what you want to do in the online game.

qwe said...

rohan crone has many ways for us to use. When you start the Rohan Online game, your character will be level 1. I remembered that when I started playing this Rohan game with some little cheap rohan money. My friends all told me that the best way to spend rohan online gold is a good way. But I could not like spending my own rohan online crone. If you do not like upgrading level step by step, you can cost rohan gold to help your character to reach level high.
rf gold which in RF Online Game is very popular for many players. Play this online game the premise that we have more enough rf online gold first. They are able to combine creative tools and weapons with some rf money and the Light form of universal magic. Under such sustained attacks they fell from power, yet they have bided their rf cp and time. Due to make cheap rf gold the intense gravity on their home planet, the Bellato are the smallest people.

yanhui said...

I think goonzu is my favorite game, I did not know how to play at first, someone told me that you must have goonzu gold. That he gave me some goonzu money, and then he said that I could buy goonzu gold, but I did not have so much money, and then I played it in all my spare time. From then on, I have got a lot of goonzu online gold, if I did not continue to play it, I can sell cheap goonzu gold to anyone who want.

Once I played GuildWars, I did not know how to get strong, someone told me that you must have gw gold. He gave me some GuildWars Gold, he said that I could buy Guild Wars Gold, but I did not have money, then I played it all my spare time. From then on, I got some GuildWars money, if I did not continue to play it, I can sell cheap gw gold to anyone who want.

Anonymous said...

My friends and I like to buy habbo credits, because the habbo gold is very useful to upgrade equipment. Only your equipment becomes better, then you can win this game. In habbo coins, you can buy everything you want in this game. Tomorrow will be my birthday, so my friends promise to buy habbo gold as gifts. I am so happy. They understand me so well, cheap habbo credits is my favorite.
I like hero gold very much because it is very useful. In fact at first sight I have fallen in love with hero online gold. So no matter how much I have spent to buy hero gold, I never regret. Because of hero online money, I meet a lot of friends. So I never hesitate to buy hero money.

Anonymous said...

As a new player , you may need some game guides or information to enhance yourself.
Rose zuly is one of the hardest theme for every class at the beginning . You must have a good way to manage your rose zulie.If yor are a lucky guy ,you can earn so many rose online zuly by yourself . But if you are a not , I just find a nice way to get rose online zulie. If you need , you can Arua ROSE zuly at our website . Go to the related page and check the detailed information . Once you have any question , you can connect our customer service at any time .


Making angels goldis the old question : Honestly there is no fast way to make lots of angels online gold . Sadly enough a lot of the people that all of a sudden come to with millions of buy angels gold almost overnight probably duped .
here I will tell you all of the ways that I know and what I do to cheap angels online gold.