Explore Your Storage with FileBench
18 Jul '08 - 20:51 by benrFileBench is one of the most powerful and flexible benchmarking tools around. Your typical tool like Bonnie++ or IOzone tend to take some discrete operation and do it multiple times at differing block sizes (8K file in 1K blocks, 8K file in 2K blocks, etc). These commonly used benchmarks are known as "micro-benchmarks". Using them tends to be controversial and can be confusing, leading to claims like "My new Seagate disk gets 800MB/s!!!" In order to make them useful you need to use DirectIO or preform operations that are larger than you installed RAM to avoid "cache effect".
By contrast, FileBench is better described as an "application simulator" or as I prefer to call it, a "workload generator". Whereas most benchmarks may use only a single file, FileBench creates filesets prior to actually running a workload. In this way, it can pre-create thousands of files in hundreds of directories with file of varying sizes (all with in given ranges) on which to actually test. This gives you much more realistic ideas of what performance may actually look like in production.
FileBench workloads are actually scripts in the "F" language which define flowops, such as createfile, deletefile, fsync, closefile, etc. This means that you can effectively model bazaar or unusual scenarios, like creating thousands of new files, writing 1 byte, and closing each. Furthermore, because we're working on a much larger scale, we can leave caching enabled to see how caching helps or hurts a workload.
All that said, FileBench is somewhat non-intuative and is in a lot of flux now. These things are slowly being worked out, and I myself am trying to chip in, but there is a lot of polish to be slapped on this thing.
To get started with FileBench, download the latest version. Packages are available for Solaris (X86 & SPARC), as well as source. Please note that if you install on SPARC or in a Zone the "isaexec" links will fail... in that case, just copy the appropriate binaries (amd64/ or sparc/) into /opt/filebench/bin. Furthermore, please note that the "amd64/" is a farce, FileBench is distributed 32bit X86, not 64bit. (That'll be fixed soon.)
Running a Single Workload
In /opt/filebench/bin/(platform/) you will find a binary called "go_filebench", this is Filebench itself. Invoking it will start an interactive shell. Here you can load a workload to run. The workloads are found in /opt/filebench/workloads. The workloads are "F" script files that you can look at and modify to fit your specific need. Each workload has variables associated with it that determine where to run the benchmark (the directory or filesystem you wish to test), number of files, filesize, thread count, etc. We can either create a custom workload with the variable values we want, or we can modify them in the interactive shell prior to run.
Lets take a simple example. In this case I've decided to run the "varmail" workload on "/pool/test" (a ZFS dataset):
root@ultra ~$ /opt/filebench/bin/amd64/go_filebench FileBench Version 1.3.3 filebench> load varmail 8429: 4.475: Varmail Version 2.1 personality successfully loaded 8429: 4.475: Usage: set $dir=8429: 4.475: set $filesize= defaults to 16384 8429: 4.476: set $nfiles= defaults to 1000 8429: 4.476: set $nthreads= defaults to 16 8429: 4.476: set $meaniosize= defaults to 16384 8429: 4.476: set $readiosize= defaults to 1048576 8429: 4.476: set $meandirwidth= defaults to 1000000 8429: 4.476: (sets mean dir width and dir depth is calculated as log (width, nfiles) 8429: 4.476: dirdepth therefore defaults to dir depth of 1 as in postmark 8429: 4.476: set $meandir lower to increase depth beyond 1 if desired) 8429: 4.476: 8429: 4.476: run runtime (e.g. run 60) filebench> set $dir=/pool/test filebench> run 60 8429: 39.650: Creating/pre-allocating files and filesets 8429: 39.656: Fileset bigfileset: 1000 files, avg dir = 1000000, avg depth = 0.5, mbyte s=15 8429: 39.657: Creating fileset bigfileset... 8429: 46.876: Preallocated 812 of 1000 of fileset bigfileset in 8 seconds 8429: 46.876: waiting for fileset pre-allocation to finish 8429: 46.876: Starting 1 filereader instances 8430: 47.883: Starting 16 filereaderthread threads 8429: 50.893: Running... 8429: 111.443: Run took 60 seconds... 8429: 111.445: Per-Operation Breakdown closefile4 382ops/s 0.0mb/s 0.0ms/op 5us/op-cpu readfile4 382ops/s 6.3mb/s 0.0ms/op 28us/op-cpu openfile4 382ops/s 0.0mb/s 0.0ms/op 29us/op-cpu closefile3 382ops/s 0.0mb/s 0.0ms/op 6us/op-cpu fsyncfile3 382ops/s 0.0mb/s 19.8ms/op 31us/op-cpu appendfilerand3 382ops/s 3.0mb/s 0.0ms/op 43us/op-cpu readfile3 382ops/s 6.3mb/s 0.0ms/op 28us/op-cpu openfile3 382ops/s 0.0mb/s 0.0ms/op 29us/op-cpu closefile2 382ops/s 0.0mb/s 0.0ms/op 6us/op-cpu fsyncfile2 382ops/s 0.0mb/s 20.8ms/op 34us/op-cpu appendfilerand2 382ops/s 3.0mb/s 0.0ms/op 32us/op-cpu createfile2 382ops/s 0.0mb/s 0.1ms/op 71us/op-cpu deletefile1 382ops/s 0.0mb/s 0.0ms/op 44us/op-cpu 8429: 111.445: IO Summary: 300414 ops 4961.5 ops/s, (763/763 r/w) 18.6mb/s, 145us cpu/op, 10.2ms latency 8429: 111.445: Shutting down processes filebench> quit
Here I loaded the "varmail" workload (actual file is "/opt/filebench/workloads/varmail.f") and set the directory to run in as my test directory. The rest of the defaults I leave alone. In the output we see that first it created a fileset, in this case it created 1000 files in 1 directory, each file with a random size.... here's a look:
root@ultra 00000001$ ls -lh | more total 11M -rw-r--r-- 1 root root 3.7K Jul 18 15:31 00000001 -rw-r--r-- 1 root root 7.6K Jul 18 15:31 00000002 -rw-r--r-- 1 root root 11K Jul 18 15:31 00000003 -rw-r--r-- 1 root root 5.6K Jul 18 15:31 00000004 -rw-r--r-- 1 root root 13K Jul 18 15:31 00000005 -rw-r--r-- 1 root root 1.4K Jul 18 15:31 00000006 -rw-r--r-- 1 root root 16K Jul 18 15:31 00000007 -rw-r--r-- 1 root root 921 Jul 18 15:31 00000008 -rw-r--r-- 1 root root 8.2K Jul 18 15:31 00000009 -rw-r--r-- 1 root root 15K Jul 18 15:31 00000010 -rw-r--r-- 1 root root 11K Jul 18 15:31 00000011 -rw-r--r-- 1 root root 7.2K Jul 18 15:31 00000012 -rw-r--r-- 1 root root 7.9K Jul 18 15:31 00000013 -rw-r--r-- 1 root root 2.7K Jul 18 15:31 00000014 -rw-r--r-- 1 root root 1.1K Jul 18 15:31 00000015
By tweeking the variables we can increase the spread.
Finally, in the output we see that the workload ran for the time (in seconds) that we specified and then dumped out both op specific and aggregate stats. For instance, we can easily see in the output that its fsync's that are the most time consuming operation.
Running Multiple Workloads with BenchPoint
Instead of running just a single workload we commonly want to run several. This might be different workloads or even the same workload repeatedly but with different settings. We can do that with BenchPoint (currently named: "/opt/filebench/bin/filebench"; confusing I know.)
BenchPoint is actually a PERL framework around the FileBench ("go_filebench") binary. It utilizes a profile that defines all the workloads we with to run as well as all the variable settings for those. It then uses some additional scripts to handle special operations (such as exporting/importing ZFS pools after each run) and stats collection (such as watching vmstat during a run).
To get started, go into the /opt/filebench/config/ directory and look at the various *.prof files. When you see one you like, copy it to some other location, such as /tmp. Do not use the profiles in config/ as is!!! Customize them somewhere else!!! Now edit to taste, changing the global $dir to the location you wish to execute the workloads, etc.
Now that we have a customized profile, lets give it a run:
root@ultra config$ cp filemicro.prof /tmp/benr_filemicro.prof
root@ultra config$ cd /tmp
root@ultra tmp$ vi benr_filemicro.prof
...
root@ultra tmp$ more benr_filemicro.prof
# ident "@(#)filemicro.prof 1.2 08/03/31 SMI"
DEFAULTS {
runtime = 60;
dir = /pool/test/;
stats = /tmp/stats;
filesystem = nofs;
description = "FileMicro Testing";
}
Please note, I'm using ZFS but I specified the above filesystem as "nofs"... thats because if you specify "zfs" benchpoint will export/import the zpool prior to each workload... if you do not want this, specify anything other than "zfs".
Now lets run this profile. Please note, you need to be in the local directory with your custom profile and you must omit the ".prof" suffix.
root@ultra tmp$ /opt/filebench/bin/filebench benr_filemicro parsing profile for config: createandalloc Running /tmp/stats/ultra-nofs-benr_filemicro-Jul_18_2008-15h_50m_11s/createandalloc/thisrun.f FileBench Version 1.3.3 8458: 0.021: FileMicro-Create Version 2.1 personality successfully loaded 8458: 0.021: Creating/pre-allocating files and filesets 8458: 0.021: File largefile: mbytes=0 8458: 0.021: Creating file largefile... 8458: 0.021: Preallocated 1 of 1 of file largefile in 1 seconds 8458: 0.021: waiting for fileset pre-allocation to finish 8458: 0.022: Running '/opt/filebench/scripts/fs_flush nofs /pool/test/' filesystem type is: nofs, no action required, so exiting 8458: 0.031: Change dir to /tmp/stats/ultra-nofs-benr_filemicro-Jul_18_2008-15h_50m_11s/createandalloc 8458: 0.031: Starting 1 filecreater instances 8461: 1.035: Starting 1 filecreaterthread threads 8458: 4.045: Running... 8458: 5.055: Run took 1 seconds... 8458: 5.055: Per-Operation Breakdown finish 507ops/s 0.0mb/s 0.0ms/op 2us/op-cpu append-file 508ops/s 507.0mb/s 1.6ms/op 1615us/op-cpu 8458: 5.055: IO Summary: 513 ops 508.0 ops/s, (0/508 r/w) 507.0mb/s, 1666us cpu/op, 1.6ms latency 8458: 5.055: Stats dump to file 'stats.createandalloc.out' 8458: 5.055: in statsdump stats.createandalloc.out 8458: 5.055: Shutting down processes Generating html for /tmp/stats/ultra-nofs-benr_filemicro-Jul_18_2008-15h_50m_11s file = /tmp/stats/ultra-nofs-benr_filemicro-Jul_18_2008-15h_50m_11s/createandalloc/stats.createandalloc.out parsing profile for config: createandallocsync Running /tmp/stats/ultra-nofs-benr_filemicro-Jul_18_2008-15h_50m_11s/createandallocsync/thisrun.f FileBench Version 1.3.3 8469: 0.012: FileMicro-Create Version 2.1 personality successfully loaded ....
The key to success with FileBench isn't in the stats that it outputs, but rather by stats you can gather during its load. Use tools like zpool iostat, iostat, vmstat, or even DTrace.
FileBench also includes several handy utilities to assist in your benchmarking, but I'll discuss those separately in the future.
For more info on FileBench try these links:
- FileBench page on Solaris Internals Wiki
- FileBench page on OpenSolaris.org
- Official Home on SourceForge
Thanks again, Ben.
I’ve had lots of trouble in the past trying to figure out how much of my performance is disk, cache, and network. It can be frustrating when working with simple tools like bonnie++ and custom scripts. I’ll be taking a look at this shortly.
After all, you really can’t know something is working as you expect until you test it.
drew (Email) - 21 July '08 - 17:51
Занимаюсь дизайном и хочу попросить автора [[http://www.cuddletech.com]] отправить шаьлончик на мой мыил) Готов заплатить...Bounk (Email) (URL) - 19 October '08 - 07:54
Дабе немного отвлечься, предлагаю высказывать мнение за чертой о предыдущем пользователе.Например:—-(делаем такую черту)
Позитивная запись, ещё бы немного длиннее и в самый раз. (это текст)
Идею взял с ЖЖ ) Надеюсь поддержите!
Ð¤Ð¾Ñ‚Ð¾Ð³Ñ€Ð°Ñ (Email) (URL) - 01 November '08 - 04:28
Good post.Althea (Email) (URL) - 07 November '08 - 10:41
You write very well.Lajuana (Email) (URL) - 09 November '08 - 19:42
It can be frustrating when working with simple tools like bonnie++ and custom scripts. I’ll be taking a look at this shortly.Chris (Email) (URL) - 10 May '09 - 07:10
Thank you very muched hardy clothing (Email) (URL) - 11 November '09 - 03:06
Great post! Hope to be better. Better means more features.good post,I think so!
Thanks for your information, i have read it, very good！
Bing is a really overlord!! support Bing~~
This is great news. Best of luck for the future and keep up the good work.
tiffany and co (Email) (URL) - 19 November '09 - 01:45
[[http://www.buykamagra.com]] buy kamagra[[http://www.viagracialis.com]] viagra cialis
M65 Jacket (Email) (URL) - 21 January '10 - 02:46
Nike outlet & Adidas outlet expand NBA All Star shoes online, we assure you top quality but low enough price. Complete in styles, and update new products everyday! Hot selling, free and fast shipping for you![[http://www.nike-star-shoes.net/]] NBA basketball shoesnike outlet (Email) (URL) - 29 January '10 - 07:17
New battery review module surface is black, not because of the positive electrode exists, the module is likely to be integrated back contact silicon solar cells, silicon, where the role is often to extend the service life of equipment.Mitsubishi motors in October 2009 28-30 at the yokohama exhibition center held the Pacific “GreenDevice2009″ displayed on the high efficiency solar camera battery 19.1% respectively. In the square 15cm in polysilicon solar cells, realized the highest efficiency. The research achievements in 2009 September 2009 and the application of physics to the international society in October EUPVSEC “, “said in a statement.battery review (Email) (URL) - 30 January '10 - 03:44
Yooo great job with this post! LOL it did something for me.Thanks for the excellent review!
kobe bryant shoes (Email) (URL) - 08 February '10 - 01:25
Yooo great job with this post! LOL it did something for me.Thanks for the excellent review!
[[http://www.nike-star-shoes.net/Kobe_Br..]]
kobe bryant shoes (Email) (URL) - 08 February '10 - 01:25
[url=[[http://www.ed-hardy-tshirt.com/ed-hard..]] Hardy Men Polo Shirts[/url][url=[[http://www.ed-hardy-tshirt.com/ed-hard..]] Hardy Men Short Shirts[/url]
haozi (Email) - 24 March '10 - 08:02
ED Hardy Women ClothingED Hardy Men Beach Pants
haozi (Email) (URL) - 24 March '10 - 08:02
goodChristian Louboutin Shoes (Email) (URL) - 13 April '10 - 02:03
Nice web.Bryant’s low basketball shoes Zoom kobe v design inspiration originates from an unexpected place: football.Tony (Email) (URL) - 21 April '10 - 09:31
Nike outlet & Adidas outlet expand NBA All Star shoes online, we assure you top quality but low enough price.nike shox (Email) (URL) - 22 April '10 - 06:25
Web is professional.I have bought a pair of nike blazer shoes from a worldwide [url=[[http://www.nfljerseysno1.com][b]Kobe]] 5[/b][/url] shopping website. Happy to share it with you sincerly.Tom (Email) (URL) - 22 April '10 - 09:40
P90x .It really is not expensive if you factor in the costof a gym membership,P90x workout . The cost for P90X is
about three months of a paid gym membership but you get to
keep the program foreverP90x . You can try many of the
online sites, but it will be the same as buying from the
company or a Beachbody Coach. Make sure you are getting
original DVD’s. People are selling copies all over. The
problem is how long will they last, P90x workout ,and you
truly need the exercise and nutrition guide to even follow
the program. You can go to any site or you can go to
[[http://www.p90xmall.com]] and click on products. P90x dvd You can
order directly from the site,P90x dvd.
p90x (Email) (URL) - 05 May '10 - 06:11
for best web online store [[http://www.salepumashoes.com]]puma (Email) (URL) - 08 May '10 - 12:24
A good idea! [[http://www.offerreplicawatches.com.The..]] sell Chanel Watches, Replica BRM Watches,offer Cartier Watches, Copy Ebel Watches, Replica Hublot Watches, Fake Tag Heuer Watches, wholesale Richard Mille Watches.They also sell some very fashion watches, such as Montblanc Watches for sale,Chopard Watches, Dior Watches and Gucci Watches. Rolex watches are hot sell. If u are Armani Watches and Breitling Watches fan. You can still look at Omega Watches and Longines Watches, many new arrivals watches just come here.You can have a try on 58338312391273913. :[url=[[http://www.offerreplicawatches.com]www..]]].
Replica Chanel Watches,Dvd Boxes (Email) (URL) - 12 May '10 - 07:41
High-speed to the summer day of 2010,today is especially hot,it’s time for us to prepare shoes for summer,manolo blahnik shoes,ysl shoes and christian louboutin shoes may good for you,most of them are not expensive as you think.As you know manolo blahnik, ysl ,and christian louboutin are famous and fashion brands.luxury christian louboutin using only the highest quality materials. We bring you the finest quality, at the lowest prices.louboutin (Email) (URL) - 12 May '10 - 12:24
Dell inspiron 640m Battery [[http://www.adapterlist.com/dell/inspir..]]laptop battery (Email) (URL) - 14 May '10 - 09:39
Panasonic VW-VBG260 Battery [[http://www.globallaptopbattery.co.uk/c..]]laptop batteries (Email) (URL) - 14 May '10 - 09:43
All that said, FileBench is somewhat non-intuative and is in a lot of flux now. These things are slowly being worked out, and I myself am trying to chip in, but there is a lot of polish to be slapped on this thing. [url=[[http://www.mydiscountjordanshoes.com/a..]]]] air-jordan-xv[/url]
air jordan xv (Email) (URL) - 15 May '10 - 03:48
Great nike blazer shoes with high quality and economical price. Free shipping condition.The wonderful nike blazer shoes i love it.Tom (Email) (URL) - 17 May '10 - 14:09
Amazing stuff,Thanks so much for this!This is very useful post for me. This will absolutely going to help me in my projectsSwiss Rolex Watches (Email) (URL) - 20 May '10 - 11:25
welcome here to hava a look ,you wil find what you want for girls..happy to your account from I ![[http://www.christianlouboutinshoesmall..]]
ysl shoes (Email) (URL) - 25 May '10 - 07:40
YEAH!!，it’s focused on by the fashion world!the fashion chage our life style and how to feel life.
[[http://www.christianlouboutinshoesmall..]]
ysl shoes (Email) (URL) - 25 May '10 - 07:43
In the new series, as well as her old favourites such as Jimmy Choo and Narciso Rodriguez, look out for shoes from newcomer Giuseppe Zanotti and cap-toe lambskin ballet shoes at pounds 250 by Chanel. Carrie is also seen wearing manolo blahnik shoes.ysl shoes (Email) (URL) - 26 May '10 - 06:40
I just have one question – how well does that heart hold your shoes on? heart thong sandals by YSL Shoes ,Shoes and Boots, spring shoes, summer-shoes, Yves-Saint-Laurent Share This .add to [[http://www.christianlouboutinshoesmall..]]manolo blahnik shoes (Email) (URL) - 26 May '10 - 06:44
Buy Nike Air Max 90 Shoes just $45-55 USD in[[http://www.iofferitems.com,]], 40-70% Off. Cheap Air Max 90 Shoes, Free Shipping! Buy Air Max 90 Now!nike air max 90 shoes (Email) (URL) - 28 May '10 - 01:35
thank you for sharing the article.The easy-to-use Video Converter for Mac lets you to enjoy your videos on all sorts of palyback including PSP, iPod, Mobile Phone, Zune, iPhone, Apple TV and MP4/MP3 player.
Free download supported. [[http://www.videoconverterformac.com]]
video converter for mac (Email) (URL) - 28 May '10 - 05:09
This is a good,common sense article.Very helpful to one who is just finding the resouces about this part.It will certainly help educate me.Replica Tag Heuer Watches (Email) (URL) - 31 May '10 - 12:12
[[http://www.mbtshoeslatest.com]][[http://www.nikeairmaxshoe.com]]
Nike air max shoe (Email) (URL) - 24 June '10 - 06:15
good [url=[[http://www.nfljerseysno1.com][b]nike]] blazer shoes[/b][/url] in low price and high quality,Free shipping within 7 days.worth your expection.rock (Email) (URL) - 06 July '10 - 02:55
Web is professional with good content.I have bought a pair of [url=[[http://www.nfljerseysno1.com][b]Nike]] free 5.0 V4 [/b][/url] online. very nice.rock (Email) (URL) - 16 July '10 - 07:34
Web is professional. Share with you a good Nike Lunar Glide+ shoes store sincerly.you can find a nice and cheap one which fit you.Free shipping within 7 days.rock (Email) (URL) - 20 July '10 - 05:47
ed hardy[url=[[http://www.ed-hardy.cc/]ed]] hardy[/url]
[[http://www.ed-hardy.cc/ed-hardy-clothi..]] ed hardy clothes
ed hardy (Email) (URL) - 22 July '10 - 02:44
Hello This is a great blog keep your good work and thank you for hvar in with me Nike free 5.0 shoesSo nice to hear frome you.Thanks!flanan (Email) (URL) - 22 July '10 - 06:07
apparantly he’s ordered shizz Nike free 5.0 shoesfor a celebratory party in the South beach thus it appearance Nike Free 5.0 V4for instance Miami it is. I still think its kinda self indulgent him having a tv exhibit to announce it thofrance (Email) (URL) - 26 July '10 - 07:23
[url=[[http://www.cheapjerseyschina.com]disco..]] nfl jerseys from china[/url][url=[[http://www.cheapjerseyschina.com]disco..]] nfl jerseys wholesale[/url]
tanglnog (Email) (URL) - 07 August '10 - 02:29
The first layer of MBT Shoes means a high quality MBT Footwear cowhide after processing of machine. The main feature of MBT first layer cowhide: Masai Shoes surface layer are made of grain materials with close woven fibers; MBT Sandals feature smooth feeling, good strength and great abrasive resistance. MBT Medical Shoes lining are composed of suede with thick fiber, big diameter and flocking wool on the surface. Comparing with second layer of Discount MBT Sheos, first layer of MBT Shoes Cheap with more smooth surface and better quality, can be worn longer time. Our website launches MBT Outlet with first layer cowhide, so you can feel free to shop here and get satisfied MBT Shoes Clearance, including MBT Sawa, MBT Sirima, MBT Kaya, MBT Changa and so on .Welcome to our website: [[http://www.mbtshoesmasai.com]]
mbtshoesmasai (Email) (URL) - 09 August '10 - 02:57
Life stories of some men make one ugg boots cheap succumb to their ingenuity. Some people have proved and some are proving without a second cheap ugg boot store doubt that they are winners. Anybody,uggs on sale in uk who has read “A Beautiful Mind” or has watched a movie by the same name, can never remain untouched by the courage of a sundance tall ugg schizophrenic Prof. Nash who overcame the disease by merely accepting the haunting illusions and getting the uggs sundance coveted Noble prize for game theory. Political ugg classic tall boots leaders, Writers, Economist, Musicians and Sportsmen have been a beacon to their uggs classic tall fellowmen.It is from Act II Scene I Duke Senior, the banished duke says about uggs bailey button boots Sweet uses of adversity.To quote a part of it “Sweet are the uses of adversity, Which, like the toad, ugly and venomous, Wears yet a precious jewel in his bailey uggs uk head; And this our life exempt from public haunt Finds tongues in ugg argyle knit sale trees, books in the running cheap argyle uggs brooks, Sermons in stones and good in every thing.This approach closely follows the ugg classic cardy boots white cheap philosophical approach with a beauty of its own. To appreciate the beauty of life one can relish the works of artists and writers of renaissance period. Be it Da Vinci with the ethereal Mona Lisa, Rembrandt or Monet with classic cardy Water Lillies brought out the essence of life. [[http://www.uggsbailey.co.uk/sitemap.ht..]] LIJclassic cardy (Email) (URL) - 20 August '10 - 08:04
excellent article , I added you to my [[http://www.china-wholesale-directory.c..]] Top China Wholesalers category.. thanks for sharing the article!China Wholesale Directory (Email) (URL) - 25 August '10 - 08:12
very cool article ,thanks for sharing the article!like my cool stuff .very useful.uCoolStuff is the leading China wholesaler for [[http://www.ucoolstuff.com]] cool stuff [[http://www.ucoolstuff.com]] cool gifts , unusual gadgets and other unique gift ideas. We provide the very latest cool stuff and cool gifts for you