Monitoring with Zabbix

With a new site comes new opportunity. When Joyent recently added a new facility I decided to look at new monitoring solutions. We previous were standardized on Sun X4100, Sun T1000′s, and Sun X4500′s with a network using Force10 and F5. This new site would replace the X4100′s with Sun X4150′s and Dell 2950′s. Having largely avoided Dell in the past I took my time to get to know the system well and knowing that IPMI is far more utilized in that arena than with most Sun systems I was given the oppertunity to get a whole new appreciation for IPMI 2.0. Armed with this new knowledge I wanted to take our monitoring much further than we had in the past to monitoring individual BMC sensors via IPMI. This meant looking at monitoring solutions in a much deeper way.

Zabbix quickly rose to the top of my list. In the initial phase I grabbed Zabbix and Zenoss and planned for a face off. Zabbix compiles nicely and easily on Solaris/X86 and within about 30 minutes I had a server up and I created an agent tarball complete with installation script so that deploying an agent was as easy as a wget, untar, and “install.sh”. Zenoss, however, gave me problems, dealing with Python isn’t my strong point and several dependancies were required, and then I had problem after problem getting things to build properly… after about an hour I decided that as pretty as Zenoss looks in those screenshots it was out of the running for the time being.

Zabbix isn’t pretty… I’ll be honest. If you want a “tactical view” to put on an overhead projector in your NOC, Zabbix won’t give you that Hollywood movie feel. Zabbix does make up for that short coming in raw power. Let me explain…

Zabbix is agent based, you can choose to avoid this but you’ll loose most of what makes Zabbix so great. Is implemented in C and easily portable, so you don’t need to worry about having Java or Python on all the monitored hosts like many of its competitors. It adds to this the standard assortment of SNMP, custom script, and external checks (icmp, ftp, etc) you expect. Where it adds something really interesting is its WEB (why they put this in all caps I don’t know) monitoring capabilities which allow you to do more than just fetch a page but actually supply “steps” such as logging into a site and navigating around, to which response times are stored allowing you to alert someone if the login process takes more than 5 seconds or something. Very handy indeed.

Zabbix agents and other checks associate data with “keys”, these keys are then bound to “items” that describe the data and define how often to update the given data. These items are then associated with various alert conditions called “triggers”. For instance, the agent by default returns the number of users connected with the key “system.users.num”, and the stock template associates the “Number of users connected” item with that key which is polled every 60 seconds. So now we can create any number of different alert conditions based on the number of users logged in by creating triggers. One default trigger is “Too may users connected on server {HOSTNAME}” (where HOSTNAME is replaced ultimately with the appropriate host), which uses the following expression/condition:

{Template_Joyent:system.users.num.last(0)}>50

In this case, the trigger is associated with my “Template_Joyent”. The function “last(0)” (meaning the last value you polled) is applied to the key “system.users.num”, and if the value is greater than 50 the condition is true. In Zabbix all conditions should evaluate to false when things are fine. Each trigger has a Severity associated with it, in this case “Average”. So the result here is that any user configured to get alerts for Average or higher severity will get a notification when more than 50 users are logged in.

Zabbix provides a rich set of functions by which to create your triggers, such as average change over time, min and max, absolute difference, etc. This means that I could, for instance, create a trigger that alerted me if since the last polling interval more than 10 users logged in or if the average number of users over the course of an hour exceeded 50.

Where this becomes really powerful is when you choose to extend your agents. In each agents configuration file you can supply a “UserParameter” directive which runs some command and returns it with a given key. Here are some simple examples:

# SMF
UserParameter=smf.online,svcs -a | grep online | wc -l
UserParameter=smf.offline,svcs -a | grep offline | wc -l
UserParameter=smf.maintance,svcs -a | grep maint | wc -l
# X4150 IPMI (BMC Direct)
UserParameter=ipmi.amb,/usr/sbin/ipmitool sensor reading "Ambient Temp0" | cut -f2 -d|

UserParameter takes two arguments which are comma delimated: the key name and the command to run. In the above, I can return the number of “online” SMF Services by grepping out of “svcs -a” and then returning that as “smf.online”. Restart the agent, go back to the server and add a new Item for this key and start creating triggers. Now I can be alerted if, for instance, the number of online services decreases by some number in a given time. The IPMI example there provides a workaround for environments where you may not have access to the management port of your server and instead want to return IPMI data directly from the OS using ‘ipmitool’.

These examples above are simplistic, you can get more advanced by allowing the server to pass arguments. For example, if you want to monitor disk ops, you probably don’t want to add a separate key for each disk, thus you could specify the disk name back on the server which is passed to your agent as an argument.

These abilities remove a lot of the cruft and put the power into your hands. If you have a highly customized environment Zabbix is a great choice.

However, in Zabbix 1.4 there is a lot more that is needed. Currently features like escalations are planned but not expected till Zabbix 1.6. Without features like limiting repeat pages your forced to get your triggers properly defined rather than masking away false-positives in your alerting policy, such as the way Nagios handles “flapping”.

The “Overview” (all in one view of the world) page is something that takes some getting used to. Rather than a pretty page in black with “0 Services Down, 0 Servers Down” Nagios style page you instead get a list of defined triggers and a column for each monitored host which is color coded. If the box is green, life is good. If the box is red, life isn’t. Several nifty things like flashing green if the trigger is fine now but wasn’t less than 15 minutes ago are handy but sometimes annoying especially during testing.

But, and this is a big but, Zabbix does give you something exceedingly useful… all the monitored keys can be graphed. Click on the color block of any monitored trigger and you can view its value history as a graph. This means that you can take add-on graphing applications like Cacti or MRTG and roll the functionality directly into Zabbix. Want to know what load average has looked like for the last week? No problem. And, add to this the ability to custom create graphs which can combine multiple keys into a single view.

If you see a screenshot with pretty graphs all over it on the Zabbix front page, thats a “Screen”. A screen is a page custom layed out with several custom graphs. So you might want a graph that has the memory usage and load average of every system on your network, you can put those together in a custom graph and then place that on your “Screen”. If you take some time and create some nifty graphs like this you may find ourself looking more at your screen than at the Overview page.

Isn’t as pretty as Zenoss or as streamlined as Nagios, but it really is a SysAdmins tool. It doesn’t hide functions away from you or gloss over details to make you feel nurtured, its all out there gritty and raw for you to use an manipulate. There is a nature learning curve in wrapping your head around the concepts of “items” and “triggers” and how you can combine them in really powerful ways, but before long you’ll be frustrated by the limits of other solutions. Having a full featured and easily extensible agent really is my favorite aspect and frees you from the concerns that come with having to pass around SSH Keys required to make external scripts work with other solutions.

That said, if you decide to implement Zabbix expect to spend some time crafting triggers to suite your needs. If you want to get beyond the basics you’ll need get your hands dirty, which is easy to do after playing with it a bit, but it you want something you can just deploy and forget consider a commercial tool like Uptime.

I’m only grazing the basics here. If you want to learn more check out Zabbix.com.

UPDATE: Screenshots added per comment request.

44 Responses to “Monitoring with Zabbix”

  1. Take a look at opsview. It is a monitoring solution adding HA features like distributed checks and a decent reporting interface to Nagios.

    http://www.opsview.org

  2. John Levon says:

    Nice overview. I look forward to more in the series (can we get
    screenshots next time ;)

  3. Mark McCoy says:

    Zabbix looks pretty nice. I am in the process of installing OpenNMS to test it out, but I may also install Zabbix over the holiday break and have a shootout.

  4. David M. Besonen says:

    OT: from what you’ve seen of Dell’s latest server offerings, from a purely technical perspective, do you still prefer Sun’s hardware?

    [sorry if this posts twice, i tried to use the 'Preview Comment' button but it did not work as i expected and i was left wondering if my comment was eaten.]

  5. Vitaly says:

    Thanks for your review!
    Do you using Zabbix daily? Did you evaluate OpenNMS?

  6. lola says:

    it’s nice site!!! http://us.cyworld.com/altsoba ” rel=”nofollow”>order paxil
    %PP

  7. 1800 says:

    f9C3Ug 1800flowers [url]http://1800flowers.bloges.org/[/url] [url=http://1800flowers.bloges.org/]http://1800flowers.bloges.org/[/url] http://1800flowers.bloges.org/
    [link]http://1800flowers.bloges.org/[/link]

  8. f1800 says:

    [url]http://1800flowers.bloges.org/[/url] oypyvrzqkkniefb [url=http://1800flowers.bloges.org/]http://1800flowers.bloges.org/[/url] xbxeemhud http://1800flowers.bloges.org/ ijhwhxtb [link]http://1800flowers.bloges.org/[/link]

  9. 1800f says:

    7o1h1N Omrfstyidvrjbez [url]http://1800flowers.bloges.org/[/url] akokjvdec [url=http://1800flowers.bloges.org/]http://1800flowers.bloges.org/[/url] tfiifxuxclputu http://1800flowers.bloges.org/ cwpafqlu [link]http://1800flowers.bloges.org/[/link]

  10. bvbcvfdg says:

    WMFkHH vcxdsgcvb363454gdfgdbcv53435654

  11. john says:

    it’s nice site http://patriks.u.yuku.com/ ” rel=”nofollow”>diazepam pills 24102 http://fijyrald.u.yuku.com/ ” rel=”nofollow”>ephedrine =O

  12. advancement says:

    http://map11.weebly.com ” rel=”nofollow”> advancement boy ceremony rank scout
    http://map6.webnode.com ” rel=”nofollow”>advancement association professional researcher

  13. , http://kust1.weebly.com/sneha-nude-actress.html ” rel=”nofollow”>sneha nude actress, ysuc, http://kust1.weebly.com/endras-u-boats.html ” rel=”nofollow”>endras u-boats, =-), http://kust1.weebly.com/free-abbywinter.html ” rel=”nofollow”>free abbywinter, 5378, http://kust1.weebly.com/disadvantages-of-genetically-modified-food.html ” rel=”nofollow”>disadvantages of genetically modified food, 37936, http://kust1.weebly.com/sofiavergaradesnuda.html ” rel=”nofollow”>sofiavergaradesnuda, 766, http://kust1.weebly.com/ls-models-forums.html ” rel=”nofollow”>ls models forums, clbcj, http://kust1.weebly.com/jesse-jane-wallpaper.html ” rel=”nofollow”>jesse jane wallpaper, >:-D, http://kust1.weebly.com/bbs-models.html ” rel=”nofollow”>bbs models, :[[[, http://kust1.weebly.com/sleep-assoult.html ” rel=”nofollow”>sleep assoult, 875552,

  14. , http://kust1.weebly.com/custom-figure.html ” rel=”nofollow”>custom figure, 936, http://kust1.weebly.com/free-passwords-from-raven-riley.html ” rel=”nofollow”>free passwords from raven riley, 356, http://kust1.weebly.com/mark-dalton-zeb-atlas-video.html ” rel=”nofollow”>mark dalton zeb atlas video, yalx, http://kust1.weebly.com/ls-teen-models.html ” rel=”nofollow”>ls teen models, 8-[, http://kust1.weebly.com/adding-and-subtracting-intergers-worksheets.html ” rel=”nofollow”>adding and subtracting intergers worksheets, yabo, http://kust1.weebly.com/akira-lane-gallery.html ” rel=”nofollow”>akira lane gallery, 2624, http://kust1.weebly.com/ann-angel-free-pics.html ” rel=”nofollow”>ann angel free pics, :-P PP, http://kust1.weebly.com/shotgun-gauge.html ” rel=”nofollow”>shotgun gauge, npzci, http://kust1.weebly.com/free-watching-pirates.html ” rel=”nofollow”>free watching pirates, wgb,

  15. , http://ded2.idoo.com/beautiful-agony-free-online.html ” rel=”nofollow”>beautiful agony free online, 41721, http://ded2.idoo.com/sunny-leonne.html ” rel=”nofollow”>sunny leonne, mxbmo, http://ded2.idoo.com/emily-procter-in-bikini.html ” rel=”nofollow”>emily procter in bikini, vtb, http://ded2.idoo.com/srilankan-nudes.html ” rel=”nofollow”>srilankan nudes, %DD, http://ded2.idoo.com/abby-winters-password.html ” rel=”nofollow”>abby winters password, 40272, http://ded2.idoo.com/abbeys-winters-free.html ” rel=”nofollow”>abbeys winters free, >:DD, http://ded2.idoo.com/farang-ding-dong-girls-free.html ” rel=”nofollow”>farang ding dong girls free, 6543, http://ded2.idoo.com/sabrinasabroc.html ” rel=”nofollow”>sabrinasabroc, zbg, http://ded2.idoo.com/ls-modrls.html ” rel=”nofollow”>ls modrls, =PPP,

  16. , http://changa1.idoo.com/comwinx-clubhtml.html ” rel=”nofollow”>com/winx-club.html, 0872, http://changa1.idoo.com/how-many-zero-in-billion.html ” rel=”nofollow”>how many zero in billion, 8690, http://changa1.idoo.com/mickie-james-leg-magazine.html ” rel=”nofollow”>mickie james leg magazine, 439133, http://changa1.idoo.com/abbywint.html ” rel=”nofollow”>abbywint, :-O, http://changa1.idoo.com/ice-la-foxx.html ” rel=”nofollow”>ice la foxx, izdxew, http://changa1.idoo.com/club-winx-hentai.html ” rel=”nofollow”>club winx hentai, 8-[, http://changa1.idoo.com/emily-procter.html ” rel=”nofollow”>emily procter, 25833, http://changa1.idoo.com/samantha-anderson.html ” rel=”nofollow”>samantha anderson, >:-[, http://changa1.idoo.com/farang-ding-dong-free-video.html ” rel=”nofollow”>farang ding dong free video, =D,

  17. , http://changa1.idoo.com/abby-winters-website-password.html ” rel=”nofollow”>abby winters website password, idv, http://changa1.idoo.com/samantha-38g-anderson.html ” rel=”nofollow”>samantha 38g anderson, =-PPP, http://changa1.idoo.com/abbywint.html ” rel=”nofollow”>abbywint, axyaj, http://changa1.idoo.com/guinevere-and-carli.html ” rel=”nofollow”>guinevere and carli, arzgho, http://changa1.idoo.com/pass-ravenriley.html ” rel=”nofollow”>pass ravenriley, =))), http://changa1.idoo.com/0-in-billion.html ” rel=”nofollow”>0 in billion, 38447, http://changa1.idoo.com/slepp-assult.html ” rel=”nofollow”>slepp assult, 7584, http://changa1.idoo.com/disavantage-of-technologe.html ” rel=”nofollow”>disavantage of technologe, xjalpu, http://changa1.idoo.com/farang-ding-dong-free-video.html ” rel=”nofollow”>farang ding dong free video, hei,

  18. , http://changa2.idoo.com/free-phat-white-booty.html ” rel=”nofollow”>free phat white booty, 220638, http://changa2.idoo.com/tamil-pdf-stories.html ” rel=”nofollow”>tamil pdf stories, wfxjm, http://changa2.idoo.com/how-to-hide-ads-on-myspace.html ” rel=”nofollow”>how to hide ads on myspace, ldvr, http://changa2.idoo.com/winx-igre.html ” rel=”nofollow”>winx igre, 8))), http://changa2.idoo.com/light-brown-booty.html ” rel=”nofollow”>light brown booty, 9754, http://changa2.idoo.com/free-ann-angel-movie.html ” rel=”nofollow”>free ann angel movie, 8DD, http://changa2.idoo.com/locke.html ” rel=”nofollow”>locke, >:-((, http://changa2.idoo.com/beautiful-agony-google.html ” rel=”nofollow”>beautiful agony google, plenqo, http://changa2.idoo.com/zebatlas.html ” rel=”nofollow”>zebatlas, 607599,

  19. , http://gmail6.weebly.com/free-beautiful-agony.html ” rel=”nofollow”>free beautiful agony, sdwge, http://gmail6.weebly.com/sabrina-sabrok-nude.html ” rel=”nofollow”>sabrina sabrok nude, 1011, http://gmail6.weebly.com/free-sleep-assaultcom.html ” rel=”nofollow”>free sleep assault.com, ruy, http://gmail6.weebly.com/how-to-calculate-salary-in-canada.html ” rel=”nofollow”>how to calculate salary in canada, 8-], http://gmail6.weebly.com/nude-sneha.html ” rel=”nofollow”>nude sneha, euf, http://gmail6.weebly.com/mickie-james-roast-beef.html ” rel=”nofollow”>mickie james roast beef, =D, http://gmail6.weebly.com/korean-actress-eugene.html ” rel=”nofollow”>korean actress eugene, oaadc, http://gmail6.weebly.com/ls-model.html ” rel=”nofollow”>ls model, ebpr, http://gmail6.weebly.com/password-abby-winters.html ” rel=”nofollow”>password abby winters, bbpi,

  20. , http://gmail8.weebly.com/hientai-winx.html ” rel=”nofollow”>hientai winx, %-OOO, http://gmail8.weebly.com/samantha-anderson-38g.html ” rel=”nofollow”>samantha anderson 38g, 8D, http://gmail8.weebly.com/cody-lane-movies.html ” rel=”nofollow”>cody lane movies, yoz, http://gmail8.weebly.com/free-assault-videos.html ” rel=”nofollow”>free assault videos, kolyk, http://gmail8.weebly.com/candy-manson-pov.html ” rel=”nofollow”>candy manson pov, 0238, http://gmail8.weebly.com/free-videos-sleep-assault.html ” rel=”nofollow”>free videos sleep assault, 4005, http://gmail8.weebly.com/ashley-brooke-dildo.html ” rel=”nofollow”>ashley brooke dildo, upkd, http://gmail8.weebly.com/winx-pobarvanke.html ” rel=”nofollow”>winx pobarvanke, 8))), http://gmail8.weebly.com/abby-winter-free.html ” rel=”nofollow”>abby winter free, :-) )),

  21. , http://gmail10.weebly.com/breast-reduction-blogs.html ” rel=”nofollow”>breast reduction blogs, 8-D, http://gmail10.weebly.com/eden-mor-video.html ” rel=”nofollow”>eden mor video, cjdd, http://gmail10.weebly.com/christina-model-nude.html ” rel=”nofollow”>christina model nude, hbduha, http://gmail10.weebly.com/carmella-bing-interracial.html ” rel=”nofollow”>carmella bing interracial, 912, http://gmail10.weebly.com/nude-pics-of-sabrina-sabrok.html ” rel=”nofollow”>nude pics of sabrina sabrok, 8-PPP, http://gmail10.weebly.com/marilyn-lange.html ” rel=”nofollow”>marilyn lange, ecw, http://gmail10.weebly.com/christy-hemme-gallery-playboy.html ” rel=”nofollow”>christy hemme gallery playboy, 154, http://gmail10.weebly.com/cody-lane-violent.html ” rel=”nofollow”>cody lane violent, %[[[, http://gmail10.weebly.com/escort-carmella-bing.html ” rel=”nofollow”>escort carmella bing, 4335,

  22. , http://gmail11.weebly.com/video-sleep-assault-gratis.html ” rel=”nofollow”>video sleep assault gratis, 8(, http://gmail11.weebly.com/brookeskye-hardcore.html ” rel=”nofollow”>brookeskye hardcore, 8-OO, http://gmail11.weebly.com/adding-and-subtracting-integers-worksheets-problems.html ” rel=”nofollow”>adding and subtracting integers worksheets problems, =-P, http://gmail11.weebly.com/miko-lee-fans.html ” rel=”nofollow”>miko lee fans, 689, http://gmail11.weebly.com/chelsea-charms-videos.html ” rel=”nofollow”>chelsea charms videos, vizxsd, http://gmail11.weebly.com/winx-club.html ” rel=”nofollow”>winx club, =-DDD, http://gmail11.weebly.com/mickie-james-leg-show.html ” rel=”nofollow”>mickie james leg show, :( (, http://gmail11.weebly.com/ls-models-forum.html ” rel=”nofollow”>ls models forum, =-PPP, http://gmail11.weebly.com/sleep-assault-free-video.html ” rel=”nofollow”>sleep assault free video, gzot,

  23. , http://gmail15.weebly.com/joc-porno-jena.html ” rel=”nofollow”>joc porno jena, ikh, http://gmail15.weebly.com/assault-video.html ” rel=”nofollow”>assault video, 332, http://gmail15.weebly.com/tamil-actress-topless.html ” rel=”nofollow”>tamil actress topless, visyap, http://gmail15.weebly.com/free-full-sleepassault-videos.html ” rel=”nofollow”>free full sleepassault videos, eayp, http://gmail15.weebly.com/multiplying-subtracting-and-adding-integers.html ” rel=”nofollow”>multiplying subtracting and adding integers, vhgf, http://gmail15.weebly.com/mickie-james-in-leg-show-magazine.html ” rel=”nofollow”>mickie james in leg show magazine, %-((, http://gmail15.weebly.com/free-sleep-assult-video.html ” rel=”nofollow”>free sleep assult video, >:-)), http://gmail15.weebly.com/sabrina-sabrok-en-playboy.html ” rel=”nofollow”>sabrina sabrok en playboy, 155382, http://gmail15.weebly.com/gianna-michaels-carmela-bing-shyla.html ” rel=”nofollow”>gianna michaels carmela bing shyla, qqzf,

  24. , http://gmail15.weebly.com/multiplying-subtracting-and-adding-integers.html ” rel=”nofollow”>multiplying subtracting and adding integers, 0596, http://gmail15.weebly.com/sleep-assault-member-pass.html ” rel=”nofollow”>sleep assault member pass, =DDD, http://gmail15.weebly.com/mickie-james-in-leg-show-magazine.html ” rel=”nofollow”>mickie james in leg show magazine, lckh, http://gmail15.weebly.com/jesse-jane-free.html ” rel=”nofollow”>jesse jane free, vyips, http://gmail15.weebly.com/shyla-stylez-and-carmella-bing-and-gianna-michaels.html ” rel=”nofollow”>shyla stylez and carmella bing and gianna michaels, nyxl, http://gmail15.weebly.com/subtracting-integers-worksheet.html ” rel=”nofollow”>subtracting integers worksheet, brvwa, http://gmail15.weebly.com/tamilstories.html ” rel=”nofollow”>tamilstories, 2972, http://gmail15.weebly.com/free-ann-angel-vdeos.html ” rel=”nofollow”>free ann angel vdeos, =(((, http://gmail15.weebly.com/christinamodel-october-sets.html ” rel=”nofollow”>christinamodel october sets, zfqjc,

  25. , http://ferri2.idoo.com/free-pictures-of-danni-ashe.html ” rel=”nofollow”>free pictures of danni ashe, 8-[[[, http://ferri2.idoo.com/free-danni-ashe-nude-galleries.html ” rel=”nofollow”>free danni ashe nude galleries, kfwh, http://ferri2.idoo.com/free-daphne-rosen-clips.html ” rel=”nofollow”>free daphne rosen clips, ymdx, http://ferri2.idoo.com/free-christine-young-videos.html ” rel=”nofollow”>free christine young videos, 8-(, http://ferri2.idoo.com/free-miko-lee-pictures.html ” rel=”nofollow”>free miko lee pictures, aasel, http://ferri2.idoo.com/free-pictures-of-cody-linley.html ” rel=”nofollow”>free pictures of cody linley, 3046, http://ferri2.idoo.com/free-squirting-carly.html ” rel=”nofollow”>free squirting carly, =-PPP, http://ferri2.idoo.com/freeones-casey-parker.html ” rel=”nofollow”>freeones casey parker, 89217, http://ferri2.idoo.com/free-videos-of-dani-woodward.html ” rel=”nofollow”>free videos of dani woodward, 083260,

  26. , http://ferri3.idoo.com/hannah-montana-i-got-nerve.html ” rel=”nofollow”>hannah montana i got nerve, >:-]]], http://ferri3.idoo.com/hannah-montana-as-i-am.html ” rel=”nofollow”>hannah montana as i am, dua, http://ferri3.idoo.com/hannah-montana-pics.html ” rel=”nofollow”>hannah montana pics, svlgx, http://ferri3.idoo.com/hannah-montana-concert-tickets—az.html ” rel=”nofollow”>hannah montana concert tickets az, zefz, http://ferri3.idoo.com/goldie-blair-vs-tanya-danielle.html ” rel=”nofollow”>goldie blair vs tanya danielle, 31803, http://ferri3.idoo.com/hannah-montana-wig.html ” rel=”nofollow”>hannah montana wig, =-))), http://ferri3.idoo.com/hannah-montana-backstage-passes.html ” rel=”nofollow”>hannah montana backstage passes, pjkkpc, http://ferri3.idoo.com/hannah-montana-who-said.html ” rel=”nofollow”>hannah montana who said, =[[, http://ferri3.idoo.com/hannah-montana-halloween-costume.html ” rel=”nofollow”>hannah montana halloween costume, =-(((,

  27. , http://ferri3.idoo.com/hannah-montana-nobodys-perfect.html ” rel=”nofollow”>hannah montana nobodys perfect, hqnax, http://ferri3.idoo.com/hannah-montana-concert-schedule.html ” rel=”nofollow”>hannah montana concert schedule, irscpv, http://ferri3.idoo.com/hannah-montana-best-of-both-worlds.html ” rel=”nofollow”>hannah montana best of both worlds, 612, http://ferri3.idoo.com/gallery-and-chrissy-moran.html ” rel=”nofollow”>gallery and chrissy moran, jtsp, http://ferri3.idoo.com/gianna-michaels—carmella-bing.html ” rel=”nofollow”>gianna michaels carmella bing, ewl, http://ferri3.idoo.com/hannah-montana-theme-song.html ” rel=”nofollow”>hannah montana theme song, 731384, http://ferri3.idoo.com/hannah-montana-party.html ” rel=”nofollow”>hannah montana party, zkh, http://ferri3.idoo.com/hannah-montana-halloween-costumes.html ” rel=”nofollow”>hannah montana halloween costumes, >:-[[, http://ferri3.idoo.com/hannah-montana-one-in-a-million.html ” rel=”nofollow”>hannah montana one in a million, %((,

  28. pexNetereld says:

    May be you prefer [url=http://coloradoski.fortunecity.com/beaver-creek-ski-resort-colorado.html]beaver creek ski resort colorado[/url] ?
    Seeking this [url=http://members.lycos.co.uk/coppermountain/boston-mountain-copper-co.html]boston mountain copper co[/url] .

  29. dingo says:

    The WEB ‘steps’ really need to make use of a ‘cookiejar’, otherwise ‘steps’ doesnt do anything for you at all than just group web multiple requests under a single view.

  30. dingo says:

    also your comment “Isn’t as pretty as Zenoss or as streamlined as Nagios” — came back to haunt me this morning — I had to look up the definition of streamlined. No you must have made an editorial error — Nagios? Streamlined?

  31. cheapest mbt shoes http://www.mbtag.com mbt shoes on sale

  32. SmartMarmot says:

    I currently use zabbix to monitor a really large environment (more than 320 servers)

    I’ve founded a wonderful plugin that is more than a plugin and the others monitoring systems don’t have nothing of similar, and nothing that go inside oracle so deeply.

    In the hope that someone found useful my comment

    http://www.smartmarmot.com

    here you are going to find Orabbix opensource and released under GPL3

  33. Supra says:

    Supra Shoes are some of the art, fatally if you buy a brace concider it an investment because you can bet they position of the legendary sales of organ’s only jackets that went legendary when we kids.

    The mission of Radii footwear is to create unique designs that reflect each individual’s personality, and the Radii 420 Top definitely achieves that.

  34. Do you like the ugg ? Ugg Classic Short Boots are UGG Australia’s original heritage styles. Ugg Classic Tall will keep your feet dry and the ultimate comfortable.
    http://www.ugg-boots-london.com/ugg-classic-short-boots-c-1.html

  35. flowers says:

    Hey!!!
    I was unaware about Zabbix but know I had enough in sequence on it. Thanks for filling me up with great information. I would like to get in row on such topics again.
    flowers

  36. This is realy a good post great work well don.

  37. Linda Hughes says:

    I’m glad I found your blog. I’m brand new with Team Beachbody and I’m looking to network with as many coaches as possible.

    I found this site from my upline coach at http://MyRecruitingSystem.com guy who runs that site recruited over 100 coaches his first month. Him and his wife took the top spot with the chairmans challenge that Beachbody was putting on and Carl is flying to their home to interview them.

    He is allowing a few people outside of his team to use his system and it is awesome. I got the system and ad co-op and recruited 3 new coaches my first week. I also recruited my sister but I don’t think she is going to do much.

    Talk with everyone later

    ♥ Linda in Cali ♥

  38. Pablo says:

    Very interesting article, good job. A question about Zabbix: Is it able to receive and present SNMP traps coming from network devices?