The Joy of IPMI

27 Dec '07 - 22:27 by benr

Chances are you've heard of the Intelligent Platform Management Interface, or IPMI. And chances are very good that you view it as little more than a way to remotely reboot servers. But IPMI is oh so much more than that... wonders await you, should you just take the time to explore a little. So lets start with the basics and work outwards.

Almost any modern server is going to have a Baseboard Management Controller, or BMC for short, on the mainboard. On whitebox motherborads such as Tyan or ASUS this is normally an addon option but any purpose built server from Sun, HP, IBM, SuperMicro, etc, is going to have one on the board out of the box. The BMC acts as a hub for all the various sensor data on the board(s). In years past you might have heard of I2C and SMBus buses and sensors accessible via "lm-sensors", the BMC is the hub for these various sensor buses. The BMC, therefore, has access to all the various sensors on a give system and therefore is rich with useful data. The most common way in which to retrieve that data is via IPMI.

IPMI can be accessed in several ways, these methods are refered to as "channels", as in communications channels. The two most common are via the LAN ("lan") or if your OS has an BMC driver via the local device (commonly "/dev/bmc"). Please note that in many places the acronyms MC and BMC are used interchangeably. Now, to exploit those channels the most common method is to use the Open Source "ipmitool". This tool is found included with most OS's (including Solaris, in /usr/sfw/bin) or can be downloaded on the IPMItool SourceForge page. Other projects exist, including OpenIPMI and GNU's FreeIPMI. All these implementations offer a rich API for writing custom applications and CLI tools for interaction. As I said, IPMItool is by far the most common, so I'll discuss it here.

First to clear up a common misconception... lets take a Dell PowerEdge server. Many are convinced that you need a Dell Remote Access Card (or Controller depending on who you ask), better known as a DRAC, in order to use IPMI. You do not! Service Processors (SP), such as Sun's ILOM and ELOM (on X86, we're ignoring SPARC here) or Dell's DRAC, are not BMC's, rather they are mini-computers on a card, typically running Linux, powered by "trickle" or "standby" power such that they are running even if the mainboard is not running. These cards simply act as a conduit to access the BMC and other functions of the system. The web interfaces on the SP's, for instance, commonly are just passing IPMI commands back to the BMC. Thus, if you click "Power On" in the SP web interface your really just sending an IPMI "power on" command to the BMC. The point is, you do not need an SP to use IPMI with a system! The caviate is, depending on the architecture of the system, you may require an SP to talk to the BMC if the system is not running. For instance, on a Dell PowerEdge you can talk IPMI to the BMC without a DRAC by "Sharing" the first gigabit port, meaning that you really don't need a DRAC at all unless you want the ability to, for instance, get SNMP data which is really just an SNMP agent on the DRAC pulling data from the BMC and returning it as OIDs and branded up as "Dell OpenManage". To keep going with the Dell example, if you SSH onto a DRAC and use the "connect com2" command to do serial redirection, your actually doing a local IPMI Serial-over-LAN session, your just doing it inside the chassis.

Okey, so, IPMI is everywhere. So what can we do with it? Like I said, most people are familiar with this:

$ ipmitool power status
Chassis Power is on

$ ipmitool chassis status
System Power         : on
Power Overload       : false
Power Interlock      : inactive
Main Power Fault     : false
Power Control Fault  : false
Power Restore Policy : always-off
Last Power Event     : command
Chassis Intrusion    : inactive
Front-Panel Lockout  : inactive
Drive Fault          : false
Cooling/Fan Fault    : false
Front Panel Control  : none

$ ipmitool chassis power cycle
...

In the above examples I'm using the local "bmc" communications channel. The command "power" is actually a shortcut for "chassis power", so "ipmtool power cycle" and "ipmitool chassis power cycle" are the same thing. When the "-I (channel)" is not specified, local "bmc" channel is used. Here is a LAN example. (Those above was from a Sun X4150, below are Dell 2950):

$ ipmitool -I lanplus -H 10.0.50.60 -U root -f /ipmi.pass power status
Chassis Power is on

$ ipmitool -I lanplus -H 10.0.50.60 -U root -f /ipmi.pass chassis status
System Power         : on
Power Overload       : false
Power Interlock      : inactive
Main Power Fault     : false
Power Control Fault  : false
Power Restore Policy : always-off
Last Power Event     : 
Chassis Intrusion    : inactive
Front-Panel Lockout  : inactive
Drive Fault          : false
Cooling/Fan Fault    : false
Sleep Button Disable : not allowed
Diag Button Disable  : allowed
Reset Button Disable : not allowed
Power Button Disable : allowed
Sleep Button Disabled: false
Diag Button Disabled : true
Reset Button Disabled: false
Power Button Disabled: true

The syntax above is fairly straight forward. I'm using the "lanplus" channel (the "lan" channel is for IPMI 1.5 commands, whereas "lanplus" is for IPMI 2.0 RMCP+), -H specifies the IP address of the IPMI interface, -U is the IPMI user (typically "root"). In recent releases of ipmitool the -P "password" option has been replaced with "-f /file", the file contains the password in plaintext, this ensures that the IPMI password isn't viewable via a process listing which is seen via "ps -ef" or the SNMP process tables. The default password on Dell PowerEdge servers is "calvin", on Sun Fire servers its "changeme", in both cases the user is "root".

So... what else is there to see? There are two really interesting things to look at...

The first is the Sensor Data Repository (SDR). Here you will find thresholds and values for all the available sensors. Here is an example on a Sun X4100 M2:

$ ipmitool sdr elist
sys.id           | 00h | ok  | 23.0 | State Asserted
sys.intsw        | 01h | ok  | 23.0 | 
sys.psfail       | 02h | ok  | 23.0 | Predictive Failure Deasserted
sys.tempfail     | 03h | ok  | 23.0 | Predictive Failure Deasserted
sys.fanfail      | 04h | ok  | 23.0 | Predictive Failure Deasserted
mb.t_amb         | 05h | ok  |  7.0 | 34 degrees C
mb.v_bat         | 06h | ok  |  7.0 | 2.88 Volts
mb.v_+3v3stby    | 07h | ok  |  7.0 | 3.18 Volts
mb.v_+3v3        | 08h | ok  |  7.0 | 3.34 Volts
mb.v_+5v         | 09h | ok  |  7.0 | 5.02 Volts
mb.v_+12v        | 0Ah | ok  |  7.0 | 12.10 Volts
mb.v_-12v        | 0Bh | ok  |  7.0 | -12.35 Volts
mb.v_+2v5core    | 0Ch | ok  |  7.0 | 2.54 Volts
mb.v_+1v5core    | 0Dh | ok  |  7.0 | 1.53 Volts
mb.v_+1v2core    | 0Eh | ok  |  7.0 | 1.22 Volts
fp.t_amb         | 14h | ok  | 12.0 | 24 degrees C
pdb.t_amb        | 1Bh | ok  | 19.0 | 23 degrees C
io.t_amb         | 22h | ok  | 15.0 | 22 degrees C
bp.power         | 0Fh | ok  | 13.1 | State Deasserted
bp.locate        | 10h | ok  | 13.2 | State Deasserted
bp.locate.btn    | 11h | ok  | 13.2 | State Deasserted
bp.alert         | 12h | ok  | 13.3 | State Deasserted
fp.prsnt         | 13h | ok  | 12.0 | Device Present
fp.usbfail       | 15h | ok  | 12.0 | Predictive Failure Deasserted
fp.power         | 16h | ok  | 12.1 | State Asserted
fp.locate        | 17h | ok  | 12.2 | State Deasserted
fp.locate.btn    | 18h | ok  | 12.2 | State Deasserted
fp.alert         | 19h | ok  | 12.3 | State Deasserted
fp.ledbd.prsnt   | 1Ah | ok  | 12.0 | Device Present
ps0.prsnt        | 1Ch | ok  | 10.0 | Device Present
ps0.vinok        | 1Eh | ok  | 10.0 | State Asserted
ps0.pwrok        | 1Dh | ok  | 10.0 | State Asserted
ps1.prsnt        | 1Fh | ok  | 10.1 | Device Absent
ps1.vinok        | 21h | ns  | 10.1 | Disabled
ps1.pwrok        | 20h | ns  | 10.1 | Disabled
io.id0.prsnt     | 23h | ok  | 15.0 | Device Present
io.id1.prsnt     | 24h | ok  | 15.0 | Device Absent
io.hdd0.fail     | 25h | ok  |  4.0 | Predictive Failure Deasserted
io.hdd1.fail     | 26h | ok  |  4.1 | Predictive Failure Deasserted
io.hdd2.fail     | 27h | ok  |  4.2 | Predictive Failure Deasserted
io.hdd3.fail     | 28h | ok  |  4.3 | Predictive Failure Deasserted
p0.t_core        | 29h | ok  |  3.0 | 24 degrees C
p0.v_vdd         | 2Ah | ok  |  3.0 | 1.38 Volts
p0.v_vddio       | 2Bh | ok  |  3.0 | 1.85 Volts
p0.v_vtt         | 2Ch | ok  |  3.0 | 0.91 Volts
p0.fail          | 2Dh | ok  |  3.0 | Predictive Failure Deasserted
p0.d0.fail       | 2Eh | ok  | 32.0 | Predictive Failure Deasserted
p0.d1.fail       | 2Fh | ok  | 32.1 | Predictive Failure Deasserted
p0.d2.fail       | 30h | ok  | 32.2 | Predictive Failure Deasserted
p0.d3.fail       | 31h | ok  | 32.3 | Predictive Failure Deasserted
p1.t_core        | 32h | ok  |  3.1 | 21 degrees C
p1.v_vdd         | 33h | ok  |  3.1 | 1.38 Volts
p1.v_vddio       | 34h | ok  |  3.1 | 1.85 Volts
p1.v_vtt         | 35h | ok  |  3.1 | 0.91 Volts
p1.fail          | 36h | ok  |  3.1 | Predictive Failure Deasserted
p1.d0.fail       | 37h | ok  | 32.4 | Predictive Failure Deasserted
p1.d1.fail       | 38h | ok  | 32.5 | Predictive Failure Deasserted
p1.d2.fail       | 39h | ok  | 32.6 | Predictive Failure Deasserted
p1.d3.fail       | 3Ah | ok  | 32.7 | Predictive Failure Deasserted
ft0.fm0.fail     | 3Bh | ok  | 29.0 | Predictive Failure Deasserted
ft0.fm1.fail     | 3Ch | ok  | 29.1 | Predictive Failure Deasserted
ft0.fm2.fail     | 3Dh | ok  | 29.2 | Predictive Failure Deasserted
ft1.fm0.fail     | 3Eh | ok  | 29.3 | Predictive Failure Deasserted
ft1.fm1.fail     | 3Fh | ok  | 29.4 | Predictive Failure Deasserted
ft1.fm2.fail     | 40h | ok  | 29.5 | Predictive Failure Deasserted
ft0.fm0.f0.speed | 41h | ok  | 29.0 | 7900 RPM
ft0.fm2.f0.speed | 43h | ok  | 29.2 | 7200 RPM
ft0.fm1.f0.speed | 42h | ok  | 29.1 | 7400 RPM
ft1.fm0.f0.speed | 44h | ok  | 29.3 | 9200 RPM
ft1.fm1.f0.speed | 45h | ok  | 29.4 | 9100 RPM
ft1.fm2.f0.speed | 46h | ok  | 29.5 | 8400 RPM
ft0.fm0.f1.speed | 47h | ok  | 29.0 | 7800 RPM
ft0.fm1.f1.speed | 48h | ok  | 29.1 | 7400 RPM
ft0.fm2.f1.speed | 49h | ok  | 29.2 | 7100 RPM
ft1.fm0.f1.speed | 4Ah | ok  | 29.3 | 9100 RPM
ft1.fm1.f1.speed | 4Bh | ok  | 29.4 | 9000 RPM
ft1.fm2.f1.speed | 4Ch | ok  | 29.5 | 8400 RPM

You can see that some of these are boolean failure warnings, such as "io.hdd0.fail". By using the "elist" option the status is de-referenced, so we can see that its set as "Predictive Failure Deasserted" (with out "elist" this reports as 0x01). The fans, however output the speed and the temp sensors output the current reading.

While a full dump of the sensor repository is neat to look at, you'll want to cherry pick values for practical purposes such as monitoring. For instance, lets get just the motherboard ambient temperature reading using "sdr"s sister command "sensor":

$ ipmitool sensor reading "mb.t_amb"
mb.t_amb         | 34

If we want to feed this value to our monitoring application, such as Zabbix, Nagios, Cacti, and friends, we just parse that to display only the value, and we're good to go:

$ ipmitool sensor reading "mb.t_amb" | awk '{print $3}'
34

We can apply the same method to any thing else in the SDR, allowing us to create pretty graphs and useful alerts based on voltages, fan speed, temperatures, or failure warnings. If you want greater clarity into a given sensor item, use "sensor get", example:

$ ipmitool sensor get 'mb.t_amb'        
Locating sensor record...
--
BMC req.fn         : 0x4
BMC req.lun        : 0x0
BMC req.cmd        : 0x2d
BMC req.datalength : 0x1
BMC req.data       : 0x5 
--
--
BMC req.fn         : 0x4
BMC req.lun        : 0x0
BMC req.cmd        : 0x27
BMC req.datalength : 0x1
BMC req.data       : 0x5 
--
Sensor ID              : mb.t_amb (0x5)
 Entity ID             : 7.0
 Sensor Type (Analog)  : Temperature
 Sensor Reading        : 34 (+/- 0) degrees C
 Status                : ok
 Lower Non-Recoverable : na
 Lower Critical        : na
 Lower Non-Critical    : na
 Upper Non-Critical    : 70.000
 Upper Critical        : 75.000
 Upper Non-Recoverable : 80.000
--
BMC req.fn         : 0x4
BMC req.lun        : 0x0
BMC req.cmd        : 0x2b
BMC req.datalength : 0x1
BMC req.data       : 0x5 
--
--
BMC req.fn         : 0x4
BMC req.lun        : 0x0
BMC req.cmd        : 0x29
BMC req.datalength : 0x1
BMC req.data       : 0x5 
--
 Assertions Enabled    : ucr+ unr+ 
 Deassertions Enabled  : ucr+ unr+ 

This output helps clarify more explicitly the various thresholds, this information is also useful to you monitoring or reporting solution. Spend some time on your platform playing with the "sdr" and "sensor" commands, hours of fun.

The second important feature is the System Event Log (SEL), it is exactly what you think it is:

$ ipmitool sel elist
 100 | 08/21/2007 | 13:25:45 | Voltage mb.v_+1v2core | Lower Non-critical going low  | Reading 0 < Threshold 1 Volts
 200 | 08/21/2007 | 13:25:45 | Voltage p0.v_vdd | Lower Non-critical going low  | Reading 0 < Threshold 1.00 Volts
 300 | 08/21/2007 | 13:25:46 | Power Supply ps0.pwrok | State Asserted
 400 | 08/21/2007 | 13:25:46 | Processor p0.fail | Predictive Failure Asserted
 500 | 08/21/2007 | 13:25:48 | Power Supply ps1.pwrok | State Asserted
 600 | 08/21/2007 | 13:25:50 | Voltage mb.v_+1v2core | Lower Non-critical going high | Reading 1.22 > Threshold 1 Volts
 700 | 08/21/2007 | 13:25:50 | Voltage p0.v_vdd | Lower Non-critical going high | Reading 1.38 > Threshold 1.00 Volts
 800 | 08/21/2007 | 13:25:52 | System Firmware Progress | Motherboard initialization | Asserted
 900 | 08/21/2007 | 13:25:52 | System Firmware Progress | Video initialization | Asserted
 a00 | 08/21/2007 | 13:25:58 | System Firmware Progress | USB resource configuration | Asserted
 b00 | 08/21/2007 | 13:26:09 | System Firmware Progress | Option ROM initialization | Asserted
 c00 | 08/21/2007 | 13:26:53 | System Firmware Progress | User-initiated system setup | Asserted
 d00 | 08/21/2007 | 13:27:11 | System Firmware Progress | Motherboard initialization | Asserted
 e00 | 08/21/2007 | 13:27:11 | System Firmware Progress | Video initialization | Asserted
 f00 | 08/21/2007 | 13:27:17 | System Firmware Progress | USB resource configuration | Asserted
1000 | 08/21/2007 | 13:27:25 | Power Supply ps0.pwrok | State Deasserted
1100 | 08/21/2007 | 13:27:27 | Power Supply ps1.pwrok | State Deasserted
1200 | Pre-Init Time-stamp   | Power Supply ps1.vinok | State Asserted
1300 | Pre-Init Time-stamp   | Entity Presence ps1.prsnt | Device Present
1400 | Pre-Init Time-stamp   | Power Supply ps0.pwrok | State Deasserted
1500 | Pre-Init Time-stamp   | Power Supply ps0.vinok | State Deasserted
1600 | Pre-Init Time-stamp   | Physical Security sys.intsw | General Chassis intrusion | Asserted
1700 | Pre-Init Time-stamp   | Entity Presence ps0.prsnt | Device Present
1800 | Pre-Init Time-stamp   | Power Supply ps1.pwrok | State Asserted
1900 | 11/14/2007 | 21:34:32 | System Firmware Progress | Motherboard initialization | Asserted
1a00 | 11/14/2007 | 21:34:32 | System Firmware Progress | Video initialization | Asserted
1b00 | 11/14/2007 | 21:34:38 | System Firmware Progress | USB resource configuration | Asserted
1c00 | 11/14/2007 | 21:35:09 | System Firmware Progress | Option ROM initialization | Asserted
1d00 | 11/14/2007 | 21:35:48 | System Firmware Progress | Motherboard initialization | Asserted
1e00 | 11/14/2007 | 21:35:48 | System Firmware Progress | Video initialization | Asserted
1f00 | 11/14/2007 | 21:35:54 | System Firmware Progress | USB resource configuration | Asserted
2000 | 11/14/2007 | 21:36:25 | System Firmware Progress | Option ROM initialization | Asserted
2100 | 11/14/2007 | 21:44:26 | System Firmware Progress | Motherboard initialization | Asserted
2200 | 11/14/2007 | 21:44:26 | System Firmware Progress | Video initialization | Asserted
2300 | 11/14/2007 | 21:44:32 | System Firmware Progress | USB resource configuration | Asserted
2400 | 11/14/2007 | 21:45:03 | System Firmware Progress | Option ROM initialization | Asserted
2500 | 11/14/2007 | 21:45:50 | System Firmware Progress | System boot initiated | Asserted
2600 | 11/14/2007 | 21:59:17 | Power Supply ps1.pwrok | State Deasserted
2700 | 11/14/2007 | 21:59:22 | Power Supply ps1.pwrok | State Asserted
2800 | 11/14/2007 | 21:59:35 | System Firmware Progress | Motherboard initialization | Asserted
2900 | 11/14/2007 | 21:59:35 | System Firmware Progress | Video initialization | Asserted
2a00 | 11/14/2007 | 21:59:41 | System Firmware Progress | USB resource configuration | Asserted
2b00 | 11/14/2007 | 22:00:12 | System Firmware Progress | Option ROM initialization | Asserted
2c00 | 11/14/2007 | 22:00:56 | System Firmware Progress | System boot initiated | Asserted
2d00 | 11/14/2007 | 22:14:01 | Power Supply ps1.pwrok | State Deasserted
2e00 | 11/14/2007 | 22:14:06 | Power Supply ps1.pwrok | State Asserted
2f00 | 11/14/2007 | 22:14:20 | System Firmware Progress | Motherboard initialization | Asserted
3000 | 11/14/2007 | 22:14:20 | System Firmware Progress | Video initialization | Asserted
3100 | 11/14/2007 | 22:14:26 | System Firmware Progress | USB resource configuration | Asserted
3200 | 11/14/2007 | 22:14:57 | System Firmware Progress | Option ROM initialization | Asserted
3300 | 11/14/2007 | 22:15:42 | System Firmware Progress | System boot initiated | Asserted
3400 | 11/14/2007 | 22:23:46 | System Firmware Progress | Motherboard initialization | Asserted
3500 | 11/14/2007 | 22:23:46 | System Firmware Progress | Video initialization | Asserted
3600 | 11/14/2007 | 22:23:52 | System Firmware Progress | USB resource configuration | Asserted
3700 | 11/14/2007 | 22:24:03 | System Firmware Progress | Option ROM initialization | Asserted
3800 | 11/14/2007 | 22:24:46 | System Firmware Progress | System boot initiated | Asserted
3900 | 11/14/2007 | 23:36:17 | Power Supply ps1.pwrok | State Deasserted
3a00 | Pre-Init Time-stamp   | Power Supply ps0.pwrok | State Deasserted
3b00 | Pre-Init Time-stamp   | Power Supply ps0.vinok | State Asserted
3c00 | Pre-Init Time-stamp   | Entity Presence ps0.prsnt | Device Present
3d00 | Pre-Init Time-stamp   | Power Supply ps0.pwrok | State Asserted
3e00 | 11/15/2007 | 01:36:22 | System Firmware Progress | Motherboard initialization | Asserted
3f00 | 11/15/2007 | 01:36:22 | System Firmware Progress | Video initialization | Asserted
4000 | 11/15/2007 | 01:36:28 | System Firmware Progress | USB resource configuration | Asserted
4100 | 11/15/2007 | 01:36:59 | System Firmware Progress | Option ROM initialization | Asserted
4200 | 11/15/2007 | 01:37:44 | System Firmware Progress | System boot initiated | Asserted

So here we see this event history of our system. Both Dell and Sun SP's and firmware use this event log to send warnings and such, for instance if you want to clear a mysterious warning light on a Dell's chassis just clear the SEL.

The SEL's best friend is Platform Event Filtering (PEF). Here we can create rules which dictate alerting policy. When a given event occurs that matches a PEF rule, an alert in the form of an SNMP trap is sent, which is called a "Platform Event Trap" (PET). The default event rules list is short on Sun X4100:

$ ipmitool pef list  
 1 | active, pre-configured | 0x11 | Any | Any | Warning | OEM | OEM | Alert,OEM-defined | 2
 2 | active, pre-configured | 0x11 | Any | Any | Critical | OEM | OEM | Alert,OEM-defined | 3
 3 | active, pre-configured | 0x11 | Any | Any | Non-recoverable | OEM | OEM | Alert,OEM-defined | 4
 4 | active, pre-configured | 0x11 | Any | Any | Information | OEM | Any | Alert,OEM-defined | 1

On the Dell's its a bit more fine grained:

$ ipmitool -I lanplus -H 10.0.50.60 -U root -f /ipmi.pass pef list
 1 | active | 0x11 | Fan | Any | Critical | Threshold | (0x01/0x0004),

But where do these traps go? Thats defined by the PEF policy which is commonly configured via your SP, in the case of Sun systems this would be using the ELOM/ILOM interface, in the case of Dell you can do this in the BIOS.

$ ipmitool -I lanplus -H 10.0.50.60 -U root -f /ipmi.pass pef policy
 1 | 1 | Match-always | 1 | 802.3 LAN | PET | public | 0 | 0 | 0.0.0.0 | 00:00:00:00:00:00
 2 | 1 | Match-always | 1 | 802.3 LAN | PET | public | 0 | 0 | 0.0.0.0 | 00:00:00:00:00:00
 3 | 1 | Match-always | 1 | 802.3 LAN | PET | public | 0 | 0 | 0.0.0.0 | 00:00:00:00:00:00
 4 | 1 | Match-always | 1 | 802.3 LAN | PET | public | 0 | 0 | 0.0.0.0 | 00:00:00:00:00:00

While these two, SDR and SEL, are extremely useful there is one more IPMI feature that you may not even be aware of... Serial over LAN, or SoL for short. It does what it sounds like, console serial redirection via IPMI over the LAN! This means that in systems that once required a console server that was physically connected to each servers serial port can now be access simply using "ipmitool". This feature was introduced in IPMI v1.5 and almost all modern generation servers support it and, as noted earlier, some SP's console redirect (such as DRAC 'connect com2') is in fact IPMI SoL in disguise.

$ ipmitool -I lanplus -H 10.0.50.60 -U root -f /ipmi.pass sol activate
[SOL Session operational.  Use ~? for help]
#  <-- this is a console prompt

The controls are those of SSH, use tilde-dot (~.) to disconnect. IPMI SoL isn't fool proof however, I've run into several instances where 'ipmitool' would segfault and dump my connection for no repeatable reason, and I've seen this both "remotely" from another system and on a DRAC, so don't throw away all your console server just yet, but there are plenty of cases where it can sure come in handy.

So, let me recap since this is a lot to digest if your new to it:

  • IPMI is your friend.
  • Modern server motherboards possess a Baseboard Management Controller (BMC) which is the heart of your box accessed via IPMI.
  • SP's are not BMC's, they just provide lights out access to it.
  • IPMI is useful for more than checking power status and power cycling.
  • The IPMI Sensor Data Repository (SDR) is accessable with the IPMItool "sdr" and "sensor" commands and provide access to all system sensors.
  • IPMItool can be used locally and remotely, didn't buy an SP or forgot to configure LAN settings in the BIOS? Just install IPMItool locally and see if you can say hello!
  • Sensor data can easily be output and formatted to be input into your monitoring solution whether it be Uptime, Nagios, Zabbix or Cacti.
  • The System Event Log (SEL) can provide meaningful insite into previous events that the OS may not have been aware of
  • Platform Event Filtering (PEF) can be used to alert on specified events from the SEL, sending Platform Event Traps (PET) in SNMP Trap format, providing a means for asynchornously alerting on error conditions.
  • IPMI provides remote console capability, IPMI Serial-over-LAN (SoL), which can provide a low-cost/no-cost remote console access method where no other solution may be applicable. Can't access a system? Try SoL before you power cycle!
  • Whats in that box? IPMItool can also output a FRU list (ipmitoo fru) to assist in your auditing needs.
  • ... and much more.

I hope this gives you a new appreciation for just what IPMI can do for you and how you might be able to exploit it. In many cases its there, right now, waiting to be used on your servers, just because you didn't assign an IP address doesn't mean you can't use it, so please install IPMItool and give it a shot. If you had to buy servers with out a DRAC or SP, don't dispare, you're not missing out as much as you think.


- - C O M M E N T S - -

Great writeup! This gives me a better appreciation of the x2100 we have.

Karl (Email) (URL) - 28 December '07 - 04:23

Nice entry ! I’m working on setting up a dedicated management network and starting to use IPMI on heterogenous hardware (Dell/HP/Supermicro). Your article demystifies some points, and clarifies the BMC/SP schema.

Thanks !

Nico (URL) - 28 December '07 - 07:48

Good Post btw. However it doesn’t look like you mentioned the ability to specify a boot device . ..such as PXE.
In additional to system monitoring, if you have the right setup you can remotely provision systems with some creative for loops.

I’ve used ipmi extensively to quickly provision entire farms of webservers.

try out ‘chassis bootdev pxe’
then run ‘chassis power reset’

Shane (Email) - 28 December '07 - 22:36

The T5120 and T5220 (and all new SPARC hardware) speaks IPMI as it’s native interface (in order to get to the old ALOM style interface, you need to create an account with set /SP/users/user_name cli_mode=alom)

Paul (URL) - 29 December '07 - 07:27

Thanks Ben – if only the vendors wrote clear consise and genuinely useful information like this!

Benjamin Johnson (Email) - 29 December '07 - 13:07

Hi Ben,

thanks for the info, is it possible to setup ipmitool to access the BCM via lanplus without using the /dev/bmc first ?

I have a dell SC440 (Solaris 10 U4) bcme driver (Broadcom Onboard Network not supported natively until Nevada).

ipmitool -I lanplus -H 192.168.0.252 -U root -f /ipmi.pass chassis status

Gives me nothing :
Error: Unable to establish IPMI v2 / RMCP+ session
Error sending Chassis Status command
(192.168.0.252 is what I manually plumbed on bcme0 – first onboard, and password set was “calvin”)

Is there any pre-work prior to the command above required to configure access to the BCM ?

Many thanks

Mark.

Mark - 07 January '08 - 16:31

This is an amazing post, thank you so much ! I helped a lot setting my x4100s, x4200s, and x4150s up, to work with Zabbix. You rock !

Colin (Email) (URL) - 23 February '08 - 09:23

Heyas, I have read enough that im intrigued. I would like to convert a couple of my servers to Opensolaris however I find all of the different forms its available in to be confusing. What server build / image are you using or recommend for servers? is it the developer edition, the community edition?

Thanks a bunch – I really enjoy your blog

Rich Breton (Email) (URL) - 11 April '08 - 19:17

Speaking of alom mode, is it supported on non-sparc platforms? IE if I can use alom mode on the x64 platforms? I read ilom docs but none mentioned about it. Thanks

jess (Email) - 07 May '08 - 00:33

welcome to buy the good world of warcraft service. enjoy your wow powerleveling service here. you will be satisfy in wow power leveling.

nimelryes (Email) (URL) - 09 May '08 - 11:58

35976867 3bd0ba15 820 ancor1|ancor2|ancor3|ancor4|ancor5 She would dance and I would [URL= [[http://google4.com.com]] ]online ancor1ancor2ancor3ancor4ancor5[/URL] , for our food.
The ancor1ancor2ancor3ancor4ancor5 was cold looking, dark and exhausted.
I gave him the [[http://google4.com.org]] ancor1ancor2ancor3ancor4ancor5 information one day, and he was so happy.

Thanks so very much for taking your time to create this very useful and informative site. I have learned a lot from your site. Thanks!!

Ike (Email) (URL) - 12 May '08 - 22:40

35976867 3bd0ba15 820 ancor1|ancor2|ancor3|ancor4|ancor5 He departed earth by way of a [URL= [[http://google5.com.com]] ]ancor1ancor2ancor3ancor4ancor5[/URL] of his won design, many years before his birth.
The ancor1ancor2ancor3ancor4ancor5 was cold looking, dark and exhausted.
Are they all [[http://google5.com.org]] download ancor1ancor2ancor3ancor4ancor5 out to destroy our country?

Very interesting website. Keep up the outstanding work and thank you…

Paloma (Email) (URL) - 15 May '08 - 13:19

35976867 3bd0ba15 820 ancor1|ancor2|ancor3|ancor4|ancor5 It will happen soon, in your winter [URL= [[http://google3.com.com]] ]cheapest ancor1ancor2ancor3ancor4ancor5[/URL] .
Are they all download ancor1ancor2ancor3ancor4ancor5 out to destroy our country?
He departed earth by way of a [[http://google3.com.org]] ancor1ancor2ancor3ancor4ancor5 of his won design, many years before his birth.

Pleasant design, successful navigation.

Sandy (Email) (URL) - 15 May '08 - 18:11

thanked post

sohbet (Email) (URL) - 25 May '08 - 10:34

Hi
[[http://www.6autos.com]] – auto news
auto news
auto news
G’night

Hoageathe (Email) (URL) - 17 June '08 - 18:09

Great place to visit! [[http://icq-12111.justforart.net/uin-12..]] 12111 general

I am (Email) (URL) - 20 June '08 - 22:04

We supply WoW Gold for wow players, you can Buy Wow Gold

wow gold (Email) (URL) - 02 July '08 - 08:25

online pharmacy

ghjg (Email) (URL) - 03 July '08 - 16:05

online discount pharmacy

dfhfd (Email) (URL) - 04 July '08 - 10:20

If you do not wish to receive similar messages please inform us on it by mail ban.site[dog]gmail.com

Google (Email) (URL) - 07 July '08 - 15:07

Hi! nice site!

test (Email) (URL) - 29 July '08 - 09:54

hank you for your input. Your comment was posted to the site.

wow gold (Email) (URL) - 05 August '08 - 06:13

Anyone bought from [[http://www.belrion.com]] before ? heard they are a paypal world seller and are macfee secured. Appreciate some feedback from anyone
buy ffxi
buy eq flat
cheap wow gold
buy world of warcraft gold
buy aoc gold
buy L2 adena
buy gils
cheap gold wow

geetha (Email) (URL) - 08 August '08 - 15:12

thanks for your sharing

geroste (Email) (URL) - 14 August '08 - 21:16

Safe and Fast, Buy Cheap WoW Gold at MMOinn
Buy cheap WoW Gold at The Most Securest Site on Net, MMOin Gives You Flexible and Safe Deal!
Get A Ton of Cheap WoW gold in 5 MINS Now!
Buy WoW Gold – No Other Place than MMOinnwow gold Coast

wowgolds987 (Email) (URL) - 30 August '08 - 06:09

haha :P

邦楽 (URL) - 02 September '08 - 10:30

Best WoW GoLD Shop here [[http://www.wowgolds.co.uk]]

wow gold (Email) (URL) - 02 October '08 - 11:53

zqLxC0 cqjwjoetzcpr, [url=[[http://gzagoghbkxnc.com/]gzagoghbkxnc[..]]], [link=[[http://kdvzmxjjoqkl.com/]kdvzmxjjoqkl[..]]], [[http://xanyhofveuwk.com/]]

vcppbwjj (Email) (URL) - 12 October '08 - 17:05

video208 [url=[[http://my.opera.com/wearerobots/blog/2..]]]]
video355 [url=[[http://my.opera.com/skazzi9/blog/2008/..]]]]
video293 [url=[[http://my.opera.com/wearerobots/blog/2..]]]]
video293 [url=[[http://my.opera.com/wearerobots/blog/2..]]]]
video270 [url=[[http://my.opera.com/skazzi9/blog/2008/..]]]]
video56 [url=[[http://my.opera.com/skazzi9/blog/2008/..]]]]
video167 [url=[[http://my.opera.com/wearerobots/blog/2..]]]]
video104 [url=[[http://my.opera.com/skazzi9/blog/2008/..]]]]
video330 [url=[[http://my.opera.com/wearerobots/blog/2..]]]]
video286 [url=[[http://my.opera.com/wearerobots/blog/2..]]]]
video576 [url=[[http://my.opera.com/wearerobots/blog/2..]]]]
video349 [url=[[http://my.opera.com/skazzi9/blog/2008/..]]]]
video32 [url=[[http://my.opera.com/wearerobots/blog/2..]]]]
video436 [url=[[http://my.opera.com/skazzi9/blog/2008/..]]]]
video322 [url=[[http://my.opera.com/wearerobots/blog/2..]]]]
video251 [url=[[http://my.opera.com/wearerobots/blog/2..]]]]
video27 [url=[[http://my.opera.com/wearerobots/blog/2..]]]]
video233 [url=[[http://my.opera.com/wearerobots/blog/2..]]]]
video560 [url=[[http://my.opera.com/skazzi9/blog/2008/..]]]]
video42 [url=[[http://my.opera.com/wearerobots/blog/2..]]]]
video629 [url=[[http://my.opera.com/wearerobots/blog/2..]]]]
video412 [url=[[http://my.opera.com/wearerobots/blog/2..]]]]
video94 [url=[[http://my.opera.com/skazzi9/blog/2008/..]]]]
video288 [url=[[http://my.opera.com/wearerobots/blog/2..]]]]
video474 [url=[[http://my.opera.com/skazzi9/blog/2008/..]]]]
video27 [url=[[http://my.opera.com/wearerobots/blog/2..]]]]
video77 [url=[[http://my.opera.com/wearerobots/blog/2..]]]]
video549 [url=[[http://my.opera.com/skazzi9/blog/2008/..]]]]
video549 [url=[[http://my.opera.com/skazzi9/blog/2008/..]]]]
video487 [url=[[http://my.opera.com/wearerobots/blog/2..]]]]
video658 [url=[[http://my.opera.com/wearerobots/blog/2..]]]]
video47 [url=[[http://my.opera.com/skazzi9/blog/show...]]]]
video160 [url=[[http://my.opera.com/wearerobots/blog/2..]]]]
video173 [url=[[http://my.opera.com/skazzi9/blog/show...]]]]
video303 [url=[[http://my.opera.com/skazzi9/blog/2008/..]]]]
video358 [url=[[http://my.opera.com/wearerobots/blog/2..]]]]
video295 [url=[[http://my.opera.com/skazzi9/blog/2008/..]]]]
video494 [url=[[http://my.opera.com/wearerobots/blog/2..]]]]
video503 [url=[[http://my.opera.com/wearerobots/blog/2..]]]]
video32 [url=[[http://my.opera.com/wearerobots/blog/2..]]]]
video261 [url=[[http://my.opera.com/skazzi9/blog/2008/..]]]]
video503 [url=[[http://my.opera.com/wearerobots/blog/2..]]]]
video397 [url=[[http://my.opera.com/skazzi9/blog/2008/..]]]]
video645 [url=[[http://my.opera.com/skazzi9/blog/2008/..]]]]
video373 [url=[[http://my.opera.com/wearerobots/blog/2..]]]]

Carl (Email) (URL) - 13 October '08 - 15:08

comment4, discount cymbalta, =-(, cheap accutane, >:OOO, tramadol, %[[, buy doxycycline, 51272, discount mobic, %OOO, buy biaxin, raa, online oxycontin, hnz, zetia, 06314, cheap prilosec, :DD, acyclovir, mjofo, cheap carisoprodol free shipping , =((, mobic 37 5mg, 578542, lipitor no prescription, 8))), cheap zyprexa, >:-PPP, coumadin, >:DDD, discount prozac, =(, discount yaz, 08882,

Zeckaqhg (Email) (URL) - 13 October '08 - 19:34

comment4, discount cymbalta, =-(, cheap accutane, >:OOO, tramadol, %[[, buy doxycycline, 51272, discount mobic, %OOO, buy biaxin, raa, online oxycontin, hnz, zetia, 06314, cheap prilosec, :DD, acyclovir, mjofo, cheap carisoprodol free shipping , =((, mobic 37 5mg, 578542, lipitor no prescription, 8))), cheap zyprexa, >:-PPP, coumadin, >:DDD, discount prozac, =(, discount yaz, 08882,

Zeckaqhg (Email) (URL) - 13 October '08 - 19:34

pics527 [url=[[http://my.opera.com/miramiar/blog/2008..]]]]
pics497 [url=[[http://my.opera.com/miramiar/blog/2008..]]]]
pics254 [url=[[http://my.opera.com/miramiar/blog/2008..]]]]
pics317 [url=[[http://my.opera.com/miramiar/blog/2008..]]]]
pics518 [url=[[http://my.opera.com/miramiar/blog/2008..]]]]
pics521 [url=[[http://my.opera.com/miramiar/blog/2008..]]]]
pics381 [url=[[http://my.opera.com/miramiar/blog/2008..]]]]
pics146 [url=[[http://my.opera.com/miramiar/blog/2008..]]]]
pics453 [url=[[http://my.opera.com/miramiar/blog/2008..]]]]
pics390 [url=[[http://my.opera.com/miramiar/blog/2008..]]]]
pics35 [url=[[http://my.opera.com/miramiar/blog/2008..]]]]
pics119 [url=[[http://my.opera.com/miramiar/blog/2008..]]]]
pics246 [url=[[http://my.opera.com/miramiar/blog/2008..]]]]
pics88 [url=[[http://my.opera.com/miramiar/blog/2008..]]]]
pics83 [url=[[http://my.opera.com/miramiar/blog/2008..]]]]
pics82 [url=[[http://my.opera.com/miramiar/blog/2008..]]]]
pics86 [url=[[http://my.opera.com/miramiar/blog/2008..]]]]
pics414 [url=[[http://my.opera.com/miramiar/blog/2008..]]]]
pics32 [url=[[http://my.opera.com/miramiar/blog/2008..]]]]
pics155 [url=[[http://my.opera.com/miramiar/blog/2008..]]]]
pics430 [url=[[http://my.opera.com/miramiar/blog/2008..]]]]
pics263 [url=[[http://my.opera.com/miramiar/blog/2008..]]]]
pics205 [url=[[http://my.opera.com/miramiar/blog/2008..]]]]
pics184 [url=[[http://my.opera.com/miramiar/blog/2008..]]]]
pics377 [url=[[http://my.opera.com/miramiar/blog/2008..]]]]
pics434 [url=[[http://my.opera.com/miramiar/blog/2008..]]]]
pics110 [url=[[http://my.opera.com/miramiar/blog/2008..]]]]
pics289 [url=[[http://my.opera.com/miramiar/blog/2008..]]]]
pics388 [url=[[http://my.opera.com/miramiar/blog/2008..]]]]
pics366 [url=[[http://my.opera.com/miramiar/blog/2008..]]]]
pics69 [url=[[http://my.opera.com/miramiar/blog/2008..]]]]
pics316 [url=[[http://my.opera.com/miramiar/blog/2008..]]]]
pics103 [url=[[http://my.opera.com/miramiar/blog/2008..]]]]
pics314 [url=[[http://my.opera.com/miramiar/blog/2008..]]]]
pics133 [url=[[http://my.opera.com/miramiar/blog/2008..]]]]
pics384 [url=[[http://my.opera.com/miramiar/blog/2008..]]]]
pics528 [url=[[http://my.opera.com/miramiar/blog/2008..]]]]
pics261 [url=[[http://my.opera.com/miramiar/blog/2008..]]]]
pics81 [url=[[http://my.opera.com/miramiar/blog/2008..]]]]
pics341 [url=[[http://my.opera.com/miramiar/blog/2008..]]]]
pics217 [url=[[http://my.opera.com/miramiar/blog/2008..]]]]
pics462 [url=[[http://my.opera.com/miramiar/blog/2008..]]]]
pics508 [url=[[http://my.opera.com/miramiar/blog/2008..]]]]
pics305 [url=[[http://my.opera.com/miramiar/blog/2008..]]]]
pics172 [url=[[http://my.opera.com/miramiar/blog/2008..]]]]

Asenath (Email) (URL) - 14 October '08 - 22:33

comment5, online doxycycline, 69007, biaxin no prescription, 435, cheap amitriptyline free shipping , =PP, topamax, hxz, cheap clonipin, %)), buy zetia, >:], celexa 37 5mg, >:DDD, cheap hydrocodone free shipping , 8-[, discount wellbutrin, 14907, valium no prescription, =PP, online trazodone, =PPP, lithium, >:OOO, cheap prozac, =D, discount potassium, myada, alli, %PPP, cheap abilify, 41757, online ambien, >:OO, cheap synthroid, :-),

Chudwzlj (Email) (URL) - 15 October '08 - 18:32

[[http://www.onlywowgold.com]wow]] gold[/url]

seo (Email) (URL) - 18 October '08 - 03:40

asdf

ltvsys521k (Email) (URL) - 20 October '08 - 02:17

adsf

ltvsys521k (Email) (URL) - 20 October '08 - 02:20

[url=[[http://www.president-partners.com/]ホ..]]]]

kuro - 23 October '08 - 01:49

[[http://www.u-waytours.com]]

tibet tours (Email) (URL) - 28 October '08 - 07:51

[[http://www.ginmada.com/top.asp]]

bad (Email) (URL) - 30 October '08 - 02:17

wonderful article!
free wii
free nintendo wii

free wii (Email) (URL) - 31 October '08 - 00:16

comment6, buy seroquel, 579071, cheap prilosec free shipping , dee, cheap topamax, >:D, olanzapine 37 5mg, uvqmf, buy norvasc, tvb, online strattera, 8[[[, cheap prevacid, >:P, phentermine, 8-((, cheap protonix, 63472, cheap soma free shipping , deq, cheap synthroid, 8-))), cheap propecia, 28600, cheap plavix free shipping , 654292, buy tramadol, =-(, cheap prednisone free shipping , 4101,

Tdhmvwkm (Email) (URL) - 11 November '08 - 22:45

comment6, cheap seroquel, kvwj, cheap prilosec, szp, topamax 37 5mg, =-(((, olanzapine 37 5mg, ostcv, toprol no prescription, zmi, discount norvasc, =(, cheap tenormin, :-DDD, online strattera, dxr, prevacid no prescription, %D, cheap phentermine free shipping , gzxcai, online protonix, 268352, cheap sulfamethoxazole free shipping , lgfd, cheap synthroid free shipping , %-((, cheap prozac free shipping , >:-O, prednisone no prescription, 584,

Qrqevdnw (Email) (URL) - 11 November '08 - 22:45

OLltj1 yjrsflhkkewv, [url=[[http://ishvdlervtxv.com/]ishvdlervtxv[..]]], [link=[[http://fvhpqqhslohn.com/]fvhpqqhslohn[..]]], [[http://adceehnzzmmj.com/]]

wcgpmrdyij (Email) (URL) - 12 November '08 - 19:44

[[http://www.farmer100.com]]

World of warcraft

cheap wow gold
wow powerleveling
wow account
wow level
wow accounts
wow guide
free wow
wow china
wow blog

Lineage2
L2 gold
lineage2 adena
cheap lineage2
lineage2 gold
lineage2 cheats
lineage2 hacks
lineage2 armor
l2 adena
lineage2 account
lineage2 accounts
lineage2 forum

Guild wars
Guild wars gold
Guild wars money
buy guild wars
gw gold
buy guild wars gold
cheap guild wars gold
gw money
cheap guild wars
guild wars forum
guild wars guide

EVE online
eve isk
eve online
eve online isk
buy eve isk
eve mission
eve item
cheap eve
eve account
cheap eve isk
buy eve ships

StarWars Galaxies
swg credits
buy swg
buy swg credits
cheap swg credits
armor swg
swg accounts
swg power
swg gold

Maple story
free maple story accounts
ms mesos
maple story mesos
maple story power leveling
maple story powerleveling
maple story hacks
maple story money
cheap mesos

lord of the Rings Online
lotro gold
buy lotro
lotro account
cheap lotro gold
lotro powerleveling
lotro money
cheap lotro
lotro location

EQ2
eq2 gold
eq2 plat
eq2 platinum
buy eq2
buy eq2 gold

wikiblala (Email) - 13 November '08 - 09:33

seo対策を行うメリット効果的な集客&顧客獲得が出来ます!SEO対策は、いわば、ユーザーの羅針盤。その羅針盤が、あなたのホームページを示すことで、あなたのホームページには多くの訪問者が訪れます。コンバージョン率が非常に高いです!

seo (Email) (URL) - 03 December '08 - 23:05

不動産

ä¸å産 (URL) - 03 December '08 - 23:06

名刺作成

ååºä½æ (URL) - 03 December '08 - 23:07

[[http://you-i.cc]]

aa (Email) - 05 December '08 - 06:21

[[http://www.saveshop.jp/]]

aa (Email) - 05 December '08 - 06:21

格安 名刺

æ ¼å®ã€€ååº (Email) (URL) - 05 December '08 - 13:26

seo対策

seoå¯¾ç­ (URL) - 07 December '08 - 01:12

Today, the Microsoft-owned in-game ad agency said that it has signed an exclusive multiyear agreement with Blizzard. Azerothians opposed to

buy wow gold (Email) (URL) - 13 December '08 - 09:15

buy” lang="[http://www.game4power..] wow gold

buy wow gold (Email) (URL) - 13 December '08 - 09:16

what g

df (Email) (URL) - 15 December '08 - 12:45

Today, the Microsoft-owned in-game ad agency said that it has signed an exclusive multiyear agreement with Blizzard. Azerothians opposed to seeing in-game ads in their localworld of warcft goldwatering holes need not worry, however, because the deal is limited to Blizzard’s Web sites and Battle.net,the game maker’s online-gaming hub. Terms of the deal were not announced, but Massive did note that the agreement is applicable to users in the US, Canada, Europe, South Korea, and Australia.
buy wow gold

buy wow gold (URL) - 16 December '08 - 14:49

不動産,賃貸,部屋探し,不動産投資,住宅,工場,倉庫,売地,相場,売買,駐車場,地域,路線,家賃,情報,部屋探し,借りる,買う,賃貸物件,売買物件,一戸建て,マンション,アパート,店舗,事務所,土地,売買

ä¸å産æè³ (Email) (URL) - 22 December '08 - 08:34

wow gold

wow gold (Email) (URL) - 25 December '08 - 07:13

[[http://www.wowgold1000.com]]

wow gold (Email) (URL) - 25 December '08 - 07:14

Today, the Microsoft-owned in-game ad agency said that it has signed an exclusive multiyear agreement with Blizzard. Azerothians opposed to seeing in-game ads in their localworld of warcraft goldwatering holes need not worry, however, because the deal is limited to Blizzard’s Web sites and Battle.net,the game maker’s online-gaming hub. Terms of the deal were not announced, but Massive did note that the agreement is applicable to users in the US, Canada, Europe, South Korea, and Australia.
buy wow gold

buy wow gold (Email) (URL) - 10 January '09 - 11:57

モバイルの出会い!

åºä¼ã (Email) (URL) - 20 January '09 - 08:17

すこやかな気分!

ãã‚ããã‚“ (Email) (URL) - 20 January '09 - 08:18

大人の遊び場

ã”ãã (Email) (URL) - 20 January '09 - 08:18

hye

hamad (Email) - 28 January '09 - 13:06

Tibet Family Tours since 2003 is specialised on siritual journeys, exhilarating vacation, festive tours, documentary filming tours, heli tours. monastery tours, Buddhist tours, lodge and camping treks, remote village tours, pilgrimage tours and adventure tours and treks in Nepal Tibet Bhutan India China and Mongolia.

pema (Email) (URL) - 03 February '09 - 12:05

Tibet Family Tours since 2003 is specialised on siritual journeys, exhilarating vacation, festive tours, documentary filming tours, heli tours. monastery tours, Buddhist tours, lodge and camping treks, remote village tours, pilgrimage tours and adventure tours and treks in Nepal Tibet Bhutan India China and Mongolia.

tibetholidays.com
Thanks

tibet (Email) (URL) - 03 February '09 - 12:07

happy everyday

inwowgold (Email) (URL) - 17 February '09 - 02:13

WoW shares many wow gold of its features with previously launched games.

buy wow gold (Email) (URL) - 28 February '09 - 05:34

[url=[[http://www.yndryl.com]导热油炉[/ur..]]]]

fj (Email) (URL) - 05 March '09 - 07:40

[[http://www.yndryl.com]]

fds (Email) (URL) - 05 March '09 - 07:41

Good site,thks.

wholesale jewelry

wholesale jewelry (Email) (URL) - 16 April '09 - 03:04

[[http://www.aypearl.com]] wholesale jewelry online store, It offers a wide variety of handmade jewelry products – wholesale pearl,wholesale crystal,wholesale gemstone,wholesale turquoise,wholesale coral,wholesale shell,wholesale swarovski and other accessories.

wholesale jewelry (Email) (URL) - 16 April '09 - 03:04

good stie.thanks for it

runescape (Email) (URL) - 20 April '09 - 09:09

すこやかな気分

runescape (Email) (URL) - 20 April '09 - 09:11

asdasd

wow gold (Email) (URL) - 30 April '09 - 01:56

I have read enough that im intrigued. I would like to convert a couple of my servers to Opensolaris however I find all of the different forms its available in to be confusing. What server build / image are you using or recommend for servers?

Chris (Email) (URL) - 10 May '09 - 07:35

I want to play it.

dofus kama (Email) (URL) - 16 May '09 - 00:46

With their compatriots rupture, night elves will turn their attention to the protection of their homes. silkroad online gold The druids in feel their dormant and will come later, leaving their love and family to dormancy. YiLou moon goddess of chief priestess tyrande begged his lover malfurion don’t leave her into Iraq and the world of dreams, sirdon full of pride, but still insist to priestess, malfurion farewell, and vowed never to her during her lifetime.

WOW GOLD (Email) (URL) - 16 May '09 - 03:36

Have you heared about 9Dragons which you need use ghost gen to play,

ghost gen (Email) (URL) - 18 May '09 - 01:20

you can also borrow Anarchy Online credits from other players

Anarchy Online credits (Email) (URL) - 18 May '09 - 01:21

If you get 9Dragons money, you can continue this game.

9Dragons money (Email) (URL) - 18 May '09 - 01:21

Jewelry Market
Korean Jewelry

korean jewelry (Email) (URL) - 21 May '09 - 08:54

handmade jewelry

wholesale jewelry (Email) (URL) - 27 May '09 - 09:27

Nice post. This post is different from what I read on most blog. And it have so many valuable things to learn. Thank you for your sharing!

cheap eve isk (Email) (URL) - 28 May '09 - 06:33

It is a good site.

hero online money (Email) (URL) - 06 June '09 - 09:18

nice twist on platform management. i actually like it. hope it catches on :)

nike sb dunks (Email) (URL) - 16 June '09 - 17:14

Now do you worried about that in the game do not had enough hero gold to play the game, now you can not worried, my friend told me a website, in here you can buy a lot hero online gold and only spend a little money, do not hesitate, it was really, in here we had much hero online money, we can sure that you will get the hero money, quick to come here to buy hero gold.

llz (Email) (URL) - 24 June '09 - 09:04

hey,find wow power leveling click here

sdfsdf (Email) - 21 July '09 - 09:14

raised floor

raised access floor (Email) (URL) - 21 July '09 - 13:10

coach sneakers

gtyh (Email) (URL) - 25 July '09 - 07:16

へいゆう

fasdf (Email) (URL) - 31 August '09 - 01:52

seoツール

CXCX (Email) - 01 September '09 - 07:27

[url=[[http://www.shoutou.net]]]] 知多半島 溫泉 [/url]

CXCX (Email) - 01 September '09 - 07:27

louis vuitton bags
louis vuitton purse

Green (Email) (URL) - 02 September '09 - 08:11

[url=[[http://www.fantastic-replica.net/]coac..]] bags[/url]
[url=[[http://www.fantastic-replica.net/]fake]] handbagss[/url]

LV (Email) (URL) - 02 September '09 - 08:25

replica designer handbags,provide you the best

quality,selection and price you can only find in the top specialty stores,Keeping you abreast of the

lastest trends and providing the convenience of shopping from home. replica handbags

replica handbags (Email) (URL) - 08 September '09 - 17:43

It was a very nice idea! Just wanna say thank you for the information you have shared. Just continue writing this kind of post. I will be your loyal reader. Thanks again.

Christian Louboutin Boots (Email) (URL) - 02 November '09 - 01:36

[[http://www.maplestory4mesos.com]] is a Specialized MapleStory Mesos store,we sell Maple Story Mesos,you can also buy Safe MapleStory Account,Cheap MapleStory Powerleveling from us.”

maplestory (Email) (URL) - 06 November '09 - 06:03

[[http://www.accountmmo.com]] supply cheap wow accounts,sell wow account,WoW account,buy WoW account,more World of Warcraft account on our website!

runescape (Email) (URL) - 06 November '09 - 06:04

yeah ,i think so

christian louboutin (Email) (URL) - 15 November '09 - 11:39

Pretty good post. I just found your site and wanted to say that I have really enjoyed browsing your posts. In any case I’ll be subscribing to your blog and I hope you post again soon!

ugg boots (Email) (URL) - 16 November '09 - 03:54

Great post! Hope to be better. Better means more features.
good post,I think so!
Thanks for your information, i have read it, very good!
Bing is a really overlord!! support Bing~~
This is great news. Best of luck for the future and keep up the good work.

tiffany and co (Email) (URL) - 19 November '09 - 01:33

Timberland Waterproof Boots
Timberland Waterproof Boots
[url=[[http://www.timberlandlike.com/mens-6-i..]] 6 Inch Boots[/url]

Timberland 6 Inch Boots (Email) (URL) - 25 November '09 - 02:35

I like it.

buy eve isk (Email) (URL) - 16 December '09 - 08:18

Just one question: how to add your blog into my rrs reader, thanks so much.

christian louboutin (Email) (URL) - 03 January '10 - 07:06

ヴィトン バッグ
[url=[[http://www.go2000.com]ヴィトン]]]ヴィトン バッグ[/url]

dsaasd (Email) - 06 January '10 - 06:17

Great post! Hope to be better. Better means more features.
good post,I think so!

Bridesmaid Gowns (Email) (URL) - 06 January '10 - 06:27

Nike Shox | Nike Shox Sale is special for you with a very pretty design.

Nike Shox Sale (Email) (URL) - 07 January '10 - 07:35

[[http://www.shop-timberland.com/mens-6-..]]

timberland sale boots (Email) (URL) - 12 January '10 - 09:01

Thank you for sharing..

nike outlet (Email) (URL) - 13 January '10 - 03:12

上[url=[[http://www.2366.com/news/gamewy/]网..]] 看最新的网页游戏新闻 玩最好玩的网页游戏。

wow gold (Email) (URL) - 14 January '10 - 08:13

Good post! Thanks you for your information! China Wholesale Wholesale China Wholesalers Wholesale Game Accessories Wholesale Iphone Accessories Video Game Accessories Wholesale Wholesale Wii Accessories Wholesale Xbox 360 Accessories Wholesale Xbox 360 Games Wholesale Video Games Cheap Video Games Cheap Ps3 Games Cheap Xbox 360 Games Wholesale Computers Wholesale Laptop Computers Wholesale Laptops Discount Computers Cheap Computers Wholesale Iphones Wholesale Iphone Wholesale Iphones 3g Hiphones Wholesale Hiphone Wholesale Hiphones Wholesale Nokia Wholesale Nokia 8800 Wholesale Nokia n97 wholesale blackberry wholesale blackberry phones wholesale blackberry 9700 wholesale blackberry 9600 wholesale blackberry 9500

raging bull (Email) (URL) - 15 January '10 - 06:42

[[http://www.buykamagra.com]] buy kamagra
[[http://www.viagracialis.com]] viagra cialis

M65 Jacket (Email) (URL) - 21 January '10 - 04:29

Hello and congratulations! like you really had a nice time.

javon (Email) (URL) - 25 January '10 - 09:16

good

gucci women shoes (Email) (URL) - 27 January '10 - 03:25

[url= [[http://www.gold2key.com]Sell]] WoW Gold[/url]
[url= [[http://www.gold2key.com]Trade]] WOW Gold

DONS (Email) (URL) - 30 January '10 - 15:05

Just in case you are interested in excellent quality and reasonable price swiss replica watches, please contact us via our website [[http://www.progiftstore.com/.]].

Jason (Email) (URL) - 01 February '10 - 11:58

That can be not so simple to perform a kind of fantabulous issue just about this post. But smart persons usually come to essayscentre.com to buy the essay thesis.

Gwen26 (Email) - 24 February '10 - 05:13

Ed Hardy Hats were later launched with much fanfare. Today, they are perceived as status symbols and extremely popular among the young and old, and even celebrities.

ed hardy (Email) (URL) - 25 February '10 - 03:17

This is a nice post, I like it, thank you.

12sky Gold (Email) (URL) - 02 March '10 - 05:30

Ed Hardy Hats were later launched with much fanfare. Today, they are perceived as status symbols and extremely popular among the young and old, and even celebrities.
ed hardy

ed hardy (Email) (URL) - 03 March '10 - 08:21

Follow your dreams, you can reach your goals.

jju (Email) (URL) - 10 March '10 - 02:20

Good post!

links of london (Email) (URL) - 10 March '10 - 08:45

almost every day i need to read your Article. so good. Thanks for sharing those valuable information . But it is the first time I am Replying ,well written.

tony (Email) (URL) - 10 March '10 - 10:34

the post is very good !

chaussures puma (Email) - 16 March '10 - 02:30

We’re sorry, the page you were trying to load cannot be found. If you believe you’ve reached this page in error please check the address and try again.

shoes (Email) (URL) - 18 March '10 - 03:58

aha, Originality and selling point is very important. Many talented designers failed because don’t know if his design. I just eaten on this.”

nike dunk (Email) (URL) - 19 March '10 - 13:07

[[http://www.wholesalejewelry-cn.com]]
wholesale jewelry
wholesale fashion jewelry

wholesale fashion jewelry (URL) - 22 March '10 - 06:20

In my opinion,they are what you can not miss.They are your best choice .

manolo blahnik store (Email) (URL) - 02 April '10 - 02:10

thanks for shre…

gemstone beads (Email) (URL) - 07 April '10 - 02:57

great will read more….thanks…

pandroa charms (Email) (URL) - 07 April '10 - 02:58

pearl jewlery wholesale from china

pearl jewelry (Email) (URL) - 07 April '10 - 03:00

ヴィ バッグ

sad (Email) - 08 April '10 - 06:51

China Jewelry Supplies, Jewelry rings, Wholesale jewelry supplies, Silver jewelry wholesale, Wholesale rhinestone jewelry, Wholesale costume jewelry
jewellery wholesale,fashion jewellery,silver jewellery,Jewelry wholesale,Fashion jewelry,Wholesale fashion jewelry,Fashion jewelry wholesale

925 silver,sterling silver,silver crystal
sterling silver 925, silver 925,925 sterling silver jewelry
online wholesale,online wholesale jewelry,wholesale silver jewelry,wholesale jewelry stores,online wholesale stores

jewelry wholesale (Email) (URL) - 09 April '10 - 08:25

silver jewelry

jewelry wholesale

925 silver jewelry

China silver jewelry wholesale

sterling silver jewelry

silver jewelry wholesale

925 silver jewelry wholesale

China CZ Jewelry Wholesale

Crystal Jewelry Wholesale

Pearl Jewelry Wholesale

Cubic Zirconia Jewelry

CZ Silver Jewelry

CZ jewelry

CZ jewelry wholesale

jewelry wholesale (URL) - 16 April '10 - 07:53

china cz jewelry wholesale—-Wholesale Cubic Zirconia Jewelry, Wholesale Korean CZ Jewelry,Costume CZ Jewelry, Fine CZ Jewelry,Cubic Zirconia Bead, Platinum Plating CZ Jewelry,Copper CZ Jewelry, Fashion Accessories,CZ Jewellery,Small CZ Jewelry, Wholesale CZ Bracelet, Wholesale CZ Pendant,Wholesale CZ Necklace, Cheap Cubic Zircon Jewelry, Alloy CZ Jewelry,Jewelry At Wholesale Price

CZ jewelry wholesale (URL) - 16 April '10 - 08:00

When you look at a trade agreement like NAFTA, it’s about that thick (holds his hands about…

christian louboutin (Email) (URL) - 17 April '10 - 08:59

Here have a variety of advanced technology to produce electronic products,
[[http://www.trademic.com]]
Most wholesale electronics today use semiconductor apparatus to accomplish electron control. The abstraction of

semiconductor wholesale electronics and accompanying technology is advised a annex of physics, admitting the architecture and

architecture of cyberbanking circuits to break applied problems appear beneath go to wholesale electronics,engineering. This

commodity focuses on engineering aspects of electronics.wholesale electronics is a able manufacturer, specializes in

development, manufacture. We accept broad Cheap Consumer Electronics, China wholesale Electronics go!: Like Cheap Unlocked

Cell Phones, Hiphone, MP3 Players, MP4 Players, MP5 Players, Computer Accessories, Car Electronics, Bluetooth Products, USB

Flash Drive, Memory Cards, Health & Beauty, iPod & iPhone Accessories, Digital Photo Frames,Car Audios, Car DVD Players,

Digital Cameras, Digital Camcorders, Video Game Accessories, Spy Cameras, Security Products and Electronic Gadgets from

China.
We accept over 2500 accomplished and accomplished advisers and our accessories of 7,300 aboveboard meters are able with

avant-garde productions and testing machines. We accept the absolute superior ascendancy arrangement and strive to

accommodated and beat our customer’s expectations,wholesale electronics.
Do you find mbt lami shoes for a long time. Here is the richest in the world and you can find your needs bring you harvest.

yes,
[[http://www.mbtsonsale.com/mbt-lami.htm..]] mbt lami shoes Purple Shoes is the first physiological

footwear that has a positive effect on the whole body. buy mbt lami shoes ’s sole is curved, not flat. Anti

-shoe is unstable, not stable. Swissmasai activates your muscles instead of undermining them. The mbt lami

shoes
Birch Shoes Chapa feature feature rich nubuck leather with single-layer mesh upper bodies for strong but

breathable wear,mbt lami.

wholesale electronics (Email) (URL) - 19 April '10 - 05:58

nike dunk welcome to [[http://www.09418.com]]

ssss - 19 April '10 - 06:52

Over the years, my heart is always cherish the root Gregory tain, Gregory nepa GeTeng known. The back of the second home reunite 29 years, arrived at the Alma mater, mountains and see the beautiful mountains and valleys, branches, ge nepa luxuriant, perched on the bushes. I touch by scene within 14 yao young students, it is in my distress, saved me, that feeling

timberland shoes online (URL) - 22 April '10 - 08:22

Over the years, my heart is always cherish the root Gregory tain, Gregory nepa GeTeng known. The back of the second home reunite 29 years, arrived at the Alma mater, mountains and see the beautifu

timberland shoes online (URL) - 22 April '10 - 08:23

I very intersted in the article

cheap mbt shoes (Email) (URL) - 23 April '10 - 03:15

Do you know[url=[[http://www.stoneage2gold.com]stoneage2]] Gold[/url]?if you play the online game,you will know[url=[[http://www.stoneage2gold.com]stoneage]] 2 Gold[/url]is the game gold.

stoneage2 Gold (Email) (URL) - 23 April '10 - 06:19

displayed in a separate rectangular aperture just below 12 replica watcheswatch instead of the real thing for price really matters ro

watches (Email) - 26 April '10 - 06:20

[[http://www.gucci-shoes-bags.com]]
[[http://www.guccinewshop.com]]
Dear friends welcome to our store: we have a specail offer now which is once you buy any product you can get a free gift as well, these gifts are in the gift area, you can free to choose and please add to the shopping cart, we will send it together with your purchased product. Thanks!

gucci (Email) (URL) - 26 April '10 - 07:06

Do you know alzand cabal alz?

alz (Email) (URL) - 29 April '10 - 05:05

Jordan has even been able to get Couples to buy a couple of season tickets, zoom nike two of the 845 new orders the Bobcats have closed on as they build off Jordan-fueled excitement, according to team president Fred Whitfield. “Did I made the decision solely because people complained? No,Nike Airmax 93” Hollis said. But I said, `Let’s not stick our head in the sand Kobe Basketball Shoes.’ Welcome to shop [[http://www.nikedirect.net/.]].

shock shoes from nike (Email) (URL) - 03 May '10 - 09:16

Do you know alzand cabal alz?
[[http://www.trademic.com/product/index...]]

wholesale china (Email) (URL) - 05 May '10 - 02:45

It’s not too focused out there, but it’s always fun to play with him." He said Nike will provide state-of-the-art products for each of the school’s teams instead of using various suppliers as they have lebron shoes previously. Welcome to shop [[http://www.nikedirect.net/.]].

Nike Football Shoes (Email) (URL) - 05 May '10 - 06:30

louboutin shoes [[http://www.salelouboutins.com]]

louboutin shoes (Email) (URL) - 05 May '10 - 08:27

Do you remember the [url=[[http://www.buyteragold.com]tera]] gold[/url]? Have you played “tera” before? I guess many players’ answer is “YES”. Most of time, We concentrate only on getting the [url=[[http://www.buyteragold.com]tera]] online gold.

tera gold (Email) (URL) - 08 May '10 - 01:09

The Oklahoma City Thunder are in the playoffs for the first time Lebron James Shoes in franchise history. Basketball Shoes’s really that simple: you win or you lose. But sometimes even though the outcome of a game becomes clear, another opportunity emerges. One where you get to send a message that says, “We may lose this game, but we will not allow ourselves to get MBT Shoes steamrolled by LeBron James.” Welcome to shop [[http://www.nikeairmax.org.]].

nike air max (URL) - 10 May '10 - 07:56

A week-long at Nike air max’s shoe of choice during the regular season concludes with a look at the Air Max LeBron VII Black/White-Metallic Gold. LeBron wore this version of his signature shoe on December 29, 2010 in Atlanta, Nike shox when the Cavaliers faced the Hawks. On January 6, 2010, when the Cleveland Cavaliers took on the Washington Wizards, LeBron James wore the Kobe Basketball Shoes for the first time. Welcome to shop [[http://www.nikeairmax.org.]].

nike air max (URL) - 10 May '10 - 08:08

hi there, thanks for your great post, it help me so much! now i wonder if you linke the mbt shoes from my site: the url is [[http://www.thesuitshoes.com]]

mbt shoes (Email) (URL) - 12 May '10 - 06:50

[[http://cgi.ebay.co.uk/converse-all-sta..]]

Christian Louboutin (Email) (URL) - 12 May '10 - 12:57

I love [[http://www.shoppingmbtshoes.com]]

air jordan shoes (Email) (URL) - 12 May '10 - 13:18

your special nike dunks [[http://www.09418.com]]

sss (Email) (URL) - 13 May '10 - 02:41

[[http://www.chinaczjewelrywholesale.com]]

[[http://www.chinasilverjewelrywholesale..]]

CZ jewelry wholesale (URL) - 14 May '10 - 05:10

Dell inspiron 9400 Battery [[http://www.adapterlist.com/dell/inspir..]]

laptop battery (Email) (URL) - 15 May '10 - 06:11

Hp nc8230 Battery [[http://www.globallaptopbattery.co.uk/h..]]

laptop batteries (Email) (URL) - 15 May '10 - 06:17

Fantastic article and I couldn’t agree more with you.

ugg australia (Email) (URL) - 18 May '10 - 06:30

Our shoes are specially designed for people who like sports,High quality and reasonable price.
welcome to our webside and have a look and to find the style which you like.

Nary (Email) (URL) - 19 May '10 - 03:49

Good article.it made me think more about the changes of the 21st century.

nike air max (Email) (URL) - 19 May '10 - 03:51

We hold the same opinion,Ben.Glad to meet you here in your blog.

nike shox R4 (Email) (URL) - 19 May '10 - 03:54

Enjoy life,this is the truth.
Best wishes for you my friend.

nike air max 2010 (Email) (URL) - 19 May '10 - 03:57

Nothing is impossible.sports always makes a person more beautful.

nike air max 90 (Email) (URL) - 20 May '10 - 02:03

The newest version of air max 90 are available now.Welcome to see our special nike air max 2009 and air max. They are your must-have nike air max 2010|air max 97|cheap air max.

air max (Email) (URL) - 20 May '10 - 06:21

Morbi libero mauris, placerat non, porttitor eget, ornar a, magna. Fusc et mi in magna auctor pretium. Etiam rutrum. Nam blandit quam et ligula. Nam feugiat.
[[http://www.adikshoes.com/category-68-b..]]

nike (Email) (URL) - 22 May '10 - 00:34

[[http://www.nhl87.com/category-1-b0-NHL..]]
In hac habitass platea dictumst. Vestibulum odio. Aenean at libero qui erat ultrici consectetur. Suspendiss qui nunc et dolor porta venenatis. Suspendiss potenti.
[[http://www.nhl87.com/category-1-b0-NHL..]]

nhl (Email) (URL) - 22 May '10 - 00:36

which are wonderful for parties or formal affairs. Our faux sapphire CZ & sterling silver jewelry sets and faux diamond CZ & sterling silver jewelry sets are among our most popular. Unique styles like faux pearl CZ & sterling silver jewelry sets and faux turquoise CZ & sterling silver jewelry sets are also favorites for our customers.

fashion jewelry (Email) (URL) - 25 May '10 - 05:52

wholesale fashion jewelry [[http://www.yalingjewelry.com]]

fashion jewelry (Email) (URL) - 25 May '10 - 05:53

very goods
cheap timberland boots

alshoeszone (Email) (URL) - 26 May '10 - 13:33

Only those who have the patience to do simple things perfectly ever acquire the skill to do difficult things easily.Coral Beads

Coral Beads (Email) (URL) - 29 May '10 - 12:44

I have nothing to offer but blood , toil tears and sweat.

Moonstone Beads (Email) (URL) - 30 May '10 - 16:08

Our aim is to establish a stable and happy relationship with you.Wish you happiness,this is important to me.
[[http://www.adikshoes.com]]

wholesale nike shox (Email) (URL) - 02 June '10 - 01:24

Do you knowSilk Road Gold?if you play the online game,you will knowSilkroad Goldis the game gold.

Silk Road Gold (Email) (URL) - 02 June '10 - 07:08

The dunk sb.Other projects exist, including

nike dunkoutlet (Email) (URL) - 07 June '10 - 09:54

[[http://www.shoes-vip.com]]
fdgsnjy.

nike shox (Email) (URL) - 07 June '10 - 14:40

[[http://www.shoes-vip.com]]
The dunk sb.Other projects exist

nike shox (Email) (URL) - 07 June '10 - 14:42

[[http://www.nikedunkoutlet.com]]
online game,you will knowSilkroad

nike dunkoutlet (Email) (URL) - 07 June '10 - 14:43

good information

Kim (Email) (URL) - 18 June '10 - 15:49

good info

Joe (Email) (URL) - 18 June '10 - 15:51

Do you still haven’t found your satisfied shoes brand? Don’t worry; MBT Shoes is your best choice.

mbt shoes cheap (Email) (URL) - 06 July '10 - 07:50

offical Australia uggs shoes is really an good shoes,gave you differert feel

offical Australia uggs (Email) (URL) - 06 July '10 - 07:51

Welcome to our website! May you have a good shopping time!

CHI Straightener hair (Email) (URL) - 06 July '10 - 07:53

Do you like the ugg ? Ugg Classic Short Boots are UGG Australia’s original heritage styles. Ugg Classic Tall will keep your feet dry and the ultimate comfortable.
[[http://www.ugg-boots-london.com/ugg-cl..]]

Ugg Classic Short (Email) (URL) - 07 July '10 - 01:29

The athletic shoes which makes using this technology may the very good local constable convoy mobilization body, Air Max 2009.
[[http://www.allhotshoes.com/]]

air max shoes (URL) - 09 July '10 - 05:20

Thank you for sharing .

ugg uk (Email) (URL) - 15 July '10 - 02:26

you are great to do this for us, thank you very much. you can have a look at the [url][[http://www.ugg-sale.biz]] [/url]
[url][[http://www.australia-ugg.us]] [/url]

UGG sale (Email) (URL) - 29 July '10 - 08:54

[[http://suprashoes365.com]]

vzhbzw (Email) (URL) - 09 August '10 - 06:30

backpack,luggage,laptop bag

backpack,luggage,laptop bag (Email) (URL) - 18 August '10 - 03:05

[[http://www.pdftoimageconverter.com]] PDF to IMAGE Converter with reliable quality and humanized design is your ideal helper, which can protect U from having troubles in converting pdf to image! Unimaginable functions will not let U down forever!

PDF to IMAGE Converter (Email) (URL) - 23 August '10 - 01:51

very cool article ,thanks for sharing the article!like my cool stuff .very useful.
uCoolStuff is the leading China wholesaler for [[http://www.ucoolstuff.com]] cool stuff [[http://www.ucoolstuff.com]] cool gifts, unusual gadgets and other unique gift ideas. We provide the very latest cool stuff and cool gifts for you

cool stuff (Email) (URL) - 25 August '10 - 08:24

excellent article , I added you to my [[http://www.china-wholesale-directory.c..]] Top China Wholesalers category.. thanks for sharing the article!

China Wholesale Directory (Email) (URL) - 25 August '10 - 08:32

[[http://www.macvobconverter.net]] VOB Converter mac is 2010 the hottest software which is very popular among mac users who want to convert VOB to other video formats on mac like MP4, AVI, WMV, MPG, MPEG, MOV, TS, FLV, etc. With super fast conversion speed and high output quality, it can ensure you a fluent process to convert VOB mac. And in the same way, this Mac VOB Converter can convert various video formats to VOB for enjoyment.
[[http://www.macvobconverter.net/mac_vob..]]

VOB Converter mac (Email) (URL) - 30 August '10 - 05:41

[[http://www.ripblurayformac.net/blu-ray..]] Blu-ray to iTunes Mac supports output formats compatiable with iTunes including: MP4, MOV, M4V, iPod Videos, iPhone Videos, iPad Video and Apple TV Video, after the conversion, you can transfer the converted Blu-ray DVD movies to iTunes freely on Mac OS X.

[[http://www.ripblurayformac.net/blu-ray..]] Blu-ray to iTunes can quickly convert Blu-ray DVD (.m2ts) files and DVD (.vob) movies and ISO/IFO images to iTunes compatiable format with just a few clicks, and It is more than a Blu-Ray to iTunes Converter and can help you to remove Blu-Ray AACS encryption, region codes and BD+ copy protection, and transfer Blu-ray to iTunes movie with fast conversion speed and high quality.

Blu-ray to iTunes Mac (Email) (URL) - 01 September '10 - 01:50

Personal information





Remember your information?
Comment

Small print: All html tags except <b> and <i> will be removed from your comment. You can make links by just typing the url or mail-address.


^M