Crossbow for Christmas

After 2 years of waiting, Project Crossbow has arrived! It integrated into Nevada Build 105 on Dec 4th, and BFU’s became available around the middle of the month. SX:CE isn’t available just yet, but should be up in about a week I hope. Crossbow is huge. This is a monumental improvement to Solaris and continues to push the bar out of reach of its competitors.

Simply put, Crossbow redefines the nature of network virtualization. To date, virtualization was limited to creating traditional “virtual interfaces” like so:

root@quadra ~$ ifconfig e1000g1:1 plumb 10.0.0.50 netmask 255.255.255.0 up
root@quadra ~$ ifconfig -a
lo0: flags=2001000849 mtu 8232 index 1
        inet 127.0.0.1 netmask ff000000
e1000g1: flags=201000843 mtu 1500 index 2
        inet 10.0.0.18 netmask ffffff00 broadcast 10.0.0.255
        ether 0:1b:21:25:3e:7b
e1000g1:1: flags=201000843 mtu 1500 index 2
        inet 10.0.0.50 netmask ffffff00 broadcast 10.0.0.255

Creating virtual interfaces like this gets the job done but has a number of drawbacks, all based on the fact that its not a real interface. Stats are screwed up, you can’t snoop the interface, you can’t tune it, etc.

Crossbow changes all that. Now we can create Virtual NIC’s (vnic’s) which are, for all intents and purposes, real interfaces. They have their own network stack and queues, they can be tuned, the can be snooped, they can be VLAN’ed, etc. Anything you can do to a real interface you can do to a VNIC.

While VNICs are handy things to have in the globalzone, they really shine when used with virtualization such as Solaris Containers (zones) or Xen guests, because we now can hand off interfaces that are fully controllable from within the virtual environment without having to dedicate a physical NIC to each one. The result is virtualized environments that feel way more like real servers.

If you’re not already familiar with the dladm command its time for you to get acquainted. dladm is short for “Data Link Administration”, and now compliments ifconfig. For some time now its been used for managing WIFI, 802.11ad Link Aggregation (“teaming” or “trunking”, depending on your pedigree), and more recently VLANs. its even replacing the old (and crappy) ndd with dladm‘s “link properties”… a welcome improvement.

As of snv_105 several new options are available, namely sub-commands for creating VNICs and Etherstubs. A VNIC is a virtual network interface with all the trimmings of a real network interface. For the moment, it appears the max number of vnic’s is 799, but thats not set in stone, and frankly if you need more than that you need to re-architect. Etherstubs are in-software switches which can be used in concert with VNIC’s to create entirely virtualized in-software networks! In short, a standard VNIC will be associated with a physical GLDv3 network adapter, but we can also create a VNIC associated with an Etherstub to keep anything from ever touching the wire.

Lets ponder this. Why would you want a VNIC that uses a software switch (etherstub)? Seems completely useless right? Not entirely. On a traditional network you would create a DMZ with firewall and other goodies which routes to a private internal network… imagine that you can now do that all inside a single system!

Ok, so lets get cracking. Once you have snv_105 installed, we’ll create a VNIC associated with physical e1000g1, then an etherstub and 3 more VNICs that are internal using that etherstub:

root@quadra ~$ dladm show-link
LINK        CLASS    MTU    STATE    OVER
e1000g1     phys     1500   up       --
e1000g2     phys     1500   down     --
e1000g0     phys     1500   unknown  --

root@quadra ~$ dladm create-vnic -l e1000g1 vnic0
root@quadra ~$ dladm create-etherstub etherstub0
root@quadra ~$ dladm create-vnic -l etherstub0 vnic1
root@quadra ~$ dladm create-vnic -l etherstub0 vnic2
root@quadra ~$ dladm create-vnic -l etherstub0 vnic3
root@quadra ~$ dladm show-link
LINK        CLASS    MTU    STATE    OVER
e1000g1     phys     1500   up       --
e1000g2     phys     1500   down     --
e1000g0     phys     1500   unknown  --
vnic0       vnic     1500   up       e1000g1
etherstub0  etherstub 9000  unknown  --
vnic1       vnic     9000   up       etherstub0
vnic2       vnic     9000   up       etherstub0
vnic3       vnic     9000   up       etherstub0

So we have a variety of VNIC’s at our disposal. We now treat these like regular interfaces, using ifconfig to plumb them and assign IP’s:

root@quadra ~$ ifconfig -a
lo0: flags=2001000849 mtu 8232 index 1
        inet 127.0.0.1 netmask ff000000
e1000g1: flags=201000843 mtu 1500 index 2
        inet 10.0.0.18 netmask ffffff00 broadcast 10.0.0.255
        ether 0:1b:21:25:3e:7b 

root@quadra ~$ ifconfig vnic0 plumb 10.0.0.19 up
root@quadra ~$ ifconfig vnic1 plumb 10.100.0.2 netmask 255.255.255.0 up
root@quadra ~$ ifconfig vnic2 plumb 10.100.0.3 netmask 255.255.255.0 up
root@quadra ~$ ifconfig vnic3 plumb 10.100.0.4 netmask 255.255.255.0 up

root@quadra ~$ ifconfig -a
lo0: flags=2001000849 mtu 8232 index 1
        inet 127.0.0.1 netmask ff000000
e1000g1: flags=201000843 mtu 1500 index 2
        inet 10.0.0.18 netmask ffffff00 broadcast 10.0.0.255
        ether 0:1b:21:25:3e:7b
vnic0: flags=201000843 mtu 1500 index 7
        inet 10.0.0.19 netmask ff000000 broadcast 10.255.255.255
        ether 2:8:20:3a:70:5a
vnic1: flags=201000843 mtu 9000 index 8
        inet 10.100.0.2 netmask ffffff00 broadcast 10.100.0.255
        ether 2:8:20:f2:56:4d
vnic2: flags=201000843 mtu 9000 index 9
        inet 10.100.0.3 netmask ffffff00 broadcast 10.100.0.255
        ether 2:8:20:bc:b1:a1
vnic3: flags=201000843 mtu 9000 index 10
        inet 10.100.0.4 netmask ffffff00 broadcast 10.100.0.255
        ether 2:8:20:55:11:56

Please notice that they all have individual MAC addresses! There are severla methods for how the MAC is chosen, but I won’t go into them here.

If you are using Solaris Containers these VNIC’s would be given to a Zone as an “IP-Instance” (exclusive mode), a feature which was added some time ago but untill now only usable by dedicating a physical interface. The same should apply to Xen or other virtualization tools.

Finally, in our whirlwind tour of this amazing technology, lets look at my favorite feature of Crossbow.

Crossbow is both Network Virtualization (we looked at that above) and Network Resource Control. With Crossbow we have a real network resource control capability that is free from the terror that is IPQoS.

There are three types of resource controls at present: max bandwidth (rate limiting), priority (relative to other traffic), and cpu’s. Please note that these controls are not cumulative, but rather apply to any given point in time. These controls can be applied either to an entire link (NIC or VNIC) or alternatively to a particular network flow.

Let me pause here. If your not familiar with a “network flow”, it is a defined collection of network communication. For instance, a flow might refer to all HTTP (port 80) traffic to a given IP address, or perhaps all TCP traffic, or perhaps a combination of FTP, SMTP, and HTTP ports. If you’ve worked with firewall rules your familiar with the concept, a flow simply allows us a way to apply some action to a specific flow of traffic.

Crossbow adds the new command flowadm to define and control network flows. Here is an example:

root@quadra ~$ flowadm add-flow -l vnic0 -a transport=tcp,local_port=80 httpflow
root@quadra ~$ flowadm add-flow -l vnic0 -a transport=tcp,local_port=443 httpsflow
root@quadra ~$ flowadm show-flow
FLOW        LINK        IP ADDR                        PROTO  PORT    DSFLD
httpflow    vnic0       --                             tcp    80      --
httpsflow   vnic0       --                             tcp    443     --

flowadm relies on attributes that describe a flow, and properties which assign some resource control. We’ll add bandwith control to the flows above by modifying the “maxbw” property:

root@quadra ~$ flowadm show-flowprop
FLOW         PROPERTY        VALUE          DEFAULT        POSSIBLE
httpflow     maxbw              50          --             50M
httpflow     priority        --             --
httpsflow    maxbw              80          --             80M
httpsflow    priority        --             --

Here the maxbw is specified in Mbps. Docs show that percentages, Kbps, etc are supported, but they don’t seem to work right now.

maxbw will rate limit to the specified throughput, priority can be set “low”, “normal”, “high” or “rt” (real time). Using these controls carefully you can partition off bandwidth pretty nicely.

In addition to all this, extended accounting has been extended to incorporate accounting based on links or flows, but I’ll save that for another day.

Congrats to everyone on the Crossbow team. This is a major achievement and an amazing technological advance!

This entry was posted on Monday, December 29th, 2008 at 9:20 am and is filed under OpenSolaris. You can follow any responses to this entry through the RSS 2.0 feed. Both comments and pings are currently closed.

174 Responses to “Crossbow for Christmas”

Adam says:

December 29, 2008 at 3:12 pm

This sounds great. As a Joyent customer, I would love to have detailed network statistics for my zones.

A.
Zachary Schneider says:

December 29, 2008 at 4:19 pm

I have been following crossbow for awhile, very excited about it. I know OpenSolaris has ipf integrated but if OpenBSD’s pf were integrated this would make me switch my firewall systems to OpenSolaris too….

Alan Pae says:

December 29, 2008 at 7:31 pm

Ben,

Great post. However, could you put the following into a

 container?

using ifconfig to plumb them and assign IP's:
root@quadra ~$ ifconfig -a lo0
Please notice that they all have individual MAC addresses!

Thanks,
alan

Alan Pae says:

December 29, 2008 at 7:32 pm

Sorry,

Make that an html “pre” container
benr says:

December 29, 2008 at 7:51 pm

Fixed.
darkfader says:

December 30, 2008 at 5:56 pm

this is outright crazy – i didnt know i had gotten something that great for christmas
Sunay Tripathi says:

February 5, 2009 at 7:52 am

Great Overview on Crossbow Ben! And thanks everyone for
trying it out. You can find more details relating to architecture
or building advanced virtual networks aka Virtual Wire at
http://blogs.sun.com/sunay
David Magda says:

February 7, 2009 at 2:07 am

FYI, Jonathon Schwartz just linked to this post (second last paragraph):

http://blogs.sun.com/jonathan/entry/q2_fy2009
Mike says:

February 12, 2009 at 1:00 pm

Great, yet even more complexity added to an already cryptic OS! I’m sorry but Solaris is becoming ever more hard to follow, constant updates and changes.
Paul Murphy says:

February 16, 2009 at 8:11 pm

“and now compliments ifconfig.” By offering flowery praise? Bowing?

You want “complements” – and no it’s not just a spelling error. The terms complement and supplement have well defined, well understood, meanings in economics that get borrowed in usage like this. People who use “compliments” instead are demonstrating that they don’t know, and don’t care.

FYI:
A long time ago two people I knew started an economics consultancy – and described their skills as complimentary in their marketing materials. Go figure
samax says:

August 10, 2009 at 4:47 pm

OpenSolaris has ipf integrated but if OpenBSD’s pf were integrated this would make me switch my firewall systems to OpenSolaris too….
how to grow taller 101 says:

August 31, 2009 at 3:18 pm

With Crossbow you indeed have a real network resource control capability that is free from the terror that is IPQoS.
Grow Taller says:

October 11, 2009 at 3:45 pm

wow, that looks quite complicated!
cheap links of london says:

November 7, 2009 at 1:06 am

Thank you very much!
liubaiying says:

December 8, 2009 at 8:28 am

links of london sweetie ring
links of london ring
Pauline says:

December 29, 2009 at 9:37 am

links of london sweetie bracelet
links of london sweetie
liubaiying says:

January 5, 2010 at 3:19 am

It is hard for women to resist the temptation of jewelries and women’s jewelry box is like an abysm which is never full.
uggs says:

January 6, 2010 at 10:04 am

We supplier the most complete ugg boots collections at favorable price,chose your ugg boots here.our ugg boots is your best choice.
raging bull says:

January 15, 2010 at 6:26 am

Good post! Thanks you for your information! China Wholesale Wholesale China Wholesalers Wholesale Game Accessories Wholesale Iphone Accessories Video Game Accessories Wholesale Wholesale Wii Accessories Wholesale Xbox 360 Accessories Wholesale Xbox 360 Games Wholesale Video Games Cheap Video Games Cheap Ps3 Games Cheap Xbox 360 Games Wholesale Computers Wholesale Laptop Computers Wholesale Laptops Discount Computers Cheap Computers Wholesale Iphones Wholesale Iphone Wholesale Iphones 3g Hiphones Wholesale Hiphone Wholesale Hiphones Wholesale Nokia Wholesale Nokia 8800 Wholesale Nokia n97 wholesale blackberry wholesale blackberry phones wholesale blackberry 9700 wholesale blackberry 9600 wholesale blackberry 9500
ed hardy says:

January 15, 2010 at 7:28 am

Good post! Thanks for your information! ed hardy ed hardy ed hardy clothing ed hardy clothing ed hardy swimwear ed hardy swimwear ed hardy jeans ed hardy jeans ed hardy hoodies ed hardy hoodies ed hardy shoes ed hardy shoes ed hardy uk ed hardy uk ed hardy bags ed hardy bags ed hardy shirts ed hardy shirts christian audigier christian audigier ed hardy mens ed hardy mens ed hardy womens ed hardy womens ed hardy kids ed hardy kids ed hardy
charms says:

January 16, 2010 at 9:09 am

Once she was satisfied, she jumped out of her chair and headed to the comm shack links of london jewellery, pushing past Rynyan, who was loitering in the hatchway and clearly relished the close contact links of london. I’m caUing for the beam. Sooner you two dreamers are out of my hair, the better. And out of my head Links of London sale .
linksjuy says:

January 20, 2010 at 8:54 am

Thank you for sharing your brushes! I’m having fun playing with them.
kamagra says:

January 21, 2010 at 1:08 am

thanks
Omnilens says:

January 21, 2010 at 7:04 am

What is unique to Pandora bracelets is that every each style is unique. Belles can even organize each string of beads, diamonds and pendants according to their own tastes.Rolling slightly with movements of the wrist as beads in the bracelet have a certain room to slide，Pandora bracelet enables girls to be the eye-catching ones.And the well selected diamonds and ultimate manual carving ornamentations bring much charm and a sense of fashion to those smooth and round gemstones with wild colors, which represent a colorful beauty.The various sweet and lovely jewelry designs awake the sweet and lovely heart of girls，shaping their ideal and romantic temperament perfectly. It\’s so touching and irresistible.
american drew furniture says:

January 21, 2010 at 8:29 pm

I agree and I will come back and follow more of your posts.
charms says:

January 22, 2010 at 7:19 am

thank you for sharing, it is great.
abercrombie clothing says:

January 22, 2010 at 8:29 am

good post
charms says:

January 22, 2010 at 8:40 am

I agree and I will come back and follow more of your posts.
discount links of london says:

January 22, 2010 at 9:15 am

Thank you for the valuable information. I have used most of these services. Keep up the good work.
tiffany says:

January 23, 2010 at 3:58 am

Oh,you said right,i like you!
iphone says:

January 29, 2010 at 7:31 am

Everything will be all right,I am behind you.
As Seen On TV says:

January 30, 2010 at 6:00 am

Good post! Thanks for your information! As Seen On TV
links of london says:

February 5, 2010 at 6:23 am

GOOD
manolo says:

February 6, 2010 at 8:54 am

http://www.ladyshoesstore.com/
laptop battery club says:

February 8, 2010 at 8:38 am

Your article is very useful!Thank you for sharing.Nice post.
Topi says:

February 10, 2010 at 6:51 pm

This info rocks… (y)
Anonymous says:

February 11, 2010 at 1:56 pm

Very nice comments
tom maik says:

February 16, 2010 at 10:20 am

I’m rushing to catch a plane back to Indy this morning so I can’t go into too much detail http://www.tradingforexcurrency.com
Engagement Rings says:

February 18, 2010 at 12:36 pm

The ring reminds you of your significant other and also represents beginning of new life which is filled of new hopes and dreams. And hence everyone wants their engagement ring to be unique and wonderful. And the best place to buy a perfect engagement ring is online.
manolo says:

February 25, 2010 at 6:16 am

I like the side of the article, and very like your blog, to write well and hope to continue your efforts, we can see more of your articles.manolo blahnik. Recommend you to take a look at it, is now being discounted, blahnik manolo Fall-Winter Collection in hot!
edhardy says:

March 1, 2010 at 12:14 am

Are you want to own the cheapest ed hardy ?
links of london says:

March 4, 2010 at 5:47 am

These beautiful jewelries can catch the eyes of women all the time since they always believe that the jewelries in the shop window are much better than those in their jewelry box.
Mike Hunter says:

March 5, 2010 at 9:44 am

actually I tried this as well and it didn’t work out for me (though, as advised, I did everything as advised). but I’ll definitely give that another shot… hope, to my favourite music found by http://www.mp3hunting.com mp3 search I’ll find inspiration;) well, lets see if there is a happy end for my project, too. I’ll keep you posted about the result.
street lamps says:

March 8, 2010 at 2:48 am

I had never see a blog batter than this blog, I like this blog very very much.By the way, do you like my products, solar street light, many other solar products.
bt lami shoes for sale says:

March 9, 2010 at 3:20 am

one day i went shopping outside,and in an ed hardy store,I found some kinds of ed hardy i love most they are Your website is really good Thank you for the information
links of london says:

March 9, 2010 at 7:11 am

thanks for sharing.
AlstonIsabella says:

March 10, 2010 at 1:39 am

That’s great that we are able to get the business loans moreover, this opens new possibilities.
wholesale lingerie says:

March 10, 2010 at 10:55 am

he content of the articles there will be a lot of attractive people to appreciate, I have to thank you such an article. As hard as it is to answer those questions, it would definitely not help by burying our head in the sand and refusing to talk about them
grace says:

March 16, 2010 at 7:47 am

That’s great that we are able to get the business loans moreover, this opens new possibilities.
fsdfs says:

March 22, 2010 at 4:23 am

aaaaaaa
[url=http://www.3721.com/]uuuuuuuu[/url]
laptop battery says:

March 22, 2010 at 10:27 am

If you are looking for the best brand new laptop batteries at the most preferred price, you have come to the right place. We provide the highest quality Battery at the lowest price with the highest level of service, all in a secure and convenient platform.
http://www.adapterlist.com/hp/pavilion-dv2000.htm
http://www.adapterlist.com/hp/pavilion-dv6000.htm
Aoc Gold says:

March 23, 2010 at 8:53 am

i would say it is wonderful,thanks!
laptop battery says:

March 29, 2010 at 1:41 pm

This is a very good article,so nice
http://www.uk-laptopbattery.com
links of london says:

March 31, 2010 at 3:01 am

http://www.coolinks.co.uk
http://www.linkslife.uk.com
air max 90 says:

April 1, 2010 at 2:25 pm

If you want to have a pair of discount Nike Air Max shoes, please visit our shop. We main offer air max 90, air max 2009, air max ltd, air max tailwind and so on. We offer long term warranty for all our products and also offer best service for our clients. Welcome to select and buy!
mbt footwear says:

April 2, 2010 at 8:06 am

good mbt shoe for you
super-e-world says:

April 3, 2010 at 8:21 am

electronics shop http://www.super-e-world.com/
adidas shoes says:

April 8, 2010 at 10:20 am

The aim of Adidas shoes is to make the very best adidas superstar shoes at an affordable price.cheap Adidas shoes of running sneakers is about a lifestyle. Always making style and innovative advances, cheap Adidas shoes have the fashionable running shoes you will love.From inexpensive adidas running shoes to competitive track shoes, the Adidas superstar sneakers offer great value.

http://www.adidas-cheap.com/
mbt shoes says:

April 12, 2010 at 3:58 am

welcome to buy mbt healthy shoes
rc toys says:

April 12, 2010 at 4:00 am

rc toys your hobbies ,welcome to buy .big discount
mbt says:

April 12, 2010 at 4:02 am

mbt shoes in stock
goodmore says:

April 16, 2010 at 3:12 am

verygood
goodmore says:

April 16, 2010 at 3:14 am

[[http://www.tiffanystock.com]]
goodmore says:

April 16, 2010 at 3:24 am

[[Tiffany & Co is well-known for its sterling silver jewelry, as sterling silver jewelry become more adorable and popular among people. For classic and quality necklaces, more and more people choose Tiffany & Co because they believe that good necklaces need a proper home.

These lovely necklaces and this Elsa Peretti® Open Heart Necklace are throwing off their regal brilliance for amazing diamonds. Tiffany & Co guarantee that all of them have absolutely excellent quality and unique design.

Want to see more buying advices for this Elsa Peretti® Open Heart Necklace? Please visit our community which have more useful tips or you can directly chat with us online.]]
goodmore says:

April 16, 2010 at 3:28 am

These lovely necklaces and this Elsa Peretti® Open Heart Necklace are throwing off their regal brilliance for amazing diamonds. Tiffany & Co guarantee that all of them have absolutely excellent quality and unique design.
[Tiffany & Co guarantee that all of them have absolutely excellent quality and unique design. ]
goodmore says:

April 16, 2010 at 3:31 am

Tiffany, a symbol of the United States design, considers Roman and dreams reputation as the theme nearly two centuries. It meets all the world’s imagination and desires of women in functional beauty and softness emotional. Tiffany’s creative ideas are full of rich features: simple clear-cut lines of the cool and aloof about the clarity move God’s grace. Harmony, proportion and well-organized, is present in the design of every Tiffany integration naturally.Tiffany’s design emphasis excellent. It can not arbitrarily extracted from the natural world inspired by all things, leaving the cumbersome and artificial, just for the sake of clear concise, and each reflects a masterpiece of the American people’s straightforward, optimistic and resourcefulness.
[[http://www.tiffanystock.com]]
wholesale new era hats says:

April 16, 2010 at 8:19 am

Thanks for posting this. Very nice recap of some of the key points in my talk. I hope you and your readers find it useful! Thanks again
Anonymous says:

April 20, 2010 at 4:57 am

When you look at a trade agreement like NAFTA, it’s about that thick (holds his hands about…
gossip girl says:

April 22, 2010 at 1:02 am

It’s healthy and fashionable attracted many people, who were scheduled to cretivity, quickly, we will with the fastest speed the goods to your hands, we will give you the best service and good credit.
nike shox says:

April 22, 2010 at 2:29 am

gald to find this blog
http://www.us-mbt.com
P90X says:

April 22, 2010 at 3:24 am

wonderful! I like read this article
http://www.p90xhot.com
Hi Jordan shoes says:

April 23, 2010 at 7:49 am

So far, nothing shows that the five officials were involved in the same case as Wei. The bribes they allegedly took were also far less, according to the news report. It is the second major bribery scandal concerning the SFDA in less than four years. Zheng Xiaoyu, former head of the SFDA, jordan shoes was executed on July 10, 2007 for taking bribes of 6.49 million yuan for approving licenses for new drugs. “Zheng’s scandal spurred the country’s determination to crack down on irregularities in the entire process from the approval of new drugs to their manufacture and sale,” said Feng Yun, a lawyer specializing in the pharmaceutical industry. “In the latest case, the fact that no senior official was involved indicates the crackdown has already found some success.” However, supervision for the officials who hold important posts overseeing the country’s drug supply should be strengthened, the lawyer said. “Generally speaking, a drug company needs to spend 2 million yuan in the whole process to get a license for a new drug, which usually takes two to three years. Some companies tend to get the license as earlier as possible to earn more money. Therefore, offering bribes to officials was a good move in their eyes,” he said jordan shoes .
r4 ds says:

April 23, 2010 at 8:49 am

Tiffany’s creative ideas are full of rich features: simple clear-cut lines of the cool and aloof about the clarity move God’s grace.
labatterie says:

April 26, 2010 at 6:41 am

These lovely necklaces and this Elsa Peretti® Open Heart Necklace are throwing off their regal brilliance for amazing diamonds. Tiffany & Co guarantee that all of them have absolutely excellent quality and unique design.
wangrongjiao says:

April 28, 2010 at 7:29 am

Everyone has the heart of adoring beautiful things.Women may not wear links of london jewellery, she can’t not but love jewellery. Jewelry is the most feminine thing, and thebest thing close to the small woman’s heart.
supra shoes says:

April 29, 2010 at 1:40 am

thank you so
supra cuban says:

April 29, 2010 at 8:48 am

All html tags except and will be removed from your comment. You can make links by just typing the url or mail-address.
wangrongjiao says:

May 3, 2010 at 1:58 am

This idea is borne out by the fact many people are wearing items passed through generations of their family today. Fashion is hugely expansive right now, encompassing styles from links of london bracelets every era. Look futuristic or retro, create a Forties vibe for your outfit inks of london sweetie bracelet matter so long as you are being an individual and creative. No one look is dictated, only your imagination is the limit.
Nike Free 5.0 says:

May 3, 2010 at 9:11 am

Zoom Kobe Basketball followed the group for all 18 holes, too. The county sheriff is a Republican, Nike shox tailwind and so is one county commissioner, but not one state legislator identifies with the GOP. Eugene is a Democratic stronghold Nike Shox shoes in a blue state. Lane County registers nearly twice as many Democrats as Republicans. Welcome to shop http://www.nikedirect.net/.
wholesale says:

May 4, 2010 at 3:06 am

Nice post what i saw!
Thanks!
http://www.trademic.com
www.thesuitshoes.com says:

May 5, 2010 at 3:03 am

Look at this site: http://www.thesuitshoes.com
Nike Air Max Shoes says:

May 5, 2010 at 6:08 am

Palin’s appearance will mark a detour from shock shoes from nike conservative enclaves like Orange County, and Redding, Calif. Nike Free Shoe was about ending the different shades of green, different fonts and different messages we were sending while respecting the past and launching into a new Michigan State. Welcome to shop http://www.nikedirect.net/.
Supra says:

May 7, 2010 at 6:34 am

here we sale supra shoes
http://www.supramvp.com
http;//www.nikesuprashoes.com
kii says:

May 8, 2010 at 12:06 pm

thank you for sharing.
Dress up says:

May 9, 2010 at 12:04 pm

All html tags except and will be removed from your comment. You can make links by just typing the url or mail-address.
nike air max says:

May 10, 2010 at 8:15 am

For the second time in just over one year, Nike running shoes Missouri coach Mike Anderson has turned down a hefty raise and the chance to revive a moribund power conference program to remain with the Tigers.The latest suitor was Oregon, Nike air force which fired Ernie Kent a month ago after a 16-16 season and ninth-place finish in the Pac-10. Anderson confirmed Sunday that the job was his if he desired.”We listened,” he said. “I owe Lebron James Shoes to my family.” Welcome to shop http://www.nikeairmax.org.
wangrongjiao says:

May 11, 2010 at 2:13 am

Later the girl knew a man who said that he had nothing except money and bought her a lot of, of course he had her love. Soon after they rent a house and live links of london jewellery together. The man following her at everything, and the girl was very happy about her decision and thought she chose the right man for her future life. However, such life did not last very long, when the girl found she pregnant, the man suddenly disappeared.
mbt shoes says:

May 11, 2010 at 6:02 am

http://www.supracollect.com
Air Jordan says:

May 11, 2010 at 8:15 am

Air Jordan http://www.jordan56.com
Replica Chanel Watches,Dvd Boxes says:

May 12, 2010 at 7:21 am

A good website recommend you:www.offerreplicawatches.com.They sell Chanel Watches, Replica BRM Watches,offer Cartier Watches, Copy Ebel Watches, Replica Hublot Watches, Fake Tag Heuer Watches, wholesale Richard Mille Watches.

They also sell some very fashion watches, such as Montblanc Watches for sale,Chopard Watches, Dior Watches and Gucci Watches. Rolex watches are hot sell. If u are Armani Watches and Breitling Watches fan. You can still look at Omega Watches and Longines Watches, many new arrivals watches just come here.You can have a try on 58338312391273913. :[url=http://www.offerreplicawatches.com]www.offerreplicawatches.com[/url].
wangrongjiao says:

May 14, 2010 at 9:14 am

Immediately catch of Joe Smith, Joe Smith is to buy only the birds, not kill, officials say he is not honest, the Joe Smith beat him, then links of london someone is forced admissions, Joe Smith was sentenced to death, autumn Wenzhan. pandora rings jewelry people have reported seeing his son, returned home. And accompanied by John Doe to see Joe Smith Joe Smith was links of london sentenced to death, thinking clearly is to buy pandora beads and charms ， how to kill has become a pick up? John Doe 1 came to a small town, shop around to find Miejiang found Miejiang whereabouts immediately report, the magistrate received a report and track down the Miejiang, pandora jewelry done a quiet conscience, fear.
air jordan xv says:

May 15, 2010 at 3:27 am

In short, a standard VNIC will be associated with a physical GLDv3 network adapter, but we can also create a VNIC associated with an[url=http://www.mydiscountjordanshoes.com/air-jordan-xv-c-79.html] air-jordan-xv

[/url]
adidas-cheap.com says:

May 16, 2010 at 8:57 am

Our cheap Adidas shoes online store supply all kinds of Adidas shoes,contain adidas superstar, adidas nizza hi, adidas forum mid, adidas rod laver,adidas porsche design etc.Our Gucci outlet online store are offering Gucci new released collections ans Gucci handbags,Gucci Wallets,Gucci men shoes,Gucci Sunglasses,Gucci women shoes,Gucci belt,Gucci caps etc.

http://www.adidas-cheap.com/
new era 59fifty hats says:

May 17, 2010 at 12:56 pm

Dear friends, thank you for visiting our website ,we are an international trade company,which specializes in hats.We wholesale hats at competitive price,providing a huge range of hats with different brand name,such as Red Bull Caps,red bull energy hats, monster energy hats,dc shoes hats , etc.You can buy cheap hats. Welcome to visist here .
new era Philadelphia Phillies Hats says:

May 18, 2010 at 2:16 am

We wholesale hats at competitive price,providing a huge range of hats with different brand name,such as coogi hats, new era Pittsburgh Pirates Hats,Jordan hats,famous hats,dc shoes hats,new era MLB hats, etc.You can buy cheap hats. Welcome to visist here.
cheap nfl jerseys says:

May 18, 2010 at 2:27 am

Dear friends, thank you for visiting our website ,we are an international trade company,which specializes in NFL jerseys.We wholesale jerseys at competitive price,providing a huge range of NFL jerseys of different teams,such as Arizona Cardinal,Atlanda Falcons ,www.4unfl.com Baltimore Ravens,etc.You can buy cheap jerseys. Welcome to visist here .
Discount NFL Jerseys says:

May 18, 2010 at 1:26 pm

Dear friends, thank you for visiting our website ,we are an international trade company,which specializes in NFL jerseys.We wholesale jerseys at competitive price,providing a huge range of NFL jerseys of different teams,such as Arizona Cardinal,Atlanda Falcons ,Baltimore Ravens,etc.You can buy cheap jerseys. Welcome to visist here .
kobe bryant shoes says:

May 19, 2010 at 4:58 am

http://www.kobeshoes.org/
http://www.kobeshoes.org/
laptop ac adapter says:

May 20, 2010 at 5:44 am

Hello,I love reading through your blog, I wanted to leave a little comment to support you and wish you a good continuation. http://www.gpscardvd.com Wishing you the best of luck for all your blogging efforts.
designer handbags says:

May 20, 2010 at 8:38 am

wow,It a good arcticle,Welcome to our website:http://www.yoursbag.com,ordering handbags what you like.
cheap nfl jerseys says:

May 20, 2010 at 12:14 pm

Dear friends, thank you for visiting our website ,we are an international trade company,which specializes in NFL jerseys.We wholesale jerseys at competitive price,cheap nfl jerseys,Atlanda Falcons ,Baltimore Ravens,etc.You can buy cheap jerseys. Welcome to visist here .
new era Los Angeles Dodgers Hats says:

May 20, 2010 at 3:42 pm

Best new era caps,wholesale new era hats, Monster Energy Hats, Dc Shoes Hats, Red Bull Hats,New Era Caps,NFL Hats ,Famous Hats ,new era 59fifty hats,jordan hats and coogi hats,etc are in stock now. Our site provide first-class service and reliable quanlity garantee,do not hesitate to shake hands with us and go with the tide as soon as possible!
HP0-J33 says:

May 21, 2010 at 5:24 am

High quality Cisco,HP,IBM, Oracle and other Certification exmas training materials are provided here at Pass4sure Pass4sure helps you on your way to your certifications
Click pass 4 sure to get more information!
links jewelry says:

May 22, 2010 at 8:56 am

great point !I love your article very much, just like Women love fashion jewelry ,I write a blog about links of london include links of london bracelet and links of london charms,My favarite !
jordan shoes says:

May 24, 2010 at 8:30 am

thanks you so much
jason says:

May 25, 2010 at 2:41 am

thank u let me know about dladm , i like this topic . and i also like something about fashion thing like christian shoes and herveleger dress, and have added your blog to wait the new things. thank you!
New Orleans Saints Jerseys says:

May 27, 2010 at 3:00 am

Dear friends, thank you for visiting our website ,we are an international trade company,which specializes in NFL jerseys.We wholesale jerseys at competitive price,providing a huge range of NFL jerseys of different teams,such as Arizona Cardinal,Atlanda Falcons ,Baltimore Ravens Jerseys,etc.You can buy cheap jerseys. Welcome to visist here .
New Orleans Saints Jerseys says:

May 30, 2010 at 1:39 pm

Dear friends, thank you for visiting our website ,we are an international trade company,which specializes in NFL jerseys.We wholesale jerseys at competitive price,providing a huge range of NFL jerseys of different teams,such as Arizona Cardinal,Atlanda Falcons ,Baltimore Ravens,etc.You can buy cheap jerseys. Welcome to visist here .
Website: http://www.cheapnfljerseys4u.com
new era hats wholesale says:

May 30, 2010 at 3:41 pm

A good website recommend to
you: http://www.goahats.com they sell New Era Hats, 59fifty baseball hats, Dc Shoes Hats, Red Bull Hats,New Era Caps,NFL Hats And Famous Hats at cheap price.
Replica Tag Heuer Watches says:

May 31, 2010 at 7:01 am

Ha, that’s actually a really good suggestion. Thanks so much for this!
hulu downloader says:

June 1, 2010 at 2:31 am

whole idea that complex software should “help” me doing things
Cheap NFL Jerseys says:

June 1, 2010 at 3:47 am

thank you for posting it.Cheap NFL Jerseys
ugg boots says:

June 12, 2010 at 9:49 am

thanks for your posting.
Ugg Classic Boots says:

June 15, 2010 at 7:11 am

Thanks for the great post today！ http://www.uggclassicboots.org
Discount Ugg Boots says:

June 15, 2010 at 7:13 am

I really love your website, it’s so useful, I’m just baking a cake for my aunt！ http://www.uggmall.us
Fivefingers Kso says:

June 15, 2010 at 7:13 am

I am glad to post my views and points in this blog. http://www.fivefingersrunning.com
Ugg Sheepskin Boots says:

June 15, 2010 at 7:14 am

Many thanks for sharing this, very useful! http://www.uggbootshort.com
UGG Schuhe says:

June 15, 2010 at 7:15 am

Pretty good post. I just found your site and wanted to say that I have really enjoyed browsing your posts. http://www.uggofficial.de
nike air shoes says:

June 17, 2010 at 1:50 am

Nike Shoes, nike dunks, Nike air jordan ,Nike Shox Nike Air Rift, nike sneakers, Nike Air Force One, jordan shoes, Nike Air MaxShop authentic Nike Air Force One / 1 Shoes, including Nike Air Force 1 Premium, Nike Air Force 1 Supreme, Nike Air Force 1 Mid and ike Air Force 1 low. http://www.iofferitems.com
sunny says:

June 23, 2010 at 2:52 am

pvc strip curtains [url=http://www.hisure-pvc.com][b]pvc strip curtains[/b][/url]
sunny says:

June 23, 2010 at 3:53 am

pvc strip curtains
sunny says:

June 23, 2010 at 3:54 am

pvc strip doors
http://www.hisure-pvc.com
sunny says:

June 23, 2010 at 3:55 am

Inset Proof Door Curtains
http://www.hisure-pvc.com/product/Inset-Proof-Door-Curtains_1.htm
sunny says:

June 23, 2010 at 3:56 am

pvc sheets
http://www.hisure-pvc.com/product/Wide-PVC-Sheet_1.htm
linda says:

June 23, 2010 at 4:02 am

[url=http://www.hisure-pvc.com][b]plastic strip curtain[/b][/url]
linda says:

June 23, 2010 at 4:03 am

Inset Proof Door Curtains
linda says:

June 23, 2010 at 4:05 am

anti-static pvc curtain
Detroit Lions jerseys says:

July 1, 2010 at 3:36 am

On a traditional network you would create a DMZ with firewall and other goodies which routes to a private internal network… imagine that you can now do that all inside a single system!
kobe bryant shoes says:

July 3, 2010 at 12:32 pm

http://www.kobeshoes.org/
http://www.kobeshoes.org/
nike shox sale says:

July 5, 2010 at 7:42 am

yeach,it is very good!
P90x dvd says:

July 5, 2010 at 7:44 am

you are right!
Insanity workout says:

July 5, 2010 at 7:48 am

you know it.
cheap ghd says:

July 5, 2010 at 7:50 am

you need do it now!
capshotcomi says:

July 9, 2010 at 5:13 pm

wholesale Monster Energy hats
china wholesale shoes says:

July 12, 2010 at 9:36 am

http://www.aj-wholesale.com
saints jerseys says:

July 14, 2010 at 8:48 am

Saints jerseys
Steelers jerseys
All at unbeatable prices!!
NFL Jerseys says:

July 18, 2010 at 12:29 pm

thank u let me know about dladm , i like this topic . and i also like something about fashion thing like christian shoes and herveleger dress, and have added your blog to wait the new things. thank you!

http://www.jerseysusa.com/nfl-jerseys/minnesota-vikings
http://www.jerseysusa.com/nfl-jerseys/indianapolis-colts
Oxy says:

July 19, 2010 at 1:41 pm

This is my first time i visit here. I found so many interesting stuff in your blog, especially its discussion. From the tons of comments on your articles, I guess I am not the only one having all the enjoyment here! Keep up the excellent work.
red bull caps says:

July 27, 2010 at 5:37 am

So beautiful sharing!Thank you very much.
red bull caps
Best wishes!Your article is very good!
It is so nice.
Welcome to visit our website:
http://www.caps-hat.com
rosetta stone software says:

July 29, 2010 at 12:52 pm

SO GREAT rosetta stone software,SO WONDERFULrosetta stone software,YOU CAN IMAGINING HOW GREAT THE rosetta stone software [URL=[[http://www.cheaprosetta.com/]] rosetta stone software[/URL] WAS.
herve leger clothes says:

July 29, 2010 at 1:00 pm

THANK YOU VERY MUCH , I LIKE THIS TOPIC VERY MUCH.IF YOU WANT TO FIND THE CHEAP AND HIGH QUALITY CLOTHES,GO TO OUR WEBSITE:[[http://www.hervever.com/]]
cheap nfl jerseys says:

August 3, 2010 at 3:19 am

lots of good advice on your post. and as a return,i will buy a Cheap nfl jerseys to you for my thanking.
Michael Jordan Shoes says:

August 6, 2010 at 3:55 am

Nice to be visiting your blog again Air jordan 1, it has been months for me. Well this article that i’ve been waited for so long. I need this article to complete my assignment in the college, and it has same topic with your article Air Jordan 2010. Thanks, great share.
discount louis vuitton handbags says:

August 6, 2010 at 3:00 pm

Your article are great, will visit very soon. there is a site: http://www.lovemypursemall.com
fivefingers says:

August 11, 2010 at 6:50 am

撒地方撒飞洒
wholesale nfl jerseys says:

August 11, 2010 at 12:42 pm

Perhaps this is one of the most interesting blogs that I have ever seen. Interesting article, Funny comment. Keep it up!
nike football shoes says:

August 14, 2010 at 8:10 am

It is very beautiful. Thank you for sharing. There is a site： http://www.nikesshox.com
fivefingers says:

August 18, 2010 at 8:47 am

As we know, now GHD are loved by more and more people, which will save up to 45%.
buy cheap insanity dvds says:

August 19, 2010 at 1:08 pm

Good post, thanks for sharing, I enjoy it very much! There is a site: http://www.cheapinsanitydvds.com/
jimmy choo shoes says:

August 22, 2010 at 5:26 pm

In our websitehttp://http://www.iclshoes.com” rel=”nofollow”>http://www.iclshoes.comyou can have more choices
jimmy choo shoes says:

August 31, 2010 at 2:16 am

http://www.iclshoes.com/
http://www.zentai-mart.com/
NFL Jerseys says:

October 3, 2010 at 3:06 am

This fall Authentic NFL Jerseys PLAY 60 and United Way are teaming up for Back to Football On September, a first-of-its-kind campaign to make youth health and wellness a nationwide priority. September 10, in cities and towns nationwide, passion for the NFL will be on full display as schools and offices show their NFL Jerseys online pride for a chance to win exciting prizes.
In classes, schools, office buildings and local stores across the country, everyone will be getting ready for the first weekend of NFL games and celebrating the return of football. Also if you want to buy Jerseys on line. Don’t hesitate to contact me: http://www.nflJersey-online.com
Live Stream says:

October 15, 2010 at 4:51 pm

Your Website Ben is very nice. Thanks to old Rockwood, to making you
emily says:

October 21, 2010 at 5:44 am

It looks great ,I have learned a recruit!Recently,I found an excellent online
http://manoloblahnikoutlets.com” target=”_blank” rel=”nofollow”> manolo blahnik outlet store ,the manoloblahnik shoes are in good quality and cheap price ,they are worth buying !
emily says:

October 21, 2010 at 5:46 am

[url=http://manoloblahnikoutlets.com/]manolo blahnik outlet[/url]

provides kinds of manolo blahnik shoes ,they are in first rate quality and best price , you will never regert for buying them .
lacoste observe says:

November 9, 2010 at 3:25 am

Merely want to say your article is impressive. The clarity in your post is simply striking and i can take for granted you are an expert on this field. Well with your permission allow me to grab your rss feed to keep up to date with future post. Thanks a million and please keep up the fabulous work.
http://www.buylacosteclothing.com/lacoste-shoes-lacoste-observe-shoes-c-14_26.html
pumas ferrari 2010 says:

November 9, 2010 at 3:26 am

Only want to say your article is brilliant. The lucidity in your post is simply impressive and i can assume you are an expert on this field. Well with your permission allow me to grab your rss feed to keep up to date with incoming post. Thanks a million and please keep up the a uthentic work.
womens puma shoes says:

November 9, 2010 at 3:27 am

http://www.pumaferraris.com/women-puma-speed-cat-suede-sx-c-30
Advantageously, the post is really the freshest on this valuable topic. I concur with your conclusions and will thirstily look forward to your next updates. Just saying thanks will not just be adequate, for the exceptional clarity in your writing. I will right away grab your rss feed to stay abreast of any updates. Genuine work and much success in your business enterprize!
ugg shoes says:

November 16, 2010 at 7:20 am

This article was Very helpful. Actually, I am fond of reading online punjabi news. Thanks for writing such a complete ..
thank you for sharing.
ugg uk says:

November 19, 2010 at 7:16 am

http://www.uggsalebootsuk.com/ugg-sale-catalog/new-products
wholesale polo shirts says:

November 21, 2010 at 7:19 am

this is really a god-sent gift to me.nice click to here.i got the most usefully valuable info from you.million thanks.for my thankful return:http://micsourcing.com/wholesale-Polo-Shirts-1273-1.html Wholesale polo shirt, Best Polo Shirts Wholesale ：Buy China Polo Shirts Wholesale from China Supplier. owning a selection of cheap Wholesale Polo Shirts products you like.
new era hats says:

November 29, 2010 at 3:24 am

We have thousands of New Era Hats,http://www.hatmvp.com ” rel=”nofollow”>dc shoes hats,Red Bull Hats,New Era Caps,NFL Hats And Famous Hats at cheap price for Wholesale.
Welcome to our website:
http://www.hatmvp.com rel=”nofollow”> http://www.hatmvp.com
Jordan Hats says:

December 1, 2010 at 3:06 am

Fantastic Read! Looking forward to more! Bookmarked the site and will be back again!
Jordan Hats
Baseball Hats says:

December 1, 2010 at 3:07 am

That is an awfully astounding column you’ve posted.Thanks a lot for that a fantastically amazing post!
Baseball Hats
ugg sale uk says:

December 1, 2010 at 7:29 am

A wide range of selection ugg uk online for you.
Red Bull Hats says:

December 2, 2010 at 8:53 am

Crossbow power is strong, is far before good weapon

http://www.mvpcaps.com” title=”Red Bull Hats ” rel=”nofollow”>Red Bull Hats
Wholesale NFL jerseys says:

December 2, 2010 at 8:54 am

The blog article very surprised to me! Your writing is good.
Cheapest Football Jerseys says:

December 2, 2010 at 8:56 am

I really liked your article and I shared with my friends in my facebook account ..
ghd straighteners says:

December 4, 2010 at 8:13 am

What kind of hair style do you like ?
belstaff jackets says:

December 4, 2010 at 8:36 am

Hey ,boys and girls,nice to talk with you if you can see my message,and
also it’s our fate to share my idea with you.what do you think of it?
wholesale NFL Jerseys says:

December 6, 2010 at 7:34 am

These are wonderful! Thank you for sharing
Wholesale NFL jerseys
Tory Burch Shoes says:

December 6, 2010 at 9:23 am

I am a little bit short-spoken since I was very young,because I

do not like talking too much ,if there is a choice,I would rather

doing or talking.I don’t know why.maybe this is me inborn.
sushilsharma1973 says:

March 9, 2011 at 10:57 am

I definitely believe that the answers granted is highly relevant to most people . Regards .
Locksmith San Jose CA
paul smith bags says:

March 11, 2011 at 2:06 am

[url=http://www.shopcomeon.com]paul smith bags [/url]

The perfect wash bag for the modern man to stash all his overnight

essentials in one super-stylish place, Paul Smith’s jersey case turns

a tired gift into something suitably cool this new year 2011