Archive for January, 2008

OGB: Defining the Future of OpenSolaris

Tuesday, January 29th, 2008

I’ve been asked to provide some insight in this blog regarding the activities of the OpenSolaris Governing Board (OGB), and so I’m delivering.

I debate is raging on the OGB-Discuss list regarding the nature of our community, its future, and the applicability of our current Constitution. From the outside it might seem a bit unruly, and to some extent it is, but let me help sum up the nature of this debate and its importance.

As I’ve stated in the past, the OpenSolaris community is a social organization first and foremost, built around the source code that makes up the Solaris core operating system, currently known as “Nevada”. The scope of the community has grown over time with the additional codebases being opened, such as Sun Cluster know in the open as “Open HA Cluster”. The community is still chiefly focused on Solaris code but we’re growing. Activities of the community range from various documentation efforts (led by the Documentation Community Group and its projects) to evangelism activities (led the Advocacy Community Group and its projects) to bug fix (this is more of a gray area).

We have two intertwined discussions going on.

The first is about the structure of our community as defined by the Constitution. The model comes from the Apache Software Foundation (ASF). Community Groups (known as “projects” at ASF, Ant is an example) are the heart of it all, here there is a governance structure composed of “Core Contributors” who you can think of as the Core Team, and “Contributors” which is a more generic term for “developer”. Contributors and Core Contributors both have voting rights both in their Community Groups (CG for short) and the community in general for OGB elections and ratifications. The Core Contribs and Contribs from all the CG’s together comprise the membership of the OpenSolaris Community en mass.

Community Groups can create Projects by an approving vote of at CG’s Core Contributors. Projects are provided with special resources on OpenSolaris.org including a SCM repository (either Hg or SVN, it’s your choice), a web structure, etc. Projects then can go off and do work. The intent is that the CG Core Contribs will be there to offer assistance, guidance, and leadership when required.

Currently we don’t actually enforce this structure. Projects are created by but not explicitly owned by a CG, rather a project can be “endorsed” by any number of CG’s (there is actually a page of check boxes in which your CG can just check off any and all Projects which it wants to endorse). Some people feel this is a strength, others a significant weakness.

Another problem is that most of the current Community Groups, which are formed by submitting a proposal to the OGB for approval, pre-dated the existing governance. They were created more so as Special Interest Groups (SIGs) for the website around launch time and have existed since. For instance, “Storage” is a CG, “ZFS” is a CG, “Desktop” is a CG, etc.

The infrastructure provided to projects and CG’s contributes to another problem, each of these entities has a mailing list. This is why we have more mailing lists than I can count, some of which are accessible via Email or Web via Jive Forums, others that are straight up Mailman mailing lists.

The second issue is how this structure relates to development efforts. This is where terms unfamiliar to many start flying around such as “ARC” (Architecture Review Committee), “Consolidation” (a specific functional area of Solaris), “C-Team” (Consolidation Team), etc, which are either unknown to much of the community or, at best, highly misunderstood.

Naturally the debate revolves around how to continually “open up” development of the codebases while still maintaining quality through existing procedures.

The position Sun seems to have taken, and sticks to, is to modernize existing internal procedures and methodology (such as moving from Teamware to Mercurial as the SCM) and making that process more externally visible and accessible. This is why contribution today is only possible by requesting an Sun internal developer to work with you, walking you through the process ultimately leading to integration into the golden repository inside of Sun. In addition, it is required for all developers to sign a Sun Contributor Agreement (SCA) to ensure Sun has all the rights it needs from a legal perspective regardless of the license you contribute with. (NOTE: There is some debate about this actually that I’m exploring privately with the appropriate persons at Sun and will divulge my findings when I know what the story is.) Today the primary repository is secure within Sun but plans are in place to create Mercurial repositories that will act as bridges, one that is synced for read-only checkouts, another which accepts commits which are screened before being put into the master Teamware repository (known in Teamware-esse as a “gate”).

I’m raising a question though… is integration in the way described above all there is? While the code is open and there is a method to integrate code back into the respective internal gates, the OpenSolaris community actually has no control over them. Thus, the OGB doesn’t control that code, only the social organization (community) around it. As I described in my last blog entry, there is no open source or free software license of which I am aware that requires that the code author (in this case Sun Microsystems Inc, SMI for short) accept patches, thus we always face a potential issue between what members of our community want and what SMI will accept. Sun’s procedures also don’t facilitate rouge development or “submit and forget” (patch on list) style development.

I want to encourage as much development as possible, and I want to extend the resources of our community to everyone that wants to be involved. The fact is, many external contributors don’t care about Sun procedures or whether they get integrated, only so long as that their work is available to others who want it. For these people, we can either let them work alone, create an effort on SourceForge like anyone else, or we can try to be the SourceForge of OpenSolaris inviting developers to use our resources and work within our framework, which brings a great deal more attention and potential input and collaboration from other similarly minded developers and the core engineers (who are all internal to SMI today) themselves.

In that light, I want to ensure CG’s are properly formed and organized, and that developers can create Projects as easily as possible. I want people to be able to start developing regardless of intentions to integrate. Contribution thus occurs to the community, not exclusively to the internal gates.

Let me reiterate, as a member of the OpenSolaris Governing Board my duty is to the community, not to Sun or to Sun’s internal gates. I must therefore seek for every opportunity by which to empower, enable, and bring together that community… the social organization, the people.

The idea of developing independent of “the process” is controversial. John Plocher, who most certainly will serve on the board next year if he’s willing, describes this best. Bear in mind while reading this that Sun’s Architecture Review Committee (ARC) is a requirement of any non-trivial change and the saying goes “ARC early, ARC often”:

Sun’s ARC process is simply “think before you act”, “do things
by intent”, and “set expectations, then live up to them”. In other
words, “be an engineer”.

This is very true, but ultimately at odds with the weekend coder hacking for fun. I have several projects I’d like to work on, but I have no intention of going to an ARC, making a case, and then arguing my approach… that feels a whole lot like work… for free. At that point I might as well start looking at the SMI Jobs Board and get paid for it. However, that said, if your a 3rd party company who wants to integrate functionality then this is a great help to you. And, doubtless, there are true open source developers who wouldn’t mind the ARC process and perhaps even enjoy it.

The Sun procedures and ARC process will always be a reality of putting code into (insert name for Solaris here; ON, Nevada, OpenSolaris, whatever). What I’m fighting to ensure is that its not the only way we are willing to accept contributors, because if it is I’m not governing the OpenSolaris community as I see it, but rather coordinating unpaid external labor… not fun and not in line with Free Software ideals, imho.

There are a host of issues that become important as a result of these visions. Making SMI development more and more transparent is important to everyone, and that means making SMI developers comfortable with having discussions made in the appropriate external forum. Perhaps the easiest way to accomplish this would be for Sun to explicitly disallow internal email lists and force all non-direct discussion to be transparent…. but boy would you piss off a lot of people internally that way. If its not forced, it will simply be a matter of making the external community space a friendly place to be, with minimal fluff and maximum exposure, to the benefit of all.

Another long post, I know, who has the time to read this crap… if you scanned quickly to the bottom thats fine by me, the essential take away here is that while things may look a bit heated on some of the mailing lists right now its all for honorable reasons, and we can only hope that the discussion drives towards action that will better ourselves and our community.

What is Open?

Sunday, January 27th, 2008

With my OGB seat came a re-newed effort on my part to really look long and hard at where we’re at (OpenSolaris) and where we need to go. There are a lot of problems that need fixing, most of them frankly are social, not technical.

A common sentiment has been that OpenSolaris is “open, but not really open”. I’ve expressed this view myself… but what does it mean?

OpenSolaris, by which I actually mean Nevada, is in fact “Open Source”. Its code is readily available complete with gobs of tools and supporting componants. There is an constantly declining number of closed componants, but those are not required for OpenSolaris to be usable. Its covered under an OSI approved license. And, if we look at Richard Stallman’s criteria, we meet them all:

  • Freedom 0: The freedom to run the program for any purpose.
  • Freedom 1: The freedom to study and modify the program.
  • Freedom 2: The freedom to copy the program so you can help your neighbor.
  • Freedom 3: The freedom to improve the program, and release your improvements to the public, so that the whole community benefits.

Its important to note that I can’t find a single definition of free or open source software that requires the original code author to accept improvements back. So long as you can modify and redistribute you fit the definitions.

So why isn’t OpenSolaris truly open in the minds of many community members? It comes down to what “open” really means. There is a distinction to be made between “open source” and “open development”.

Some people use the term “openness”. This can refer to either the quantity of code thats open, such as in the case of closed applications that release certain modules or API’s as “open”. It can also refer to the development model associated with open source codebases that are distributed as a binary software package, commonly a commercial application. For example, Cisco could release IOS code completely under an OSI license, but if you couldn’t get modifications back into Cisco routers you might be tempted to say “not very open.”

Applied to OpenSolaris, the problem is all the hurdles to pushing changes up-stream so that they appear in a GA release of Solaris or Solaris Express. Currently those hurdles include signing the Sun Contributor Agreement, requesting and then working together with a “sponsor” who helps you with code review and walking you through the integration process, etc.

So we might conclude that a “very open” project is one that readily accepts patches and integrates them so long as they are appropriately licensed (commonly this is just assumed, actually) and don’t break anything (an informal code review, typically with the outcome of “yes” or “no”). At some point you contribute enough patches to be trust worthy and you get commit access to the repository. A lot of projects function in this way, I’d say most of the projects you see on Freshmeat or SourceForge run in this way.

To be honest, do most people adopt that sort of model because its philosophically superior? Not really, its just low hassle. If someone has good stuff to add, great, but no one is gonna baby sit the contributions typically, if it breaks anything its gone and future contributions are more closely screened. I use this model for my own projects, such as ToasterView, but not for any great reason, just because I’m happy to have others help fix bugs, but I don’t want to manage an effort. In the case of ToasterView someone actually made enough changes that they forked it, and I was happy that they did… ToasterView is still alive and well, but there is a great (and superior) alternative now as an independent development effort, and I’m very honored by that.

Solaris, by any name, is a big beast known for its quality control and stability. Sun would be irresponsible to make up-stream integration easy… its not easy for Sun employees, frankly. So how do we make contribution easier?

The method in place today, as re-iterated by Dr. James Hughes, Solaris CTO, in the January SVOSUG meeting, is to “train” external contributors to embrace long standing internal development methodology, with the hope that over time people will become more and more accustom to it and accepting. There are some ups and downs to this. The “up” is that if your a student, for instance, who really wants to know what developing software in a big shop like Sun is like this is a great opportunity. But for the weekend warrior or SysAdmin who just wants to push in a bug fix or one-line patch its a major pain in the butt.

Lets just assume, for the time being, that no matter what happens contributing Solaris code upstream is going to include sponsors, and ARC, and C-Teams, and all those things. What do we do?

Well, we want to make our community more “developer friendly” in general.. that means we want to provide the resources to work on what they want to work on. We can encourage that by making projects easier to instantiate. Want to develop an extension for SMF? You should be able to go to the SMF community, outline your idea and request a project, if approved you get a project space, mailing list, SCM repo, and you’re off and running. When your code hits some maturity point, you go back up to the SMF Community Group and start pimping your bad ass code. This allows you to work with minimal hassle and attract other developers that might want to help, all the while doing it in close relation with the SMF core team.

A next step might be to provide some place where people are encouraged to share changes that aren’t ready to go through a formal integration process. Thanks to distributed SCM’s like Mercurial (Hg) pushing change-sets around is really easy. OpenSolaris currently provides resources for posting WebRev code reviews: cr.opensolaris.org. Its possible that better advertising this existing resource might be enough to ease the process. Pull down the code you want to work on from Hg, modify it, create a WebRev based on your changeset, post it to cr.opensolaris.org, and shoot out a mail letting people know its available if they want it, and just walk away.

The extreme, of course, is to fork a given repository. Anyone can create their own ON repository, Genunix has provided an SVN repo for years now at svn.genunix.org. It would be easy enough to create an “open dev” codebase that is sync’ed with the master gates but allows commits from a variety of community contributors.

But the question is… are those things enough? What do we really want to get to? Will I, Ben Rockwood, ever have the ability to commit to the main ON Gate at will? No… even Bryan Cantrill has to go through code review, ARC, etc.

This is where we need to have a community dialog. If we could do anything we wanted to the OpenSolaris development and contribution model, what would it look like? We need to gather those opinions together and then temper them against reality to see if they can work.

I encourage you to ponder the question and share your opinions here or on an appropriate OpenSolaris maiing list so that we can all collectively drive towards the “place we want to be”(tm).

Up.Time Software: The Ultmate Monitoring Solution

Saturday, January 26th, 2008

A couple things here and there have kept me from continuing my series of posts regarding systems management solutions. One of the monitoring solutions I’ve planned to write about it Up.Time. While I haven’t had the time to write it, I was thrill to check my favorite site, SunHelp.org, and see that Super Admin Bill Bradford wrote an excellent review himself: Software Review: up.time 4 Enterprise Monitoring.

In my professional opinion, Up.Time is the best, most comprehensive, and most polished out of the box solution available at any price. Yes, its proprietary closed source commercial software… but, whether your using Zenoss, HP OpenView, Hyperic, or another other solution out there, your going to only get a small subset of monitoring capability without spending some time extending it yourself or digging around for modules written by someone else. Most, such as NetNMS or Zenoss, are limited by the OIDs exposed by SNMP and then extended by creating custom scripts that SSH into boxes every n seconds. Others such as Zabbix and Hyperic provide a client side agent that gathers up fairly generic information such as disk usage, CPU and memory usage, and maybe an odd and end on top. But Up.Time gathers a massive range of metrics, stores them all, and provides useful graphing and reporting capabilities, including report automation, to make it all very useful.

I’ve solved more than a few problems because of the realization that the historical data I needed to analyze a problem was already right under my nose because Up.Time had been gathering it and I didn’t even realize it. A great example is IO response time! I spent quite a bit of time ripping apart iostat.c to learn how to extend Zabbix, Hyperic, or other solutions to record a_svct… then I realized that all that data was already being gathered with Up.Time right out of the box. Not only does it gather single return metrics, it also stores useful multi-string return data such as the top CPU consuming processes during a given period. Just knowing that the CPU was saturated on Monday of last week isn’t enough! What was actually using that CPU? Up.Time can tell you, no modification required.

With all my searching to date, there is only one “install and forget” solution on the market, and thats Up.Time. If you want to solve your monitoring problems with money its hands down the solution you need to use. I’m not saying its perfect, there are a couple things here and there I’d like to change, but I’m hard pressed to find anything as powerful as it.

Read Bill Bradford’s excellent review for a better look at Up.Time.

January SVOSUG

Saturday, January 26th, 2008

Last night Dr. James Hughes, Solaris CTO, spoke about Indiana. The meeting was less than elegant. Some interesting bits of information come about toward the end, especially concerning contribution to ON, to which his method seem to be to train external contributors over time to Sun’s development method. I also asked a terse open ended question, given that he’s a CTO, “What is the future of Solaris?”. Judge for yourself:

A New Representative of the People on the OGB

Thursday, January 24th, 2008

On Monday I took “office” as a member of the OpenSolaris (Community) Governing Board, filling the vacancy of Mr James Carlson. I’m proud to be given this position, which I shall fill for the remainder of the current term which ends Apr 1, 2008. It is a great honor to serve the community in this unique and privilege way.

While many of you have found OpenSolaris politics off-putting, discouraging, or simply pointless, I assure you that there is still a lot to be done and a lot that can be accomplished, even in the next 3 months before a new OGB takes office.

I want to make clear that as an OGB Member I am representing the OpenSolaris Community… if your reading this blog I’m talking to you. It is my job to represent your interests, needs, and facilitate opportunity for all. If you’re discouraged or confused its my job to do what I can to make the situation more bright. The OGB can’t solve every problem, nor should it, but it should adequately respond to issues confronting community members and always make decisions based on the collective needs and desires of the community at large.

I want to be your advocate. If you don’t feel you have a place to turn feel free to reach out to me and I’ll do what I can…. thats why I’m here.

OpenSolaris is a community built around the Open Source Solaris codebase, complete with all the efforts to support its growth including Advocacy, Documentation, etc. But right now there isn’t much open about it. Much of the development still occurs behind closed doors and is dumped into the public space after the fact. Very little attribution occurs. Contribution of code is absolutely painful and I’ve talked to dozens of would-be contributors that just didn’t need the hassle. Some of this is existing process, yes, but its more so a cultural problem. I believe that there are ways to significantly improve the ease of contribution… I mean, when the argument is “with other projects I just send a patch to a mailing list and I’m done” how can we feel unable to facilitate contribution!

On Monday I went out and bought one of those yuppy fancy Moleskine note books and I’ve begun re-examining everything I can find. The CDDL, the Charter, the Constitution, the various CG’s and projects, old mail threads… I’m putting in the time and research required to really start building a base on which to try to effect change, and I think I’m already seeing benefits. I helped review the CDDL before it went to OSI, I helped in the drafting of the Constitution… but in the last 2 years we’ve put those things to the test and they have come up lacking, in some cases because we do not adequately embrace them, in others because they don’t adequately fulfill their purpose.

I may make things better, I may make them worse. I may make you happy, I may piss you off. But I’m definitely going to try to do my best to do whats right for this community, because at the end of the day, no matter how fed up I get with any of this stuff, I still love Solaris and I’ll come back to it again and again… so i’ll take the blessings that we’ve had (Solaris is Open!!!) and build on those, because Sun can always close back up (as stupid as that would be). So lets put on a happy face and try to make the best of what we have and push towards and even better tomorrow.

Sun Aquires MySQL AB

Thursday, January 17th, 2008

I’m getting requests to comment on this and, for the time being, I’m going to limit myself. I’ll say that its happened, Sun stock rose almost US$1/share prior to the market open and held onto the gain pretty well all day. Personally I think this is a mistake for Sun and MySQL both and as a shareholder I’m very upset at Sun’s continued lack of focus or commitment. That said, I need to spend time looking at the details of the deal to see if this jives, my gut says “someone was gonna buy ‘em, why not Sun?” but my head turns toward Oracle, a major source of revenue for Sun that may or may not be effected by this deal, and PostgreSQL, a commitment Sun made and apparently doesn’t think is yielding results. But I’ll response in greater clarity at a later date about the acquisition and the quarterly results.

Update: I’ve decided that I’m not going to say anything more about it. Clearly a lot of people are divided on the deal. Separating the hype coming from Wall Street between reaction to the recent quarterly results and the MySQL announcement is difficult right now. I personally think there were better ways to spend the money, but I’m just going to have to trust Jonathan on this one.

Mommy, Why is There a Server in the House?

Monday, January 14th, 2008

Holy crap this is hilarious…

I found this in James McPherson’s blog, who points to an online version: Read it now.

Ya, its Microsoft, but its still really funny. Honestly, I wish there was a book like this for explaining what programmers and sysadmins do… maybe LOPSA should commission something like that.

Burnout, Stress, and GTD

Friday, January 11th, 2008

With the new year comes new hope. While Dec 31st and January 1st are really no different, something changes in the mind… the past and the future, clearly delineated in a unique way.

I’ve struggled with what I can only call “burnout” for some time now. More simply put, its that unceasing need to “take a holiday”, but, even with some time off here and there the need is unceasing. Work, of any kind, whether completing a company project, personal open source project, or just taking out the trash, just seems burdensome. The time spent thinking about a task exceeds the time it would take to complete the task in exponential quantities.

This thinking is better clarified in conventional marketing acronym: FUD. FUD is used in non-obvious context such as “Thats FUD,” but the acronym in fact stands for those old standby emotions that destroy anything good and pure: Fear, Uncertainty, and Doubt. The fear that you’ll fail, the uncertainty on whether you can deliver, and the doubt that you have any real ability or usefulness at all, or that there is even any point. Christians would pinpoint these as the great weapons of Satan, whereas the secular would disregard it as simple depression.

FUD can result from both success and failure. You do something well and fear the inability to repeat the performance or you do something poorly and doubt your own ability. A quote that has always haunted me came from Henry Ford, a seemingly limitless fountain of wisdom, that goes like this: “You can’t build a reputation on what you are going to do.” With a great deal of shame I admit that the first time I heard this my internal voice admitted: “It’s worked pretty well for me.”

Proverbs 12:18 say “Reckless words pierce like a sword, but the tongue of the wise brings healing.” Churchill said, “To build may have to be the slow and laborious task of years. To destroy can be the thoughtless act of a single day.” It only takes a couple reckless words, commonly wrapped in meaningless disclaimers like “constructive criticism” or “just kidding” to open the flood gates of personal FUD.

All this really comes down to is a sense of ambiguity and confusion. What lies around the next corner? Where is all this leading? Will the result justify the effort? Will I ever get any better? A thousand questions with no foreseeable answer that conspire to keep you from even making the attempt.

The result is stress, your bodies reaction to imminent danger, real or imagined. More commonly in this day and age, the latter.

This truly is the information age. While I once looked at it as a catchy phrase for journalists, I sure many thought the same of the “industrial revolution”. The tipping point between a “phenomenon” and an “age” is mass acceptance by the culture with permanent integration. My favorite descriptive blurb is “when grandma does it.” While telecommunications have for decades carried our voices around the world, in this information age we now get all the information delivered, literally, to our pockets. And that reality is catching up to me.

This is not an uncommon thing really… while many of us have prided ourselves on brandishing gadgets like wireless PDA’s, iPhones, laptops, BlackBerry’s and all manner of cell phone, the strain is starting to wear thin. Being constantly connected and accessible was once of great novelty… now its a lurking menace.

In the last couple weeks several things have occurred to me that I find disturbing and I’ve tried to be honest to them. For instance, I’ve noticed that frequently my pulse is too high. Maybe thats part of getting older, an awareness of your own beating heart, but so be it. Over time I came to realize that there are several identifiable triggers that raise my heart rate, a symptom of acute stress:

  • If my BlackBerry vibrates. I get 2 vibrations for a message, and I get 2 vibrations followed by a ring for a phone call. The first vibration spikes my heart rate commonly, and then again waiting for the ring which commonly, “thankfully” I think, doesn’t come.
  • When I look at my Inbox. Mailing lists are a godsend and a satanic curse. Even the most restrained mailing lists consists of perhaps 5% material you care about, the rest gets quickly scanned and ignored. As a SA I get automated reports and monitoring alerts which make it all the worse. And, of course, there is both personal and business mail boxes.
  • When instant messages come in for an unexpected source. What am I going to be asked to do? What didn’t I yet do? They probly aren’t just saying hello and IM’s take longer than phone conversations.

All these stresses come from what some call “information overload”. Too many inputs from too many directions.

Information overload is helped along by the ease in which people can create and communicate in the information age. I once saw a great PBS documentary on the tools of writing, wherein someone noted that in centuries gone by writing with quill and ink was a slow and arduous task. Only a few works could be put to paper before the ink ran out and you had to stop, this added to the speed at which a quill scrapes over paper. The result, he argued, was a time when thoughts could be thought and re-thought, formed and re-formed, even during the writing process itself, leading to more thoughtful and concise writing that we’ve seen since the invention of the typewriter. I combine this with the ability to communicate in seconds via email or IM; not only can you input ideas quickly, perhaps more quickly than you can convince them, but you can direct them at others without a thought. The result is a maelstrom of requests and comments that are totally unnecessary given a little thought.

All this plays into a solution: GTD. David Allen’s Getting Things Done is a wonderful way of framing all this together into a system by which we can attack the underlying problems.

I realized, quite by chance, the other day that my elevated stress levels are symptoms of a total loss of “control”. What I’ve needed to do is execute the GTD work flow of Collect, Process, Organize, Review, and Do. There are a million little things, all around me, all the time, that need doing, and the noise in my head is so loud from all these personal reminders that I’ve just tuned them out completely and gone into panic mode.

I came to this conclusion indirectly trying to attack a small part of the problem actually. As part of my “information age” breakdown, I’ve suddenly become aware that I’ve transitioned from a person who’s created to little into a person who’s created too much. Code, scripts, notes, configs, scattered everywhere. I’ve transitioned from older more trustworthy SCM’s for management (Subversion) to newer more “hip” solutions (Mercurial) and paid the penalty, in particular because distributed SCM’s are lousy if you want to manage a golden archive of growing data in a (duh) centralized place.

Added to this is a realization of my own digital mismanagement. I’ve never in my life taken pictures with film, it has always been digital. My first Sony Mavica used floppy disks, a necessity at the time due to the absence of digital camera drivers for UNIX systems, with the added advantage of utilizing a cheap medium that could be archived (“tossed in a box”). But when I upgraded to a Canon PowerShot I suddenly had to download my pictures. The unique thing about pictures, for me, is that in the short term they seem insignificant… but months and years later they are invaluable. There are years of pictures that I’m simply uncertain of where they are, somewhere in a pile of hard drives, I hope.

And even my domains. I bought “clanrockwood.com” when Nova was born to provide updates to family without disturbing us during the first few months. I thought I’d continued to renew the domain, but a recent “What is going on with that domain anyway?” check made me realize that its been snatched away and I need to spend time auditing my records to see at what point I missed a renewal or allowed someone else to park it.

I’ve created a small empire of digital artifacts and, frankly, I don’t know where half of them are. A sad statement for a professional who views storage as his specialty. I only take comfort in statements such as “Who has the worst cars? Mechanics.” True or not, it dulls the pain a bit. Frankly, I need to take a week off work just to become a full time data archaeologist, seeking out and collecting all my scattered bits and calculating the damage.

While watching a presentation by Linus Torvalds at Google about ‘Git’, I noticed another Google Talk by David Allen on GTD. This served as a much needed wake up call: I’d fallen off the wagon. I was still using my planner, but I wasn’t “collecting” what I needed to do but rather recording what I’d done. Those millions of little items seemed too insignificant to collect and the few that I did put in my planner just got pushed from day to day.

I’m happy to say, however, that I’m turning it around! I added additional pages to my planner that very day and just started writing down everything, not matter how insignificant. “Pickup shoe in front yard”, “Clean trash out of truck”, nothing omited. Then I immediately took all those “single step” items and ran around the house in a blaze doing them. Anytime I saw something, anything, that “bugged” me or gave me the slightest hint of “needs doing” I immediately attended to it. In particular David says in the video (above) “Anything thats on your desk thats not equipment, reference, or decoration is something that needs doing.” That struck a cord. I cleaned off my desktop (physical and virtual) and removed anything that didn’t need to be there. And, by the end of the day, I felt significantly better. I was on the path to having control again.

I should also credit Sun Blogger David Pickens. In an attempt to troubleshoot the symptoms I began relying on an RSS reader to cut down on my excess information input, its less stressful to get it all delivered than to hop sites looking for it. Since I started actively reading the feeds I saw several GTD posts from David and those served as the nudges I needed to push me in the right direction, which finally converged when I watch David Allen’s Google talk.

So I’m on that path. I’m going to rely increasingly on RSS feeds, adopt “Inbox Zero” concepts with earnest, remove myself from any mailing list in which read less than 50% of by volume, and continually seek out new ways to acknowledge and handle “the little things” that add up. One simple change I’m making is changing the ring styles of my phones, using audible only tones that inform my brain before my hip. Vanity Vanity, all is Vanity, there is nothing new under the sun…. as always, the joy of rediscovering life’s little realities: ignore the insignificant and soon enough it won’t be.

Here are my take away bullet points that I’m going to try to incorporate more into my personal day-to-day operations:

  • Consolidate information inputs as much as possible.
  • Use applications with simplistic interfaces that limit the quantity of information present to you. This can be accomplished with folders or by view mail 10 at a time rather than a never-ending list.
  • Switch ring tones from time-to-time to keep your mind from anticipating.
  • Always collect items that require action beyond the thought or that aren’t handled on the spot.
  • Don’t stop collection just because you hit the end of the page… insert another one and keep going.
  • Don’t slip into collecting only work items.
  • Don’t consider anything insignificant.
  • If you feel any form of stress symptom, stop and analyze the situation to determine the trigger and record it then and there.
  • Spent time doing “non-productive” tasks outside of the routine. Read a history book, philosophy, fiction… supply your brain with non-routine inputs.
  • Play games more.
  • Take commitments seriously… if there is doubt about the ability to deliver don’t commit, or at the least hedge the commitment “I’ll try, but don’t make me a blocker.”
  • Compliment others, lift people up frequently, only criticize them when positive connentation is crystal clear.
  • Let the “shoulda, coulda, woulda” crap go. ‘Do, or do not. There is no try.’

One final thought. What surprised me the most in this thought experiment was that its easy to mis-interpret stress. Commonly the desire for a vacation is to get away from work… but sometimes, in my case, work wasn’t expressly the problem, its was the way in which I was managing both my work and personal life. If I was to take a vacation the real purpose would have to be to switch focus to non-work tasks that need completion, taking a trip to Hawaii wouldn’t actually solve anything. Like David Allen says, just as in martial arts, its about clearing the area and returning to calm so you can be ready for the next input.

HD TV

Sunday, January 6th, 2008

I was excited to hear that Warner Brothers is dropping support for HD-DVD. That seems like whats needed to break the stalemate between the BluRay/HD-DVD cold-war. To date I’ve not gotten involved, frankly. I watch High Def movies, but thanks to Comcast I can watch HD “OnDemand”.

Tim Bray was recently asking around about HD setups… I thought I’d share some of my thoughts on the matter in a general way because I have unique concerns.

I upgraded to HD last year. Truth be told, it was the first TV I’ve bought because everything prior was a hand me down tube that someone else was dumping. When I finally convinced Tamarah that it was time to upgrade I had some special concerns. First, it has to be cheap enough to buy cash, thus I set my budget at $2,000, no more. Secondly, HDMI is a pretty awesome inter-connect, so I wanted as many HDMI ports as possible. Thirdly, it needs to be an appropriate size for our living room configuration (which comes out to about 42″, anything larger is just silly for our living room). And finally, I need something really practical, and I love the idea of wall mounting, now or in the future.

Wall mount-ability was a big issue for me. If you think about it, the TV in most homes is like a shrine, everything is build around it. I like TV as much as the next guy and I enjoy films, but my TV is not the center of my life and neither should it be the center of my home. Wall mounting I think makes your TV a part of the room while not the center. I don’t currently wall mount, the room just isn’t in a good configuration for it, but I like the option to do so.

The big question becomes whether to go LCD or Plasma. I chose Plasma for the following reasons:

  • Plasma’s are cheaper now. Bigger screen at lower cost.
  • Plasma’s have _real_ blacks. My previous hand-me-down tubes had horrible color problems and when watching dark SciFi or old B/W pictures you just go nuts looking at dark green instead of black.
  • Plasma’s are glass! Ya, thats right. LCD screens are not hard coated (not that I’ve seen) but rather soft. With young kids they are going to hit it, touch it, draw on it, throw things at it, etc. I have well behaved kids, but accidents happen. With an LCD they may damage the soft surface… with Plasma the glass is tougher and easier to clean.

The only downside to Plasma, besides being slightly heavier, is that they are really hot. I don’t think the kids could burn themselves, but I warn them all the same.

I will also note that Plasma can and do “burn”. We put “The Little Mermaid” on for Nova one day, and the screen was left on after the movie finished for a couple hours. The root menu has very contrasting colors and after I noticed and turned off the screen you could still see the imprint for several hours. Thankfully the anti-burn is pretty good and within a day it was good as new. If an image were left static for a day or longer, I’m not sure how permanent the effects could be, but this is only a potential concern if using the screen as a computer monitor… this alone may warrant computer users moving to LCD.

I personally chose to buy a Philips 42″ Plasma from Costco. I think I paid like $1299 or something for it, which was the best price around that I could find at the time. It has dual HDMI inputs and lots of features. While there are better screens around, the Sharp’s caught my eye, the cost savings was more appealing that a moderate improvement in picture quality.

Another reason for “cheaping out” was so that I could put the money instead into a Logitech Harmony Remote. I bought the 880 model and we love it! Normally I wouldn’t pay that much (around $300 I recall) for a remote, but having different remotes for TV, VCR, Cable Box/DVR, and DVD was driving Tamarah nuts, plus the Philips remotes are unbelievably awful. With about 15 minutes of programming we can no just press the “Watch TV” button and everything does what it should and reconfigs the remote appropriately. It was absolutely worth the money and more useful than slightly better image quality.

As for the DVD player, I bought a cheapo Philips DVD ($49) with HDMI output and 1080p upscale. The upscale doesn’t do jack, really, but sounds nice. The key factor here, again, is kids. If the kids destroy the DVD Player I’m not going to cry about it. Previously I had one of the first Sony all-in-one home theater systems (later to be dubbed “Dream Theater” or something), which was a great concept but I didn’t have anywhere to put the rear speakers, had piles of cables everywhere (not they are wireless thankfully) and it was pricy. Frankly, I’m not so much of an audiophile as to care much and frankly the majority of films we watch pre-date stereo.

One note I’ll throw in… if you pay more than $20 for an HDMI cables your getting screwed. I see cables at Best Buy for upwards of $50. I bought mine at my local computer supplier (Centeral Computer) for $10 and they are brilliant. I ultimately bought 2 HDMI cables and an HDMI-to-DVI cable… but I’ve never gotten my MacBook Pro’s screen resolution fine tuned to the screen so its just generally blurry… thats not the Plasma’s fault though but mine.

If you do get HD, I highly recommend the “Discovery HD” channels show “Sunrise Earth”. Brilliant show, featuring sunrise at some point on the globe without any time-laps. Total HD pr0n, but very relaxing and interesting to watch. I’ve got several on the DVR which I put on when Tamarah and I talk at night.

Whenever I do move to HD movies, I’ll probly opt for a PlayStation 3. Its not a great game platform (yet) but sure seems like a great BluRay player by all accounts.

Moving Pictures: Flicks to See

Friday, January 4th, 2008

The blogs getting a bit heavy… time to tone down a couple notches. Films are always a good topic…

Blade Runner is my all time favorite film. I first saw it when I was like 13 and doing a baby sitting job. (Yes, I did a lot of baby sitting as a kid, I earned enough one summer to pay for SCUBA lessons, gear, the works… sucked living in a family of non-divers, but was fun to get it.) I put the kid down to sleep and had like 2-3 hours to kill, so I rummaged around in a box of VHS tapes and there was one with just a bad label, written in a sharpy “Blade Runner”. The title alone was stimulating, had to be good! I imagined some dragon fantasy or something, but was blow away by what I found. It was a bad taping off HBO or something, the full US theatrical release with that horrible narration and all. Everything about the film blew me away and I was most excited by the hour afterwards that I sat on the couch in the dark just unraveling the story and philosophy buried within it, heavy stuff for a 14 year old kid.

While its an amazing film there are tons of little quirks in it. Painstaking effort went into the visual effects, but there are several “WTF?” blunders in there, such as Pris not looking exactly like Pris in the Deckard fight at the end, or the dove flying into the blue sky, and what exactly was that unicorn clip all about? Like many fans of the film these things don’t turn you off but rather engage your curiosity.

In the 4 disk Collectors Edition released in December we finally got all the answers. On Disk 2 is a painstakingly long 3+ hour documentary on the making of the film. I have never seen a documentary so candid and blunt in all my life. One of the producers wanted more sex, the visual effects department used the Millennium Falcon as one of the buildings in the city flyovers (I didn’t even notice that one before), and that “missing replicant” that was omited from the Bryant briefing was not actually Deckard but rather a character that they chopped from the film due to length and cost. As long as it was, it was worth every minute of it and paid for the disks in and of itself.

If your a serious fan you’ve probly already bought it. If your a fan of the film but haven’t, do yourself a favor and buy it! Don’t bother with the 2 Disk version, go for the 4 Disk which includes several variations of the film. If you are seriously die hard, buy the 5 disk ‘Brief Case”, which contains the oh so sought after “Work Print” version of the film.

If your film collection is kinda shabby, I recommend putting Blade Runner together with the recently re-released Patton:

Patton is one of the greatest films ever made. If you’ve never seen it in its full glory you must have a run at it, the various lines and music in it are strung throughout our culture in ways that your probly not even aware. Its full glory is only matched by films such as The Right Stuff and Citizen Kane. (If you are snickering at Citizen Kane your a moron who needs to go watch the damn thing… Wells is amazing.)

Thanks to my favorite channel, TCM, I’ve gotten to better know James Cagney as of late. I watched all that I could and put the rest on the DVR. James Cagney is known far and wide as the father of all on-screen gangsters… but he’s so much more than that. There is a brilliance in Cagney that can’t be described. My favorite of his films were ones in which he plays the tough guy with a heart of gold. I think that element, more than any other, was the setup for the most beloved mob stories… sure he’s a tough guy that takes no lip and shots anyone that gets in his way, but he’s doing it because he loves his brother or his girl or whatever. There is always a sense, not matter how despicable his character, that he’s just doing the best he can to get through life.

One of the films I watch tonight was City for Conquest in which he plays a reluctant New York boxer. Its the kind of film that leaves a mark… you leave wanting to be just like Jimmy. He’s down to earth, so unlike Cary Grant or Jimmy Steward or Clark Gable you don’t feel like you have to move up the social ladder or be more suave or something, you just have to put your heart in the right place and roll with the punches life brings.

Now, that said, White Heat is close but far more gritty than any other pictures he’s done. The infamous line “TOP OF THE WORLD MA’!!!” comes from that film, and he’s utterly ruthless. If your into that HBO crap like “The Soprano’s” go and have a look at Cagney in that film. Holy crap man…. very little redeeming quality in that character, but damn he’s still got his reasons.

Of course, if you only see one Cagney film, let it be Angels with Dirty Faces, perhaps the most commonly known. I’ve seen that one several times over the years and I always love it. Its probly Cagney at his best.

Now… truth be told, my favorite “sit down and just be happy for 2 hours” genre is romantic comedies. Tamarah and I have watched When Harry Met Sally about 5,000 times… but the romantic comedies of the last 30 years have been lacking, at best. For real whit slinging you’ve got to go back to the 30′s and 40′s. The Thin Man, My Man Godfrey, and my favorite Love Crazy are some of the best comedies ever made, featuring William Powell and (excepting My Man Godfrey) Myrna Loy. These two probly describe Tamarah and I better than any other couple on screen, we aspire and revel in their chemistry. Behold!

Someone actually put Love Crazy up on YouTube in 11 parts… see if you like it, here’s the first part:

Just classic. If your tired of the horrible crap thats pouring into theaters, getting worse every year, don’t give up on film, just start digging into the past. The old the better. Chaplin, Cagney, Gable, Astaire, Crosby, Stewart, Grant…. there are hundreds of amazing films that you’ll love, you just don’t know it yet. TCM is always a good place to start. The rules are simple… black and white is better and never assume. The rewards are easy.. women (not teenage girls) of beauty and wit and charm, men of integrity, character and strength. If it helps, start with a Hitchcock film like Notorious (did you know that MI:2 was an adaptation of Notorious?) and work out from there.