Is VMware’s vCloud Express all about freedom? It needs an interface for libcloud.

September 3rd, 2009

VMware’s vCloud Express holds a unique position of offering an API that is both a provider API, and a low-level virtualization API.  This has  the potential to give users/customers an incredible amount of freedom in terms of both providers, and virtualization technologies.  However, it’s bit late to the Internet (external cloud) party, and people can be skeptical about late arrivals declaring themselves a Standard. So to be a good citizen both symbolically and practically, VMware needs to build some bridges with some existing efforts, not just invite others to its party.

But who?

Libcloud.  If VMware is all really all about freedom, it needs to work with other efforts equally invested in user freedom, and libcloud is all about provider flexibility.

Wait. What’s libcloud?

Libcloud aims to be a unified interface to cloud (infrastructure) providers. It’s company/provider agnostic, and speaks to provider API’s. It’s built for people who need to to talk to the cloud that they don’t own, like EC2, Slicehost, etc. (Yes, other projects have the same vision, and many want to standardize the cloud, but frankly libcloud has gotten farther than anybody, in less time than anybody, with real code living sitting in github right now.).
The main user/sponsor of libcloud is Cloudkick, who makes a really nice monitoring/management dashboard for popular providers (BTW, I really recommend Cloudkick, no affiliation.)

VMware totally wants tools like Cloudkick to work with vCloud Express providers.

Screenshot image of reboot screen for cloudkick

Cloudkick reboot screen

Libcloud can already do a lot of basic management tasks with a growing list of providers.

infrastructure providers libcloud currently supports

provider list reboot create destroy images sizes
EC2 yes yes no yes no no
EC2-EU yes yes no yes no no
Slicehost yes yes yes yes yes yes
Rackspace yes yes yes yes yes yes
Linode yes no no no no no
VPS.net no no no no no no
GoGrid no no no no no no
flexiscale no no no no no no
Eucalyptus no no no no no no

But what if libcloud worked with the potentially hundreds of vCloud Express providers that will exist shortly?

infrastructure providers libcloud could support with vCloud Express interface

provider list reboot create destroy images sizes
EC2 yes yes no yes no no
EC2-EU yes yes no yes no no
Slicehost yes yes yes yes yes yes
Rackspace yes yes yes yes yes yes
Linode yes no no no no no
VPS.net no no no no no no
GoGrid no no no no no no
flexiscale no no no no no no
Eucalyptus no no no no no no
vCloud Express host 1 maybe maybe maybe maybe maybe maybe
vCloud Express host 2 maybe maybe maybe maybe maybe maybe
vCloud Express host 3 – 1000?!? maybe maybe maybe maybe maybe maybe, it really depends on how much VMware cares

The way the libcloud project is working right now, there’s basically one rep from each provider helping to make an interface to libcloud.  With just a little bit of engineering time, VMware has the power to make an interface that would result in compatibility with 100’s (1000’s?) of providers.

So what are you waiting for, VMware? Join the libcloud list and get involved.  With a bit of effort you can some street cred for vCloud Express’s mission, without changing any of your technology, adding a ton of value to all your provider partners.

vCloud Express is VMware acknowledging the Internet

September 1st, 2009

In plain English: Today VMware outlined a service where you can pay a 3rd party host your VMware guests. They also released an API that would make it so you wouldn’t have to switch management suites when you switched providers. Or decided later on to host your VM’s yourself. The hosting service is called vCloud Express, and it currently includes 5 providers, expected to grow to hundreds (thousands ?). The API is part of their vCloud universe, which includes a lot of other stuff besides vCloud Express.

The most exciting part of this is independence. A customer shouldn’t have to switch software when they grow. Or when they shrink. When they’re focused on agility. When they’re focused on performance. When they’re focused on security. So many software vendors can only have one kind of customer. Though there’s room for improvement, this move by VMware suggests that they’re creating a platform for people to use no matter where’s they’re at.

Industry articles are saying vCloud Express competes directly with Amazon’s EC2 service, and though there is an overlap (you can now pay somebody, not VMware, to host VMware-powered virtual servers), VMware’s strategy is a bit different. They don’t want to be the service provider. They either want to sell you the bits OR sell the provider the bits. But they’re creating a flexible space for the customer, where we don’t have to change technologies or management tools, no matter how much/little involved we are in managing the low-level infrastructure.

I see vCloud Express as more akin to a combination of the open-source/ EC2 API-comptible Eucalyptus and EC2 itself.  Users can grow management process, in-house tools, and 3rd party tools around either a behind-the-firewall Eucalyptus environment or Amazon Ec2, because it’s basically written for the same API.  And if all goes according to plan, VMware vCloud API can achieve the same thing.  A mixed environment with common tools written against the same platform.

I have a million bones to pick with VMware’s cloud approach, and the standard corporate hubris involved in being a late-comer to an established market, and submitting a proprietary reality as a new standard :D

But for this week, I want to just say, “right on” to VMware.  Though they don’t see it this way, it’s a major course correction, and a great example for other enterprise software vendors.

vCloud Express is off to a great start, and I hope to see its vision of customer freedom truly realized.  If so, its success wouldn’t even be tied to VMware hypervisors…

Google Apps wishlist: More finely tuned administrative controls

April 1st, 2009

In Google Apps there are users, and there are administrators… of everything.  A Google Apps administrator has the permission to change anything and everything about a domain’s settings.

Wish: Google would let organizations create administrators of just some things. 

As it stands,  organizations are unable to give administrative power in an a la carte manner via the Google Apps Dashboard. This can bring  extra burden to organizations who typically would let first level support handle basic account stuff, and leave more delicate configuration changes to a select group of people.

This can result in the person you trust to change your SSO server configuration, having to be the person who resets a user password.

Not optimal.

When your pilot is small, it’s fine limiting your Google Apps cabal to a small set of administrators who have the power to change anything in the Google Apps dashboard, but who rarely get called on to support uesr requests. But once your Google Apps implementation grows, that design doesn’t scale so well.

Google Apps does have an API which has led to many 3rd party tools, (some costing $30,000+), which may allow customers to more finely tune administrative rights, but this basic characteristic would be most welcomed in the native Google Apps Dashboard, as most pilot users will need this before they commit to anyting enough to buy 3rd party tools.

Google Apps in the Enterprise: What’s hard, what’s easy, what’s unexpected.

April 1st, 2009

There are plenty of people talking about cloud computing, hosted apps, and Google Apps, but not that many documenting the process in the enterprise, except for soundbyte-ready “We saved thousands of dollars!” testimonials.  I thought I’d share some of the highs and lows of implementing Google Apps, especially Google Docs, in a non-web enterprise with thousands of users.

There will be both raves and complaints, but mostly just decision-making quandaries, as this stuff is so new, both culturally and product-wise.  I’m a big fan of Google Apps, and would recommend it to any type of organization, but that doesn’t mean there aren’t tons of challenges and improvements to be made by Google, 3rd party tools providers, and even us users. :D

When it comes to adopting emerging web tools, industry coverage typically represents two extremes:  hip private companies and independents who embrace the chaos, and archaic giants who fail to recognize the value of  web productivity tools, are overcome by fear and conservatism, and are handicapped by (perceived?) regulation.  

Many organizations don’t fit in either of those buckets. Most of us work in organizations with people of varying degrees of literacy and enthusiasm about cloud apps.

I’ll write about having a cloud initiative in a thousands-of-employees public company that has: people wildly enthusiastic about 3rd party cloud computing, hostile gatekeepers, and most plentiful, people who don’t necessarily care either way, but who need to get on board for any initiatives to move forward.

I’m going to take you on a magic ride.

Stay tuned for posts about wishlists, gold-stars, and shoulda-woulda-coulda’s.

Did 30 Rock reference Tim O’Reilly last night?

March 20th, 2009

View the 20 second clip:
(apologies people not in the States who haven’t configured a hack/proxy server yet to watch Hulu)  

Now imagine… If you were nerd predisposed to O’Reillyisms… if you and your friends followed him and his posse on twitter, and read the O’Reilly Radar blog, you’d be hyperventilating over twitter, too, when Tracy Jordan says, “You’re my Radar O’Reilly!”  Except he didn’t. He said, “You’re my Radar Oreily.”  That slight difference in the spelling of O’Reilly matters.  I found out tonight there was a character named Radar Oreily in a popular television show, MASH that took place in the military. (And now the helicoptor part makes so much sense…)

Le sigh…

Ah well.  One day we will reach the singularity, and Liz Lemon and Clay Shirky will be on the same panel. But for now, we wait.

Guess Who’s Not Crazy: That little Plugin notification in WordPress 2.7

February 8th, 2009

In my fresh WordPress 2.7 install, the Plugins nav had a “1″ next to it that would not go away. I couldn’t figure out what the heck it was trying to notify me about.

Here’s what I’ve been trained to think it means:

  • 1 plugin needs attention
    (As in, “you’re not quite done installing a plugin, you need an API key or something.”)
    or
  • 1 plugin just got installed. Or enabled. Or disabled.
    (And this notification will soon fade away.)

Sometimes it was red.

Sometimes it was grey.

Here’s what it actually meant:

An inactive plugin that came with my install, WP-Super-Cache,was eligible for an upgrade. This was installed via Dreamhost who may have packaged some dormant plugins. I have no idea at the moment whether non-Dreamhost installs will run into this.

I guess it’s a variation of the “needs attention” design pattern, but given that it was an inactive plugin, and the status of the available upgrade wasn’t particularly prominent or connected or linked-to from the Plugin (1), I know I’m not the only one who’s been stumped by this. I won’t name names, but a WP vet I asked didn’t know either.

GUESS WHO’S NOT CRAZY.

The more you know.

Google Video is winding down new uploads, hopefully it doesn’t touch Google Apps Video.

January 14th, 2009

I just read over at Search Engine Land that Google announced it will be shutting down/stopping new development on multiple Google products, including Google Video (so far, just new uploads, not deleting anything, or disabling the search of existing content).

As you may or may not know, Google Apps, the Google suite of collaboration and office tools, includes a video component.  While parts of the experience resemble and no doubt share technology with Google Video, the upload and video administration experience are different enough to suggest they’re two separate products (with frustratingly similar names ;D), and that Google Apps users shouldn’t worry about their Google Apps Video going anywhere.
Still… it got me thinking… consumer Google Docs features roll down to Google Apps customers all the time, it’s not so crazy to think that a consumer Google service change could impact Google Apps customers.
For this reason, I posted on the Google Apps support forum asking for emotional closure :D

These Drupal links matter to you 20080909

September 9th, 2008
  • Oh yeah, Lullabot is the primary organizer behind a big Drupal conference, Do it with Drupal.  3 days in New Orleans in December.  No BarCamp or Drupalcon, it looks to be a highly curated event, with major speakers from within and outside the Drupal community, 1000-2000 attendees (?).  I’m super excited that Drupal is getting a major event like this. The Drupalcons and Drupalcamps are great, but I think this kind of context for Drupal can legitmize in some corporate environments.

  • I swear I don’t work for Lullabot, but another announcement related to them: There are some Lullabot Drupal workshops next week in Portland.
  • BTW, Drupalcon Szeged was very well documented, often with full videos and slides from the talks. Check out the full session page with links to files and descriptions for the Drupalcon Szeged talks. Bravo to the group who ran it. I’ve heard only good things from those who attended, that it was a great atmosphere. Also, as somebody viewing from afar, the speed with which they’ve uploaded videos after the event is quite fast!
  • This is interesting. Web-learning mainstay Lynda.com has Drupal training videos. As with most Lynda.com content, there are some free samples on the course page. It’s great that they have some Drupal training, but it’s confusing that they cover MAMP and WAMP installation, but neglect what is by far the most prominent Drupal hosting environment (or any web hosting environment): LAMP (Linux). Maybe the context is proof of concept?
    Also, Lynda.com has WordPress coursework up, so Drupal is not the first open source tool to make the cut, but it’s still significant that a site mostly known for teaching HTML and Final Cut Pro has Drupal videos.

  • LA People, DrupalCamp LA is next week, September 13th, 14th
(Very cool Drupal  knitting chart by ejhogbin)

How to install the Python prerequisites for the Memetracker Drupal module

September 8th, 2008

How to install the Python prerequisites for the Memetracker Drupal  module.

Usually the installation of Drupal modules is pretty straightforward:

  • Download module to modules/
  • Uncompress
  • Enable
  • Configure
  • Profit

But the Memetracker module is a bit different, requiring a bunch of Python stuff, and ideally, “root” on your server.  It’s not that hard to set up, but if you’re not used to installing stuff outside of the Druapl-verse, these notes might help you.

(These instructions are for Ubuntu Hardy Heron. The steps are likely very similar on other Debian-based distributions, including earlier versions of Ubuntu.
I’ve also successfully installed Memetracker on Centos 5.x/Redhat Enterprise Linux 5.x. I have a document for that coming soon, though the packages and steps are very similar, and you could extrapolate these notes and apply to other Linux versions.)

Most of you should skip to step 2, as you probably already have Drupal running..

1. Make sure you have all “normal” LAMP and Linux utilities installed for your typical Drupal install.


1a. Install the LAMP stuff, mail server stuff that Drupal requires.

# apt-get install apache2 php5 libapache2-mod-php5 php5-mysql mysql-server php5-gd postfix 

(Note: Though Drupal core can run on PHP4, the Memetracker module *requires* PHP5, so that’s what we’re using here.  You don’t have to go out of your way to get this on Hardy Heron, but there is a small possibility some of you went out of your way to get PHP4, so I’m steering you towards PHP5 here.)

1b. Though not required to run Drupal, these additional packages make life much easier, and it’s just a matter of time before you miss them:

# apt-get install openssh-server wget build-essential groff-base man-db unzip

2.  Unlike most Drupal setups, you also need to have some Python resources handy to run Memetracker.

2a. The first bunch of Python tools already have nice Ubuntu packages already made up for you.

# apt-get install python-numpy python-numeric python-dev python

2b. Pyclust doesn’t have an Ubuntu package made for it.  We need to compile it from source (There will be a python-cluster package in the next Ubuntu version, Intrepid Ibex.)

Get the source:

# wget http://bonsai.ims.u-tokyo.ac.jp/~mdehoon/software/cluster/cluster-1.41.tar.gz

(Note, this is the newest version as of 20080908.  Please check http://bonsai.ims.u-tokyo.ac.jp/~mdehoon/software/cluster/software.htm  for newest version.)

Uncompress the source:

# tar -xvzf cluster-1.41.tar.gz

Now install it:

# cd cluster-1.41
python setup.py install

You now have all your Python stuff installed. 
Let’s verify it works:

# python
>> from Pycluster import *
(You will get your Python prompt back if you have your Python stuff installed correctly.)

That’s it. You now have your environment ready for Memetracker.  There’s lots of other stuff you can do to optimize your system for Memetracker, and I have some additional Memetracker documentation coming up.  However I noticed an immediate need for this Python stuff to be written down in a step-by-step manner, as many Drupal folks don’t usually have to do so much Python/Linux stuff.

When Chrome crashes

September 3rd, 2008

You’re almost pleased.

When a page bombs out, it only kills that one tab/window.
Notice only one unhappy tab. The rest go on living.