Moving workloads, split cluster or the cloud?

Monday, January 12, 2009 Category : , 3

A few little elements have popped up this week to raise the whole question again of VMotion across data centers or stretched ESX clusters.

Splitting a ESX cluster across sites has been a something that most of us have looked at over the last year and most of us still want to do it at some stage. However is it really a good idea? Chad Sakac did a great write up on this “The Case For and Against Stretched ESX Clusters” that I often refer people to as it is well worth the read. 

Then last week over on the Cisco Data Center podcast Sidney Morgan, IT Manager at Cisco was interviewed (MP3) about their internal use and plans for virtualisation. They mention at one point they may have been one of VMware’s largest customers. Sidney is asked what is the next wave for their datacenters. The goal is to “not only load balance between rooms but between datacenters”. Sidney seems to be talking about VMotioning across locations, talking about using it for much better BC failover, using layer 2 adjacencies to allow DRS across sites for failure in a true active/active nature, inter rather than intra data center. In marketing speak the end goal according to Sidney is “End to end virtualisation, any application, on device running on any network hosted out of the most convenient data center”. The first bit sounds like split clusters to me where as the second sounds like vCloud.

Moving the running machine networking wise is sort of easy, it’s moving the storage that’s the issue. As Alan pointed out on “The Virtual Datacenter Blog” in referring to some Cisco comments, the amount of bandwidth consumed by video is going to be dwarfed by that of moving VMs. 

However it has been my belief that in the early generations of vCloud we are probably not going to see VMotion and dynamic movement of workloads across clouds (sure you can spin up a new VM, but that’s different to moving a running one). This is certainly not what I thought the vCloud API would provide, although there may be a mechanism to move a powered off or suspended VM. The dynamic moving of workloads around the cloud is something for down the track, first generations will be more about deployment placement choice than say load balancing. Until its released or we see it under NDA we just don’t know yet.

So it was all good, then I got a curve ball. Today I reviewed the VMware partner training materials on vCloud that Eric Sloof posted about. You could not count the times within these sessions that it mentioned VMotion and Storage VMotion and this got me worried. This training is early days and the full details for vCloud is not released yet, but … putting the idea of VMotion which is really split ESX clusters and Storage VMotion which could certainly be used as a way to migrate all of a workload to another site is putting dangerous thoughts into sales peoples heads. I can imagine what sales people will say to customers after reviewing this material, “Oh yea, VMotion into the cloud, no problem, you can Storage VMotion the VMDK files over too”. No offence to all my sales friends.

Lets see what pans out but I think VMware are going to have to be really clear as to what the goal is, setting the right expectation. If we have all sorts of confusing messages mixing up split clusters with federated clouds and vendors like Cisco pushing its all sweet, you just need layer 2 adjacencies (ignore the storage, thats an exercise for the reader, a bit like the replication bit within SRM) we may have some untangling to do. 

On the other hand it may all be sweet and all that fibre capacity bandwidth the carriers have is going to get sold real quick. Boss, can you place an order for 10G between data centers and the cloud provider please, bandwidth is cheap isn't it.

Exciting times.

Rodos

Confirmation of cloud approach for 2009

Category : , 2

The cloud has been on radar.

On Jan 5 Gartner put out their new years resolutions for CIOs for 2009. I don't have access to the report however Sam over at the Cloud Pulse blog must have because he reported on its contents in relation to cloud.

Sam reports that Cloud "figures prominently" and that CIOs are encouraged to "start taking cloud seriously."

"You will need to start leading your organization safely in this inevitable direction, or risk being sidelined by its progress."

Its interesting that one of the recommendations of "exploring" the Cloud is to "start to assess the cost of internal applications of a utility (per-seat, per-month) basis". This was one of the items on my list last week of things which CIOs need to start putting into their planning and review now.

Here was the list of "get ready" items I listed last week.

  • virtualise
  • centralise
  • automate
  • package
  • streamline networking
  • WAN acceleration
  • understand current chargeback or costing models
Rodos

Update : I managed to obtained a full copy through my employer (thank you marketing).

What is the Cloud? A conversation.

Saturday, January 10, 2009 Category : , 2

There have been some posts about “What is a cloud?”.  Scott started the conversation in his shortakes by saying how ”amorphous and undefined cloud computing is”. Simon then gave the answer a shot by writing up some detailed notes on “What is a cloud?

Having been writing about VMware and Cloud since Sept last year, how could I stand back without entering the conversation. I think it’s a great dialog for the VMware community and enterprises to be having. Vendors respond to the market so the market needs to be talking.

Let’s define some things out here. How does the industry define cloud?
“Cloud computing is Internet-based ("cloud") development and use of computer technology ("computing"). The cloud is a metaphor for the Internet, based on how it is depicted in computer network diagrams, and is an abstraction for the complex infrastructure it conceals. It is a style of computing in which IT-related capabilities are provided “as a service”, allowing users to access technology-enabled services from the Internet ("in the cloud") without knowledge of, expertise with, or control over the technology infrastructure that supports them.”
“Cloud computing is “a style of computing where massively scalable IT-related capabilities are provided ‘as a service’ across the Internet to multiple external customers.”

“Cloud Computing = an emerging IT development, deployment and delivery model, enabling real-time delivery of products, services and solutions over the Internet (i.e., enabling cloud services)”

“Cloud Computing is a lightweight entry/exit service acquisition model, consumption based pricing, accessible using standard internet protocols, elastic and improved economics due to shared infrastructure.”


Now what are the common elements amongst these definitions? I think a lot of these and other broader characteristic based definitions can be solidified into three core elements.

Remote delivery. 
Usually described as over the Internet but its just as valid for delivery to be via a private network. After all the term cloud comes from the traditional method of drawing the Internet, or a Wide Area Network (WAN), on a network diagram.
Elastic. 
Whether you call in resources on demand or scalable the intent here is the elastic nature. This core element shows how the core elements can be broken down into further frequently derived characteristics. Due to elasticity more flexible pricing models may be used, such as pay as you go.
Service delivery.
All of the definitions described what is delivered as a service. This service is what abstracts the underlying technology from the delivery of that technology. What this requires is standards on how that service is delivered which we will expand on more shortly. 
As a great preacher I know always says “What is this text not telling us?” What is not cloud computing.  I think Wikipedia has a good statement on this.
“Cloud computing is often confused with grid computing, ("a form of distributed computing whereby a 'super and virtual computer' is composed of a cluster of networked, loosely-coupled computers, acting in concert to perform very large tasks"), utility computing (the "packaging of computing resources, such as computation and storage, as a metered service similar to a traditional public utility such as electricity") and autonomic computing ("computer systems capable of self-management"). Indeed many cloud computing deployments are today powered by grids, have autonomic characteristics and are billed like utilities, but cloud computing can be seen as a natural next step from the grid-utility model.”
VMware support this view of what Cloud is not. In the VMware whitepaper “IT in the Cloud: Using VMware vCloud for Reliable, Flexible, Shared IT Resources” it is stated that “cloud is a continuation of utility based computing”. I think this is where some confusion exists in the VMware space as the term “internal Cloud” is often used. Internal Clouds are the morphing of you’re internal utility based computing, which is based on VDC-OS. 

Maybe we need a better definition for internal Clouds. If you have a single internal data center with a virtualized environment based on VDC-OS what you have is utility computing, not cloud. Once you have two data centers and start choosing to pull services from either one, over your network, you just turned each of them into an internal Cloud, because now they are providing elastic capacity to each other and we have an element of remote delivery of a service, hence matching our definition of Cloud. Once you start to describing, moving and orchestrating these services (workloads) with vCloud, we are truly Cloudy, all be it internally. 

I wonder if we need this distinction for internal Clouds and if this segmentation is right? Maybe we can get Bill Shelton to comment and give some insights on this proposed distinction.

Now let’s get back to this service delivery part of the definition as I think this is very important. Any of these clouds, no matter if they are yours or someone else’s all deliver some form of service. There are many different services and interaction which will be to a standard or an API that may be either propriety or open. By now I think we can take it as a accepted that there are three types of services categories delivered via Cloud. These are Software or Application (SaaS), Platform (PaaS) and Infrastructure (IaaS). Let’s delved into these.

Software as a Service (SaaS). 
Software is essentially applications services where all of the applications and data are stored within the cloud. Here we are being provided a high level service which will include nearly all of the elements apart from the client interface. Popular examples are Salesforce.com, Webex, Gmail. Google Apps. Each of these delivers a service to a standard that is propriety or open (such as HTTP). There are other software services provided within SaaS, what about Google News which is a Cloud service provided by an open standard of either (HTTP or RSS). The use case here is if as an organization you need a new application, you can go to the cloud for delivery and you only need to manage the client end.
Platform as a Service (PaaS). 
Platform is the building blocks for delivering an application service. Examples of platforms are resources such as computing execution cycles, storage, authentication. You need to provide some magic sauce to make effective us of a PaaS, whether that be in the form of code to be executed, data to be stored and you will need to integrate that into whatever application it is that you have. Popular examples are Google App Engine, Amazon S3, Microsoft Azure, 3tera. Again, each of these delivers the service to a standard that is propriety or open (such as Python, Ruby, Hadoop, .Net, AppLogic). The use case here is if you need a particular resource, instead of managing in you can go to the cloud for delivery but you are going to need to somehow manage the integration of this service into your overall solution. That integration may be trivial or complex.
Infrastructure as a Service (IaaS). 
Infrastructure relates to computer infrastructure which typically equates to a virtualisation platform executing a machine. Examples include Amazon EC2, GoGrid. Again, each of these delivers the service to a standard that is propriety or open (such as AMI, OVF). The use case here is if you need some capacity to execute a generic machine work load, instead of building the infrastructure yourself you can go to the cloud. However you will be responsbile generally for the maintenance of the workload and all its software.
VMware fits into this cloud computing space at many levels, as I have previously described

VMware is attempting to be the platform of choice for IaaS, this is through VDC-OS and vApp. By introducing the concept of federation between clouds via the vCloud API a new model comes into play that is very attractive to the corporate market, something that does not exist in the current Cloud space. VMware lead in the virtualized datacenter and they need to quickly capture some market share in the Cloud virtualisation space too. 

There is a space for VMware in SaaS. As Bill Shelton has previously publically mentioned VMware are investing into the Virtual Appliance space. A virtual appliance can be seen as a form of SaaS and you have the advantage that you can run it locally or out in the Cloud. This also allows SaaS providers much great flexibility in how they deploy their offerings for customers.

The PaaS space is where VMware has the challenge. What VMware want here is everyone to build their systems on open standards. This allows them to be packaged into IaaS workloads that can be run anywhere (internally or externally) without lockin to propriety providers, such as Microsoft Azure. An example here is writing in Ruby and deploying in Ruby On Rails.

Lastly, as its slightly off topic. How do organizations prepare for the Cloud. Without diving into details here is what will hold you back. If you have not virtualised, centralised, automated and packaged; if you have not streamlined networking, accelerated you WAN and gained an understanding of you chargeback or costing models; you are going to be starting from the change room whilst your competitors are poised on the start line and it may be a long slow walk to get there.

Let the conversation continue.

Rodos

Get ready for vCenter Orchestrator

Thursday, January 08, 2009 Category : 3

Get ready in 2009 for VMware vCenter Orchestrator. A new product page is now available on the VMware website. 


What is Orchestrator? Orchestrator is a GUI based workflow tool that interacts with the VMware API, CLI and VC UI, SSH, WMI, SMTP, SNMP, Databases and 3rd part systems. A library of prebuilt workflows (400) will be included. Orchestrator is currently used by vCenter Lifecycle Manager so its already out in the wild. 

Why do we care about Orchestrator? Well as has been predicted 2009 is the year of automation for VMware; automation is a key step on the journey to Cloud computing and vCloud and VDC-OS. On the VMware round table podcast today all of the panel agreed that automation is a big topic at the moment and a focus for the coming year. John Troyer indicated that it is seen as a precursor to adoption of the cloud.

To get a good understanding of Orchestrator, Sia Yiu, who is the Product Manager Orchestrator gave a session at the last VMworld, AD2530 "An Introduction to VirtualCenter Orchestrator: the VMware Automation and Orchestration Tool". The abstract is
Find out what the automation engine that powers Lifecycle Manager can do for your virtual infrastructure. VMware VirtualCenter Orchestrator is a key solution in the VMware product set for automating and orchestrating the virtualized infrastructure. It provides simplicity and power through a drag and drop implementation of the VI API and a complex workflow engine.

Through demo and interactive discussion, this session provides an in-depth look at the technical underpinnings of VMware VirtualCenter Orchestrator. We will show how VMware VirtualCenter Orchestrator provides significant cost savings through automating repeatable IT processes.
If you have access to the VMworld content there is an audio recording along with the presentation.

What will be interesting is to see the balance and interaction between all the PowerShell development/examples and Orchestrator. As we move closer to a release of the seperate product these details should come to hand.

Rodos

VMware Community Roundtable - don't miss it again

Wednesday, January 07, 2009 Category : 0

The next VMware Community Roundtable is on in the morning (well my time anyway). However many people miss it because of timezone differences or just plain not noticing. Well, a solution is at hand.

Talkshoe have a neat widget you can load into your own webpage, blog etc that dynamically updates to the next episode date and time (as long as John remembers to do this, which he does not always do).

Here is what it looks like in use.




It reveals the time and date in your locale and the topic.

You can get a version of it for your own use at this link.

Now you don't need to get all confused with timeanddate.com and other such tom foolery. Note that if you look on the actual page on Talkshoe it even has a nice countdown timer, but this does not show you it in your local time.

What are you waiting for, go and embed it somewhere now!

Powered by Blogger.