SpotCloud explores the utility computing future

  •  BY
  •  In News
  •  Dec 12, 2013
  •  738
  •  0

SpotCloud could emerge as an option for offsetting capital-equipment costs.

One of the most popular images used to illustrate the concept of cloud computing is the electrical grid. The cloud can be tricky to pin down, but everyone is familiar with plugging into a standardized socket and drawing the juice necessary to run many electrical devices from a network of large power plants.

Taking the image further, it stands to reason that if were headed toward a future where organisations can draw from a compute grid as needed, there ought to be a way to sell excess capacity back to the gridparticularly since companies are much more likely to be running their own data centers than their own power plants.

Enter SpotCloud, a new service from cloud software provider Enomaly that enables organisations with compute capacity to spare to sell that capacity to buyers looking to the cloud to perform short-term compute tasks at lower costs with different instance sizes, or from a farther-flung set of data centers than what an Amazon or a Rackspace might offer.

I took SpotCloud for a spin from a buyers perspective. I created an account, added some funds with a credit card and launched virtual machine instances on a handful of compute providers. The service, which recently entered a public beta phase, worked as advertised: I was able to shop around among the listed providers, upload my own VMs (Virtual Machines) for deployment and access my instances over the network, mostly via SSH (Secure Shell).

While I found a handful of small interface issues during my testing, the bigger questions surrounding the service boil down to customers figuring out that they may use this unusual service. While the major cloud players, such as Amazon, are working to build the case that their cloud services can meet or exceed organizations own data center standards for reliability and security, Enomaly is staking out the opposite end of the spectrum for SpotCloud.

For instance, buyers have access to relatively little information about the sellers: Enomaly describes SpotCloud as an opaque market, arranged to enable sellers to discount excess capa-city without cannibalizing full-price inventory. Along similar lines, there are no service-level agreements on SpotCloud, and the only indication of the service level to expect from a particular provider is a 1 to 10 rating, the makeup of which isnt explicitly defined.

With that said, I can imagine a number of testing uses for SpotCloud, and the ability to pick providers in particular geographical locations could come in handy for temporarily bulking up content delivery capacity around specific events.

On the seller side, SpotCloud could emerge as an option for offsetting capital-equipment costs. However, in the short term, I see potential value in offering low-cost capacity on the market as a way to load-test an organisations virtualisation infrastructure.

For buyers, the only costs associated with SpotCloud are for the compute hours consumed. For
sellers, Enomaly takes a cut of up to 30 percent, and offering capacity on the market involves running Enomalys Elastic Computing Platform software on their host machines.

SpotCloud in the lab

I signed up for a SpotCloud account at spotcloud.com by providing an e-mail address for a Google Account and logging in through Googles authentication page. We maintain an eWEEK Labs Google Apps account, so I was able to administer SpotCloud accountssuspending accounts and changing passwords, for instanceusing Googles tools.

For most organisations, however, this Google-centricity will prove annoying. But Enomaly CTO Reuven Cohen told me that a separate authentication mechanism for SpotCloud is in the works.

I added $10 to my account with a credit card payment and set off to browse the available virtual machine instances in the market. I found 103 instance types on offer from about 15 providers listed in a table. Each instance type was listed with the number of processors, amount of RAM, the country and city where the instance would be hosted, and a service quality rating of between 1 and 10.

The rating isnt clearly defined anywhere, and theres no indication provided as to whether the provider has remaining capacity. For instance, when I spied instances with 24 processor cores and 32GB of RAM on offer for 75 cents an hour, I tried to start one, but the request failed without mentioning why. I was then able to launch a smaller instance size from the same provider.

I could filter the table on minimum and maximum CPUs or memory, maximum cost and geographical location, but I couldnt sort the table by any of its headings.

I compared the hourly prices in the market to those on Amazons spot market for its own EC2 (Elastic Compute Cloud) service. When I checked, the spot price at Amazon for a 1 CPU instance with 617MB of RAM was .007 of a cent per hour. On the SpotCloud market, I found similarly sized instances ranging from .001 of a cent to 1 cent per hour. For Amazons larger-size spot instances, I again found SpotCloud offerings both above and below the Amazon asking price.

Going beyond price

For SpotCloud, a bigger advantage than price, compared with Amazon, is a broader range of geographical locations for the hosting. While the service maintains a fairly small number of providers, theyre spread more broadly than the Amazon spot data centers are.

On the other hand, among the items on the disadvantage side of the ledgerbeyond the limited information about exactly whos hosting your datais the much sparser set of tools SpotCloud offers for managing instances.

SpotCloud providers list available instances for limited termsI found terms of between 6 and 168 hoursand the service doesnt include tools for managing expiring terms. Also, when I picked out a provider and turned to launch an instance, SpotCloud offered up a few sample instances from which to choose, but to use one of them, I had to download the image from their site and then upload it back into my account.

Sample images include a JeOS (just-enough OS) image of Ubuntu Linux, which makes a good base for trying out the service, and a Varnish Web-caching appliance that locks itself down after initial configurationa model that Enomaly suggests for bolstering the securing of these instances.

While the selection of prebuilt VM images provided by Enomaly is limited, I found it fairly easy to create my own VM images for use on SpotCloud. Enomaly provides a small command-line application that I used to convert a raw disk image into a SpotCloud appliance. For instance, I used the tool with one of the Debian 6 KVM (Kernel-based Virtual Machine) images from my recent review of that OS, and I was soon running a VM based on the image on a SpotCloud provider.

I used the command-line disk-conversion tools that ship with Oracles VirtualBox to convert a VM I created with that application to a raw format, and then built a SpotCloud appliance from there. I performed a similar operation with a VMware image.

On a few of my appliance-building adventures, I encountered an issue in which my VM would run, but its IP address status would remain indefinitely at pending. This may have been due to an issue Ive encountered in the past with moving Ubuntu-based VMs from one host to another, in which the OS expects its configured network adapter to have a particular MAC address. In these cases, I had to tweak my OS image to address the issue before uploading it.

Beyond creating images for use with SpotCloud, I was able to use Enomalys command-line tool to carry out most operations available through the services Web interface. I could list the providers and virtual machine types, spawn new instances based on my uploaded images and destroy running instances. The command-line tool authenticates with the SpotCloud service by creating a
URL through which I logged in using the same Google log-in interface that serves the Website.

The command-line tool draws on an API thats documented at tinyurl.com/4o6y7ga and that organisations can tap to fill in some of the management gaps I encountered with the Web interface.

eWEEK Labs Editor in Chief Jason Brooks can be reached at jbrooks@eweek.com. Air Max Flair KPU


Add new comment