Cloud Computing Workshop 2011: Oracle, Rackspace and Amazon

This year I really kept the best until the end! Last week I was running a 2-day cloud computing workshop with a 2-hour hands-on management presentation the night before the workshop for Contribute in Belgium. Contribute is an Oracle Platinum partner and being surrounded by Oracle Fusion Middleware experts, DBAs, application architects and senior level management the technical level of the workshop was very high with many interesting discussions.

We covered Oracle Public Cloud (OPC), Amazon Web Services (AWS) and Rackspace (RS). OPC is not available yet, but the overall functionality including its limitations for the first release is more or less known and quite interesting compared to let’s say running WebLogic on AWS.

To prove the point I was running WebLogic 12c on AWS cloud with 30GB of heap on a high-mem 4xl instance with 8 cores. Proving the point cost me a bit more than US$2.

Typically I expected that the more tech savvy audience prefers AWS over Rackspace, yet this time people were impressed by the easy setup of Rackspace and the way they handled a minor problem with their web console file-upload feature during a live chat session.

Among hundreds of other details we looked at the I/O performance. The performance of Amazon’s EBS is known to be interesting (you may want to read this as ‘difficult’). See Adrian’s posting for a thorough explanation, some benchmarks here, and some more details there.

The out-of-the-box performance looking at Rackspace Cloud is more consistent and there is a surprisingly high throughput which is almost independent of the data size. Here is some data comparing a local laptop disk, to the disks attached to the Rackspace Cloud servers to my brand new consumer SSD (not sure if a 512 GB SSD still qualifies as ‘consumer’). All numbers refer to a READ-benchmark with increasing data size.

Laptop HD (500GB SATA): 80 MB/s

Laptop SSD (Crucial m4): 281 MB/s

Rackspace (SAN): 302 MB/s

 

I am only posting the screenshot for one of the Rackspace I/O measurements since quality isn’t perfect. There is some older data with graphs available in a previous post of mine.

 

 

 

 

 

 

 

 

 

Now I am still curious about the dip on the left part of the graph which is consistent over several instances and measurements. Any comments?

Oracle Technologist of the Year Cloud Architect Award for Frank Munz

Last week I received the Oracle Technologist of the Year Award, Cloud Architect.

It makes me feel flattered and it’s of course a great honor for me being on this list of fame together with companies such as Dell, TurkCell and others! The award is part of Oracle’s Excellence Awards program. The winners were selected by a panel of judges that scored each entry across multiple categories.

I know there was a tremendous amount of support for the nomination of my Oracle Middleware and Cloud Computing book by my customers, workshop participants, individual book reviewers, Oracle user groups, middleware experts and even some people at Oracle HQ – many thanks to all of you!

Read the full story in the Oracle Magazine:

 

 

 

 

 

 

 

Oracle Cloud Computing Buch zu gewinnen!

(Posting in GERMAN ONLY)

Während der DOAG2011 Konferenz können Sie ein Examplar des Oracle Cloud Computing Buches gewinnen:

✘✘✘ Unterstützen Sie die Oracle Cloud Computing Buch Seite und klicken Sie auf “gefällt mir”.

✘✘✘ Oder melden Sie sich bei der munz & more Info-Newsletter an. Es erscheinen ca. 4 Ausgaben pro Jahr mit Informationen über Vorträge und Workshops zu Cloud Computing, Oracle WebLogic, Service Bus und SOA Suite.

Die Gewinner werden Ende November benachrichtigt. Der Rechtsweg ist ausgeschlossen. Link zur Amazon-Seite mit Kritiken zu “Middleware and Cloud Computing”.

Ebook Released: Middleware and Cloud Computing

 

 

 

 

 

 

 

 

 

 

After a couple of fun days playing with (mostly disastrous) tools, converters and the Kindle itself I published the first Kindle edition of “Middleware and Cloud Computing”. It contains more than 100 coloured graphics (well, of course they are not coloured on your b/w Kindle, but on the Kindle reader for your Mac, PC, Android, iPad etc) and more than 100 clickable links to additional resources, publications and tools.

Please spread the word, twitter it to the networked part of the known universe and don’t forget to LIKE its Amazon and Facebook site. Do you you really, really want to support it? Sincerely? The best you could do is writing a review once you have read it.

 

thanks and best wishes,

Frank

Amazon’s AWS outage – did the Cloud Fail?

 

There was a major outage in one of Amazon’s regions affecting several availability zones last Thursday.

- For a summary of the events and their impact see this blog entry of RightScale (I guess but I am not sure if it was written by Thorsten). The RightScale blog is updated now with some more details of the event.

 

- George Reese, the grand homme of Cloud Computing, calls this event a shining moment for clouds. Don’t get me wrong. I am big fan of George, not only because he is following me on twitter :) . He gave a podcast interview repeating that you need to design for the cloud by designing for failure instead of sticking with your traditional architecture.

- Amazon did an poor job communicating what happened. Failures are a part of business but they have to be dealt with accordingly. Add this to your lessons learned list about Clouds. At least I did. Here is their summary.

- In my Cloud Computing book there is a whole chapter about RightScale (who provided the best analysis so far) as well as a section about disaster recovery and another one on designing for clouds (“why it is not enough to simply run WebLogic on AWS”) . There is also a free chapter for download available at Oracle’s Archbeat site.

IMHO this event teaches us that it is not enough to know how to simply run WebLogic on AWS or any other IaaS cloud provider such as Rackspace. By the way, this is one of the reasons why my book has more than the initially planned 120 pages …

Reduce Costs Amazon AWS, Rackspace Cloud and other IaaS Providers

Anybody working regularly with IaaS providers such as Amazon or Rackspace can recount a personal story of a forgotten instance.

The most dramatic stories are not about a cheap micro instance – my personal story with AWS cost me some US$200 when I missed to turn off an EC2 instance and went for a diving trip to Egypt. I’ve got a number of suggestions that might save you some money.

 

  • Above all, you want to avoid paying for unused resources. Using auto scaling is a great mechanism for running only the required instances, and for example, to scale down at night when fewer EC2 instances are required.
  • Often the monthly bill tells you that there something is still running somewhere. Make sure you stop unused resources as quickly as possible. If you know in advance that you want them to be stopped at the end of the day, then use the Unix at command to schedule the termination of the instances.
  • Although AWS management console provides dashboards, there is no super-dashboard. Instead, you have to flip through all tabs yourself (starting from from the “S3” tab to “EC2” and all the tabs up until “RDS”). Only after checking all tabs can you be sure you have an accurate overview of the current resources for the selected region.
  • Remind yourself that the AWS management console is always displaying resources per region. Once you switch to another region, e.g. from Asia/Pacific to Europe, you will no longer be able to see instances running in Asia/ Pacific.
  • The console is sometimes out of sync. When this happens, remember to click on the refresh button so as to avoid only seeing outdated information.
  • The command-line tools I introduce later will work with resources for the default region in the US (unless you specify otherwise). Remain vigilant at all times e.g. when working in Europe do not start and then forget an instance in the US.
  • Always double check for running instances before engaging in another project, leaving for a sabbatical or a trip around the world.

Be careful and make sure you don’t wast money that is better spend for a fabulous diving trip.

These tips are taken out of my Middleware and Cloud Computing book.

 

Update as of May 2012:

You can setup billing alerts now for AWS and use SNS to recalculate your auto scaling. See Jeff’s posting on AWS typepad here.

Rackspace uses Akamai now

Rackspace is changing its CDN partnership from Limelight to Akamai.

My book “Middleware and Cloud Computing” covering Rackspace Cloud and Cloud Files with the classical Limelight CDN as well as Amazon CloudFront gives a striking example of the importance of CDNs in modern system architecture. Often CDNs replace the front-end web servers for a cluster of application servers. Compared to offloading static content to web servers, CDNs are more scalable, provide lower latency for the clients because of the many cache locations and require no administration.

Many European companies that I know of are using Akamai already so moving to Rackspace Cloud becomes a much smaller step for them.

Announcement: Winners of the Cloud Book Raffle

Yes, it took me a while for this announcement. Books are surprisingly time consuming even after they are written. Yet the two copies of my book

“Middleware and Cloud Computing”

are already on their way to the happy winners:
- T. K. from Xensio (DE)
- E. F. from Sunrise (CH)

Congratulations :)

And a Merry Christmas to all of you!

P.S. An official announcement of the book will follow. It’s available in the US and can be ordered in DE and UK.

PP.S. We are almost living in 2011. Marketing is changing. Show the world that you LIKE the book’s web site. Spread the word, invite your friends, tell your colleagues. There will be more stuff to be won… Cheers!

Come to my Cloud Computing Talk at DOAG 2010

Come to my Weblogic and Cloud Computing talk from 15:00h – 15:45h
in room Kopenhagen.

- Win a copy of my Oracle Cloud Computing Book!
- Learn how to use a computer in the cloud for one year for free!
- Understand WebLogic showstoppers in public clouds and design tradeoffs for clustering, JMS, load balancing, CDNs and databases.

Win a Copy of Middleware and Cloud Computing Book

If you are interested in Middleware and Cloud Computing subscribe to my my newsletter and win one of the first two copies of my brand new cloud computing book. The drawing will be Dec. 15th 2010.

There are only 4 mailings per year and you can unsubscribe any time from the newsletter.

Oracle Middleware and Cloud Computing Book

Amazon AWS vs. RackSpace Cloud Windows 2008 I/O Test

I did a basic test trying to measure the un-tuned out-of-the-box I/O performance of Rackspace Cloud instance with the HDTune utility on a Windows Server 2008 instance. According the the RS documentation their disks are local RAID10. Then I run the same utility on 8 core extra large  EBS backed EC2 instance provided by Amazon (wanted to make sure it is not an issue due to a small EC2 instance size). According to the docs EBS should provide consistent performance of a SAN regardless of the instance type.

Here are the somehow surprising results. I was expecting, that they perform somehow equal but RS is in the range of 300 MB/s whereas the EC2 instance is below 40 MB/s.

Rackspace Cloud with Windows 2008:

AWS with Windows 2008:

Interesting enough also the CPU usage is quite different: 2% only for AWS and 31% for RS.

I welcome any comments and I am aware that the tool is meant to measure disks and not RAID or SAN volumes. Still I am surprised by the huge difference. I wonder if the difference is only due to the difference of local RAID vs. SAN. Also I wonder how is the SAN attached then, since the SAN performance is still worse than my laptop disk.

RackspaceCloud Support for MultiCast?

A WebLogic server cluster used to use IP multicast (MC) for cluster heartbeats and global JNDI updates. Today there is another option with Unicast. Still large cluster deployments benefit from multicast. Often using MC is problematic, there is a whole list of possible problems with Windows, routers and firewalls swallow the MC packets (by design, unless you configure them otherwise) and on Unix it could be disabled for the NIC. Apart from WLS clustering it is used by products such as TIBCO EMS for failover.

I had an excellent discussion with the support team of RackspaceCloud about using IP multicast. “There is no obvious reason why it shouldn’t work“, they told me, but at the end there was some doubt left. Since I know AWS doesn’t support MC on EC2 I decided to give it a try.

How to reproduce

  1. Launch two instance in RSC. Should take some 3 minutes. 1 went for a 1GB Win2008 because I wanted to check for poetential Win problems. Note: Currently you cannot create an image from a Windows server, that’s why I started two images from the very beginning, otherwise it makes more sense to prepare one and then clone it.
  2. I downloaded Mozilla FireFox because InternetExplorer drives my crazy with all its security fuss when doing a simple proof of concept.
  3. Download and install WLS10.3.2
  4. I turned off the Win firewall just in case. I don’t wanted the firewall to block the MC packets.
  5. I shared my WebLogic installation directory and copied it over. Yes, you can do that in the RS cloud and at least for a POC it saves a lot of time.
  6. Open a cmd prompt cd to server\bin and run the setWLSEnv to set the environment:

    C:\Oracle\Middleware\wlserver_10.3\server\bin>setWLSEnv.cmd

  7. Repeat step 2 to 6 on the other instance, then run the MC test utility on both sides using a different name with -N, e.g use -N Tom on the other side:
    C:\Oracle\Middleware\wlserver_10.3\server\bin>java utils.MulticastTest -n
    Frank -A 237.0.0.1 -P 8001
    ***** WARNING ***** WARNING ***** WARNING *****
    Do NOT use the same multicast address as a running WLS cluster.
    Starting test.  Hit any key to abort
    Using multicast address 237.0.0.1:8001
    Will send messages under the name Frank every 2 seconds
    Will print warning every 600 seconds if no messages are received
     I (Frank) sent message num 1
    Received message 2 from Frank
     I (Frank) sent message num 2
    Received message 3 from Frank
     I (Frank) sent message num 3
    Received message 4 from Frank
     I (Frank) sent message num 4
  8. If MC was working correctly you’d expect to see your own messages as well as the messages from the remote side, but we just seeing the local ones.

Conclusion: there is no support for Multicast between two instances in the RackspaceCloud. The RSC support team officially confirmed that later as well :” Unfortunately, multicasting is disabled on our hypervisors to preserve network sanity. We apologize for the inconvenience.

So what?

Note: Oracle states MC is not working for AWS either and the preferred solution is Unicast (which is acceptable IMHO).

How to Connect to the Cloud

Quite often I chat with customers about cloud computing and tell them they could have a server running in the cloud for as little as 1 cent per hour.  Then their next question is: “Well, if it is running in the cloud, how can I access it then?“.

There seems to be a lot of confusion about it. Just because your server is running in the cloud, doesn’t mean it is not tangible. So the short answer is: “Use ssh and connect to it.“. Your server is not hidden in a nebula – it’s fully connected to the internet (at a fantastic bandwidth, a WebLogic 10.3.2 package download is completed in 4 mins at 3.8 MB/s) . For Amazon’s AWS you typically have to provide a X.509 certificate and RackspaceCloud uses password for root login with ssh.

Windows Options

Even if your managing the cloud from your Windows desktop you are not out of luck connecting to a UNIX server in the cloud, there are a couple of options:

  • There a free version of VNC for private and commercial use which is called TightVNC, see http://www.tightvnc.com.
  • NX is a desktop virtualization solution from a company called NoMachine. NoMachine designed the NX libraries to provide a self-tuning protocol with compression and reduced round-trips for X11 even over slow connections. Have a look at their homepage under http://www.nomachine.com. They provide a free version which is limited to two connections only.
  • FreeNX was created in 2004 as the first complete free and GPLed server implementation of NX, see http://freenx.berlios.de.
  • Cygwin is another solution, see http://www.cygwin.com. It provides a UNIX environment for Windows and comes with a X-server that can display your X based applications on your UNIX host. The software was written by Cygnus Solutions which now belongs to Red Hat.