Search This Blog

Showing posts with label OpenStack. Show all posts
Showing posts with label OpenStack. Show all posts

Friday, 18 May 2012

VMware, a changing beast .. VMUG 17/5/2012

Attended the London VMUG yesterday which turned out to be a particularly interesting agenda.

UG have previously been very infrastructure specific. Servers, hardware, software releases, storage, heated network debates and third party vendors touting their wares.

This one had a slight deviation into some of the new VMware initiatives. First a short, but nice presentation on vFabric and vApp. Both things I'm interested in due to my employer recently jumping on the VMware/Spring stack. tcServer, Gemfire and even big brother EMC rolled in with a couple of Greenplum racks.

The second break from tradition was a slot given over to Neil Mills (@MillsHill_Neil) of Mills Hill Recruiting.

The pre-amble by Simon Gallagher (@vinf_net) very much set the tone on how the traditional VMware geek needed to, or should start to become way more holistic in their approach to technology and solutions.

Neil followed this up with his presentation setting the vision for the 'Cloud Angel' and the next 5 years.

Cloud Angel: Someone who's no longer constrained by the silos of technology, someone who's adept with the cloud harp and can transfix the business with their melodic musings of an automated data centre with apps and services flowing from the fingers of devs out to consumers with no more than a man and a dog.

Being a VMUG it was a VMware centric presentation, VCP will be/already is expected, push your VMware and storage, VMware and security, VMware and <insert technology>, you get the idea. On the journey home this poked a few brain cells.

Together the two presentations got me wondering about the future and how much of an angels tool box will contain the VMware we know today, 5 years is a long time.  Can they continue to be this dominant? I think something missed, maybe for controversial reasons, is to consider some of the alternatives.

VMware acquisitions are taking them up into the app layers while the new kids on the block are starting to get rowdy, OpenStack, Piston, Eucalyptus, AWS etc.  The trend is also towards infrastructure as a commodity, vBlock, Flexpod, wheel it in and wheel it out, bursting into public clouds, moving into public clouds.

Its the new things that will keep them in this market, I guess that's an obvious statement! But will it also become the direction at the expense of the more traditional. vApp is a great example that just happens to run on vSphere, but does it have to?! I wonder if theres a secret lab where virtual pixies are plugging the next generation of solutions into other API's and one day we'll might even see vSphere being given away.

VMware were undoubtedly a game changer in this industry but we're starting to see the next evolution. It will be interesting to see how they, and the Angels adapt.

I hope they do, I already buried Netware and that was traumatic enough.

Wednesday, 8 February 2012

Crowbar and OpenStack Pt Deux

As a follow up to part 1 which left me with an 'installed' environment but no networking I thought I should post a follow up.

Since I last messed around a new version of crowbar (1.2) had been released so that was used.  A nice addition is rather than research/guess the OpenStack barclamp install order they are now nicely arranged on the Crowbar admin panel.

I also came to the conclusion that my networking 'issues' were a result of both me trying to install on vSphere, which has no support for native VLAN's and by complicating things by trying to shoe horn the networking into my corp range.

So I build a little lab which consisted of anything not nailed to a desk, I could find lying around, or that no-body would notice missing.


Switch - vlans created with SVI ports as needed for default gateways and all ports 802.1q to the nodes.

Crowbar install went fine using Pt1 to fill in the missing details.

The Swift install failed until I added some more storage (those cutting edge USB disks on top) and restarted the Crowbar install from scratch.

My first attempt at building a instance failed.  The instance remained in status of 'building'.

To debug

Use the Nova console to check which node the image has been deployed to and then grep the local /var/log/nova/nova-compute.log for ERROR.

2012-01-13 02:52:59,933 ERROR nova.compute.manager [-] Instance '5' failed to spawn. Is virtualization enabled in the BIOS? Details: internal error no supported architecture for os type 'hvm'

This is a result of the crappy hardware I'm using so I changed the nova barclamp to 'qemu' and bingo,   deployed instance - well, sometimes.  It seems pretty hit and miss, which I can't yet trace.  I suspect I could still be suffering from the Heath Robinson lab I've put together.  Pt.3 :)


Some useful bits I picked up and am keeping here for the moment

nova uid and password : admin / crowbar

Deployed nova/images instance path - on nodes :
  /var/lib/libvirt

sudo nova-manage service list

mysql -u<user> -p<password>

Log entries of instance deploy and destroy.

2012-01-13 09:02:57,736 INFO nova.virt.libvirt_conn [-] instance instance-00000007: deleting instance files /var/lib/nova/instances/instance-00000007

2012-01-13 09:02:58,462 INFO nova.virt.libvirt_conn [-] Instance instance-00000007 destroyed successfully.

2012-01-13 09:07:29,306 INFO nova.virt.libvirt_conn [-] Instance instance-00000009 spawned successfully.

Wednesday, 30 November 2011

Crowbar & OpenStack Install Part 1

A few weeks ago I decided to investigate OpenStack.  The core components are a collaboration and resulting love child of NASA and RackSpace and is an Open Source solution to build a blaah blaah cloud.  It seems to be gaining good traction and is often mentioned in the same breath as VMware.  In fact it appears everyone not in VMwares back pocket is jumping on the bandwagon and so seemed worthy of a look.

This is still a moving target for me, its not 'up' and has certainly not been painless and smooth, but I'm writing up Pt.1 as much for me as for the blogosphere.


OpenStack is, well, just that, a stack of different products which together produce an end solution.  In my eyes and how I'd describe it to 'management' is its comparable to LAMP.  Linux, Apache, MySQL and PHP.


I won't go into the details you can read yourself - http://en.wikipedia.org/wiki/OpenStack


I started by reading the install docs and attempting to install each piece individually and then I guess hook them all together.


This didn't go well and a twitter reply from Matthew McClean suggested I take look at Dells Crowbar.


The rest of this post will be the process, troubleshooting and useful links I've come across as I attempt to install Crowbar on my journey to OpenStack nirvana ..


Crowbar background


https://github.com/dellcloudedge/crowbar/wiki

http://robhirschfeld.com/2011/03/14/how-openstack-installer-works/

Resources


4 VMware guests - Each has two NICS each on a vlan, eth0 vlan 66 and eth1 99.  eth0 will be re-configured from the default so its available on my corp LAN.

  • Admin Node - 2GB RAM, 20GB disk
  • Node 1 - 1GB RAM, 15GB  disk
  • Node 2 - 1GB RAM, 8GB disk
  • Node 3 - 1GB RAM, 8GB disk


Installation

The documented install procedure - https://github.com/dellcloudedge/crowbar/wiki/Install-crowbar


If only it were that simple.

NB//Crowbar.iso is a base install, it has none of the OpenStack components. 
This will build, pretty seamlessly, your 'admin' node which is then used to build the other components.
Here things went a little squiffy.

Theres a  nice YouTube video of building the environment which I started to follow :




But with little success.  The first barclamp (name assigned to the Crowbar packages, which actually in turn directly represent Chef cookbooks) which the video has you assign is Glance, which for me failed.  Attempting to resolve this I joined the Crowbar lists and co-coincidently someone else asked about the order to install applications and had another link :

MySQL
Keystone
Nova Dashboard
Glance
Nova
Very different to the order on the video ! - But its still worthwhile watching.

Another little find went into some further details - http://kb.dtosolutions.com/wiki/Deploying_a_small_OpenStack_test_environment_using_Crowbar


From these I eventually cooked up the following install method which seems to be more successful than anything else so far.

Due to a bug in the dashboard when removing or adding nodes I found you had to create all your nodes upfront before you start to apply barclamps.  Create 3 nodes, power them all on so they run the discovery image and become available in the Crowbar console (unassigned, yellow).

Click bulk edit and assign all three.  They will install the OS, reboot a few times and then go 'assigned' in the console with a green icon.


Assuming you have the admin node built and three green nodes.

  • Build MySQL proposal and assign server to node 1 and client to node 2 and 3
  • Build Keystone and assign to node 1
  • Nova Dashboard to node 1
  • Glance to node 1
  • Nova.  
Nova requires a 'controller' and then compute nodes.  Trying to do all three failed for me so I did them individually.  In my case I'm using VMware for this POC so the nova proposal needs to be changed.  Edit the line :
"libvirt_type": "kvm", -> "libvirt_type": "qemu",
And assign Controller to node 1 and then compute to 2 and 3.

Throughout all of this I had a tail -f running to the admin log :



/opt/dell/crowbar_framework/log/production.log


By all accounts I should now have a working environment. I don't, everything appears to be installed but the learning curve continues.

Nova dashboard is not working which I've traced to a routing issue on node 2. It has the admin interface up but the default gateway is using one of the networks I didn't change at the install time.


Nagios is not working. Watching the production.log during the barclamp installs showed Nagios errors but I'm ignoring them/that for now.


Troubleshooting / Hints 'n' tips : 


Barclamps sometimes report failure to deploy but repeating the same task will be successful.


If your running your POC on hypervisors or something else that has the technology make good use of snapshots.