Tuesday, August 28, 2012

Learn why success greets NYSE Euronext's Community Platform for Capital Markets cloud

Listen to the podcast. Find it on iTunes/iPod. Read a full transcript or download a copy. Sponsor: VMware.

Get the latest announcements about VMware's cloud strategy and solutions by tuning into VMware NOW, the new online destination for breaking news, product announcements, videos, and demos at: http://vmware.com/go/now.

Our next VMworld case study interview revisits a unique vertical industry cloud -- NYSE Euronext's Capital Markets Community Platform -- to take stock of how mission-critical cloud services are being delivered.

We'll learn about how this innovative cloud and groundbreaking business model targets the needs of Wall Street IT leaders, how the business of the financial services industry has received them, and explore how providing cloud services as a business has evolved.

This story comes as part of a special BriefingsDirect podcast series from the 2012 VMworld Conference in San Francisco the week of August 27. The series explores the latest in cloud computing and software-defined datacenter infrastructure developments.

Our guest is Feargal O'Sullivan, the Global Head of Alliances at NYSE Technologies. The discussion is moderated by Dana Gardner, Principal Analyst at Interarbor Solutions. [Disclosure: VMware is a sponsor of BriefingsDirect podcasts.]

Here are some excerpts:
Gardner: How have things progressed over the past year?

O'Sullivan: We've been very happy with the progress we've made. When we announced at VMworld last year, we had just gone into early access for our first clients in our data center in the New York, New Jersey, Connecticut tri-state area, where we have all of our US-based markets running the New York Stock Exchange Markets, the Arca Electronic Markets, and AMEX.

That has since gone into production, has a number of clients on it, is being perceived very well by the community, and is really driving as a lynchpin of our strategy of building a global capital markets community.

Since the success of that, we've actually progressed further, to the point of having deployed the same environment in a second data center that we own and run just outside of London, in a town called Basildon, which is where we run all of our European markets, the Euronext side of NYSE Euronext.

We now have an equivalent VMware-based cloud environment and a range of ancillary services for the capital markets industry available in that location. Clients can now access, as a service, both infrastructure and platform capabilities in both of those facilities.

Furthermore, we've extended to two other financial centers in the world, one in Toronto and one in Tokyo. That's a slightly more stripped-down version of the community platform, but it's very useful for clients who are really expanding the business and gone globally.

Four locations

Now, we have those four locations up and running in production with production clients, so we are very happy with that progress.

Gardner: What is it about the way that we're doing things now -- the whole software-defined datacenter model -- that's allowed you to build out so quickly?

O'Sullivan: Clearly, the technology has advanced significantly from the old days. The capability around virtualization on the the hardware server level with the VMware hypervisors, and in particular the vCloud service suite, gives clients their own control over their environment.

Also on the networking side, it's become much more viable for clients to actually deploy into shared environment, still maintaining confidence that they're going to get both the security profile that they're looking for, as well as the performance capability.

We use the EMC VNX array with the FAST Cache capability to give a very stable performance profile based on demand. It allows different workloads, and yet each gets very good performance and response time. So there are many components along the way. Also, management and monitoring of these types of infrastructures have improved.

Our clients have certainly seen that enhancement in the technology. The financial services industry is unique in the way it leverages technology on two aspects.

One, security profile is absolutely critical. Security isn't just around customer data, but around application development and tools of the trade, intellectual property that firms might have, trading strategies, different analysis, analytics, and other types of components that they develop and build,. They feel they're highly proprietary in nature and don't want to allow anybody to get access to them. So they place security extremely high on the list.

The other unique aspect is performance aspect. It's a slightly different performance model from your typical sort of three-tier web store type of environment. Financial services, first of all, push very high volumes of content through their applications. They need to do so in microseconds, or at least milliseconds, of response time and latency measurements, and they also most importantly need to do so predictably.

With a big batch job of some kind, say a genetic folding job, you drop off a job, go away for 12 hours, and you come back. A little bit of clearly inefficient processing time is not great, because that drags out the whole thing over time, but there is no sort of critical "need it here," "need it now" requirement. So latency spikes are less of a problem.

Latency spikes

But in our industry, latency spikes are a real problem. People look for predictive latency, so we had to make sure that we applied a very tight security profile to our cloud, and a very high performance profile as well.

Gardner: How have you been able to build on this cloud in terms of those value-added services that you deliver specifically to a financial clientele?

O'Sullivan: That's why we built our cloud, because there are many service providers who offer very valuable cloud capabilities that are based on core infrastructure and core computing capabilities, and they do so very well. However, we consider ourselves a vertical industry community. We're specifically focused on capital markets participants. We try to support and make it cheaper, more cost-effective, and more readily accessible to a wider range of participants to be able to get access to the markets.

So in our cloud and our community, we provide a range of platform and services that we have added. The core is "Come into our vCloud Director environment and access your compute infrastructure." By the way, we have a Compute On Demand Virtual Edition, we also have a Compute On Demand Physical Edition for those cases where that latency issue is of the utmost importance.

Then, we provide clients with the value-added features that we know they need, because they're in the capital markets business. The key one is market data. This is something that is absolutely critical in financial services, because every trade, no matter what you are buying or selling, always starts with a quote. Even if you walk into the shop and you ask how much it would it be for a can of soda, they say it's $1 or $1.20, whatever it is, and then you decide if you want to buy.

So in the financial services industry market data is the starting point, the driver of all the business. And the volumes on this, the sheer size of the content that comes down, is really outstanding. It's at the point now that even if you were to just subscribe to all North American equities and options, you'd need a 10-gigabit Ethernet pipe, and at points during the day, you're probably using upwards of 8 gigabits of that pipe just to get all that content.

Obviously, we can provide raw content, but we've added a range of services into our cloud and into the community. We can say, "We can offer you a nice filtered market data feed, where you just present us with the list of instruments you want, and we can add value-added calculations, do analytics, and provide that to you."

We've also developed an historical market-data access service. So if you want to go back and test your strategies against previous days of trading, back for many, many years, we have a database that's deployed in the cloud. So you can query the database, load it into your virtual environment, and analyze and back-test your strategies.

We've added order-routing capabilities, so when you are ready to send your orders to the market, if you are a market maker yourself, you might go direct to our gateway. If you're a sponsored participant, you might go through our risk-managed gateway, which would be sponsored by a broker.

Or if you are just a regular buy-side firm, a money manager, you might use our routing network and ask us to write your orders to the different brokers or the different markets, and we can handle that. Those are either ends of the trade.

Integration pieces

On Thursday, Aug. 30, I'm going to be presenting with VMware and EMC in one of the breakout sessions about us moving up the stack to start offering more of the integration pieces of this. We're using the Spring environment and a range of other VMware tools, GemFire, and so on, to demonstrate a full trading system deployed in the virtual environment with the integration tools -- all running hosted in our environment.

It's more of a framework that we're showing, but it provides platform as a service (PaaS), not just the market data in, which is our specialty, and the order routing out. Once you're within your environment, the range of additional tools makes it easy for you to develop and customize your own trading tools and your own trading strategies. That's something I will be talking about on Thursday.

Gardner: How has the reception in the market?

O'Sullivan: The good news is that we've definitely had great progress here. We have a number of clients in all of the locations I mentioned. We're continuing to grow. It's a tough environment, as you can imagine, both just in the general economy and in particular in the financial services industry. So we expect to continue to grow this significantly further.

We have been certainly very happy with the uptake so far. We knew that we were going out well ahead of everybody else and we were very keen to do so, because we see and understand the vision that VMware and EMC in particular have been promoting over the past few years. We agree with it fully. We feel like we're uniquely positioned within the capital markets industry as the neutral party.

Remember, we're just a place where people go to trade. We don't decide what you buy or what you sell or how much it should be. We just provide the facility, the rules, and the oversight to ensure an orderly market. We wanted to make it easier and more cost-effective for firms to get access to that environment.

So by providing all of this capability, we think we're in a fantastic position now, that as more and more firms continue to explore virtualization and outsourcing of non-business critical functions, which for a while used to be running on your own servers, but which are now nothing but overhead.

We see them moving more and more into the cloud. We expect over the next two or three years, that this is really going to explode. We intend to be there, established, fully in production, tried and tested, and leading the industry from the front, as we think we should be with the a name like the New York Stock Exchange.

Well-known brand

That’s a brand that's so well-known globally. It's the best place to trade. It's the most reliable and most secure place to trade stocks, with the best oversight, and we want to apply that model to all of the services that we offer our clients.
Listen to the podcast. Find it on iTunes/iPod. Read a full transcript or download a copy. Sponsor: VMware.

Get the latest announcements about VMware's cloud strategy and solutions by tuning into VMware NOW, the new online destination for breaking news, product announcements, videos, and demos at: http://vmware.com/go/now.

You may also be interested in:

HP expands Converged Cloud portfolio to work with VMware's new vCloud Suite 5.1

HP today announced at the VMworld 2012 conference in San Francisco that it's expanding its HP Converged Cloud portfolio with new solutions for VMware vCloud Suite 5.1, enabling clients to transform traditional virtualization deployments into private and hybrid cloud environments with less risk and complexity.

Combined with VMware vCloud Suite 5.1, HP CloudSystem doubles VM density, reduces network complexity, and provides added flexibility to support almost any workload, says HP.

Introduced in April, HP Converged Cloud extends the power of the cloud across infrastructure, data and applications. Based on a single architecture, HP Converged Cloud helps integrate many combinations of private, managed and public clouds, as well as traditional IT, providing workload portability as well as dynamic scaling. [Disclosure: HP and VMware are sponsors of BriefingsDirect podcasts.]

The expanded HP Converged Cloud portfolio from VMworld enables clients to:
  • Reduce complexity of building and managing cloud with integrated solutions.

  • Accelerate cloud adoption with comprehensive security and compliance controls that can be automatically applied to virtual machines (VMs).

  • Decrease the risk of data loss with automated policy-based data protection.

vCloud Suite 5.1

The HP announcement dovetails with VMware's unveiling of vCloud Suite 5.1, which delivers its software-defined datacenter, an architecture for implementing cloud computing. vCloud Suite 5.1 extends the benefits of virtualization to every domain in the datacenter – compute, storage, networking, and the associated availability and security services, says VMware.

The software-defined datacenter architecture abstracts all hardware resources and pools them into aggregate capacity, enabling automation to safely and efficiently dole it out as needed for applications. Tenants or customers utilizing the software-defined datacenter can have their own virtual datacenters with a logically isolated collection of all the virtual compute, storage, networking and security resources they are used to.

As organizations move from a virtualized environment to a private or hybrid cloud, they may face significant challenges.



On Tuesday, VMware CTO Steve Herrod unveilved an enterprise mobility solution suite called Horizon. It goes a long way to helping enterprises deliver and control applications and data that can be accessed via most smartphones, tablets and PCs.

New HP CloudSystem capabilities integrated with the VMware vCloud Suite 5.1 include:
  • HP Cloud System optimized for VMware, which provides faster time to revenue with pre-integrated solutions that include HP Converged Infrastructure and cloud management from HP and VMware.
  • Auto-flexing feature, which reduces response time to business requests and improves overall service levels by enabling VMware administrators to provision hardware for vCloud Director to automate the scaling of converged infrastructure.
  • VM importing, which simplifies clients’ path to the cloud by easily importing running VMs into an HP CloudSystem without downtime or reconfiguration.
  • HP Cloud Maps for VMware, which accelerates the design of cloud services and automates the deployment of virtual applications using pre-packaged, optimized HP CloudSystem templates.

Data protection enhancements

Also, at VMworld, Autonomy, an HP Company, announced a major feature enhancement to HP Data Protector 7 that delivers integrated security for vCloud Director 5.1, providing fully automated, policy-based protection for cloud environments.

This is a key offering from Autonomy and provides policy-based data protection for an array of configurations within a virtual datacenter. It also allows organizations to control how often they back up their data, as well as how much data to retain and store.

The solution enables service providers to offer flexible protection options within multi-tenant cloud environments. Organizations that use vSphere and seek to maximize storage efficiency for VM backup can leverage Data Protector 7 to de-duplicate data anywhere – at the application source, backup server, or target appliance – and centrally manage the de-duplicated data movement across the enterprise for disaster recovery.

The solution enables service providers to offer flexible protection options within multi-tenant cloud environments.



Using Data Protector 7, customers can eliminate protection gaps found in cloud-based deployments. Traditional data-protection solutions often fail to understand how much data to back up and the level of data protection required for the diverse types of data that reside within an organization.

Customers can also reduce the risk of data loss, as business critical backup policies are automatically applied to new VMs within a virtual datacenter. And with HP StoreOnce Catalyst replication feature, customers can attain back-up at speeds of up to 100 terabytes per hour, three times faster than the leading industry storage alternative, says HP.

PCI industry security


HP has also partnered with VMware to offer a converged payment card industry (PCI) Compliance Security Solution Stack that provides a single security framework to address diverse virtual and cloud infrastructures. The solution provides comprehensive, cost effective and easy-to-manage protection that enables strong security, beyond simply meeting compliance requirements.

The PCI Compliance Security Solution Stack is a pre-certified reference architecture for testing applications, defending against cyber threats, as well as providing enterprise-wide visibility across virtual and cloud infrastructures. The solution accelerates the path to compliance covering 110 of the 200 PCI requirements, spanning all 12 regulation sections.

The solution leverages market-leading technology from HP TippingPoint, HP ArcSight, HP Atalla and VMware cloud infrastructure, allowing users to:

The solution accelerates the path to compliance covering 110 of the 200 PCI requirements, spanning all 12 regulation sections.


You may also be interested in:

Thursday, August 23, 2012

Legal services leader Foley & Lardner makes strong case for virtual desktops

Listen to the podcast. Find it on iTunes/iPod. Read a full transcript or download a copy. Sponsor: VMware.

T
he latest BriefingsDirect enterprise user IT adoption story centers on how global legal services leader Foley & Lardner LLP has adopted virtual desktops and bring-your-own-device (BYOD) to enhance end-user productivity across their far-flung operations.

We'll see how Foley has delivered applications, data, and services better and with improved control -- even as employees have gained more choices and flexibility over the client devices, user experiences, and applications usage.

Learn more here about adapting to the new realities of client computing and user expectations with Linda Sanders, the CIO, and Rick Varju, Director of Engineering & Operations, both at Foley & Lardner LLP. The discussion is moderated by BriefingsDirect's Dana Gardner, Principal Analyst at Interarbor Solutions. [Disclosure: VMware is a sponsor of BriefingsDirect podcasts.]

Here are some excerpts:

Gardner: What was "the elephant in the room," when it came to the old way of doing client-side computing? Was there something major that you needed to overcome?

Sanders: Yes, we had to have a reduction in our technology staffing, and because of that, we just didn't have the same number of technicians in the local offices to deal with PCs, laptops, re-imaging, and lease returns -- the standard things that we had done in the past. We needed to look at new ways of doing things, where we could reduce the tech touches, as we call it, and find a different way to provide a desktop to people in a fast, new way.

Varju: From a technical perspective, we were looking for ways to manage the desktop side of our business better, more efficiently, and more effectively. Being able to do that out of our centralized data center made a lot of sense for us.

Other benefits have come along with the centralized data center that weren't necessarily on our radar initially, and that has really helped to improve efficiencies and productivity in several ways.

Gardner: Tell us about your organization at Foley. Linda, how big are you, where do you do business?

Virtualized desktops

Sanders: Foley has approximately 900 attorneys and another 1,200 support personnel. We're in 18 U.S. offices, where we support virtualized desktops. We have another three international offices. At this time, we're not doing virtualized desktops there, but it is in our future.

Gardner: Rick, how has virtual desktop infrastructure (VDI) been an enabler?

Varju: The real underlying benefit is being able to securely deliver the desktop as a service (DaaS). We are no longer tied to a physical desktop and that means you can now connect to that same desktop experience, wherever you are, anytime, from any device, not just to have that easy access, but to make it secure by delivering the desktop from within the secure confines of our data center.

That's what's behind deploying VDI and embracing BYOD at the same time. You get that additional security that wouldn't otherwise be there, if you had to have all your applications and all data reside on that endpoint device that you no longer have control over.

With VMware View and delivering the DaaS from the data center, very little information has to go back to the endpoint device now, and that's a great model for our BYOD initiatives.

Mobile devices

In terms of raw numbers, every attorney in the firm has a mobile device. The firm provides a BlackBerry as part of our standard practice and then we have users who now are bringing in their own equipment. So at least 900 attorneys are taking advantage of mobility connectivity, and most of those attorneys have laptops, whether they are firm issued or BYOD.

Easily 1,500 personnel taking advantage of some sort of connectivity to the firm through their mobile devices.

Gardner: So as IT and business management, you get a better control and a sense of security, and the users get choice and flexibility?

Sanders: That's correct. Before, we were selecting the equipment, providing that equipment to people, and over and over again, we started to hear that that's not what they wanted. They wanted to select the machine, whether it be a PC, a Mac, an iPad, or smartphone. And even if we were providing standard equipment, we knew that people were bringing in their own. So formulating a formal BYOD program worked out well for us.

In our first year, we had 300 people take advantage of that formal program. This year, to date, we have another 200 who have joined, and we are expecting to add another 100 to that.

As Rick mentioned, we did also open this up to some of our senior level administrative management this year and we now have some of those individuals on the program. So that too is helping us, because we don't have to provision and lease that equipment and have our local technology folks get that out to people and be swapping machines.

Now, when we're taking away a laptop, for example, we can put a hosted desktop in and have people using VMware View. They're seeing that same desktop, whether they're sitting in the office or using their BYOD device.
They're seeing that same desktop, whether they're sitting in the office or using their BYOD device.


Gardner: Do you have any metrics in terms of how much this all saved you?

Sanders: Over three years, we'll probably be able to reduce our spend by about 22 percent.

Realistic number

We had our business manager within technology calculate for us what we were spending year after year on equipment, factoring in how much tech time is involved in that, and coming up with a realistic number, where people could go out and purchase equipment over a three-year time frame.

That was the start of it, looking at that breakdown of the internal time, selecting a dollar amount, and then putting together a policy, so that individuals who decided to participate in it would know what the guidelines were.

Our regional technology managers met one on one or in small groups with attorneys who wanted to go on the program, went through the program with them, and answered any questions upfront, which I think really served us well. It wasn’t that we just put something out on paper, and people didn’t understand what they were signing up for.

Those meetings covered all the high points, let them know that this was personal equipment and that, in the end, they're responsible for it should something happen. That was how we put the program together and how we decided to communicate the information to our attorneys.

Gardner: Has something about the DaaS allowed you to extend these benefits beyond just your employees? Is there some aspect of this that helps on that client services equation.
That does provide some additional benefit for our attorneys, when it comes to delivering the best possible service we can to our clients.
?

Varju: The ease of mobility and some of the productivity gains make a big difference. The quicker we can get access to people and information for our attorneys, no matter where they are and no matter what the device they're using, is really important today. That does provide some additional benefit for our attorneys, when it comes to delivering the best possible service we can to our clients.

One of the things that we're looking at now is unified communications, and trying to pull everything to the desktop, all the experiences together, and one of those important components is collaboration.

If we can deliver a tool that will allow attorneys and clients to collaborate on the same document, from within the same desktop view, that would provide tremendous value. There are certainly products out there that will allow you to federate with other organizations. That’s the line of thinking we're looking at now and we'll look to deploy something like that in the near future.

The biggest plus

Sanders: The biggest plus is, as Rick mentioned, for people who are mobile, is that they have the same desktop, no matter where they are. As I talked about before, whether they're in the office or out of the office, they have the same experience.

If we have a building shut down, we are not trapped into not being able to deliver a desktop, because they can’t get into the building and they can’t work inside. They're working from outside and it’s just like they are sitting here. That’s one of the biggest pluses that we've seen and that we hear from people -- just that availability of the desktop.

Varju: Before deploying VDI and VMware View, we delivered a more generic desktop for remote access. So to Linda’s point, being able to have your actual desktop follow you around on whatever device you are using is big. Then it's the mobility, even from within the office.

When an attorney signs up for the Technology Allowance Program, we provide them a thin client on their desk, which they use when they're sitting in their office. Then, as part of the Technology Allowance Program and Freedom of Choice, they purchase whatever mobility technology suits them and they can use that technology when working out of conference rooms with clients, etc.
The ability to move and work within the office, whether in a conference room, in a lobby, you name it, those are powerful features for the attorneys.


So remote access and having their own personal desktop follow them around, the ability to move and work within the office, whether in a conference room, in a lobby, you name it, those are powerful features for the attorneys.

We're definitely ahead of the curve within the legal vertical. Other verticals have ventured into this. Two in particular have avoided it longer than most, the healthcare and financial industries. But without a doubt, we're ahead of the curve amongst our peers, and there are some real benefits that go along with being early adopters.

Gardner: Explain for me, Rick, how you went about architecting this solution, and perhaps a little bit about the journey, and both good and bad experiences there?

Process and strategy

Varju: We've been virtualizing servers for quite some time now. Our server environment is just over 75 percent virtualized. Because of the success we have had there, and the great support from VMware, we felt that it was a natural fit for us to take a close look at VMware View as a virtual desktop solution.

We started our deployment in October of 2009. So we started pretty early, and as is often the case with being an early adopter, you're going to go through some pain being among the first to do what you are doing.

In working with our vendor partners, VMware, as well as our storage integrators, what we learned early on is that there wasn’t a lot of real-world experience for us to draw from when designing or laying out the design for the underlying infrastructure. So we did a lot of crawling before we walked, walking before we ran, and a lot of learning as we went.

But to VMware’s credit, they have been with us every step of the way and have really taken joint ownership and joint responsibility of this project with Foley. Whenever we have had issues, they have been very quick to address those issues and to work with us. I can't say enough about how important that business relationship is in a project of this magnitude.

While there was certainly some pain in the early stages of this project and trying to identify what infrastructure components and capacities needed to be there, VMware as a partner truly did help us get through those, and quite effectively.
To VMware’s credit, they have been with us every step of the way and have really taken joint ownership and joint responsibility of this project with Foley.


PCoverIP
protocol is critical to the overall VDI solution and delivering the DaaS, whether it's inside the Foley organization and the WAN links that we have between our offices, or an attorney who is working from home, a Starbucks or you name it. PCoverIP as a protocol is optimized to work over even the lowest of bandwidth connections.

The fact that you're just sending changes to screens really does optimize that communication. So the end result is that you get a better user experience with less bandwidth consumption.

Freedom of choice

Sanders: The success that we've had, as we have spoken about throughout this call, has been the ability to deliver that desktop and to have attorneys speak to their peers and let them know. Many times, we have attorneys stop us in the hallway to find out how they too can get on a hosted desktop.

Leveraging with the BYOD program helped us, giving people that freedom of choice, and then providing them with a work desktop that they can access from wherever.

We're really looking at unified communications. One of the things that I'm very interested in is video at the desktop. It's something that I am going to be looking at, because we use video conferencing extensively here, and people really like that video connection.

They want to be able to do video conferencing from wherever they are, whether it's in a conference room, outside the office, on their laptop, on a smartphone. Bringing in that unified communication is going to be one of the next things we're going to focus on.
Any time we look at a change in technology, especially the underlying infrastructure, we always take a look at what cloud services are available and have to offer.


Varju: Cloud computing is certainly an interesting topic and one that you can spend a day on, in and of itself. At Foley, any time we look at a change in technology, especially the underlying infrastructure, we always take a look at what cloud services are available and have to offer, because it's important for us to keep our eye on that.

There is another area where Foley is doing things differently than a lot of our peers, and that's in the area of document management. We're using a cloud-based service for document management now. Where VMware View and VMware, as an organization, will benefit Foley as we move forward is probably more along the lines of the Horizon product, where we can pull our SaaS-based applications or on-premise based applications all together in a single portal.

It all looks the same to our users, it all opens and functions just as easily, while also being able to deliver single sign-on and two-factor authentication. Just pulling the whole desktop together that way is going to be real beneficial. Virtualizing the desktop, virtualizing our servers, those are key points in getting us to that destination.
Listen to the podcast. Find it on iTunes/iPod. Read a full transcript or download a copy. Sponsor: VMware.

You may also be interested in:

Wednesday, August 22, 2012

VMware CTO Steve Herrod on how the software-defined datacenter benefits enterprises

Listen to the podcast. Find it on iTunes/iPod. Read a full transcript or download a copy. Sponsor: VMware.

Get the latest announcements about VMware's cloud strategy and solutions by tuning into VMware NOW, the new online destination for breaking news, product announcements, videos, and demos at: http://vmware.com/go/now.
In advance of next week's VMworld conference in San Francisco, I recently sat down with Steve Herrod, Chief Technology Officer and Senior Vice President of Research & Development at VMware.

Our discussion hinges on the intriguing concept of the software-defined datacenter. We look at how some of the most important attributes of datacenter capabilities and performance are now squarely under the domain of software enablement.

A top technology leader at VMware, Herrod has championed this vision of the software-defined datacenter and how the next generation of foundational IT innovation is largely being implemented above the hardware.

For example, those who are now building and managing datacenters are gaining heightened productivity, delivering far better performance, and enjoying greater ease in operations and management -- all thanks to innovations at the software-infrastructure level.

Join the discussion here and further explore how advances in datacenter technologies and architecture are -- to an unprecedented extent -- being driven primarily through software. [Disclosure: VMware is a sponsor of BriefingsDirect podcasts.]

Here are some excerpts:
Gardner: We've heard a lot over the decades about improving IT capabilities and infrastructure management, but it seems that many times we peel back a layer of complexity and we get some benefits, and we find ourselves like the proverbial onion, back at yet another layer of complexity.

Complexity seems to be a recurring inhibitor. I wonder if this time we're actually at a point where something is significantly different. Are we really gaining ground against complexity at this point?

Herrod: It’s a great question, because complexity is associated with IT and why we'll do it differently this time. I see two things happening right now that give us a great shot at this.

One is purely on expectations. All of the opportunities we have as consumers to work with cloud computing models have opened up our imagination as to what we should expect out of IT and computing datacenters, where we can sign up for things immediately, get things when we want them, and pay for what we use. All those great concepts have set our expectations differently.

A good shot

Simultaneously, a lot of changes on the technology side give us a good shot at implementing it. When you combine technology that we'll talk about with the loosened-up imagination on what can be, we're in a great spot to deliver the software-defined datacenter.

Gardner: You mentioned cloud and this notion that it’s a liberating influence. Is this coming from the technologists or from the business side? Is there a commingling on that concept quite yet?

Herrod: It’s funny. I see it coming from the business side, which is the expectation of an individual business unit launching a product. They now have alternatives to their own IT department. They could go sign up for some sort of compute service or software-as-a-service (SaaS) application. They have choices and alternatives to circumvent IT. That's an option they didn't have in the past.

Fundamentally, it comes down to each of us as individuals and our expectations. People are listening to this podcast when they want to, quickly downloading it. This also applies to signing up for email, watching movies, and buying an app on an app store. It's just expected now that you can do things far more agilely, far more quickly than you could in the past, and that's really the big difference.

Gardner: Tech users are getting higher expectations based on what they encounter on their consumer side of technology consumption. We see what the datacenters are capable of from the likes of Google and Facebook. Is it possible for enterprises to also project that sort of productivity and performance onto what they're doing, and maybe now that we've gone through an iteration of these vast datacenters, to do it even better?

Herrod: I have a lot of friends at Facebook, Zynga, and Google, running the datacenters there, and what’s exciting for me is that they have built a fully software-defined datacenter. They're doing a lot of the things we are talking about here. But there are two unique things about their datacenters.
When you go into the business world, they don't have legions of people to run the infrastructure.


One is that they have hundreds or even thousands of PhDs who are running this infrastructure. Second, they're running it for a very specific type of application. To run on the Google datacenter, you write your applications a very specific way, which is great for them. But when you go into the business world, they don't have legions of people to run the infrastructure, and they also have a broad set of applications that they can’t possibly consider rewriting.

So in many ways, I see what we're doing is taking the lesson learned in those software-defined datacenters, but bringing it to the masses, and bringing it to companies to run all of their applications and without all of the people cost that they might need otherwise.

Gardner: Let’s step back for some context. How did we get here? It seems that hardware has been sort of the cutting edge of productivity, when we think of Moore’s Law and we look at the way that storage, networks, and server architecture have come together to give us the speeds and feeds that have led to a lot of what we take for granted now. Let’s go through that a little bit and think about why we're at a point where that might not be the case anymore.

Herrod: I like to look at how we got to where we are. I think that's the key to understanding where we're likely to go from here.

History of IT decisions

W
e started VMware out of a university, where we could take the time to study history and look at what had happened. I liked looking at existing datacenters. You can look through the datacenter and see the history of IT decisions of the past.

It's traditionally been the case that a particular new need led the IT department to go out and buy the right infrastructure for that new need, whether it’s batch processing, client/server applications, or big web farms. But these individually made decisions ended up creating the silos that we all know about that exist all over datacenters.

They now have the group that manages the mainframe, the UNIX administration group, and the client PC group, and none of them is using common people or common tools as much as they certainly would like to. How we got to where we are were isolated decisions for the right thing at the right time, without recognizing the opportunity to optimize across a broader set of the datacenter.

The whole concept of software-defined datacenters is looking holistically at all of the different resources you have and making them equally accessible to a lot of different application types.

Gardner: Earlier, I used the metaphor of an onion. You peel back complexity and you get more. But when it comes to the architecture of datacenters, it seems that the right comparison might be a snowball, which is layered on another layer, or it has been rolling and gathering as it goes, but not rationalized, not looked at holistically.
Every single day you hear about a new case where a business unit or an employee is able to circumvent IT to scratch the itch they have for some particular type of technology.


Are there some sorts of imperatives now that are driving people to do that? We talked about the cloud vision, but maybe it’s security, maybe it’s the economics, maybe it’s the energy issues, or maybe it's all those things together.

Herrod: It’s a little of each. First of all, I like the onion analogy, because it makes you cry, and I think that’s also key. But it’s a combination of requirements coming in at the same time that's really causing people to look at it.

Going back to the original discussion, it starts with the fact that there are choices now. Every single day you hear about a new case where a business unit or an employee is able to circumvent IT to scratch the itch they have for some particular type of technology, whether it's using Dropbox instead of the file servers that the company has, buying their own device and bringing it in, or just signing up for Amazon EC2, instead of using their local datacenter. These are all examples of them being able to go around IT.

But what often happens subsequently is that, when a security problem happens, when you realize that you are not in compliance, IT is left holding the bag. So we get an environment here where the user demand can be handled other ways, but IT has to be able to compete with those.

We have to let IT be a service provider and be able to be as responsive with those, so that they can avoid people going around them. But they still need to be responsible to the business when it comes time to show that Sarbanes-Oxley (SOX) compliance is appropriate or to make sure that your customer records aren’t leaked out to everyone else on the Internet.

That unique balance between the user choice and IT control is something we've all seen over the last several decades, and it’s showing up again at an even larger state.

New competition


Gardner: As you pointed out, Steve, IT isn’t just competing against itself. That is to say, maybe a 5 percent or 10 percent improvement over how well it did last year will be viewed as very progressive. But they're competing now against other datacenter architects. Maybe it’s a SaaS provider, maybe it’s a cloud provider, maybe it’s managed service provider (MSP) or telco that's now offering additional services.

We're really up against this notion that if you don’t architect your datacenter with that holistic software-defined mentality, and someone else does that, you're in trouble.

Herrod: It’s a great point. There are rate cards now for what you can use something else for. You might pay 7 cents per hour for this, or "this much" per transaction. IT departments in general have not traditionally had a good way of, first, even knowing how much they are costing, but second, optimizing to be competitive. So there's this awareness now of how much I'm spending and how long it takes. These metrics are causing this.

Gardner: Let’s revisit the context and the history here, looking at virtualization in particular. We've seen it extend beyond servers to data, storage, and also networking. Is this part of what you've got in your vision of software defined? Is it strictly virtualization, or does it encompass more? Help me understand how you've progressed in your thinking along these lines, particularly in regard to virtualization?

Herrod: We'll step back a little bit. VMware, over the last 13 years or so, has done a very good job of completely optimizing how servers are used in the datacenter. You can provision a new virtual machine (VM) in seconds. The cost has gone down in orders of magnitude. We've really done a good job on the compute and memory aspect of a datacenter.
It's absolutely crucial to look at the breadth of things that are involved in the datacenter.


But as you said, a couple of things have to happen from there. It's absolutely crucial to look at the breadth of things that are involved in the datacenter. We talk to customers now, and often they say, "Great, you've just lowered the cost and time taken to provision a new server. But when I put this in production, by the way, I care what LUN it ends up on, I have to look at what VLAN is there, and if it's in the right section of my firewall setup."

It might take seconds to provision a VM, but then it takes five days to get the rest of the solutions around it. So we see, first of all, the need to get the entire datacenter to be as flexible and fast moving as the pure server components are right now.

Again, if you look at the last couple of years, I would rate the industry -- ourselves and others -- as moving forward quite well on the storage side of things. There are still some things to do for sure, but storage, for the most part, has gotten a good head start on being fully virtualized and automated.

The big buzz around the industry right now has been the recognition that the network is the huge remaining barrier to doing what you want in your datacenter. Plenty of startups and all kinds of folks are working on software-defined networking. In fact, that's what we use as the term for the software-defined datacenter, because as networking follows as this big inhibitor, you'll be opened up to having a truly planned datacenter solution in place.

Now, we can break that down a little bit. It's important to talk about the technology piece of this. But when I say software-defined, I really look at three phases of how software comes in and morphs this existing hardware that you have.

The first step

The first step is to abstract away what people are trying to use from how it is being implemented. That's the core of what virtual even means, separating the logical from the physical. It gives you hardware independence. It enables basic mobility and all sorts of other good things.

The second phase is when you then pool all of these abstracted resources into what we call resource pools. Anyone who uses VMware software knows that we create these great clusters of computing horsepower and we allow vMotion and mobility within it.

But you need to think about that same notion of aggregation of resources at the storage and networking levels, so they become this great pool of horsepower that you can then dole out quite effectively. So after you've abstracted and pooled, the final phase is how you now automate the handling of this. This is where the real savings and speed come from.

Once you have pools of resources, when a new request comes in, you should be able to allocate storage, security, networking, and CPU very quickly. Likewise, when it goes away, you should be able to remove it and put it back into the pool.

That's a bit of a mouthful, but that's how I see the expansion. It first goes from just compute into storage, networking, security, and the other parts of the datacenter. Then simultaneously, you're abstracting each of these resources, pooling them, and then automating them.
When a new request comes in, you should be able to allocate storage, security, networking, and CPU very quickly.


Gardner: What's really fascinating to me are the benefits you get by abstracting to a virtualization and software-defined level -- the ability to implement with greater ease -- but that comes with underlying benefits around operations and management.

It seems to me that you can start to dial up and down, demonstrate elasticity at a far greater level, almost at that data-center level, looking at the service-level agreements (SLAs) and the key performance indicators (KPIs) that you need to adhere to and defining your datacenter success through a business metric, like an SLA.

Does it ring true with you that we're talking about some real management and operational efficiencies, as well as implementation efficiencies?

Herrod: It is, Dana, and we talk about it a few different ways. The transformation of datacenters, as we got started, was all about cost savings and capital expenses in financial terms. Let's buy fewer servers. "Let's not build another datacenter."
Get the latest announcements about VMware's cloud strategy and solutions by tuning into VMware NOW, the new online destination for breaking news, product announcements, videos, and demos at: http://vmware.com/go/now.
But the second phase, and where most customers are today, is all about operational efficiency. Not only am I buying less hardware, but I can do things where I'm actually able to satisfy, as you said, the KPIs or the SLAs.

Doing even more


I
can make sure that applications are up and running with the level of availability they expect, with less effort, with fewer people, and with easier tools. And when you go from capital expense savings to operational improvements, you impact the ability for IT to do even more.

To take that one level further, whenever I hear people talk about cloud computing -- and everyone talks about this with all sorts of different impressions in mind -- I think of cloud as simply being about more speed. You can do something more quickly. You can expand something more quickly. And that's what this third phase after capital and operational savings is about, that agility to move faster.

As businesses’ success ties so closely to how IT does, the ability to move faster becomes your strategic weapon against someone else. Very core to all this is how can we operate more efficiently, while satisfying the specific needs of applications in this new datacenter.

Gardner: Another area that I hear about benefiting from this software defined datacenter is the ability to better reduce and manage risk, particularly around security issues. You're no longer dealing with multiple parties, like the group overseeing UNIX, the group overseeing PC, the group doing the x86 architectures. The likelihood for process cracks to develop and security issues to unfortunately crop up seem to be more likely under those circumstances.

But when you have got a more organized overview of management operations and architecting at a similar level, you can instantiate the best practices around security. Please address this issue of security as another fruit to be harvested from a software-defined datacenter.
Security means a lot of different things, and it has been affected by a number of different aspects.


Herrod: Security means a lot of different things, and it has been affected by a number of different aspects.

First of all, I agree that the more you can have a homogenous platform or a homogenous team working on something, the less variation and process you end up with, exactly as you said, Dana. That can allow you to be more efficient.

This is a replacement for the traditional world of ITIL, where they had to try to create some standard across very different back ends. That's a natural progression for getting rid of some of the human errors that come into problems.

A more foundational thing that I am excited about with the software-defined datacenter is how, rather than security being these physical concepts that are deployed across the datacenter today, you can really think of security logically as wrapping up your application. You can do some pretty interesting new things.

A quick segue on that -- the way most security works in datacenters today is through statically placed appliances, whether they're firewalls, intrusion detection, or something else. Then the onus is on you to fit your application in the right part of the datacenter to get the right level of protection that you have, and hopefully it doesn’t move out of that protection zone.

Follows the application

What we're able to deliver with the software-defined datacenter is a way that security is a trait associated with the application, and it essentially wraps and follows the application around. You've virtualized your firewall and you've built it into the fabric of how you're automating deployments. I see that as a way to change the game on how tight the security can be around an application, as well as making sure it's always around there when you deploy it.

Gardner: For end users the proof is in how they actually consume, relate to, and interact with the applications. Is there something about the applications specifically that the software-defined datacenter brings, a higher level of user productivity benefits? What's really going to be noticeable for the application level to end users?

Herrod: That's a great question. I'm an infrastructure guy, as are probably many people listening here, and it’s easy to forget that infrastructure is simply a means to an end. It's the way that you run applications that ultimately matters. So you have to look at what an application is and what its ideal state looks like. The idea of the software-defined datacenter is to optimize that application experience.

That very quickly translates into how quickly can I get my application from the time I want it until it's running. It dictates how often this application is up, what kind of scale it can handle as more people come in, and how secure it is. Ultimately, it's about the application. I believe the software-defined datacenter is the way to optimize that application experience for all the users.

Gardner: Steve, how about not just repaving cow paths in terms of how we deploy existing types of applications. Is there something inherent in a software-defined datacenter benefit that will work to our advantage on innovative new types of applications?
We are at a point where, depending on who you listen to, about 60 percent of all server applications are running virtual.


They could be for high performance computing, big data and analytics, or even when we go to mobile and we have location services folded into some of the way that applications are served up, and there is sort of a latency sensitive portion to this. Are there new types of apps that will benefit from this software-defined architecture?

Herrod: This is one of the most profound parts, if we get it right. I've been talking about can we collapse the silos that were created. Can we get all of our existing apps onto this common platform? We're doing quite well on that. We are at a point where, depending on who you listen to, about 60 percent of all server applications are running virtual, which is pretty amazing. But that also means there is 40 percent that aren’t. So I spend a lot of time understanding why they might not be today.

Part of it is that just as businesses get more comfortable and get there, their business critical apps will get onto the system, and that's working well. But there are applications that are emerging, as you talked about, where if we're not careful, they'll create the next generation of silos that we'll be talking about 10 years from now.

I see this all the time. I'll visit a company that has a purely virtualized pool, but they have also created their grid for doing some sort of Monte Carlo simulations or high-performance computing. Or they have virtualized everything except for their unified communication environment, which has a special team and hardware allocated to it.

We spend quite a bit of time right now looking at the impediments to having those run on top of virtualization, which might be performance related or something else. Then going beyond impediments to how can we make them even better when they are run on top of the virtualized platform.

Great applications


Some of the really interesting things we're able to show now with our partners are things I would have never dreamed of as great candidates when we started the company. But we're able to satisfy very strict real-time requirements, which means we can run some great applications used in various sorts of stock trading, but also used in things like voice over IP (VoIP) or video conferencing.

Another big area that's liable to create the next round of silos, if we're not careful, is the big data and Hadoop world. Lots of customers are kicking the tires and creating special clusters and teams to work on that. But just recently, we've shown that the performance of Hadoop on top of vSphere, our virtualization platform, can be great.

We can even show that we can make it far easier to set up. We can make Hadoop more available, meaning it won’t crash as often. And we can even do things where we make it more elastic than it already is. It can suck up as many resources in the software-defined datacenter as it wants, when it needs them, but it can also give them all back when it's not using them.

It’s really exciting to look across all these apps. At this point, I don’t see a reason why we can't get almost any type app that we're looking at today to fit into the software-defined datacenter model.

Gardner: That’s exciting, when we don’t have any of the stragglers or large portions of business functions that are cast off. It seems to me that we've reached the capability of mirroring the entire datacenter, whether it’s for purposes of business continuity or disaster recovery (DR), or backup and recovery. It gives us the choice of where to locate these resources, not at the individual server, virtual machine level, or application level, but really to move the whole darn datacenter, if that’s important, without a penalty.
Very rapidly, this notion of DR has been a driving reason for people to virtualize their datacenter.


For our last blue-sky direction with this conversation, are we at the point where we have fungibility, if you will, of datacenters, or are we getting to that point in the near future, where we can decide at a moment’s notice where we're going to actually put our datacenter, almost location independent?

Herrod: It’s a ways out, before we're just casually moving datacenters around, for sure. But I have seen some use cases today that are showing what's possible, and maybe I'll just give you a couple of examples.

DR has long been one of the real pains for IT to deal with. They have to replicate things across the country and keep two datacenters completely in sync, literally the same hardware, the same firmware layer, and all of that that goes into it.

Very rapidly, this notion of DR has been a driving reason for people to virtualize their datacenter. We have seen many cases now, where you're able to failover your entire datacenter, effectively copying the whole datacenter over to another one, keeping the logical constructs in place, but hosting in a completely different area.

To get that right, your storage needs to be moved, your network identities need to be updated, and those are things that you can script and do in an automated way, once you've virtualized the whole datacenter.

Fun example


A
nother really fun example I see more and more now is, as mergers and acquisitions happen, we've seen several cases where one company buys another. They both had fully virtualized their datacenter and they could put on a giant storage drive the datacenter at one company and begin to bring it up on the other side, once they copied it over there.

So the entire datacenter isn't moved yet, but I think there are clear indications of once you separate out where something runs and how it runs from what you are really after, it opens up the door for a lot of different optimizations.

Gardner: We're coming up on the end of our time, but we also have the big annual VMworld show in San Francisco coming up toward the end of August. I know you can’t pre-announce anything, but perhaps you can give us some themes. We've talked about a lot of things here today, but is there any particular themes that we have hit on that you think are going to be more impactful or more important in terms of what we should expect at VMworld?

Herrod: It will be exciting as always. We have more than 20,000 people expected. What I'm doing here is talking about a vision and generalities of what's happening, but you can certainly imagine that what we will be showing there will be the realities -- the products that prove this, the partnerships that are in place that can help bring it forward, and even some use cases and some success stories.
You need to get to the point where you are leveraging the full automation and mobility that exists today.


So expect it to be certainly giving more detail around this vision and making it very real with announcements and demonstrations.

Gardner: Last question, if I'm a listener here today, I'm intrigued, and I want to start thinking about the datacenter at the software-defined level in order to generate some of the benefits that we have been discussing and some of the vision that we have been painting, what’s a good way to start? How do you begin this process? What are a few foundational directives or directions that you recommend?

Herrod: I think it can sound very, very disruptive to create a new software-defined datacenter, but one of the biggest things that I have been excited about in this technology versus others is that there are a set of steps that you go through, where you're able to get some value along the way, but they are also marching you toward where you ultimately end up.

So to customers who are doing this, presumably most of you have done some basic virtualization, but really you need to get to the point where you are leveraging the full automation and mobility that exists today.

Once you start doing that, you'll find that it obviously is showing you where things can head. But it also changes some of the processes you use at the company, some of the organizational structures that you have there, and you can start to pave the way for the overall datacenter to be virtualized, as you take some of these initial steps.

It’s actually very easy to get started. You can make benefits along the way. Your existing applications and hardware work. So that would be my real entreaty -- use what exists today and get your feet wet, as we deliver the next round heading forward.
Listen to the podcast. Find it on iTunes/iPod. Read a full transcript or download a copy. Sponsor: VMware.
Get the latest announcements about VMware's cloud strategy and solutions by tuning into VMware NOW, the new online destination for breaking news, product announcements, videos, and demos at: http://vmware.com/go/now.
You may also be interested in: