Click here to close now.





















Welcome!

Apache Authors: Pat Romanski, Jim Scott, Jnan Dash, Craig Lowell, Liz McMillan

Related Topics: OpenStack Journal, Linux Containers, Apache, @DevOpsSummit

OpenStack Journal: Article

Keep CALM - Embrace #DevOps | @DevOpsSummit #IoT #APM #Microservices

The next letter in the DevOps CALMS model brings us to M for Measurement

Keep CALM And Embrace DevOps – Measurement
By John Rakowski

The next letter in the DevOps CALMS model brings us to M for Measurement. Focusing on the right metrics and measurements is vital if you are going to succeed with DevOps adoption.

“You Never Know Where You Are Going Until You Know Where You Have Been”

There are not many times in my career that I am going to be able to quote Will Smith, but in the “Will2K” video, Will states “You Never Know Where You Are Going Until You Know Where You Have Been”.  For me, this summarizes why measurements and metrics are so important. Unless you can understand where you are right now then there is no way to understand whether you have been successful in regards to an initiative, in this case, DevOps adoption. Choosing the right DevOps measurements is important to eliciting the right behavior amongst IT teams, ensuring that they know what they need to focus on and, key to making sure that you are delivering the right value to the business.

Eight Essential DevOps Measurements

There are actually more than eight measurements that I would recommend for DevOps adoption. This is because your full measurement strategy really depends on what your stakeholders want to see, your goals and timescales for DevOps adoption. But at a top level, I believe there are eight metrics, which are essential, grouped around people, process and technology.

People measurements

In my experience most measurement strategies in regards to IT based initiatives focus on technology, but it’s ultimately your focus on people that will lead to success. This means employees and the customer. Two key metrics here are:

  • Key employee retention – There will be employees in your team and your business that are key to DevOps success. Those who understand that DevOps is about taking an outside-in approach, focusing on business outcomes and delighting customers.  Also those who can combine Development and Operations skills. These are skills you will want to hire, develop and retain. DevOps is a hot area from a job market perspective so you will want to make sure you keep talent in your business. Therefore identifying those employees who are vital to your DevOps efforts and then tracking retention is a must.
  • Customer satisfaction/experience – Ultimately DevOps success is not about fast release, collaboration or automation etc. Rather it’s about making sure that software fueled business services satisfy and delight customers. This means that tying DevOps to customer satisfaction or experience measurements is vital. One option here is to link your DevOps measurements with NetPromoter scores if your company uses this popular customer satisfaction metric.

Process measurements

From a process perspective, the essential metrics which focus on release and change are:

  • Release/change frequency – One of the key drivers for DevOps adoption is to release new features or applications quicker than before. The aims here are to make sure that your application users (customers or employees) receive the value they need, are happy with functionality and ultimately stay loyal to your business.  So measuring release/change frequency is essential. It could also be said that release/change frequency is one lagging metric for the leading measurement of customer satisfaction/experience.
  • Volume of failures – This measurement goes hand-in-hand with the measurement above. There is no point being able to release quickly if these releases fail and have to be rolled back.
  • Time/cost per release – Ok, maybe this should technically be two metrics. Time is money and money is required for a successful business. This means that it’s critical to measure the time taken and cost per release especially in regards to Ecommerce based applications. If the cost of frequent releases outweighs the profit brought in by the application, then your DevOps adoption is not generating the business benefits that it needs to.

Technology measurements

There are a number of technology metrics that you may choose for your DevOps adoption but here are my three essentials:

  • Mean Time To Resolution (MTTR) – As mentioned, ultimately DevOps is about making sure that software strategy drives successful business outcomes by providing applications that help to deliver the service customers want. As such performance or availability issues are a DevOps strategy killer, and focusing on keeping MTTR measurements as low as possible is important. To improve, an end-to-end monitoring solution, which monitors end-user experience through to the application database or data store is critical.
  • Mean Time Between Failure (MTBF) - This metric comes from software engineering practices and focuses on making sure that applications are available. In the software-defined business highly available applications are key as they fuel business success. Therefore this metric is important BUT
  • Mean Time To Customer Impact – The reality is that failure only becomes an issue when it impacts a business process or the customer. Also failure as per my culture blog post is not a negative in DevOps as the mantra should be fail-fast, fail-forward. A good APM platform will help you to isolate and automatically remediate emerging application issues quickly before they impact the customer. Therefore focusing on Mean Time To Customer Impact is an essential metric for DevOps and monitoring efficiency.

So here are my essential DevOps metrics. As mentioned, the list is not exhaustive but critical to any DevOps strategy. As always comments and feedback is welcome.

If you want to see how AppDynamics can support your DevOps adoption then please try our platform for free

The post Keep CALM And Embrace DevOps – Measurement appeared first on Application Performance Monitoring Blog | AppDynamics.

More Stories By AppDynamics Blog

In high-production environments where release cycles are measured in hours or minutes — not days or weeks — there's little room for mistakes and no room for confusion. Everyone has to understand what's happening, in real time, and have the means to do whatever is necessary to keep applications up and running optimally.

DevOps is a high-stakes world, but done well, it delivers the agility and performance to significantly impact business competitiveness.

@ThingsExpo Stories
Continuous processes around the development and deployment of applications are both impacted by -- and a benefit to -- the Internet of Things trend. To help better understand the relationship between DevOps and a plethora of new end-devices and data please welcome Gary Gruver, consultant, author and a former IT executive who has led many large-scale IT transformation projects, and John Jeremiah, Technology Evangelist at Hewlett Packard Enterprise (HPE), on Twitter at @j_jeremiah. The discussion is moderated by me, Dana Gardner, Principal Analyst at Interarbor Solutions.
The Internet of Everything is re-shaping technology trends–moving away from “request/response” architecture to an “always-on” Streaming Web where data is in constant motion and secure, reliable communication is an absolute necessity. As more and more THINGS go online, the challenges that developers will need to address will only increase exponentially. In his session at @ThingsExpo, Todd Greene, Founder & CEO of PubNub, exploreed the current state of IoT connectivity and review key trends and technology requirements that will drive the Internet of Things from hype to reality.
Today air travel is a minefield of delays, hassles and customer disappointment. Airlines struggle to revitalize the experience. GE and M2Mi will demonstrate practical examples of how IoT solutions are helping airlines bring back personalization, reduce trip time and improve reliability. In their session at @ThingsExpo, Shyam Varan Nath, Principal Architect with GE, and Dr. Sarah Cooper, M2Mi’s VP Business Development and Engineering, explored the IoT cloud-based platform technologies driving this change including privacy controls, data transparency and integration of real time context with p...
Container technology is shaping the future of DevOps and it’s also changing the way organizations think about application development. With the rise of mobile applications in the enterprise, businesses are abandoning year-long development cycles and embracing technologies that enable rapid development and continuous deployment of apps. In his session at DevOps Summit, Kurt Collins, Developer Evangelist at Built.io, examined how Docker has evolved into a highly effective tool for application delivery by allowing increasingly popular Mobile Backend-as-a-Service (mBaaS) platforms to quickly crea...
PubNub has announced the release of BLOCKS, a set of customizable microservices that give developers a simple way to add code and deploy features for realtime apps.PubNub BLOCKS executes business logic directly on the data streaming through PubNub’s network without splitting it off to an intermediary server controlled by the customer. This revolutionary approach streamlines app development, reduces endpoint-to-endpoint latency, and allows apps to better leverage the enormous scalability of PubNub’s Data Stream Network.
According to eMarketer.com, wearable usage will grow almost 60% in 2015 verses 2014. This year, almost 40 million U.S. adults will use wearables, including smartwatches and fitness trackers. And that’s only 16% of the penetrable market. They expect that number double in two years with close to 82 million adults wearing something connected by 2018. Almost two in five internet users by 2019. You probably think that it’ll be all those youngsters growing up with connected objects but over the next four years, older Americans will see the biggest growth with the flood of wearable health monitor dev...
There are over 120 breakout sessions in all, with Keynotes, General Sessions, and Power Panels adding to three days of incredibly rich presentations and content. Join @ThingsExpo conference chair Roger Strukhoff (@IoT2040), June 7-9, 2016 in New York City, for three days of intense 'Internet of Things' discussion and focus, including Big Data's indespensable role in IoT, Smart Grids and Industrial Internet of Things, Wearables and Consumer IoT, as well as (new) IoT's use in Vertical Markets.
I recently attended and was a speaker at the 4th International Internet of @ThingsExpo at the Santa Clara Convention Center. I also had the opportunity to attend this event last year and I wrote a blog from that show talking about how the “Enterprise Impact of IoT” was a key theme of last year’s show. I was curious to see if the same theme would still resonate 365 days later and what, if any, changes I would see in the content presented.
With major technology companies and startups seriously embracing IoT strategies, now is the perfect time to attend @ThingsExpo 2016 in New York and Silicon Valley. Learn what is going on, contribute to the discussions, and ensure that your enterprise is as "IoT-Ready" as it can be! Internet of @ThingsExpo, taking place Nov 3-5, 2015, at the Santa Clara Convention Center in Santa Clara, CA, is co-located with 17th Cloud Expo and will feature technical sessions from a rock star conference faculty and the leading industry players in the world. The Internet of Things (IoT) is the most profound cha...
Apps and devices shouldn't stop working when there's limited or no network connectivity. Learn how to bring data stored in a cloud database to the edge of the network (and back again) whenever an Internet connection is available. In his session at 17th Cloud Expo, Ben Perlmutter, a Sales Engineer with IBM Cloudant, demonstrated techniques for replicating cloud databases with devices in order to build offline-first mobile or Internet of Things (IoT) apps that can provide a better, faster user experience, both offline and online. The focus of this talk was on IBM Cloudant, Apache CouchDB, and ...
The Internet of Things (IoT) is growing rapidly by extending current technologies, products and networks. By 2020, Cisco estimates there will be 50 billion connected devices. Gartner has forecast revenues of over $300 billion, just to IoT suppliers. Now is the time to figure out how you’ll make money – not just create innovative products. With hundreds of new products and companies jumping into the IoT fray every month, there’s no shortage of innovation. Despite this, McKinsey/VisionMobile data shows "less than 10 percent of IoT developers are making enough to support a reasonably sized team....
Being heavily entrenched in the Industrial Internet of Things (IIoT) and Machine-to-Machine (M2M) technology markets, I often have the opportunity to speak with customers, partners, and analysts about sensor-to-server communication and what technology advances are on the horizon that will benefit the industry. A few of the hot buttons right now are big data and predictive analytics. The idea of comparing data in motion (at the sensor level) to data at rest (in a big data server warehouse) with predictive analytics in the cloud is very appealing to many industrial customers. The problem the ...
SYS-CON Events announced today that Kintone has been named "Bronze Sponsor" of SYS-CON's 18th International Cloud Expo®, which will take place on June 7-9, 2016, at the Javits Center in New York City, NY. kintone promotes cloud-based workgroup productivity, transparency and profitability with a seamless collaboration space, build your own business application (BYOA) platform, and workflow automation system.
In his keynote at @ThingsExpo, Chris Matthieu, Director of IoT Engineering at Citrix and co-founder and CTO of Octoblu, focused on building an IoT platform and company. He provided a behind-the-scenes look at Octoblu’s platform, business, and pivots along the way (including the Citrix acquisition of Octoblu).
The Internet of Things is clearly many things: data collection and analytics, wearables, Smart Grids and Smart Cities, the Industrial Internet, and more. Cool platforms like Arduino, Raspberry Pi, Intel's Galileo and Edison, and a diverse world of sensors are making the IoT a great toy box for developers in all these areas. In this Power Panel at @ThingsExpo, moderated by Conference Chair Roger Strukhoff, panelists discussed what things are the most important, which will have the most profound effect on the world, and what should we expect to see over the next couple of years.
Internet of @ThingsExpo, taking place June 7-9, 2016 at Javits Center, New York City and Nov 1-3, 2016, at the Santa Clara Convention Center in Santa Clara, CA, is co-located with the 18th International @CloudExpo and will feature technical sessions from a rock star conference faculty and the leading industry players in the world and ThingsExpo New York Call for Papers is now open.
We are rapidly moving to a brave new world of interconnected smart homes, cars, offices and factories known as the Internet of Things (IoT). Sensors and monitoring devices will touch every part of our lives. Let's take a closer look at the Internet of Things. The Internet of Things is a worldwide network of objects and devices connected to the Internet. They are electronics, sensors, software and more. These objects connect to the Internet and can be controlled remotely via apps and programs. Because they can be accessed via the Internet, these devices create a tremendous opportunity to inte...
Two weeks ago (November 3-5), I attended the Cloud Expo Silicon Valley as a speaker, where I presented on the security and privacy due diligence requirements for cloud solutions. Cloud security is a topical issue for every CIO, CISO, and technology buyer. Decision-makers are always looking for insights on how to mitigate the security risks of implementing and using cloud solutions. Based on the presentation topics covered at the conference, as well as the general discussions heard between sessions, I wanted to share some of my observations on emerging trends. As cyber security serves as a fou...
Discussions of cloud computing have evolved in recent years from a focus on specific types of cloud, to a world of hybrid cloud, and to a world dominated by the APIs that make today's multi-cloud environments and hybrid clouds possible. In this Power Panel at 17th Cloud Expo, moderated by Conference Chair Roger Strukhoff, panelists addressed the importance of customers being able to use the specific technologies they need, through environments and ecosystems that expose their APIs to make true change and transformation possible.
Growth hacking is common for startups to make unheard-of progress in building their business. Career Hacks can help Geek Girls and those who support them (yes, that's you too, Dad!) to excel in this typically male-dominated world. Get ready to learn the facts: Is there a bias against women in the tech / developer communities? Why are women 50% of the workforce, but hold only 24% of the STEM or IT positions? Some beginnings of what to do about it! In her Day 2 Keynote at 17th Cloud Expo, Sandy Carter, IBM General Manager Cloud Ecosystem and Developers, and a Social Business Evangelist, wil...