iRise has launched iRise 10.5, which broadens the ability to integrate iRise’s advanced product definition capabilities into the rest of the application development lifecycle, allowing artifacts to be visible and consumable in tools used later in the software development process.
iRise takes you from sketch to realistic prototype-for desktop, mobile or wearable apps-in minutes. The 10.5 release brings more features to the cloud version, and expands integrations with leading ALM tools. (Photo: Business Wire)
The Agile and DevOps movements have made strides in streamlining the process of...| By Mohamed El-Refaey | Article Rating: |
|
| July 15, 2015 10:15 AM EDT | Reads: |
218 |
This post is the first in a series of blog posts that will explore and exploit the Big Data and analytics tools. I will walk through easy steps to start working with such tools like Apache Hadoop, Pig, Mahout and solve some problems related to analytics and learning in the large scale by exploiting such tools, and shed the light on some of the challenges we face while working with these tools.
1. Apache Hadoop
1.1 Overview
Hadoop is a framework that simplifies the processing of data sets distributed across clusters of servers. Two of the main components of Hadoop are HDFS and MapReduce.HDFS is the file system that is used by Hadoop to store all the data. This file system spans across all the nodes that are being used by Hadoop. These nodes could be on a single server or they can be spread across a large number of servers.In this section, we will go through the instruction of how to get the Hadoop up and running with the configurations needed to make it useful for other components/frameworks that integrate or depends on Hadoop (e.g. Hive, Pig, HBase etc.).
Note: The installation will be a Pseudo distribution.
1.2 Tools and Versions
I've used the following tools and versions throughout this installation:
- Ubuntu 14.04 LTS
- Java 1.7.0_65 (java-7-openjdk-amd64)
- Hadoop 2.5.1
1.3 Installation and Configurations
1. Install Java using the following command:
| apt-get update apt-get install default-jdk |
2. Create Security Keys using the following commands:
| ssh-keygen -t rsa -P ' ' cat ~/.ssh/id_rsa.pub >> ~/.ssh/authorized_keys |
3. Download Hadoop tar file using:
| wget http://www.webhostingreviewjam.com/mirror/apache/hadoop/common/hadoop-2.5.1/hadoop-2.5.1.tar.gz |
4. Extract the tar file using:
| tar -xzvf hadoop-2.5.1.tar.gz |
5. Move the extracted files into a location you can easily recognize, and easily change the version used without much modifications using:
| mv hadoop-2.5.1/ /usr/local/hadoop |
6. Configure the following environment variables in the bashrc file (to make sure every time they are set with the machine sartup):
| #HADOOP VARIABLES START export JAVA_HOME=/usr/lib/jvm/java-7-openjdk-amd64 export HADOOP_INSTALL=/usr/local/hadoop export PATH=$PATH:$HADOOP_INSTALL/bin export PATH=$PATH:$HADOOP_INSTALL/sbin export HADOOP_MAPRED_HOME=$HADOOP_INSTALL export HADOOP_COMMON_HOME=$HADOOP_INSTALL export HADOOP_HDFS_HOME=$HADOOP_INSTALL export YARN_HOME=$HADOOP_INSTALL export HADOOP_COMMON_LIB_NATIVE_DIR=$HADOOP_INSTALL/lib/native export HADOOP_OPTS="-Djava.library.path=$HADOOP_INSTALL/lib" #HADOOP VARIABLES END |
7. Source the bashrc file after changes, for the system to recognize the changes using the following command:
| source ~/.bashrc |
8. Edit the Hadoop-env.sh using vim:
| vim /usr/local/hadoop/etc/hadoop/hadoop-env.sh |
The hadoop-env.sh file should look like this: That will make the value of the JAVA_HOME always available to Hadoop whenever it starts. |
9- Edit the core-site.xml file using vim as well:
| vim /usr/local/hadoop/etc/hadoop/core-site.xml |
The file will look like:![]() |
10- Edit the YARN file yarn-site.xml as follows:
| vim /usr/local/hadoop/etc/hadoop/yarn-site.xml |
The file will look like:![]() |
11. Create and edit the mapred-site.xml file:
| vim /usr/local/hadoop/etc/hadoop/mapred-site.xml |
The file will contains the following property, that specify which framework will be used for MapReduce: |
12. Edit the hdfs-site.xml file, in order to specify the directories that will be used as datanode and namenode on that server.
13.Forma t the new Hadoop file system using the following command:
| hdfs namenode -format Note: This operation needs to be done once before we start using Hadoop. If it is executed again after Hadoop has been used, it'll destroy all the data on the Hadoop filesystem. |
14. Now, all configurations are done, we can start using Hadoop, we should first run the following shell scripts:
| start-dfs.sh start-yarn.sh |
And to make sure everything is okay, and the right process is running, run the command jps and see the following: |
15- We can run MapReduce examples that exist in Hadoop bundle, but we need to run the following:
| We should create the HDFS directories required to execute MapReduce jobs: hdfs dfs -mkdir /user hdfs dfs -mkdir /user/mohamed and copy the input files to be processed into the distributed filesystem: hdfs dfs -put {here is the path to the files to be copied} input |
16- We can check the web console for the resource manager, HDFS nodes and running jobs as shown in the following screens:

Issues and problems:
I've experienced some issues related to: Ø Formatting the HDFS, and I resolved it by changing permissions and ownership of the user who can format the namenode and datanode. Ø Problem connecting to the resource manager, with the following error: ipc.Client: Retrying connect to server:
0.0.0.0/0.0.0.0:8032. Already tried 0 time(s); maxRetries=45
INFO client.RMProxy: Connecting to ResourceManager at /0.0.0.0:8032 And I resolved it by: adding a few properties to yarn-site.xml :
We reached to the end of our first post on big data and analytics, hope you enjoyed reading it and experiminting with Hadoop installation and configuration. next post will be about Apache Pig.
Read the original blog entry...
Published July 15, 2015 Reads 218
Copyright © 2015 SYS-CON Media, Inc. — All Rights Reserved.
Syndicated stories and blog feeds, all rights reserved by the author.
More Stories By Mohamed El-Refaey
Work as head of research and development at EDC (Egypt Development Center) a member of NTG. previously worked for Qlayer, Acquired by (Sun Microsystems), when my passion about cloud computing domain started. with more than 10 years of experience in software design and development in e-commerce, BPM, EAI, Web 2.0, Banking applications, financial market, Java and J2EE. HIPAA, SOX, BPEL and SOA, and late two year focusing on virtualization technology and cloud computing in studies, technical papers and researches, and international group participation and events. I've been awarded in recognition of innovation and thought leadership while working as IT Specialist at EDS (an HP Company). Also a member of the Cloud Computing Interoperability Forum (CCIF) and member of the UCI (Unified Cloud Interface) open source project, in which he contributed with the project architecture.
iRise has launched iRise 10.5, which broadens the ability to integrate iRise’s advanced product definition capabilities into the rest of the application development lifecycle, allowing artifacts to be visible and consumable in tools used later in the software development process.
iRise takes you from sketch to realistic prototype-for desktop, mobile or wearable apps-in minutes. The 10.5 release brings more features to the cloud version, and expands integrations with leading ALM tools. (Photo: Business Wire)
The Agile and DevOps movements have made strides in streamlining the process of...Sep. 16, 2015 12:00 PM EDT |
By Elizabeth White SYS-CON Events has announced today that Roger Strukhoff has been named conference chair of Cloud Expo and @ThingsExpo 2015 Silicon Valley.
The 17th Cloud Expo and 4th @ThingsExpo will take place on November 3-5, 2015, at the Santa Clara Convention Center in Santa Clara, CA.
"The Internet of Things brings trillions of dollars of opportunity to developers and enterprise IT, no matter how you measure it," stated Roger Strukhoff. "More importantly, it leverages the power of devices and the Internet to enable us all to improve the state of the world and lives of people."Sep. 16, 2015 11:00 AM EDT Reads: 258 |
By Elizabeth White Using code to define your infrastructure is a trend that is quickly becoming common practice and a critical part of any successful deployment
In his session at 17th Cloud Expo, Christopher Gallo, Developer Advocate at SoftLayer, an IBM Company, will discuss what it means to be powered by SoftLayer, and some really awesome tools to help you make your deployments agile.Sep. 16, 2015 10:45 AM EDT Reads: 415 |
By Pat Romanski WebRTC is about the data channel as much as about video and audio conferencing. However, basically all commercial WebRTC applications have been built with a focus on audio and video. The handling of “data” has been limited to text chat and file download – all other data sharing seems to end with screensharing. What is holding back a more intensive use of peer-to-peer data?
In her session at @ThingsExpo, Dr Silvia Pfeiffer, WebRTC Applications Team Lead at National ICT Australia, will look at different existing uses of peer-to-peer data sharing and how it can become useful in a live session to...Sep. 16, 2015 10:00 AM EDT Reads: 207 |
By Pat Romanski Cloud Expo is the single show where delegates and technology vendors can meet to experience and discuss the entire world of the cloud.At 16th Cloud Expo in New York City, Sandy Carter keynoted on women in tech and why women need to take risks and embrace failure to give them the courage to crash through the glass ceiling. She now shares some of her own thoughts and experiences from Cloud Expo.Sep. 16, 2015 10:00 AM EDT Reads: 158 |
By Pat Romanski The Internet of Things is in the early stages of mainstream deployment but it promises to unlock value and rapidly transform how organizations manage, operationalize, and monetize their assets. IoT is a complex structure of hardware, sensors, applications, analytics and devices that need to be able to communicate geographically and across all functions. Once the data is collected from numerous endpoints, the challenge then becomes converting it into actionable insight.Sep. 16, 2015 09:45 AM EDT Reads: 367 |
By Pat Romanski SYS-CON Events announced today that HPM Networks will exhibit at the 17th International Cloud Expo®, which will take place on November 3–5, 2015, at the Santa Clara Convention Center in Santa Clara, CA.
For 20 years, HPM Networks has been integrating technology solutions that solve complex business challenges. HPM Networks has designed solutions for both SMB and enterprise customers throughout the San Francisco Bay Area.Sep. 16, 2015 09:45 AM EDT Reads: 1,159 |
By Pat Romanski With the Apple Watch making its way onto wrists all over the world, it’s only a matter of time before it becomes a staple in the workplace. In fact, Forrester reported that 68 percent of technology and business decision-makers characterize wearables as a top priority for 2015. Recognizing their business value early on, FinancialForce.com was the first to bring ERP to wearables, helping streamline communication across front and back office functions.
In his session at @ThingsExpo, Kevin Roberts, GM of Platform at FinancialForce.com, will discuss the value of business applications on wearable ...Sep. 16, 2015 08:45 AM EDT Reads: 433 |
By Carmen Gonzalez Sep. 16, 2015 08:30 AM EDT Reads: 1,861 |
By Elizabeth White Cloudian, Inc., has released Cloudian HyperStore ‘forever live’ FL3000 series arrays and HyperStore 5.2 software. The new appliances, which can start small and scale up to 3.8 petabytes of storage in a single data center rack, offer businesses the ability to scale with the demands of the business, from terabytes to hundreds of petabytes.Sep. 16, 2015 08:30 AM EDT Reads: 305 |
By Carmen Gonzalez Sep. 16, 2015 06:00 AM EDT Reads: 2,272 |
By Elizabeth White While many app developers are comfortable building apps for the smartphone, there is a whole new world out there.
In his session at @ThingsExpo, Narayan Sainaney, Co-founder and CTO of Mojio, will discuss how the business case for connected car apps is growing and, with open platform companies having already done the heavy lifting, there really is no barrier to entry.Sep. 16, 2015 04:00 AM EDT Reads: 409 |
By Elizabeth White WebRTC services have already permeated corporate communications in the form of videoconferencing solutions. However, WebRTC has the potential of going beyond and catalyzing a new class of services providing more than calls with capabilities such as mass-scale real-time media broadcasting, enriched and augmented video, person-to-machine and machine-to-machine communications.
In his session at @ThingsExpo, Luis Lopez, CEO of Kurento, will introduce the technologies required for implementing these ideas and some early experiments performed in the Kurento open source software community in areas ...Sep. 16, 2015 03:00 AM EDT Reads: 413 |
By Liz McMillan Sep. 16, 2015 12:45 AM EDT Reads: 291 |
By Carmen Gonzalez The 17th International Cloud Expo has announced that its Call for Papers is open. 17th International Cloud Expo, to be held November 3-5, 2015, at the Santa Clara Convention Center in Santa Clara, CA, brings together Cloud Computing, APM, APIs, Microservices, Security, Big Data, Internet of Things, DevOps and WebRTC to one location.
With cloud computing driving a higher percentage of enterprise IT budgets every year, it becomes increasingly important to plant your flag in this fast-expanding business opportunity. Submit your speaking proposal today!Sep. 15, 2015 10:00 PM EDT Reads: 1,948 |
By Elizabeth White Akana has announced the availability of the new Akana Healthcare Solution. The API-driven solution helps healthcare organizations accelerate their transition to being secure, digitally interoperable businesses. It leverages the Health Level Seven International Fast Healthcare Interoperability Resources (HL7 FHIR) standard to enable broader business use of medical data. Akana developed the Healthcare Solution in response to healthcare businesses that want to increase electronic, multi-device access to health records while reducing operating costs and complying with government regulations. Sep. 15, 2015 09:30 PM EDT Reads: 583 |
By Liz McMillan As more intelligent IoT applications shift into gear, they’re merging into the ever-increasing traffic flow of the Internet. It won’t be long before we experience bottlenecks, as IoT traffic peaks during rush hours. Organizations that are unprepared will find themselves by the side of the road unable to cross back into the fast lane. As billions of new devices begin to communicate and exchange data – will your infrastructure be scalable enough to handle this new interconnected world? Sep. 15, 2015 08:00 PM EDT Reads: 511 |
By Elizabeth White Manufacturing connected IoT versions of traditional products requires more than multiple deep technology skills. It also requires a shift in mindset, to realize that connected, sensor-enabled “things” act more like services than what we usually think of as products.
In his session at @ThingsExpo, David Friedman, CEO and co-founder of Ayla Networks, will discuss how when sensors start generating detailed real-world data about products and how they’re being used, smart manufacturers can use the data to create additional revenue streams, such as improved warranties or premium features. Or slash...Sep. 15, 2015 06:00 PM EDT Reads: 409 |
By Pat Romanski SYS-CON Events announced today that Pythian, a global IT services company specializing in helping companies leverage disruptive technologies to optimize revenue-generating systems, has been named “Bronze Sponsor” of SYS-CON's 17th Cloud Expo, which will take place on November 3–5, 2015, at the Santa Clara Convention Center in Santa Clara, CA.
Founded in 1997, Pythian is a global IT services company that helps companies compete by adopting disruptive technologies such as cloud, Big Data, advanced analytics, and DevOps to advance innovation and increase agility. Specializing in designing, imple...Sep. 15, 2015 05:45 PM EDT Reads: 628 |
By Pat Romanski Sep. 15, 2015 03:15 PM EDT Reads: 883 |








SYS-CON Events has announced today that Roger Strukhoff has been named conference chair of Cloud Expo and @ThingsExpo 2015 Silicon Valley.
The 17th Cloud Expo and 4th @ThingsExpo will take place on November 3-5, 2015, at the Santa Clara Convention Center in Santa Clara, CA.
"The Internet of Things brings trillions of dollars of opportunity to developers and enterprise IT, no matter how you measure it," stated Roger Strukhoff. "More importantly, it leverages the power of devices and the Internet to enable us all to improve the state of the world and lives of people."
Using code to define your infrastructure is a trend that is quickly becoming common practice and a critical part of any successful deployment
In his session at 17th Cloud Expo, Christopher Gallo, Developer Advocate at SoftLayer, an IBM Company, will discuss what it means to be powered by SoftLayer, and some really awesome tools to help you make your deployments agile.
WebRTC is about the data channel as much as about video and audio conferencing. However, basically all commercial WebRTC applications have been built with a focus on audio and video. The handling of “data” has been limited to text chat and file download – all other data sharing seems to end with screensharing. What is holding back a more intensive use of peer-to-peer data?
In her session at @ThingsExpo, Dr Silvia Pfeiffer, WebRTC Applications Team Lead at National ICT Australia, will look at different existing uses of peer-to-peer data sharing and how it can become useful in a live session to...
Cloud Expo is the single show where delegates and technology vendors can meet to experience and discuss the entire world of the cloud.At 16th Cloud Expo in New York City, Sandy Carter keynoted on women in tech and why women need to take risks and embrace failure to give them the courage to crash through the glass ceiling. She now shares some of her own thoughts and experiences from Cloud Expo.
The Internet of Things is in the early stages of mainstream deployment but it promises to unlock value and rapidly transform how organizations manage, operationalize, and monetize their assets. IoT is a complex structure of hardware, sensors, applications, analytics and devices that need to be able to communicate geographically and across all functions. Once the data is collected from numerous endpoints, the challenge then becomes converting it into actionable insight.
SYS-CON Events announced today that HPM Networks will exhibit at the 17th International Cloud Expo®, which will take place on November 3–5, 2015, at the Santa Clara Convention Center in Santa Clara, CA.
For 20 years, HPM Networks has been integrating technology solutions that solve complex business challenges. HPM Networks has designed solutions for both SMB and enterprise customers throughout the San Francisco Bay Area.
With the Apple Watch making its way onto wrists all over the world, it’s only a matter of time before it becomes a staple in the workplace. In fact, Forrester reported that 68 percent of technology and business decision-makers characterize wearables as a top priority for 2015. Recognizing their business value early on, FinancialForce.com was the first to bring ERP to wearables, helping streamline communication across front and back office functions.
In his session at @ThingsExpo, Kevin Roberts, GM of Platform at FinancialForce.com, will discuss the value of business applications on wearable ...
Cloudian, Inc., has released Cloudian HyperStore ‘forever live’ FL3000 series arrays and HyperStore 5.2 software. The new appliances, which can start small and scale up to 3.8 petabytes of storage in a single data center rack, offer businesses the ability to scale with the demands of the business, from terabytes to hundreds of petabytes.
While many app developers are comfortable building apps for the smartphone, there is a whole new world out there.
In his session at @ThingsExpo, Narayan Sainaney, Co-founder and CTO of Mojio, will discuss how the business case for connected car apps is growing and, with open platform companies having already done the heavy lifting, there really is no barrier to entry.
WebRTC services have already permeated corporate communications in the form of videoconferencing solutions. However, WebRTC has the potential of going beyond and catalyzing a new class of services providing more than calls with capabilities such as mass-scale real-time media broadcasting, enriched and augmented video, person-to-machine and machine-to-machine communications.
In his session at @ThingsExpo, Luis Lopez, CEO of Kurento, will introduce the technologies required for implementing these ideas and some early experiments performed in the Kurento open source software community in areas ...
The 17th International Cloud Expo has announced that its Call for Papers is open. 17th International Cloud Expo, to be held November 3-5, 2015, at the Santa Clara Convention Center in Santa Clara, CA, brings together Cloud Computing, APM, APIs, Microservices, Security, Big Data, Internet of Things, DevOps and WebRTC to one location.
With cloud computing driving a higher percentage of enterprise IT budgets every year, it becomes increasingly important to plant your flag in this fast-expanding business opportunity. Submit your speaking proposal today!
Akana has announced the availability of the new Akana Healthcare Solution. The API-driven solution helps healthcare organizations accelerate their transition to being secure, digitally interoperable businesses. It leverages the Health Level Seven International Fast Healthcare Interoperability Resources (HL7 FHIR) standard to enable broader business use of medical data. Akana developed the Healthcare Solution in response to healthcare businesses that want to increase electronic, multi-device access to health records while reducing operating costs and complying with government regulations.
As more intelligent IoT applications shift into gear, they’re merging into the ever-increasing traffic flow of the Internet. It won’t be long before we experience bottlenecks, as IoT traffic peaks during rush hours. Organizations that are unprepared will find themselves by the side of the road unable to cross back into the fast lane. As billions of new devices begin to communicate and exchange data – will your infrastructure be scalable enough to handle this new interconnected world?
Manufacturing connected IoT versions of traditional products requires more than multiple deep technology skills. It also requires a shift in mindset, to realize that connected, sensor-enabled “things” act more like services than what we usually think of as products.
In his session at @ThingsExpo, David Friedman, CEO and co-founder of Ayla Networks, will discuss how when sensors start generating detailed real-world data about products and how they’re being used, smart manufacturers can use the data to create additional revenue streams, such as improved warranties or premium features. Or slash...
SYS-CON Events announced today that Pythian, a global IT services company specializing in helping companies leverage disruptive technologies to optimize revenue-generating systems, has been named “Bronze Sponsor” of SYS-CON's 17th Cloud Expo, which will take place on November 3–5, 2015, at the Santa Clara Convention Center in Santa Clara, CA.
Founded in 1997, Pythian is a global IT services company that helps companies compete by adopting disruptive technologies such as cloud, Big Data, advanced analytics, and DevOps to advance innovation and increase agility. Specializing in designing, imple...
So you think you are a DevOps warrior, huh? Put your money (not really, it’s free) where your metrics are and prove it by taking The Ultimate DevOps Geek Quiz Challenge, sponsored by DevOps Summit. Battle through the set of tough questions created by industry thought leaders to earn your bragging rights and win some cool prizes.
The world of software is completely crazy about automation. Thanks perhaps to DevOps, if anything, the mania is increasing. Some companies are eliminating the tester role in favor of tools smiths with programming experience who can build frameworks; sometimes this is called "developer productivity." The language these companies use is one of replacement; of dropping humans in favor of the machine.
I'd like to suggest a different language: The language of compliment, where we recognize that test...
Since the first release of the Stacki Open Source project, it has seen the type of growth that one would expect of a cutting edge tool that makes operations lives easier. The number of active users continues to increase, as does the breadth of things they’re achieving with the world’s fastest open source Linux install tool. Several very prominent enterprises have joined the list of active users, and have asked for a range of enhancements. Stacki 2 incorporates many of these requests. More enterp...
“This is interesting—didn’t we see this same thing in the logs just before we crashed last time?” – an anonymous and somewhat embarrassed DevOps team member
Unfortunately the “same thing” is an obscure, otherwise uninteresting log entry, in a directory structure that’s rarely checked. More unfortunate is that the “last time” was two months ago, when their eCommerce site went down on Black Friday costing hundreds of thousands of dollars, and they had noticed this same entry but just now made the...
Now – that Node.js 4.0.0 was officially released – you may wonder what it delivers to you and if you should upgrade right away, or not. This post covers the most important changes you need to know, and some key implications you may have to take into account in making your decision.
The last few months were really exciting for the Node.js community.
At the start of this year Joyent Inc. handed over the project to the community around io.js, a fork of Node.js. Soon after that, it was decided tha...
In my last post I discussed where to start when it comes to addressing the software-driven enterprise challenge head on as we see each industry's "disruption day" draw closer. In my view, perhaps the biggest challenge for the established players of the day - in the industrial revolution it was the cottage industries, today it is the incumbents in virtually every market - is one of change management, and the skills required in the new world order.
In my previous articles on the history of DevOps, I outlined the following pillars of the DevOps methodology.
The fourth pillar is Collaboration. Collaboration is defined as: "working with others to do a task and to achieve shared goals."
In traditional separated organizations, there is not often collaboration between the design, development, testing (QA), and deployment (IT) functions that go with the application delivery lifecycle.
Puppet Labs is pleased to share the findings from our 2015 State of DevOps Survey. We have deepened our understanding of how DevOps enables IT performance and organizational performance, based on responses from more than 20,000 technical professionals we’ve surveyed over the past four years.
The 2015 State of DevOps Report reveals high-performing IT organizations deploy 30x more frequently with 200x shorter lead times. They have 60x fewer failures and recover 168x faster
A recent Wall Street Journal article discussed the challenges that online content publishers have in monetizing their content as more and more user traffic shifts to mobile devices from traditional desktop/laptop computers/browsers.
Data from Mary Meeker’s 2015 Internet trends report in particular shows that the time adult users in the US spend online per day on mobile is up 51%. And the article cites similar data showing that the time spent on mobile properties of certain publishers jumped 40%...
If your primary role within your organization is Operations, you likely realize the importance and significance of monitoring. The DevOps philosophy teaches us that measuring and collecting as much as possible is critical to not only the health of infrastructure, but it also plays a critical role in the architecting efforts of both software and hardware.
Jason Dixon of Librato knows this better than many and has made a career of helping others understand and implement the best tools and proce...
I’ve encountered this a few times in the field when chatting with fellow marketers, even the most mature marketing organizations have made these mistakes. We aspire for exponential growth and to do it, we’ve adopted agile practices to fail-fast, learn from our mistakes and quickly rebound with another marketing concept that could be “the next big thing.” However, when I ask marketers about what they’d do if they really accomplished virality and if their ordering systems, websites, sales teams, e...
I love all this digital hullaballoo, really I do. I love all these different trends and disruptions and turmoil. I especially love the confusion – it gives me something to write about.
But sometimes, I’ve just had enough. Especially when the digital disruption story starts repeating itself.
Information overload has infiltrated our lives. From the amount of news available and at our fingertips 24/7, to the endless choices we have when making a simple purchase, to the quantity of emails we receive on a given day, it’s increasingly difficult to sift out the details that really matter.
When you envision your cloud monitoring system, the same thinking applies. We receive a lot of useless data that gets fed into the system, and the reality is no one in IT or DevOps has the time to manu...
Even though you are running an agile development process, that doesn’t necessarily mean that your performance testing is being conducted in a truly agile way. Saving performance testing for a “final sprint” before release still treats it like a waterfall development step, with all the cost and risk that comes with that. In this post, we will show you how to make load testing happen early and often by putting SLAs on the agile task board.
TestPlant has released the results of its annual user survey, now in its fifth year.
Its 2014 survey revealed user experience as a top theme for test teams, but this year the focus is firmly on a shift happening among many companies who are actively integrating their quality assurance teams into the Agile development cycle. Agile has been mainstream in development teams for a few years now, but until recently, most test teams sat outside the Agile cycle. This lack of integration has for some t...
At Logentries, we feel strongly about the power of log data and the unparalleled role that logs can play in effective end-to-end system monitoring. Yet we feel it also important to recognize how other monitoring approaches can further supplement a log monitoring solution to provide even greater, actionable insight into system performance. One such approach is Application Performance Management (APM) and today we're excited to announce our first APM Community Pack.
Large organizations engaged in enterprise release management seldom have a single "enterprise release manager." Instead of a single, "enterprise-wide" responsibility, most large, decentralized organizations assign responsibility for more strategic, release management functions to several existing roles.
An enterprise release management practice supports and is supported by the following enterprise release management roles:
IT Portfolio Management - An efficient ERM practice provides portf...
Early in my DevOps Journey, I was introduced to a book of great significance circulating within the Web Operations industry titled The Phoenix Project.
(You can read our review of Gene’s book, if interested.)
Written as a novel and loosely based on many of the same principles explored in The Goal, this book has been read and referenced by many who have adopted DevOps into their continuous improvement and software delivery processes around the world.
As I began planning my travel schedule last...
This is the first DevOps book that shows a realistic and achievable view of the full implementation of DevOps. Most of the books and other literature I have read on DevOps are all about the culture, the attitudes, how it relates to Agile and Lean practices, and a high level view of microservices. This book includes all that, but they are not its main focus, and it goes several steps further with respect to the architecture and infrastructure needed for the implementation.






















