Click here to close now.



Welcome!

@DevOpsSummit Authors: Liz McMillan, Anders Wallgren, Automic Blog, Cloud Best Practices Network, Ramesh Ganapathy

Related Topics: Linux Containers, Containers Expo Blog, @DevOpsSummit

Linux Containers: Blog Post

How to Select a Test Automation Tool | @DevOpsSummit #APM #DevOps

A Test Automation tool along with its associated components are primarily responsible for communicating with AUT

A Test Automation Tool can play a big role in deciding success as well as effectiveness of Test Automation. Based on the growth in the device and browser matrix, it is not recommended to build test automation framework around a single tool; however, many organizations still continue to do so. It becomes even more important to choose right tool for your automation when test automation solution is built around a specific tool.

A Test Automation tool along with its associated components are primarily responsible for communicating with Application Under Test (AUT) and for passing the instructions of test automation scripts to AUT interface (UI or API) and get responses from the AUT interfaces. The tool is also responsible for verification of the AUT responses against expected results, logging of results and report generation. Other than these basic responsibilities, the test automation tool has enhanced features such as keyword driven scripting, robustness against failures / unexpected interrupts, informative dashboard which shows progress of test automation while executing, integration with test management tools, integration with continuous integration tools, etc.

Best way to approach selection of test automation tool is to do an elaborate Proof of Concept (POC) with AUT using the tool. Most complex test scenarios (e.g. boundary conditions, large test data volume scenarios, scenarios involving boundary conditions, etc.) should be put to automation using the tool.

More than one tools must be tried for the POC and the parameters such as

  • Browsers / Devices / OSs Matrix Support
  • Extension Features – Ability to integrate with Industry standard automation frameworks / components
  • Technology Support – Ability to support different programming languages
  • Possible test coverage of AUT
  • Community Support – Extent of available help documentation, active forums / discussions regarding the tool
  • Richness of tool development interface
  • Ability to integrate with (desired) test management tools
  • Ability to integrate with (desired) continuous integration tools
  • Licensing mode (SaaS Vs Perpetual Licensing, Node locked Vs. Floating Licenses)

As ever, the IT industry continues to evolve with different technologies and gadgets. Against popular Windows desktop based UI applications of 1990s, distributed web applications are now ubiquitous and eventually will be replaced by applications on small form factor (SFF) devices. Commercial tools with initial focus on UI automation of Windows desktop applications eventually evolved to support Web applications / Web Services and are trying to catch up with UI automation on SFF devices. Many open source / freeware tools and libraries, have become equally popular and successful in addressing test automation needs (e.g. Selenium, Microsoft UI Automation Libraries, White, Sikuli, Appium, Calabash, etc.)

Typical enterprise application under test (AUT) is likely to be comprised of Data layer, Services Layers and User Interface layer. At the data layer one has choices of SQL / NOSQL technologies. For data transport there are choices like XML vs. JSON vs. custom data structures. Also one may choose to hide / expose service (API) layer along with UI layer external users. UI layer itself needs to support leading browsers (IE, Firefox, Safari, Chrome, Opera) and mobile technologies like Android, iOS, Windows Phone, etc.

Most of the applications are likely to support all leading devices as well as browsers. It is going to be difficult for any single tool to be able to keep up with the pace at which this matrix is growing. Hence single tool cannot provide foolproof test automation solution against diverse platforms.

Recommended approach is to separate framework development activity from test automation tool selection activity. Test automation framework should be robust enough to accommodate multiple test automation tools, libraries for different test automation needs (e.g. UI testing, API testing, Volume testing, Performance testing, Vulnerability testing). Each tool selection can then undergo elaborate POC as described above and consequent integration with existing test automation framework.

The post How to Select Test Automation Tool appeared first on Software Testing Services Company - AFourTech.

Read the original blog entry...

More Stories By Mahesh Kulkarni

Mahesh A. Kulkarni is Managing Director and Principal Test Architect at AFour Technologies. He has over fifteen years of experience of software engineering .Since 1998 he has worked with SMEs as well as large scale ISVs and has contributed to software quality initiatives across diverse software systems. As a part of this he has built performance testing, test automation, security testing and functional testing teams at Pune, Bangalore, and Hyderabad. Mahesh holds engineering degree from BITS, Pilani.

@DevOpsSummit Stories
Overgrown applications have given way to modular applications, driven by the need to break larger problems into smaller problems. Similarly large monolithic development processes have been forced to be broken into smaller agile development cycles. Looking at trends in software development, microservices architectures meet the same demands. Additional benefits of microservices architectures are compartmentalization and a limited impact of service failure versus a complete software malfunction. The problem is there are a lot of moving parts in these designs; this makes assuring performance compl...
For it to be SOA – let alone SOA done right – we need to pin down just what "SOA done wrong" might be. First-generation SOA with Web Services and ESBs, perhaps? But then there's second-generation, REST-based SOA. More lightweight and cloud-friendly, but many REST-based SOA practices predate the microservices wave. Today, microservices and containers go hand in hand – only the details of "container-oriented architecture" are largely on the drawing board – and are not likely to look much like SOA in any case. In his session at 17th Cloud Expo, Jason Bloomberg, President of Intellyx, provided...
With containerization using Docker, the orchestration of containers using Kubernetes, the self-service model for provisioning your projects and applications and the workflows we built in OpenShift is the best in class Platform as a Service that enables introducing DevOps into your organization with ease. In his session at DevOps Summit, Veer Muchandi, PaaS evangelist with RedHat, provided a deep dive overview of OpenShift v3 and demonstrated how it helps with DevOps.
18th Cloud Expo, taking place June 7-9, 2016, at the Javits Center in New York City, NY, will feature technical sessions from a rock star conference faculty and the leading industry players in the world. Cloud computing is now being embraced by a majority of enterprises of all sizes. Yesterday's debate about public vs. private has transformed into the reality of hybrid cloud: a recent survey shows that 74% of enterprises have a hybrid cloud strategy. Meanwhile, 94% of enterprises are using some form of XaaS – software, platform, and infrastructure as a service.
In 2013, Codenvy was releasing its SaaS and on-premise products twice a month. This created fear and loathing between teams. In his session at @DevOpsSummit at 18th Cloud Expo, Tyler Jewell, founder and CEO of Codenvy, will discuss how the journey to continuous development transformed the way they created software with 30 releases a month. Join Tyler as he shares their journey and shows how they improved.
@DevOpsSummit taking place June 7-9, 2016 at Javits Center, New York City, and Nov 1-3, 2016, at the Santa Clara Convention Center in Santa Clara, CA, is co-located with the 18th International @CloudExpo and will feature technical sessions from a rock star conference faculty and the leading industry players in the world.
SYS-CON Events announced today that Fusion, a leading provider of cloud services, will exhibit at SYS-CON's 18th International Cloud Expo®, which will take place on June 7-9, 2016, at the Javits Center in New York City, NY. Fusion, a leading provider of integrated cloud solutions to small, medium and large businesses, is the industry's single source for the cloud. Fusion's advanced, proprietary cloud service platform enables the integration of leading edge solutions in the cloud, including cloud communications, cloud connectivity, and cloud computing. Fusion's innovative, yet proven cloud sol...
SYS-CON Events announced today that Interface Masters Technologies, a leading vendor in the network monitoring and high speed networking markets, will exhibit at the 18th International CloudExpo®, which will take place on June 7-9, 2016, at the Javits Center in New York City, New York, and the 19th International Cloud Expo, which will take place on November 1–3, 2016, at the Santa Clara Convention Center in Santa Clara, CA.
The Microservices architectural pattern promises increased DevOps agility and can help enable continuous delivery of software. This session is for developers who are transforming existing applications to cloud-native applications, or creating new microservices style applications. In his session at 17th Cloud Expo, Jim Bugwadia, CEO of Nirmata, introduced best practices, patterns, challenges, and solutions for the development and operations of microservices style applications. He discussed how application container solutions can be used to efficiently deploy and operate these applications in a...
SYS-CON Events announced today that eCube Systems, the leading provider of modern development tools and best practices for Continuous Integration on OpenVMS, will exhibit at SYS-CON's @DevOpsSummit at Cloud Expo New York, which will take place on June 7-9, 2016, at the Javits Center in New York City, NY. eCube Systems offers a family of middleware products and development tools that maximize return on technology investment by leveraging existing technical equity to meet evolving business needs. Fortune 1000 companies and government agencies turn to eCube Systems to reduce risk, extend ROI and...
DevOps has often been described in terms of CAMS: Culture, Automation, Measuring, Sharing. While we’ve seen a lot of focus on the “A” and even on the “M”, there are very few examples of why the “C" is equally important in the DevOps equation. In her session at @DevOps Summit, Lori MacVittie, of F5 Networks, explored HTTP/1 and HTTP/2 along with Microservices to illustrate why a collaborative culture between Dev, Ops, and the Network is critical to ensuring success.
NHK, Japan Broadcasting, will feature the upcoming @ThingsExpo Silicon Valley in a special 'Internet of Things' and smart technology documentary that will be filmed on the expo floor between November 3 to 5, 2015, in Santa Clara. NHK is the sole public TV network in Japan equivalent to the BBC in the UK and the largest in Asia with many award-winning science and technology programs. Japanese TV is producing a documentary about IoT and Smart technology and will be covering @ThingsExpo Silicon Valley. The program, to be aired during the peak viewership season of the year, will have a major impac...
@DevOpsSummit taking place June 7-9, 2016 at Javits Center, New York City, and Nov 1-3, 2016, at the Santa Clara Convention Center in Santa Clara, CA, is co-located with the 18th International @CloudExpo and will feature technical sessions from a rock star conference faculty and the leading industry players in the world. @DevOpsSummit at Cloud Expo New York Call for Papers is now open.
Whether you like it or not, DevOps is on track for a remarkable alliance with security. The SEC didn’t approve the merger. And your boss hasn’t heard anything about it. Yet, this unruly triumvirate will soon dominate and deliver DevSecOps faster, cheaper, better, and on an unprecedented scale. In his session at DevOps Summit, Frank Bunger, VP of Customer Success at ScriptRock, discussed how this cathartic moment will propel the DevOps movement from such stuff as dreams are made on to a practical, powerful, and insanely valuable asset to enterprises. You may call it DevSecOps, or SecDevOps, o...
The 18th International Cloud Expo has announced that its Call for Papers is open. Cloud Expo, to be held June 7-9, 2016, at the Javits Center in New York City, and Nov 1-3, 2016, at the Santa Clara Convention Center in Santa Clara, CA, brings together Cloud Computing, Big Data, Internet of Things, DevOps, Containers, Microservices and WebRTC to one location. With cloud computing driving a higher percentage of enterprise IT budgets every year, it becomes increasingly important to plant your flag in this fast-expanding business opportunity. Submit your speaking proposal today!
SYS-CON Events announced today that AppNeta, the leader in performance insight for business-critical web applications, will exhibit and present at SYS-CON's @DevOpsSummit at Cloud Expo New York, which will take place on June 7-9, 2016, at the Javits Center in New York City, NY. AppNeta is the only application performance monitoring (APM) company to provide solutions for all applications – applications you develop internally, business-critical SaaS applications you use and the networks that deliver them.
With 10 simultaneous tracks, keynotes, general sessions and targeted breakout classes, Cloud Expo and @ThingsExpo are two of the most important technology events of the year. Since its launch over eight years ago, Cloud Expo and @ThingsExpo have presented a rock star faculty as well as showcased hundreds of sponsors and exhibitors! In this blog post, I provide 7 tips on how, as part of our world-class faculty, you can deliver one of the most popular sessions at our events. But before reading these essential tips, please take a moment and watch this brief video from Sandy Carter.
Your business relies on your applications and your employees to stay in business. Whether you develop apps or manage business critical apps that help fuel your business, what happens when users experience sluggish performance? You and all technical teams across the organization – application, network, operations, among others, as well as, those outside the organization, like ISPs and third-party providers – are called in to solve the problem.
In his session at @DevOpsSummit at 18th Cloud Expo, Robert Doyle, Chief Technology Architect at eCube Systems, will examine the issues and need for an agile infrastructure and show the advantages of capturing developer knowledge in an exportable file for migration into production. He will introduce the use of NXTmonitor, a next generation DevOps tool that captures application environments, dependencies and start/stop procedures in a portable configuration file with an easy-to-use GUI. In addition to capturing configuration information between Development, Test and Production, the case study ...
CIOs and those charged with running IT Operations are challenged to deliver secure, audited, and reliable compute environments for the applications and data for the business. Behind the scenes these tasks are often accomplished by following onerous time-consuming processes and often the management of these environments and processes will be outsourced to multiple IT service providers. In addition, the division of work is often siloed into traditional "towers" that are not well integrated for cross-functional purposes. So, when traditional IT Service Management (ITSM) meets the cloud, and equal...
Actifio has announced its partnership with Camouflage Software Inc., a leading provider of solutions for data masking in Test Data Management. The partnership brings a best-in-class solution to address the challenges of data access, control, security, and storage costs in the test and development space. "Software is eating the world," as Marc Andreessen famously said in 2011. Since then, more and more industries have been transformed by software, to the point where the largest distributor of films has no theaters (Netflix,) the largest provider of delivery services has no cars (Uber,) the lar...
The best way to leverage your Cloud Expo presence as a sponsor and exhibitor is to plan your news announcements around our events. The press covering Cloud Expo and @ThingsExpo will have access to these releases and will amplify your news announcements. More than two dozen Cloud companies either set deals at our shows or have announced their mergers and acquisitions at Cloud Expo. Product announcements during our show provide your company with the most reach through our targeted audiences.
Developing software for the Internet of Things (IoT) comes with its own set of challenges. Security, privacy, and unified standards are a few key issues. In addition, each IoT product is comprised of (at least) three separate application components: the software embedded in the device, the backend service, and the mobile application for the end user’s controls. Each component is developed by a different team, using different technologies and practices, and deployed to a different stack/target – this makes the integration of these separate pipelines and the coordination of software updates for ...
How do you securely enable access to your applications in AWS without exposing any attack surfaces? The answer is usually very complicated because application environments morph over time in response to growing requirements from your employee base, your partners and your customers. In his session at DevOps Summit, Haseeb Budhani, co-founder and CEO of Soha, shared five common approaches that DevOps teams follow to secure access to applications deployed in AWS, Azure, etc., and the friction and risks they impose on the business.
Everyone talks about continuous integration and continuous delivery but those are just two ends of the pipeline. In the middle of DevOps is continuous testing (CT), and many organizations are struggling to implement continuous testing effectively. After all, without continuous testing there is no delivery. And Lab-As-A-Service (LaaS) enhances the CT with dynamic on-demand self-serve test topologies. CT together with LAAS make a powerful combination that perfectly serves complex software development and delivery pipelines. Software Defined Networks (SDNs) turns the network into a flexible confi...