Consumer IoT applications provide data about the user that just doesn’t exist in traditional PC or mobile web applications. This rich data, or “context,” enables the highly personalized consumer experiences that characterize many consumer IoT apps. This same data is also providing brands with unprecedented insight into how their connected products are being used, while, at the same time, powering highly targeted engagement and marketing opportunities.
In his session at @ThingsExpo, Nathan Trel...| By Wai Lam | Article Rating: |
|
| August 29, 2015 11:00 AM EDT | Reads: |
606 |
I am not sure how many people remember Cisco SANTap. About ten years ago, Cisco introduced a data tapping mechanism in the MDS 9000 fibre channel switches. The idea was to allow the data path to be "tapped" at-will. Tapping in this case meant using a mechanism in the switch to split the data being written from client hosts to the storage, allowing the identical "split" data to be routed through a second, separate path.
SANTap therefore allowed a copy of the data to be seamlessly "mirrored" through the switch and subsequently used by other applications for multiple purposes (especially for backup). It facilitated real-time protection of critical data, and allowed advanced functions such as migration, snapshots, etc.
It was a great idea. However while it might sound like a simple solution, the details were exceedingly complicated. Two considerations immediately reveal how convoluted such a seemingly simple proposition could become:
- Fibre channel SAN inevitably involves multipath. For a LUN to be protected, all paths involved must be tapped. None can be left out. When using high-availability, this means paths will also travel through another switch. Every bit of data from these paths through different switches must be tapped without missing a single command.
- The application or appliance that receives the data must be fast enough to receive real-time tapping. The smallest hiccup in data cannot be tolerated, since the tapping mechanism will not wait for the receiving application or appliance to "catch up," or client performance will be affected. When this happens, SANTap switches to error mode and tracks the changed data in a dirty data map. The appliance then has to perform recovery - meaning copy the missed data first - and get back in sync. Unfortunately, SANTap's primary design intent was for use with backup storage, and organizations rarely implement their highest-performing servers and devices in the backup space. It wasn't surprising then to see these applications and devices struggle with data ingress off the "tap" when administrators tried out this new technology.
These two real-world scenarios are just the tip of the iceberg when it comes to tapping data from SAN. The scope and complexity cannot be exaggerated, and it could be the reason why SANTap was not adopted pervasively by many vendors for their applications. The most recent material referencing the technology was from 2007, where EMC announced SANTap with RecoveryPoint.
Years ago when SANTap was at its infancy, while I was still in my previous company, I met with the Cisco engineering team working on SANTap and tried to persuade them to adjust certain aspects of the feature so we could integrate it into our own data protection product, which was perfect for SANTap. In fact we had already demonstrated a functional version, but were running into issues when many paths were tapped.
However that was another era at another time. For various inexplicable and non-technical reasons, the project just faded into oblivion. There were no other well-known products publicized that used SANTap. Nearly a decade later, the Holy Grail of seamless live data tapping from SAN remained elusive.
That is, until now. Newly available technologies allow third parties to build SANTap-like mechanisms.
Appliances which can tap live data with a Transparent Data Intercept technique have been developed that allow live insertion of interception points into the data path of fibre channel links. This technique is normally described as physical insertion by unplugging the storage or host ports, plugging that connection into the tapping appliances, and then connecting the appliance ports back to the switches. By doing this one link at a time, the data path can be intercepted transparently without downtime, and without any changes to the SAN environment.
This works extremely well. However, the same appliance can be inserted into the data paths without having to physically unplug cables. Using switches that support virtual SAN, such as most Cisco (vSAN) or Brocade (Virtual Fabric) switches, appliances with the Transparent Data Intercept capability can be simply plug into the switch ports, and tap into the data links. No changes to the original cable configuration are necessary.
This technique brought back the memory of SANTap. With an appliance and virtual SAN, this is exactly what it is - simply plug the appliances into the switches, then use virtual SAN to map into the links to be intercepted. Once inserted, the SAN environment is automatically discovered and organized by LUNs and hosts, and all detailed paths can be clearly identified, even across switches. All the related complexity can be hidden by clever software.
The implication is quite significant, if not earth-shattering. This means using this type of technology, after plugging the appliances into the switches and creating a few small virtual SANs, selected storage or host ports can be intercepted seamlessly. The entire SAN configuration can potentially be graphically illustrated. Individual LUNs can be selected and tapped, and the data can be migrated, or backed up for disaster recovery, periodically or continuously, local or remote. In addition, this process can enable cache, anti-virus, or even just SAN system health and performance analysis.
Through advanced Transparent Datapath Intercept technology, this tapping mechanism may soon be opened up via APIs for all storage solution developers to build their own applications - fulfilling the promise originally proposed by SANTap. One can only imagine what other great innovative products people can come up with once this interface is made available.
Come to think of it, maybe Cisco should adopt this and consider it as a "SANTap, redux"...
Published August 29, 2015 Reads 606
Copyright © 2015 SYS-CON Media, Inc. — All Rights Reserved.
Syndicated stories and blog feeds, all rights reserved by the author.
More Stories By Wai Lam
Wai Lam is co-founder and CTO of Cirrus Data Solutions (www.cdsi.us.com), a developer of Data Migration Server and Data Caching Server for storage area networks (SANs). He was previously CTO and VP of Engineering at FalconStor, a company he co-founded in 2000. There, he was the chief architect, holding 18 of 21 company patents. His inventions and innovations include many industry "firsts" in advanced storage virtualization, data protection, and disaster recovery. Wai received the prestigious China national "Top 1000 Technological Leaders" award in 2013
Consumer IoT applications provide data about the user that just doesn’t exist in traditional PC or mobile web applications. This rich data, or “context,” enables the highly personalized consumer experiences that characterize many consumer IoT apps. This same data is also providing brands with unprecedented insight into how their connected products are being used, while, at the same time, powering highly targeted engagement and marketing opportunities.
In his session at @ThingsExpo, Nathan Trel...Jan. 1, 2016 07:00 AM EST Reads: 651 |
By Elizabeth White Developing software for the Internet of Things (IoT) comes with its own set of challenges. Security, privacy, and unified standards are a few key issues. In addition, each IoT product is comprised of (at least) three separate application components: the software embedded in the device, the backend service, and the mobile application for the end user’s controls. Each component is developed by a different team, using different technologies and practices, and deployed to a different stack/target – ...Jan. 1, 2016 07:00 AM EST Reads: 143 |
By Liz McMillan The web app is agile. The REST API is agile. The testing and planning are agile. But alas, data infrastructures certainly are not. Once an application matures, changing the shape or indexing scheme of data often forces at best a top down planning exercise and at worst includes schema changes that force downtime. The time has come for a new approach that fundamentally advances the agility of distributed data infrastructures.
Learn about a new solution to the problems faced by software organizati...Jan. 1, 2016 07:00 AM EST Reads: 668 |
By Pat Romanski "In the DevOps area there are a lot of people looking to adopt more and new efficient processes and that's worked well for us and the technology we provide," explained Charles Kendrick, CTO and Chief Architect at Isomorphic Software, in this SYS-CON.tv interview at DevOps Summit, held November 3-5, 2015, at the Santa Clara Convention Center in Santa Clara, CA.Jan. 1, 2016 06:00 AM EST Reads: 349 |
By Elizabeth White "We are the first enterprise class data virtualization platform. We help organizations become more resilient in the area of backup disaster recovery," explained Chak Singamsetti, Senior Solutions Architect at Actifio, in this SYS-CON.tv interview at 17th Cloud Expo, held November 3-5, 2015, at the Santa Clara Convention Center in Santa Clara, CA.Jan. 1, 2016 05:45 AM EST Reads: 570 |
By Pat Romanski "There's a very common problem that the enterprise data industry hasn't solved yet - as companies add data and new features into their application they add new data stores that are specialized for those purposes and it becomes an operational nightmare to manage. We think we have an interesting angle on that," explained Dan Lynn, CEO of AgilData, in this SYS-CON.tv interview at 17th Cloud Expo, held November 3-5, 2015, at the Santa Clara Convention Center in Santa Clara, CA.Jan. 1, 2016 05:00 AM EST Reads: 307 |
By Liz McMillan "Security starts very simply at home when you're on your PC. At DataClear we thought 'How do we make a secure desktop for people and for corporations,'" explained Tony Teora, CEO of DataClear, in this SYS-CON.tv interview at 17th Cloud Expo, held November 3-5, 2015, at the Santa Clara Convention Center in Santa Clara, CA.Jan. 1, 2016 05:00 AM EST Reads: 430 |
By Pat Romanski Containers have changed the mind of IT in DevOps. They enable developers to work with dev, test, stage and production environments identically. Containers provide the right abstraction for microservices and many cloud platforms have integrated them into deployment pipelines. DevOps and containers together help companies achieve their business goals faster and more effectively.
In his session at DevOps Summit, Ruslan Synytsky, CEO and Co-founder of Jelastic, reviewed the current landscape of De...Jan. 1, 2016 03:00 AM EST Reads: 410 |
By Liz McMillan "We've made it easy for customers that want to build their own cloud infrastructure by delivering a fully integrated software and hardware in a rack," explained Stefaan Vervaet, Director of Strategic Alliances at HGST, in this SYS-CON.tv interview at 17th Cloud Expo, held November 3-5, 2015, at the Santa Clara Convention Center in Santa Clara, CA.Jan. 1, 2016 02:45 AM EST Reads: 483 |
By Elizabeth White In their Live Hack” presentation at 17th Cloud Expo, Stephen Coty and Paul Fletcher, Chief Security Evangelists at Alert Logic, provided the audience with a chance to see a live demonstration of the common tools cyber attackers use to attack cloud and traditional IT systems.
This “Live Hack” used open source attack tools that are free and available for download by anybody. Attendees learned where to find and how to operate these tools for the purpose of testing their own IT infrastructure. The...Jan. 1, 2016 01:45 AM EST Reads: 701 |
By Elizabeth White As organizations shift towards IT-as-a-service models, the need for managing and protecting data residing across physical, virtual, and now cloud environments grows with it. CommVault can ensure protection and E-Discovery of your data – whether in a private cloud, a Service Provider delivered public cloud, or a hybrid cloud environment – across the heterogeneous enterprise.
In his session at 18th Cloud Expo, Randy De Meno, Chief Technologist - Windows Products and Microsoft Partnerships at Com...Jan. 1, 2016 12:15 AM EST Reads: 501 |
By Pat Romanski "IoT is really hitting its stride. The adoption rates are increasing and Vitria is in a good position to help people deliver on the value of IoT," explained Mike Houston, Marketing & Product Marketing Professional at Vitria Technology, in this SYS-CON.tv interview at @ThingsExpo, held November 3-5, 2015, at the Santa Clara Convention Center in Santa Clara, CA.Dec. 31, 2015 11:00 PM EST Reads: 486 |
By Liz McMillan Dec. 31, 2015 10:45 PM EST Reads: 660 |
By Liz McMillan An edge gateway is an essential piece of infrastructure for large scale cloud-based services.
In his session at 17th Cloud Expo, Mikey Cohen, Manager, Edge Gateway at Netflix, detailed the purpose, benefits and use cases for an edge gateway to provide security, traffic management and cloud cross region resiliency. He discussed how a gateway can be used to enhance continuous deployment and help testing of new service versions and get service insights and more. Philosophical and architectural ap...Dec. 31, 2015 10:00 PM EST Reads: 607 |
By Elizabeth White Dec. 31, 2015 09:45 PM EST Reads: 623 |
By Liz McMillan Dec. 31, 2015 08:15 PM EST Reads: 569 |
By Pat Romanski "IoT is going to be a huge industry with a lot of value for end users, for industries, for consumers, for manufacturers. How can we use cloud to effectively manage IoT applications," stated Ian Khan, Innovation & Marketing Manager at Solgeniakhela, in this SYS-CON.tv interview at @ThingsExpo, held November 3-5, 2015, at the Santa Clara Convention Center in Santa Clara, CA.Dec. 31, 2015 08:15 PM EST Reads: 441 |
By Pat Romanski "Open source is a very powerful thing and lies at the heart of most modern technology. It's useful to a lot of people and a lot of companies invest in it," stated Alex Gorbachev, President of Intelligent Systems Services Inc., in this SYS-CON.tv interview at 17th Cloud Expo, held November 3-5, 2015, at the Santa Clara Convention Center in Santa Clara, CA.Dec. 31, 2015 07:00 PM EST Reads: 519 |
By Aruna Ravichandran At year-end, we often consider where we’ve fallen short over the last twelve months – and how we can do better over the next twelve. For IT leaders, DevOps is likely to be a primary concern for 2016. As application awesomeness becomes more important to the business, IT must get great code into production faster. DevOps success is thus imperative – especially if you’re competing against digital-first market disrupters.
DevOps, though, isn’t just about engineering better processes. It’s also abou...Dec. 31, 2015 07:00 PM EST Reads: 459 |
By Liz McMillan This video highlights IBM's capabilities for managing and optimizing hybrid cloud environments. Learn how to balance the needs of business with the needs of corporate IT departments. Now you can maximize speed while maintaining the ability to deploy complex applications quickly in a controlled and secure way across a variety of cloud implementations.Dec. 31, 2015 04:00 PM EST Reads: 517 |

Developing software for the Internet of Things (IoT) comes with its own set of challenges. Security, privacy, and unified standards are a few key issues. In addition, each IoT product is comprised of (at least) three separate application components: the software embedded in the device, the backend service, and the mobile application for the end user’s controls. Each component is developed by a different team, using different technologies and practices, and deployed to a different stack/target – ...
The web app is agile. The REST API is agile. The testing and planning are agile. But alas, data infrastructures certainly are not. Once an application matures, changing the shape or indexing scheme of data often forces at best a top down planning exercise and at worst includes schema changes that force downtime. The time has come for a new approach that fundamentally advances the agility of distributed data infrastructures.
Learn about a new solution to the problems faced by software organizati...
"In the DevOps area there are a lot of people looking to adopt more and new efficient processes and that's worked well for us and the technology we provide," explained Charles Kendrick, CTO and Chief Architect at Isomorphic Software, in this SYS-CON.tv interview at DevOps Summit, held November 3-5, 2015, at the Santa Clara Convention Center in Santa Clara, CA.
"We are the first enterprise class data virtualization platform. We help organizations become more resilient in the area of backup disaster recovery," explained Chak Singamsetti, Senior Solutions Architect at Actifio, in this SYS-CON.tv interview at 17th Cloud Expo, held November 3-5, 2015, at the Santa Clara Convention Center in Santa Clara, CA.
"There's a very common problem that the enterprise data industry hasn't solved yet - as companies add data and new features into their application they add new data stores that are specialized for those purposes and it becomes an operational nightmare to manage. We think we have an interesting angle on that," explained Dan Lynn, CEO of AgilData, in this SYS-CON.tv interview at 17th Cloud Expo, held November 3-5, 2015, at the Santa Clara Convention Center in Santa Clara, CA.
"Security starts very simply at home when you're on your PC. At DataClear we thought 'How do we make a secure desktop for people and for corporations,'" explained Tony Teora, CEO of DataClear, in this SYS-CON.tv interview at 17th Cloud Expo, held November 3-5, 2015, at the Santa Clara Convention Center in Santa Clara, CA.
Containers have changed the mind of IT in DevOps. They enable developers to work with dev, test, stage and production environments identically. Containers provide the right abstraction for microservices and many cloud platforms have integrated them into deployment pipelines. DevOps and containers together help companies achieve their business goals faster and more effectively.
In his session at DevOps Summit, Ruslan Synytsky, CEO and Co-founder of Jelastic, reviewed the current landscape of De...
"We've made it easy for customers that want to build their own cloud infrastructure by delivering a fully integrated software and hardware in a rack," explained Stefaan Vervaet, Director of Strategic Alliances at HGST, in this SYS-CON.tv interview at 17th Cloud Expo, held November 3-5, 2015, at the Santa Clara Convention Center in Santa Clara, CA.
In their Live Hack” presentation at 17th Cloud Expo, Stephen Coty and Paul Fletcher, Chief Security Evangelists at Alert Logic, provided the audience with a chance to see a live demonstration of the common tools cyber attackers use to attack cloud and traditional IT systems.
This “Live Hack” used open source attack tools that are free and available for download by anybody. Attendees learned where to find and how to operate these tools for the purpose of testing their own IT infrastructure. The...
As organizations shift towards IT-as-a-service models, the need for managing and protecting data residing across physical, virtual, and now cloud environments grows with it. CommVault can ensure protection and E-Discovery of your data – whether in a private cloud, a Service Provider delivered public cloud, or a hybrid cloud environment – across the heterogeneous enterprise.
In his session at 18th Cloud Expo, Randy De Meno, Chief Technologist - Windows Products and Microsoft Partnerships at Com...
"IoT is really hitting its stride. The adoption rates are increasing and Vitria is in a good position to help people deliver on the value of IoT," explained Mike Houston, Marketing & Product Marketing Professional at Vitria Technology, in this SYS-CON.tv interview at @ThingsExpo, held November 3-5, 2015, at the Santa Clara Convention Center in Santa Clara, CA.
An edge gateway is an essential piece of infrastructure for large scale cloud-based services.
In his session at 17th Cloud Expo, Mikey Cohen, Manager, Edge Gateway at Netflix, detailed the purpose, benefits and use cases for an edge gateway to provide security, traffic management and cloud cross region resiliency. He discussed how a gateway can be used to enhance continuous deployment and help testing of new service versions and get service insights and more. Philosophical and architectural ap...
"IoT is going to be a huge industry with a lot of value for end users, for industries, for consumers, for manufacturers. How can we use cloud to effectively manage IoT applications," stated Ian Khan, Innovation & Marketing Manager at Solgeniakhela, in this SYS-CON.tv interview at @ThingsExpo, held November 3-5, 2015, at the Santa Clara Convention Center in Santa Clara, CA.
"Open source is a very powerful thing and lies at the heart of most modern technology. It's useful to a lot of people and a lot of companies invest in it," stated Alex Gorbachev, President of Intelligent Systems Services Inc., in this SYS-CON.tv interview at 17th Cloud Expo, held November 3-5, 2015, at the Santa Clara Convention Center in Santa Clara, CA.
At year-end, we often consider where we’ve fallen short over the last twelve months – and how we can do better over the next twelve. For IT leaders, DevOps is likely to be a primary concern for 2016. As application awesomeness becomes more important to the business, IT must get great code into production faster. DevOps success is thus imperative – especially if you’re competing against digital-first market disrupters.
DevOps, though, isn’t just about engineering better processes. It’s also abou...
This video highlights IBM's capabilities for managing and optimizing hybrid cloud environments. Learn how to balance the needs of business with the needs of corporate IT departments. Now you can maximize speed while maintaining the ability to deploy complex applications quickly in a controlled and secure way across a variety of cloud implementations.
"We specialize is business process automation and our focus today is the Internet of Things and we are promoting a platform called Connect2me," stated Yasser Khan, Founder of Plasma, in this SYS-CON.tv interview at @ThingsExpo, held November 3-5, 2015, at the Santa Clara Convention Center in Santa Clara, CA.
The relentless doubling of compute horsepower every 18 - 24 months known as Moore’s Law is one of the trends that has shaped the IT industry. Machine virtualization and cloud computing have combined to reduce the time it takes to create a new machine that harnesses the latest in computing power to nearly zero. These mammoth forces plus a bit of application developer productivity have resulted in a huge explosion in the number of machines running applications over the past 10 to 15 years.
The benefits of staying current and adopting the latest foundational technologies are undeniable. Faster c...
Collaboration is a big focus area among technology start-ups. The past five years have seen a range of new products in this area that have completely transformed the way businesses work. Thanks to the likes of Trello and Slack, team members do not even have to live in the same city or even country any longer. Start-ups like Zapier operate with a completely remote workforce thanks to these telecommuting tools.
While these tools help with keeping team members updated on the status of various tasks and work well as project management tools, they do not actually help with decision making and st...
IoT is the next development of how the Internet is applied to the world. TAM for M2M/IoT is estimated at $19 trillion. The IoT device count is in the billions but will not traverse the service providers’ networks. Service providers and vendors are struggling to understand how to map the TAM dollars to real use cases, optimal technology approaches, and profitable business models.
In his session at @ThingsExpo, Dennis Ward, IoT analyst, strategist at DWE, focused on the SP transformations that will occur. In Phase I SP infrastructure virtualization. In Phase II SPs will focus on monetization. ...
The Internet of Things (IoT) continues to be a major topic of discussion in the tech industry. Many people want to know: how is the IoT influencing me already? That’s one of the themes of this week’s conversation between Electric Cloud CTO Anders Wallgren and Software Engineering Daily Host Jeff Meyerson.
IoT continues to grow, with the proliferation of smart homes, wearables, smart cars, mHealth devices and more. For example, new cars today come pre-wired with hundreds of millions of lines of code already, and much of the embedded software is already connected to the Internet. This always-on...
The rise of cloud-based infrastructure was one of the biggest developments in IT during the past few years, and now we are seeing extensive innovations in cloud security as well. More companies are moving their business-critical data away from onsite data centers and into cloud-based infrastructure. With that in mind, 2016 is going to be another dynamic year for cloud security, as more users and IT teams will be looking for ways to enhance their cloud security while achieving heightened visibility of their cloud-based IT assets. The migration of business workloads to the cloud brings many bene...
Data has changed our world.. From our cars, homes, pets, and even our own bodies, data has opened our eyes to behavior patterns and allowed us to catch on to small issues before they become bigger problems. This phenomenon has made huge waves in the healthcare industry, including reducing operational costs, improving independent living, and increasing early detection of diseases. With the wildfire set by the Internet of Things, healthcare data from wearables and other mHealth devices are helping patients take a more informed and active role in their healthcare, and give doctors more insight in...
Many of the technologies we use in our personal and professional lives every day are changing at a very rapid pace. So, do you try to keep up and if so, how? Simple. You let go. Firms often hold on to out of date technology because of the switching costs, insecurity about the best tech choice, lack of expertise, and a host of other reasons. In staying married to old technologies, firms make switching more and more difficult. One of the most pervasive technology trends where this phenomena can be seen is in the conversion from internally maintained servers to cloud hosted servers.
2015 has been a busy year for us at Electric Cloud, as we continue to innovate on the Product front to transform the way organizations deliver software to market.
2015 saw the launch of ElectricFlow Deploy - the industry's most powerful deploy automation and ARA solution, soon followed by ElectricFlow Release - which provides DevOps teams across the organization an easy way to coordinate software releases, enabling a clear, intuitive, view of your Path to Production and the state of your Release at any given time.
Enterprises can achieve rigorous IT security as well as improved DevOps practices and Cloud economics by taking a new, cloud-native approach to application delivery. Because the attack surface for cloud applications is dramatically different than for highly controlled data centers, a disciplined and multi-layered approach that spans all of your processes, staff, vendors and technologies is required. This may sound expensive and time consuming to achieve as you plan how to move selected applications to the cloud, but smart organizations are actually reporting an improved security posture, accel...
We thought it’d be fun to offer a look back at some of 2015’s biggest performance testing stories. Or in some cases, maybe all that was tested was our patience. Either way, here’s a quick trip down memory lane.
Here we are - just a day away from 2016. It's hard to believe the year is over.
It's even harder to believe everything that happened this year. If you build and test software you probably powered through a ton during these past 12 months, to the point where you can't even understand where the time went. Yet if you pick your head up and think about all that's transpired, you might be s...
Although corporate giants realized the danger of cyber attacks and cyber crime in general, especially after attacks on Sony and Zappos, as well as the very sensitive data breach that struck Ashley Madison website, small businesses still don't do much for making their networks more secure.
Statistics say that more than half of all small businesses in the US don't provide security training for their employees, only one quarter conduct outside party security tests, and more than 40% don't produce backup copies of their most important business files, in case something goes wrong.
It's never easy to predict the future. But if you want to plan for the future, you need to keep an eye on what's coming next.
This month, we reached out to people from different areas of the software industry to get their thoughts on what to expect in 2016.
From DevOps to automation, security, and open API - these experts discuss new and continuing developments, changes, and trends that will impact that software industry in 2016.
Here are thirteen software industry predictions.
It’s a given that employee access to corporate systems should be both as secure and simple as possible. However, time-strapped CIOs under pressure from demanding staff and challenged with authenticating users all over the world on multiple devices, have been torn between relying on the fatally flawed password or hard token two-factor authentication (2FA) approach to keep their systems secure. As a result, adaptive authentication has gained popularity as it reduces the time it takes to login by verifying a user based on their location





















