Welcome!

@CloudExpo Authors: Liz McMillan, Elizabeth White, Pat Romanski, Miska Kaipiainen, Gregor Petri

Related Topics: Linux Containers, Open Source Cloud, Recurring Revenue, SAP HANA Cloud, @CloudExpo, Cloud Security, @BigDataExpo, OpenStack Journal, @ThingsExpo

Linux Containers: Article

IoT and #BigData – Who Owns All the Data? | @ThingsExpo #IoT #M2M #API

How many websites have you created accounts on?

Internet of Things and Big Data - Who Owns All the Data?

We've been doing it for years, decades for some. How many websites have you created accounts on? Your bank, your credit card companies, social media sites, hotels and travel sites, online shopping sites, and that's just the start. We do it often without even thinking about it, quickly entering our personal information, our data, in a plethora of systems. Sometimes we're not even aware of the information we are providing. It could be very personal information (think of the security questions you provide answers to for protecting your information on these systems), to information about your behavior, your interests (websites visited, internet search topics). While possibly concerning from a privacy perspective, you had some level of control. For the backend systems involved, the volume and variety of the data was a manageable situation. The tradeoff between privacy and convenience is something we, for the most part, found acceptable.

Not just about personal data
This is not a situation unique to consumers and personal data - businesses do the same thing. In order to conduct business with each other, businesses must share key information about themselves and their operations with their partners, such as key contacts within the organization, purchasing trends, locations, and shipping patterns of products. All the information that is needed by the business partners, yet is also an asset subject to privacy concerns within the business. As with our personal data, it is always a delicate balancing act of tradeoffs in order to be able to conduct business.

Then came mobile and Internet of Things
The game changed when the mobile revolution started, and continued with the explosion of the Internet of Things. Your mobile apps, along with all your ‘smart' devices that you wear (e.g., fitbit), are in your home (e.g., smart TVs, nest, smart appliances), or even your car, are sending massive amounts of disparate information out into the cloud. While the data packets for most devices tend to be small, there are a lot of devices. Gartner estimates that there will be over 20 billion ‘things' by 2020. To the sheer volume of devices, now add in the velocity of the data. These devices can be streaming a large variety information constantly. Your GPS location, house temperature, car speed, even your blood pressure. Sometimes we are aware, many times not.

The business-to-business side is not without impacts as well. RFID chips in inventory that is shipping between and through partner, smart manufacturing facilities, like smart homes, are providing huge volumes of information about their operation without even potentially realizing it.

Privacy & ownership vs the world
This is not a ‘the sky is falling' or the ‘world has my data' rant. I raise it to point out the impact of our data usage and consumption is in today's world of the ‘Internet of Everything.' I am reminded of a presentation I attended at a Gartner Symposium entitled ‘Privacy vs the World' presented by Heidi Wachs, a research director at Gartner. She raised the point that "the lines between social culture, corporate culture and regulation are blurred when it comes to privacy'." She asked the attendees, "How can organizations truly define privacy so that it is appropriately preserved?" The discussion revolved around the constant struggle and balancing of the business needs, convenience, and addressing privacy and security concerns of the users (or business partners) of the system. As many of you know, one of my favorite sayings is ‘Everything is a tradeoff.' The phrase was never truer than in our new world of Big Data and the Internet of Things. New uses and the data that is being collected appear at breakneck speeds, sometimes before we even understand the implications and tradeoffs involved.

Information is an asset
An added twist to this conundrum was raised in a recent article in The Atlantic. In the piece, the author raises the additional question, what happens to that data if the company storing it goes bust? Your personal information could be considered an asset of value that can be sold off, as what happened with Radio Shack.

While not discussed in the article, it raised another thought for me from a business-to-business perspective. What if my business partner is acquired by one of my competitors? Would it provide them insights into my operations, and help them possibly derive a competitive advantage with that information?

If data passes through your system, you have a responsibility
As technologists, we have a responsibility to help the business understand the tradeoffs and risks involved in this rapidly changing environment. We as humans, by nature, love to hoard things, and data is no different. We are accumulating large amounts of data as it passes through our systems. If it is in or passes through your system, you have a responsibility for ensuring the rules are followed. What level of privacy is needed/required/desired is fully dependent on the data itself. Not all data is created equal; some requires more privacy than others. Privacy and the security mechanisms needed to implement that privacy is not a once and done kind of thing; it's constantly evolving and changing. In the Gartner presentation I mentioned, Heidi asked a challenging question: "When a law enforcement agency comes asking for all that data you have been hoarding, what will you do?" It is better to be proactive and plan ahead than reactive when the situation occurs.

In this fast-paced, rapidly changing technology environment we live in today, we are providing and collecting huge amounts of data from an ever-increasing number of potential sources, whether they be mobiles, wearables, our vehicles, or any other of a myriad of sources we haven't even thought about. This data is traveling through the nebulous cloud environment we all love to talk about, and traveling through the ether to its final destination. Our challenge as technologists is to understand the implications, challenges, and tradeoffs involved in that world, and be able to articulate those to the business so that the proper balance between business needs, data ownership and privacy, convenience, et al, can be achieved.

It's a difficult and delicate balance. There is no one right answer, no one size fits all as to which tradeoffs are acceptable. Ultimately, that is a business decision, based on the goals and needs of the organization, and could change over time. It's walking a tightrope over a shark infested tank of water. Our job as technologists is to try and help the business understand the risks and tradeoffs so they can traverse that tightrope and get to the other side safely.

This post is sponsored by SAS and Big Data Forum.

More Stories By Ed Featherston

Ed Featherston is a director/senior enterprise architect at Collaborative Consulting. He brings 35 years of technology experience in designing, building, and implementing large complex solutions. He has significant expertise in systems integration, Internet/intranet, and cloud technologies. He has delivered projects in various industries, including financial services, pharmacy, government and retail.

Comments (0)

Share your thoughts on this story.

Add your comment
You must be signed in to add a comment. Sign-in | Register

In accordance with our Comment Policy, we encourage comments that are on topic, relevant and to-the-point. We will remove comments that include profanity, personal attacks, racial slurs, threats of violence, or other inappropriate material that violates our Terms and Conditions, and will block users who make repeated violations. We ask all readers to expect diversity of opinion and to treat one another with dignity and respect.


@CloudExpo Stories
SYS-CON Events announced today that SoftLayer, an IBM Company, has been named “Gold Sponsor” of SYS-CON's 18th Cloud Expo, which will take place on June 7-9, 2016, at the Javits Center in New York, New York. SoftLayer, an IBM Company, provides cloud infrastructure as a service from a growing number of data centers and network points of presence around the world. SoftLayer’s customers range from Web startups to global enterprises.
In his keynote at 19th Cloud Expo, Sheng Liang, co-founder and CEO of Rancher Labs, will discuss the technological advances and new business opportunities created by the rapid adoption of containers. With the success of Amazon Web Services (AWS) and various open source technologies used to build private clouds, cloud computing has become an essential component of IT strategy. However, users continue to face challenges in implementing clouds, as older technologies evolve and newer ones like Docke...
WebRTC is the future of browser-to-browser communications, and continues to make inroads into the traditional, difficult, plug-in web communications world. The 6th WebRTC Summit continues our tradition of delivering the latest and greatest presentations within the world of WebRTC. Topics include voice calling, video chat, P2P file sharing, and use cases that have already leveraged the power and convenience of WebRTC.
SYS-CON Events announced today that Pulzze Systems will exhibit at the 19th International Cloud Expo, which will take place on November 1–3, 2016, at the Santa Clara Convention Center in Santa Clara, CA. Pulzze Systems, Inc. provides infrastructure products for the Internet of Things to enable any connected device and system to carry out matched operations without programming. For more information, visit http://www.pulzzesystems.com.
IoT offers a value of almost $4 trillion to the manufacturing industry through platforms that can improve margins, optimize operations & drive high performance work teams. By using IoT technologies as a foundation, manufacturing customers are integrating worker safety with manufacturing systems, driving deep collaboration and utilizing analytics to exponentially increased per-unit margins. However, as Benoit Lheureux, the VP for Research at Gartner points out, “IoT project implementers often ...
"We have several customers now running private clouds. They're not as large as they should be but it's getting there. The adoption challenge has been pretty simple. Look at the world today of virtualization vs cloud," stated Nara Rajagopalan, CEO of Accelerite, in this SYS-CON.tv interview at 18th Cloud Expo, held June 7-9, 2016, at the Javits Center in New York City, NY.
In his keynote at 18th Cloud Expo, Andrew Keys, Co-Founder of ConsenSys Enterprise, provided an overview of the evolution of the Internet and the Database and the future of their combination – the Blockchain. Andrew Keys is Co-Founder of ConsenSys Enterprise. He comes to ConsenSys Enterprise with capital markets, technology and entrepreneurial experience. Previously, he worked for UBS investment bank in equities analysis. Later, he was responsible for the creation and distribution of life sett...
"We are a well-established player in the application life cycle management market and we also have a very strong version control product," stated Flint Brenton, CEO of CollabNet,, in this SYS-CON.tv interview at 18th Cloud Expo, held June 7-9, 2016, at the Javits Center in New York City, NY.
Adobe is changing the world though digital experiences. Adobe helps customers develop and deliver high-impact experiences that differentiate brands, build loyalty, and drive revenue across every screen, including smartphones, computers, tablets and TVs. Adobe content solutions are used daily by millions of companies worldwide-from publishers and broadcasters, to enterprises, marketing agencies and household-name brands. Building on its established design leadership, Adobe enables customers not o...
While DevOps promises a better and tighter integration among an organization’s development and operation teams and transforms an application life cycle into a continual deployment, Chef and Azure together provides a speedy, cost-effective and highly scalable vehicle for realizing the business values of this transformation. In his session at @DevOpsSummit at 19th Cloud Expo, Yung Chou, a Technology Evangelist at Microsoft, will present a unique opportunity to witness how Chef and Azure work tog...
Digital transformation is too big and important for our future success to not understand the rules that apply to it. The first three rules for winning in this age of hyper-digital transformation are: Advantages in speed, analytics and operational tempos must be captured by implementing an optimized information logistics system (OILS) Real-time operational tempos (IT, people and business processes) must be achieved Businesses that can "analyze data and act and with speed" will dominate those t...
SYS-CON Events announced today that Sheng Liang to Keynote at SYS-CON's 19th Cloud Expo, which will take place on November 1-3, 2016 at the Santa Clara Convention Center in Santa Clara, California.
What are the new priorities for the connected business? First: businesses need to think differently about the types of connections they will need to make – these span well beyond the traditional app to app into more modern forms of integration including SaaS integrations, mobile integrations, APIs, device integration and Big Data integration. It’s important these are unified together vs. doing them all piecemeal. Second, these types of connections need to be simple to design, adapt and configure...
Keeping pace with advancements in software delivery processes and tooling is taxing even for the most proficient organizations. Point tools, platforms, open source and the increasing adoption of private and public cloud services requires strong engineering rigor - all in the face of developer demands to use the tools of choice. As Agile has settled in as a mainstream practice, now DevOps has emerged as the next wave to improve software delivery speed and output. To make DevOps work, organization...
SYS-CON Events announced today that Bsquare has been named “Silver Sponsor” of SYS-CON's @ThingsExpo, which will take place on November 1–3, 2016, at the Santa Clara Convention Center in Santa Clara, CA. For more than two decades, Bsquare has helped its customers extract business value from a broad array of physical assets by making them intelligent, connecting them, and using the data they generate to optimize business processes.
Just over a week ago I received a long and loud sustained applause for a presentation I delivered at this year’s Cloud Expo in Santa Clara. I was extremely pleased with the turnout and had some very good conversations with many of the attendees. Over the next few days I had many more meaningful conversations and was not only happy with the results but also learned a few new things. Here is everything I learned in those three days distilled into three short points.
“Media Sponsor” of SYS-CON's 19th International Cloud Expo, which will take place on November 1–3, 2016, at the Santa Clara Convention Center in Santa Clara, CA. CloudBerry Backup is a leading cross-platform cloud backup and disaster recovery solution integrated with major public cloud services, such as Amazon Web Services, Microsoft Azure and Google Cloud Platform.
"This week we're really focusing on scalability, asset preservation and how do you back up to the cloud and in the cloud with object storage, which is really a new way of attacking dealing with your file, your blocked data, where you put it and how you access it," stated Jeff Greenwald, Senior Director of Market Development at HGST, in this SYS-CON.tv interview at 18th Cloud Expo, held June 7-9, 2016, at the Javits Center in New York City, NY.
SYS-CON Events announced today Telecom Reseller has been named “Media Sponsor” of SYS-CON's 19th International Cloud Expo, which will take place on November 1–3, 2016, at the Santa Clara Convention Center in Santa Clara, CA. Telecom Reseller reports on Unified Communications, UCaaS, BPaaS for enterprise and SMBs. They report extensively on both customer premises based solutions such as IP-PBX as well as cloud based and hosted platforms.
As data explodes in quantity, importance and from new sources, the need for managing and protecting data residing across physical, virtual, and cloud environments grow with it. Managing data includes protecting it, indexing and classifying it for true, long-term management, compliance and E-Discovery. Commvault can ensure this with a single pane of glass solution – whether in a private cloud, a Service Provider delivered public cloud or a hybrid cloud environment – across the heterogeneous enter...