Welcome!

Linux Containers Authors: XebiaLabs Blog, Elizabeth White, Anders Wallgren, John Esposito, Pat Romanski

Related Topics: Open Source Cloud, Linux Containers, @CloudExpo, @BigDataExpo, OpenStack Journal

Open Source Cloud: Article

DZone Guide to Data Persistence | @CloudExpo #DataCenter #Storage

Persistent data is fundamental to nearly any operation that utilizes database management systems (DBMS)

Data persistence has a way of sneaking up on developers. You start out with a simple, straightforward database that can functionally hold the data you're working with and the data you need to work with later. But as your needs change, you start to modify it here and there, until it becomes a brittle tangle of tables and keys and indexes. You need something more dynamic, but you need to retain the ability to retrieve your persistent data. Now, you're miles from where you started, and staring down the possibility of having to adopt a whole new system. That persistent data is fundamental to nearly any operation that utilizes database management systems (DBMS), but while the growth of dynamic data has led to sophisticated and reliable new relational management systems, real-world techniques for optimal data storage and retrieval have sometimes been lost in the shuffle. With that in mind, we've put together a new edition of our comprehensive DZone Guide to Data Persistence.

More than 580 IT professionals responded to our 2016 Data Persistence Survey, and those responses yielded noteworthy results that we've translated into a tool to answer all your persistent data-related questions.

The demographics of the respondents varied somewhat widely, and that variance helped provide a clear picture of the industry:

  • 69 percent of respondents use Java as their primary programming language at work
  • 68 percent develop primarily web applications
  • 66 percent have been IT professionals for more than 10 years
  • 45 percent work at companies headquartered in Europe, 27 percent in the United States
  • 44 percent work at companies with more than 500 employees, 19 percent with more than 10,000 employees

We've channeled our findings into a comprehensive resource containing persistence strategies, tools for data storage and retrieval, a checklist for choosing the right database, and an analysis of trends in the DBMS space. Among some of the more fascinating kernels of information was the surprise reveal that nearly 22 percent of the respondents didn't know whether their databases were partitioned or not. This means that nearly a quarter of developers can build applications without knowing how their database handles scale. As a result, database administrators have to be able to distribute large amounts of data under flexible read/write conditions, keeping storage abstraction as tight as possible. We also found that Oracle, MySQL and SQL Server are still the go-to servers in the commercial DBMS world, and it's not really even close. In fact, it's been years since the top three servers have faced any real challenge in both production and non-production environments.

Really, though, these findings are just the tip of the iceberg. In this guide, we've included chapters on the impact of fundamental data structures on storage and retrieval, ORM libraries for Android and iOS, how to choose a DBaaS, executive insights into data persistence, and a directory of over 50 solutions (various kinds of DBMS, ORMs, SQL generators, data grids, and more). We've designed this guide with developers in mind. Dealing with data persistence shouldn't be a headache, and these tools should help cut through some of the complexity.

Give it a read and tell us what you think!

More Stories By John Esposito

John Esposito is Editor-in-Chief at DZone, having recently finished a doctoral program in Classics from the University of North Carolina. In a previous life he was a VBA and Force.com developer, DBA, and network administrator. John enjoys playing piano and looking at diagrams, and raises two cats with his wife, Sarah.

@ThingsExpo Stories
Machine Learning helps make complex systems more efficient. By applying advanced Machine Learning techniques such as Cognitive Fingerprinting, wind project operators can utilize these tools to learn from collected data, detect regular patterns, and optimize their own operations. In his session at 18th Cloud Expo, Stuart Gillen, Director of Business Development at SparkCognition, will discuss how research has demonstrated the value of Machine Learning in delivering next generation analytics to im...
IoT generates lots of temporal data. But how do you unlock its value? How do you coordinate the diverse moving parts that must come together when developing your IoT product? What are the key challenges addressed by Data as a Service? How does cloud computing underlie and connect the notions of Digital and DevOps What is the impact of the API economy? What is the business imperative for Cognitive Computing? Get all these questions and hundreds more like them answered at the 18th Cloud Expo...
The paradigm has shifted. A Gartner survey shows that 43% of organizations are using or plan to implement the Internet of Things in 2016. However, not just a handful of companies are still using the old-style ad-hoc trial-and-error ways, unaware of the critical barriers, paint points, traps, and hidden roadblocks. How can you become a winner? In his session at @ThingsExpo, Tony Shan will present a methodical approach to guide the holistic adoption and enablement of IoT implementations. This ov...
The IoT has the potential to create a renaissance of manufacturing in the US and elsewhere. In his session at 18th Cloud Expo, Florent Solt, CTO and chief architect of Netvibes, will discuss how the expected exponential increase in the amount of data that will be processed, transported, stored, and accessed means there will be a huge demand for smart technologies to deliver it. Florent Solt is the CTO and chief architect of Netvibes. Prior to joining Netvibes in 2007, he co-founded Rift Technol...
The truth is that one of the complaints about self-driving cars is that they are too cautious so Google adapted the software so the car would move to the far right of the lane so two cars could fit in the single wide lane. This is what a regular, old fashioned, human being does so cars can move more fluidly though the heavily congested streets of California.
WebRTC is bringing significant change to the communications landscape that will bridge the worlds of web and telephony, making the Internet the new standard for communications. Cloud9 took the road less traveled and used WebRTC to create a downloadable enterprise-grade communications platform that is changing the communication dynamic in the financial sector. In his session at @ThingsExpo, Leo Papadopoulos, CTO of Cloud9, will discuss the importance of WebRTC and how it enables companies to fo...
SYS-CON Events announced today that DatacenterDynamics has been named “Media Sponsor” of SYS-CON's 18th International Cloud Expo, which will take place on June 7–9, 2016, at the Javits Center in New York City, NY. DatacenterDynamics is a brand of DCD Group, a global B2B media and publishing company that develops products to help senior professionals in the world's most ICT dependent organizations make risk-based infrastructure and capacity decisions.
SYS-CON Events announced today TMCnet has been named “Media Sponsor” of SYS-CON's 18th International Cloud Expo, which will take place on June 7–9, 2016, at the Javits Center in New York City, NY, and the 19th International Cloud Expo, which will take place on November 1–3, 2016, at the Santa Clara Convention Center in Santa Clara, CA. Technology Marketing Corporation (TMC) is the world's leading business-to-business and integrated marketing media company, servicing niche markets within the com...
Angular 2 is a complete re-write of the popular framework AngularJS. Programming in Angular 2 is greatly simplified – now it's a component-based well-performing framework. This immersive one-day workshop at 18th Cloud Expo, led by Yakov Fain, a Java Champion and a co-founder of the IT consultancy Farata Systems and the product company SuranceBay, will provide you with everything you wanted to know about Angular 2.
This is not a small hotel event. It is also not a big vendor party where politicians and entertainers are more important than real content. This is Cloud Expo, the world's longest-running conference and exhibition focused on Cloud Computing and all that it entails. If you want serious presentations and valuable insight about Cloud Computing for three straight days, then register now for Cloud Expo.
SYS-CON Events announced today that Stratoscale, the software company developing the next generation data center operating system, will exhibit at SYS-CON's 18th International Cloud Expo®, which will take place on June 7-9, 2016, at the Javits Center in New York City, NY. Stratoscale is revolutionizing the data center with a zero-to-cloud-in-minutes solution. With Stratoscale’s hardware-agnostic, Software Defined Data Center (SDDC) solution to store everything, run anything and scale everywhere...
You deployed your app with the Bluemix PaaS and it's gaining some serious traction, so it's time to make some tweaks. Did you design your application in a way that it can scale in the cloud? Were you even thinking about the cloud when you built the app? If not, chances are your app is going to break. Check out this webcast to learn various techniques for designing applications that will scale successfully in Bluemix, for the confidence you need to take your apps to the next level and beyond.
SYS-CON Events announced today that SuperAdmins will exhibit at SYS-CON's 18th International Cloud Expo®, which will take place on June 7-9, 2016, at the Javits Center in New York City, NY. SuperAdmins specializes in providing high-quality IT infrastructure services for MSPs, hosting and cloud providers. Services they offer include 24/7 NOC - Remote monitoring of the key equipment/services.
SYS-CON Events announced today the How to Create Angular 2 Clients for the Cloud Workshop, being held June 7, 2016, in conjunction with 18th Cloud Expo | @ThingsExpo, at the Javits Center in New York, NY. Angular 2 is a complete re-write of the popular framework AngularJS. Programming in Angular 2 is greatly simplified. Now it’s a component-based well-performing framework. The immersive one-day workshop led by Yakov Fain, a Java Champion and a co-founder of the IT consultancy Farata Systems and...
Join IBM June 8 at 18th Cloud Expo at the Javits Center in New York City, NY, and learn how to innovate like a startup and scale for the enterprise. You need to deliver quality applications faster and cheaper, attract and retain customers with an engaging experience across devices, and seamlessly integrate your enterprise systems. And you can't take 12 months to do it.
How do you evaluate a cloud provider for your database platform? How do you coordinate the diverse moving parts that must come together when developing your IoT product? What are the key challenges addressed by Data as a Service? DevOps, Digital, Cloud – three separate transformative trends, or one mega-trend? Which cloud model is right for your company? How can you turn your corporate data into dollars?
SYS-CON Events announced today that (ISC)²® (“ISC-squared”) will exhibit at SYS-CON's 18th International Cloud Expo®, which will take place on June 7-9, 2016, at the Javits Center in New York City, NY. Two leading non-profits focused on cloud and information security, (ISC)² and Cloud Security Alliance (CSA), developed the Certified Cloud Security Professional (CCSP) certification to address the increased demand for cloud security expertise due to rapid growth in cloud. Recently named “The Next...
Growth hacking is common for startups to make unheard-of progress in building their business. Career Hacks can help Geek Girls and those who support them (yes, that's you too, Dad!) to excel in this typically male-dominated world. Get ready to learn the facts: Is there a bias against women in the tech / developer communities? Why are women 50% of the workforce, but hold only 24% of the STEM or IT positions? Some beginnings of what to do about it! In her Day 2 Keynote at 17th Cloud Expo, San...
The IETF draft standard for M2M certificates is a security solution specifically designed for the demanding needs of IoT/M2M applications. In his session at @ThingsExpo, Brian Romansky, VP of Strategic Technology at TrustPoint Innovation, will explain how M2M certificates can efficiently enable confidentiality, integrity, and authenticity on highly constrained devices.
IoT device adoption is growing at staggering rates, and with it comes opportunity for developers to meet consumer demand for an ever more connected world. Wireless communication is the key part of the encompassing components of any IoT device. Wireless connectivity enhances the device utility at the expense of ease of use and deployment challenges. Since connectivity is fundamental for IoT device development, engineers must understand how to overcome the hurdles inherent in incorporating multipl...