Data + Cloud: What Does It All Mean?

Big Data. Fast Data. NoSQL. NewSQL. We’ve experienced something of a renaissance in the storage and processing of data in the last decade of computing after years of “Relational Winter.” We’re now entering into the next phase of this evolution: the convergence of data and the cloud.

Much of this revolution has arrived on the coattails of data fabrics designed for horizontal scale-out on commodity hardware. Cloud platforms, especially PaaS platforms like Cloud Foundry, allow us to provision the requisite virtual hardware on-demand, removing the last mile of overhead in assembling scale-out data platforms. These platforms are based on computers running in managed cloud hosting services in data centres. Coupling PaaS with microservice architectures and polyglot persistence allows developers to design systems utilizing stores uniquely designed for specific write, process, and query patterns. Leveraging the Lambda Architecture combination of real-time analytics platforms coupled with scale-out batch processing systems like Hadoop give us the ability to always ask questions of all of our data.

In this talk will look at various Spring projects that allow us, coupled with Cloud Foundry, to uniquely position ourselves to take advantage of this convergence:
* Spring Boot: the opinionated framework for microservice development
* Spring Data: the access layer for SQL, NoSQL, NewSQL, and Hadoop
* Reactor: the foundation for reactive fast data applications on the JVM
* Spring XD: the platform for data ingest, real-time analytics, batch processing, and data export

We’ll tie all of these projects together in a suite of applications running on Cloud Foundry and Hadoop, closing the Apps/Data/Cloud loop