At its Data + AI Summit, Databricks today made the requisite number of announcements one would expect from a company's flagship developer event. Among those are the launch of Delta Lake 2.0, the next ...

Spark Declarative Pipelines provides an easier way to define and execute data pipelines for both batch and streaming ETL workloads across any Apache Spark-supported data source, including cloud ...

First created as part of a research project at UC Berkeley AMPLab, Spark is an open source project in the big data space, built for sophisticated analytics, speed, and ease of use. It unifies critical ...

Streaming is one of the top trends we've been keeping up with. The latest episode in that saga was adding ACID capabilities to Apache Flink, as covered by ZDNet's Tony Baer last week. This ...

Taking on Google, Databricks plans to offer its own cloud service for analyzing live data streams, one based on the Apache Spark software. Databricks Cloud is designed to provide a platform for ...

Apache Spark 3.0 is now here, and it’s bringing a host of enhancements across its diverse range of capabilities. The headliner is an big bump in performance for the SQL engine and better coverage of ...