At its Data + AI Summit, Databricks today made the requisite number of announcements one would expect from a company's flagship developer event. Among those are the launch of Delta Lake 2.0, the next ...

The Apache Spark community has improved support for Python to such a great degree over the past few years that Python is now a “first-class” language, and no longer a “clunky” add-on as it once was, ...

Taking on Google, Databricks plans to offer its own cloud service for analyzing live data streams, one based on the Apache Spark software. Databricks Cloud is designed to provide a platform for ...

Spark Declarative Pipelines provides an easier way to define and execute data pipelines for both batch and streaming ETL workloads across any Apache Spark-supported data source, including cloud ...

Streaming is one of the top trends we've been keeping up with. The latest episode in that saga was adding ACID capabilities to Apache Flink, as covered by ZDNet's Tony Baer last week. This ...

Move comes as Snowflake and Databricks chase the same all-in-one analytics dream Google is promising a single notebook environment for machine learning and data analytics, integrating SQL, Python, and ...

Databricks Inc. today took some serious steps toward boosting the value proposition of the popular open-source Apache Spark big data processing engine, which is facing potent new competition. The San ...

The June update to Apache Spark brought support for R, a significant enhancement that opens the big data platform to a large audience of new potential users. Support for R in Spark 1.4 also gives ...