// AI news · 2026-11-05 · Databricks Blog
Apache Spark 4.3 Available in Databricks Runtime 19
Apache Spark 4.3 is now available in Databricks Runtime 19, introducing stateful real-time streaming with sub-150 ms P99 latency.
Published 2026-11-05 08:00 (Beijing time)Source Databricks BlogAuto-summarised, fact-checked against source
01Summary
Real-Time Mode enables streaming aggregation, deduplication, and custom stateful processing via familiar Structured Streaming APIs. Key features include SCD Type 2 Auto CDC, Project Feather for small-data performance, and enhanced Spark Connect and SQL capabilities.
Summarised from the original article by an open-source model, then checked automatically: every number and English name must appear in the source. The original article is authoritative.
02Key points
- Adds stateful real-time streaming with sub-150 ms P99 latency.
- Supports streaming aggregation, deduplication, and transformWithState in Real-Time Mode.
- Introduces SCD Type 2 Auto CDC for tracking record changes over time.
- Improves small-data query performance and remote application connectivity.
03Source
Introducing Apache Spark® 4.3 - Now available in Databricks Runtime 19
Databricks Blog · published 2026-11-05 08:00 Beijing time
05Related news
- Same source · Enterprises adopt open-weight models for cost and control2026-11-05 · Databricks Blog
- Same source · Snorkel AI uses Lakebase for fast CI/CD branching2026-11-01 · Databricks Blog
- Same topic · ChatGPT Can Now Generate GIFs2026-11-05 · The Verge
- Same topic · Google Public Sector Summit: Mission Meets Moonshot2026-11-05 · Google Cloud
- Same day · AI PACs spent millions shaping Congress in midterms2026-11-05 · TechCrunch AI
From AIMap AI news: collected from 1,100+ official and media sources. Summaries only restate the original article; follow the link for the full story. All stories of 2026-11-05 · Archive by date · All AI news · Today