Databricks
Data Platform
Data lakehouse platform, DBRX model, Mosaic ML acquisition.
Recent activity
-
The FDA built an AI platform, ELSA, using Databricks, which reached 85% staff adoption in just two months by consolidating data from eight centers into a single governed data foundation, Halo, streamlining data sharing and enabling real-time data processing. This consolidation effort reduced data sharing time from days to minutes and cut regulatory research times from days to three minutes. The FDA's Office of Digital Transformation used this platform to demonstrate the value of a foundational data platform, which became contagious and led to widespread adoption. AI summary
Read more → -
Omnigent's intent-based authorization closes the gap between traditional authorization and AI agents by binding a session to a declared purpose, ensuring that actions are checked against that intent and denied or gated for human approval if outside it. This approach blocks prompt injection attacks, where an attacker injects instructions into an agent's content to steer it into unauthorized actions. By pairing intent-based authorization with session-risk scoring policy, Omnigent creates a layered defense that reinforces each other. AI summary
Read more → -
Databricks developed a self-serve infrastructure vending machine, called the Field Engineering Vending Machine (FEVM), to address growing pains at scale as its GTM organization expanded to over 7,000 people, requiring isolated, governed, and cost-aware cloud resources on demand. FEVM leverages Databricks-native components and agents as first-class citizens to enable field engineering teams to build with velocity, leverage an agent-first framework at scale, and move as fast as technology changes. The vending machine is designed to provide a simple and fast way for field engineers to provision isolated, governed, and use-case-specific cloud resources. AI summary
Read more → -
Databricks' Frontier Data Agent, Genie Code, outperforms general coding agents in quality and cost by delivering accurate answers at significantly lower cost due to its deep semantic understanding of enterprise context, allowing it to skip brute-force schema exploration and reduce errors. Genie Code was the most accurate agent in a test of 400+ real data tasks, while also being the most cost-efficient. AI summary
Read more → -
Databricks now supports connecting Amazon S3 data with delegated IAM permissions, simplifying the setup process by automating the creation of an external location in Unity Catalog, which governs read and write access to the S3 bucket. This eliminates the need for manual configuration of IAM trust policies, S3 bucket permissions, and CloudFormation templates. With delegated IAM permissions, users can grant Databricks temporary authorization to provision required resources on their behalf, reducing the complexity of S3 connectivity. AI summary
Read more → -
Unity AI Gateway introduces AI spend controls, allowing organizations to set budgets and hard spend caps at the user, workspace, or organization level, with proactive budget alerts across users, workspaces, use cases, and entire accounts to monitor and contain AI costs. This release extends Unity AI Gateway's existing cost visibility with unified governance for AI usage, cost visibility, and operational accountability across models, agents, MCPs, and providers. AI summary
Read more → -
Databricks has introduced Lakebase Postgres as a solution to simplify AI agent orchestration, eliminating the need for separate infrastructure for queueing, orchestration, and observability, and allowing for scalable, durable, and concurrent task management. AI summary
Read more → -
Great first-party data alone does not guarantee effective marketing, as it often falls short of activating customer signals into real-time campaigns due to integration bottlenecks and siloed tools in the martech stack. A unified data foundation and Agentic CDP are necessary to bridge this gap. AI summary
Read more → -
Dow built a Carbon Footprint Ledger (CFL) on the Databricks Data Intelligence Platform to unify enterprise data and calculate cradle-to-gate Product Carbon Footprints (PCFs) for its entire portfolio, reducing processing time from weeks to a fraction of that with end-to-end PCF processing and full lineage and audit-grade governance. AI summary
Read more → -
Databricks' Lakehouse architecture is being used to integrate scattered R&D data from various source systems into a unified, AI-ready product, enabling industrial AI in industries like heavy-duty applications, where data from multiple sources needs to be combined for analysis. The Data Hub, built on Unity Catalog and Lakehouse Federation, provides a single UI for humans and an MCP server for agents, ensuring data governance and context. This setup accelerates complex R&D investigations from weeks to days, delivering cumulative value through reviewed business context. AI summary
Read more → -
Databricks has announced the Public Preview of Discover and Domains, powered by Unity Catalog, which provides an internal marketplace for data and AI assets, enabling users to find trusted, relevant data and AI assets through business-aligned organization, curation, and AI-powered recommendations. Domains provide business context that helps agents use the assets reliably, and the Discover page is the human-facing experience where people can browse domains and find the assets they need. This feature extends Unity Catalog Semantics to capture how organizations structure and understand their data in business terms. AI summary
Read more → -
Glaspoort's Lakebase branching setup branches every environment from production, creating ephemeral per-PR databases for CI/CD, and treats migrations as the single source of truth, avoiding the "reset-from-parent trap" in development and acceptance environments. AI summary
Read more → -
Researchers at Databricks developed a solution to map freeform text to large taxonomies of 100k+ labels, outperforming existing frontier models in accuracy and cost. By combining vector search with the Databricks AI Classify function, they achieved a five-point accuracy improvement at a fraction of the cost of traditional models. This approach is particularly useful for large-scale taxonomy classification tasks in industries such as biomedicine, finance, and e-commerce. AI summary
Read more → -
AI can unlock transformation in Retail, Travel, and Consumer Goods by addressing the three main barriers to action: trust, time, and cost, through the deployment of a unified AI system that integrates data, analytics, and governance, enabling faster decision-making and action on insights. AI summary
Read more → -
AI transparency involves documenting an AI system's data, model behavior, and decision-making processes, distinct from explainability and interpretability, which address narrower questions about individual predictions and internal model logic. Regulatory pressure from the EU AI Act ties transparency documentation directly to legal compliance for high-risk and general-purpose AI systems. AI summary
Read more → -
Responsible AI is a framework that encompasses principles, governance, and controls to build fair, transparent, and trustworthy AI systems, requiring collaboration between data scientists, governance teams, and business leaders to manage risk and build stakeholder trust. Key practices include secure data pipelines, bias mitigation, and cross-functional governance boards, with rising regulatory pressure pushing organizations toward continuous monitoring and executive-level responsible AI strategy. This framework combines technical safeguards, governance structures, and human oversight to ensure reliable AI models while protecting privacy and data security. AI summary
Read more → -
Finance teams are struggling to keep pace with the rapid changes in unit economics driven by AI agents, which are now shaping compute costs, pricing, and revenue recognition. To stay ahead, finance must develop context and control, leveraging tools like Databricks to manage the complexity of these variables. AI summary
Read more →