- California leads with AI-driven public service innovation.
- New traffic management system reduces congestion and road fatalities.
- Advanced immunization registry unifies 50 million patient records.
- Solutions slash processing times from months to days, saving lives and resources.
A pioneering state, spearheaded by a visionary governor, has embarked on an ambitious journey to redefine public services through the strategic implementation of data and generative AI. This initiative, launched with an executive order in September 2023, showcases a fearless commitment to innovation, partnering with private sector leaders like Databricks and academia to deliver long-lasting benefits to its residents.
The transformation is vividly demonstrated through two critical areas: transportation and public health. In transportation, the state's Department of Transportation, responsible for 52,000 lane miles of highway, faced dual challenges of severe congestion and a tragic daily average of 10-12 road deaths. The governor highlighted that generative AI is now applied to traffic management in a way unparalleled in any other U.S. state, focusing on efficiency not through job reduction, but by empowering departments with AI-enabled tools.
The solution, a Traffic Mobility Insights Platform, integrates diverse data sources including traffic performance, safety, transit, video feeds, and third-party data. Previously siloed data sets, such as PEMS (traffic performance) and Switter's (crash data), are now unified under a Databricks Delta Lake with Unity Data Catalog, enabling real-time spatial analysis. This platform moves from reactive to proactive response strategies, reducing assessment times from months to mere days. Its impact is profound: not only saving significant operational costs but, more importantly, converting potential crashes into lives saved.
In public health, the California Department of Public Health (CDPH) grappled with fragmented immunization data prior to the pandemic. The COVID-19 crisis necessitated a rapid shift, requiring daily reporting to the CDC and the development of tools like the Digital Vaccine Record (DVR). Partnering with Accenture, CDPH built an 'Analytics as a Service' solution leveraging Databricks' ML capabilities and MLflow. A core component is the Master Person Index (MPI), an ML-powered patient matching system designed to uniquely identify over 50 million individuals within the immunization registry.
This robust system has yielded remarkable results: over 20 million DVRs downloaded by residents, supporting 8 languages, and inspiring six other states to adopt similar solutions. Perhaps most impressively, the system achieves a submission-to-reporting time of just one hour for 680 million vaccine doses. These achievements underscore the immense potential of Databricks and AI to create scalable, efficient, and life-saving public services, setting a new standard for governmental innovation.
“Generative AI has come to traffic management in the state in a way that does not exist in any other state in America.”
- Ajali Sen, Director, Accenture
