California's State-Run AI Assistant, Poppy, Expands Its Capabilities for Government Workers

A new state-run artificial intelligence (AI) platform has been launched in California to support government workers. The platform, called Poppy, is a collection of 10 different models tailored to fit the diverse and challenging work of government. This AI assistant was made possible by Executive Order N-12-23 signed by Governor Gavin Newsom late last year.

The development of Poppy involved overcoming several challenges, including privacy, security, governance, and appropriate use considerations. Despite these hurdles, the California Department of Technology (CDT) successfully implemented a consolidated suite of models in just under a year. This achievement is significant given that getting any model up and running within state government can be a daunting task.

According to Shera Mui, deputy director of CDT’s Platform Services, what started as an effort to create a statewide chatbot quickly evolved into something more useful – a platform that could be managed and adapted to new technologies in real-time. ‘We discovered early on that we didn’t want to create large language models; that was not going to be the smart thing to do,’ Mui explained.

The team at CDT took a different approach, focusing on creating a platform that would allow users to securely choose a model best suited for their task. This flexibility is particularly useful in government work, where tasks can range from deep analysis of legal documents to creating code for new websites. The platform’s ability to keep all user data and information secure has been a major driving factor behind its development.

The early access phase involved giving 70 departments with around 100 users each the opportunity to test the first iteration of Poppy. This pilot program helped drive discussion around potential use cases, which in turn informed the development of subsequent models. The platform’s flexibility is one of its key strengths – it allows users to choose from multiple models without having to duplicate data or compromise on security.

Dr. Lucy Andrews, a scientist with the California Department of Water Resources (DWR), has seen firsthand the impact that Poppy can have in labor- and time-intensive work. She noted that the tools have played a critical part in determining the intellectual and financial value of her department’s contributions across various sources. This is particularly important for DWR, which invests tens of millions of dollars annually in scientific research.

Previously, tracking these contributions was a manual process that involved weeks of data entry using an Excel spreadsheet. With access to AI tools like Poppy, this time-consuming task has been significantly reduced – users can now complete it within 1-2 hours with a slow internet connection. The ability to track and analyze scientific relationships more effectively is also a major benefit for DWR.

Andrews noted that the department’s focus on accountability means they are taking a conscientious approach to model selection and use cases before implementing Poppy. This includes considering the environmental impact of running data centers, which support AI operations. While there may be some concerns about energy consumption, staff is working to minimize this by carefully selecting models and optimizing their usage.

Early metrics from the statewide launch show that users are interested in document summaries, policy analysis, and complex code creation – all key areas where Poppy’s capabilities can make a significant difference for government workers. Some departments have also expressed interest in exploring image generation features as part of future additions to the platform. However, more work needs to be done on outlining a long-term roadmap for these developments.

As for what’s next for Poppy, Mui sees opportunities for further expansion and improvement. This includes adding new features, tailoring models to specific departmental needs, and streamlining data sets to enhance cooperation among departments. CDT has requested $1 million in funding during the budget process toward this end – a significant investment that reflects the potential of AI tools like Poppy.

It’s worth noting that while Poppy is an advanced toolset for government workers, no decision is left solely to an AI system. Humans maintain control over all outcomes and are responsible for ensuring that AI-generated information aligns with their goals and objectives.