AI Industry on Safety and Control

In a packed conference hall in London, Dan Lahav, Co-Founder and CEO of Irregular, took the stage alongside Joëlle Pineau, Chief AI Officer at Cohere. The two leaders in the artificial intelligence sector were there to address a pressing topic: the safety and control of AI technologies as they evolve rapidly. Their insights, shared during Bloomberg Tech 2026, resonated with an audience eager to grasp the implications of AI advancements.

What Happened

The discussion highlighted the emerging risks associated with AI, particularly as frontier models become increasingly sophisticated. Lahav emphasized the necessity for credible guardrails, which he believes are essential to mitigate the potential dangers of AI misuse. “We need to ensure that as we push the boundaries of what AI can do, we also establish frameworks that can hold us accountable,” he stated.

Pineau added to this sentiment, stressing that accountability is not just a technical issue but also a societal one. “The responsibility lies not only with developers but also with society at large to engage in conversations about how AI should be governed,” she remarked. Their dialogue underscored a growing consensus among experts that proactive measures are needed to navigate the complex landscape of AI.

Understanding AI Risks

As AI technologies become more embedded in everyday life, the risks associated with their deployment are becoming clearer. Lahav and Pineau discussed several key areas of concern, including bias in AI algorithms, data privacy issues, and the potential for AI to be weaponized. Each of these risks presents unique challenges that require thoughtful solutions.

For instance, bias in AI systems can lead to unfair outcomes, particularly in sensitive areas like hiring or law enforcement. Lahav pointed out that “if we don’t address bias now, we risk perpetuating inequalities.” Pineau echoed this, noting that diverse teams in AI development can help mitigate such biases. “It’s crucial to have a range of perspectives when creating AI systems,” she said.

The Role of Regulation

Regulation emerged as a focal point in their discussion. Lahav advocated for a balanced approach, where regulations are designed to foster innovation while ensuring safety. “Too much regulation can stifle creativity, but too little can lead to chaos,” he cautioned. Pineau agreed, suggesting that regulations should be adaptive, evolving alongside technological advancements.

Both leaders acknowledged the challenges in establishing effective regulations. The rapid pace of AI innovation often outstrips the ability of regulatory bodies to keep up. Pineau emphasized the need for collaboration between tech companies and regulators. “We need to work together to create a framework that is both flexible and robust,” she said.

Community Impact

The implications of AI regulation extend far beyond the tech industry. As AI systems increasingly influence various sectors, from healthcare to finance, the stakes are high for communities. Lahav and Pineau highlighted the importance of public engagement in shaping AI policies. “The community should have a voice in how these technologies are developed and deployed,” Lahav urged.

In New York City, where innovation meets tradition, the conversation around AI is particularly relevant. Local organizations are beginning to explore how AI can enhance community services while ensuring ethical standards are upheld. Initiatives aimed at educating the public about AI's potential and risks are gaining traction, fostering a more informed citizenry.

One such initiative is the NYC AI Ethics Consortium, which brings together tech leaders, policymakers, and community advocates to discuss the implications of AI technologies in urban settings. This consortium aims to create a platform for dialogue that bridges the gap between technology and the communities that it affects. It emphasizes the importance of transparency and collaboration in AI development, ensuring that diverse voices are included in the conversation.

Local universities are also stepping up, incorporating AI ethics into their curricula. Programs at institutions like New York University and Columbia University are preparing the next generation of tech leaders to think critically about the societal impacts of AI. By equipping students with the tools to navigate complex ethical dilemmas, these programs aim to foster a culture of responsibility in future AI development.

Engaging the Local Community

As part of their outreach, the NYC AI Ethics Consortium is hosting workshops and public forums focused on AI literacy. These events are designed to demystify AI for the average citizen, allowing them to understand both the benefits and risks associated with these technologies. Community leaders and educators are collaborating to ensure that marginalized groups are included in these discussions, recognizing that the impact of AI can disproportionately affect vulnerable populations.

Local tech startups are also contributing to this dialogue by developing AI solutions that prioritize ethical considerations. For example, companies focusing on healthcare AI are working to ensure that their algorithms are not only efficient but also equitable, catering to the diverse needs of New Yorkers. This commitment to ethical AI practices is becoming a hallmark of the city's tech scene.

Real-World Applications and Challenges

As AI continues to penetrate various sectors, its real-world applications are both promising and fraught with challenges. In healthcare, for example, AI algorithms are being used to predict patient outcomes and streamline administrative processes. However, as Lahav pointed out, these technologies must be rigorously tested to ensure they do not inadvertently reinforce existing biases in medical treatment. “AI can save lives, but we need to ensure that it is equitable and accessible for all,” he stated.

In finance, AI's ability to analyze vast amounts of data can lead to more informed investment decisions. Yet, the potential for misuse, such as algorithmic trading that exacerbates market volatility, raises concerns. Pineau stressed the need for ethical frameworks that govern these applications, stating, “We must ensure that AI serves the greater good, rather than just the interests of a few.”

Looking to the Future

As we look to the future, the integration of AI in various sectors will likely continue to expand, prompting further discussions about its societal implications. The role of community advocacy will be critical in shaping policies that govern AI use. Lahav and Pineau's insights provide a valuable framework for navigating the challenges ahead. They both stressed the importance of ongoing dialogue among stakeholders, including tech companies, policymakers, and the public.

“We are at a crossroads,” Pineau said, “and how we choose to address these issues will shape the future of AI.” Lahav added, “It’s not just about creating powerful AI; it’s about ensuring it serves humanity positively.” Their call to action resonates with the broader mission of creating a safer, more accountable AI ecosystem.

Their conversation at Bloomberg Tech 2026 serves as a reminder that the responsibility for AI safety and control lies with all of us. As we embrace the potential of AI, we must also remain vigilant in addressing its risks to build a future that aligns with our values. The next steps involve not only regulatory frameworks but also grassroots movements that advocate for ethical AI practices, ensuring that the voices of marginalized communities are heard and considered in the development of these transformative technologies.