Article URL: https://turntrout.com/why-i-left-google-deepmind Comments URL: https://news.ycombinator.com/item?id=48925271 Points: 198 # Comments: 104

In January, Department of Homeland Security (dhs) officers killed at least two people. In both cases, a federal agent grasped his gun, aimed it at a peaceful citizen, and shot them dead. I learned that Google sells its Cloud services to the relevant agencies within dhs. I thought that was wrong. Federal agents should not be able to kill citizens in the street. I set out to find the most effective way to push my company to stop serving these agencies. My divestment campaign quickly broadened into an attempt to prevent Google from signing an unethical military AI deal, as the Pentagon started pressuring AI providers into military AI deals with no restrictions against use for killer robots or mass surveillance.1 I wanted AI ethics commitments to hold under pressure. In particular, I wanted Google DeepMind (gdm) to maintain its existing commitment against supporting killer robots. Over several months, I asked many people to act. I asked senior people⁠—respected people⁠—people with reputations silvered by their concern about AI ethics and safety. Nearly all declined. Take Stuart Russell, a famous AI researcher who spent over a decade crusading against autonomous weapons. I worked at his lab for years. At a conference, on-stage, he agreed to push his organization to make a statement supporting AI providers against government coercion and promised a poll of its members. The statement and poll both vanished. Or take Jeff Dean, who is Google’s Chief Scientist and the co-lead of Google’s Gemini AI project. In 2018, Jeff signed a pledge to never support the development or use of killer robots. I got Jeff to publicly and boldly co-sign an amicus brief (where outsiders weigh in to sway a lawsuit) backing Anthropic against the Pentagon. But I also asked him to use his immense leverage to stop Google from making its own unethical deal with the military, and I don’t think he did. He remains at Google despite his pledge. I wrote a 25-⁠page proposal containing contract language and oversight mechanisms. Military- and surveillance-law experts praised the proposal, which represented a principled counteroffer Google could have stood by. I sent the proposal to Demis Hassabis (gdm’s ceo) who routed it to senior policy staff, only for the proposal to wilt unattended until Google signed a deal. Senior management had insisted that Google wouldn’t sign. I disagreed with them, but they largely ignored my warnings. While I may have increased the Pentagon’s hesitation around the deal, Google still signed a deal handing over their AI without restrictions against killer robots or mass AI spying. Google’s contract restrictions were even weaker than OpenAI’s. At that point, I couldn’t stay at Google in good conscience, so I left. This essay tells the story of why I left Google DeepMind. It is also the story of something larger: how powerful people and institutions failed, one after another, to keep their AI ethics promises in the face of pressure.