Google employees demand AI rules to preclude use as weapons

By: (plus.google.com) +David Herron; Date: June 28, 2018

Tags: Google » Face Recognition » Big Brother » Machine Learning

Google's culture of open free-flowing discussion could be ending in the wake of an uproar over Google's partnership with the US Dept. of Defense, called Project Maven, on AI software to analyze drone footage. Since Google's participation in Project Maven was publicly revealed in March, a raging debate with Google has swirled around whether the company famous for its "Do No Evil" slogan should be involved with making weapons. Googlers even sent an open letter to Google CEO Sundar Pichai starting with the declaration "We believe that Google should not be in the business of war." That letter flatly called for Google's participation in Project Maven to be canceled.

On June 27, 2018, it is learned that Google has instituted new rules for internal discussion and workplace conduct within the company.

Project Maven was described a year ago as an "effort to help a workforce increasingly overwhelmed by incoming data, including millions of hours of video". That workforce appears to be the military intelligence analysts studying video from drone flights over war zones. According to (gizmodo.com) a Gizmodo report in March, the amount of footage is so vast the analysts cannot keep up.

The idea is to use machine learning, and computer vision, techniques to analyze video and automatically identify approximately 38 classes of objects. Primarily this would be in Syria in the fight against the Islamic State of Iraq and Syria (a.k.a. ISIS).

I'll note in passing - earlier this week Amazon employees launched an internal protest over the federal government using Amazon's cloud based video analysis platform, Rekognition. The issue in that case seems to be Immigration Control and Enforcement (ICE) using real time video analysis at the USA-Mexico border in the context of the current immigration crisis at the border. Given that Project Maven is having several companies in competition, Amazon is likely to be involved with Maven as well.

A Google spokesperson told Gizmodo: “We have long worked with government agencies to provide technology solutions. This specific project is a pilot with the Department of Defense, to provide open source TensorFlow APIs that can assist in object recognition on unclassified data. The technology flags images for human review, and is for non-offensive uses only. Military use of machine learning naturally raises valid concerns. We’re actively discussing this important topic internally and with others as we continue to develop policies and safeguards around the development and use of our machine learning technologies.”

In April, the (www.nytimes.com) NY Times reported on an internal letter (below) sent by Google employees to Google CEO Sundar Pichai, as well as other issues.

The video analysis technology itself is non-offensive when used to analyze drone footage. There is a slippery slope at the bottom of which are artificially intelligent robots deciding on their own what targets to attack.

Google told the NY Times that the TensorFlow software is available to any Google Cloud customer. Indeed, go to (cloud.google.com) cloud.google.com, click on Products, and you'll find several services running on Google's Cloud related to video analysis. The same is true for Amazon, where its AWS cloud platform includes video analysis services.

Part of the issue here is that Google has not done as much partnering with the US Government as has Amazon and Microsoft. Both those companies are not shy about partnering with spy agencies or the military, while Google has not openly done so. Google is, however, looking to get into the business of providing high tech solutions to the US military.

By May 30, 2018, (9to5google.com) 9to5Google reported that new policies were being developed inside Google. Despite those policies, several engineers have left Google in protest. An NY Times article the same day describes the Pentagon Contract as an Identity Crisis for Google. The Don't Be Evil motto is drilled into Googlers from the beginning, and it is hard to defend working with the military as not being Evil.

By June 1, 2018, (www.nytimes.com) the NY Times reported that Google announced it would not renew its Project Maven contract. This article spent most of its time on the competitive landscape. It's not clear precisely what it means for Google to cancel the contract, since the military could simply sign up for Google cloud services on its own without involving engineering contact from Google AI researchers. And for that matter there are plenty of AI companies with no compunctions against working with the military.

Google had hoped its involvement with Project Maven would open the door to more Government work in the future. That door may have closed now, unless Google is ingenious about a circuitous route to collaborating with the government.

By June 27, 2018, (9to5google.com) 9to5Google reported on the new policies. The policies includes limits on offensive language and ad hominem attacks, with employees subject to discipline for discriminating or attacking other Googlers, targets "trolling" (posting something meant to inflame discussion) and discussions that are “disruptive to a productive work environment.”

These kinds of rules can be broad and open to interpretation, especially when they call for an adherence to "Google Values." Maybe when Google was a 1,000 or 2,000 person company it could have a fairly well defined set of Values, but now that Google is 80,000 people?

For example:

Discussions that make other Googlers feel like they don’t belong have no place here. Avoid blanket statements about groups or categories of people. Trolling, name calling, and ad hominem attacks will not be tolerated.

This is nicely said, but is it worded precisely enough to be used as justification for firing someone?

Googlers letter to Sundar Pichai

Retrieved from: (static01.nyt.com) https://static01.nyt.com/files/2018/technology/googleletter.pdf

Dear Sundar,

We believe that Google should not be in the business of war. Therefore we ask that Project Maven be cancelled, and that Google draft, publicize and enforce a clear policy stating that neither Google nor its contractors will ever build warfare technology.

Google is implementing Project Maven, a customized AI surveillance engine that uses “Wide Area Motion Imagery” data captured by US Government drones to detect vehicles and other objects, track their motions, and provide results to the Department of Defense.

Recently, Googlers voiced concerns about Maven internally. Diane Greene responded, assuring them that the technology will not “operate or fly drones” and “will not be used to launch weapons.” While this eliminates a narrow set of direct applications, the technology is being built for the military, and once it’s delivered it could easily be used to assist in these tasks.

This plan will irreparably damage Google’s brand and its ability to compete for talent. Amid growing fears of biased and weaponized AI, Google is already struggling to keep the public’s trust. By entering into this contract, Google will join the ranks of companies like Palantir, Raytheon, and General Dynamics. The argument that other firms, like Microsoft and Amazon, are also participating doesn’t make this any less risky for Google. Google’s unique history, its motto Don’t Be Evil, and its direct reach into the lives of billions of users set it apart.

We cannot outsource the moral responsibility of our technologies to third parties. Google’s stated values make this clear: Every one of our users is trusting us. Never jeopardize that. Ever. This contract puts Google’s reputation at risk and stands in direct opposition to our core values. Building this technology to assist the US Government in military surveillance – and potentially lethal outcomes – is not acceptable.

Recognizing Google’s moral and ethical responsibility, and the threat to Google’s reputation, we request that you:

  1. Cancel this project immediately
  2. Draft, publicize, and enforce a clear policy stating that neither Google nor its contractors will ever build warfare technology
« Special feature - Planet of Giants Recreated - Planet of Giants - Doctor Who - BBC William Russell returns to the role of Ian Chesterton after 34 Years »
2016 Election 2018 Elections Acer C720 Ad block Air Filters Air Quality Air Quality Monitoring AkashaCMS Amazon Amazon Kindle Amazon Web Services America Amiga and Jon Pertwee Android Anti-Fascism AntiVirus Software Apple Apple Hardware History Apple iPhone Apple iPhone Hardware April 1st Arduino ARM Compilation Artificial Intelligence Astronomy Astrophotography Asynchronous Programming Authoritarianism Automated Social Posting AWS DynamoDB AWS Lambda Ayo.JS Bells Law Big Brother Big Data Big Finish Big Science Bitcoin Mining Black Holes Blade Runner Blockchain Blogger Blogging Books Botnets Cassette Tapes Cellphones China China Manufacturing Christopher Eccleston Chrome Chrome Apps Chromebook Chromebox ChromeOS CIA CitiCards Citizen Journalism Civil Liberties Climate Change Clinton Cluster Computing Command Line Tools Comment Systems Computer Accessories Computer Hardware Computer Repair Computers Conservatives Cross Compilation Crouton Cryptocurrency Curiosity Rover Currencies Cyber Security Cybermen Cybersecurity Daleks Darth Vader Data backup Data Formats Data Storage Database Database Backup Databases David Tenant DDoS Botnet Department of Defense Department of Justice Detect Adblocker Developers Editors Digital Nomad Digital Photography Diskless Booting Disqus DIY DIY Repair DNP3 Do it yourself Docker Docker MAMP Docker Swarm Doctor Who Doctor Who Paradox Doctor Who Review Drobo Drupal Drupal Themes DVD E-Books E-Readers Early Computers eGPU Election Hacks Electric Bicycles Electric Vehicles Electron Eliminating Jobs for Human Emdebian Encabulators Energy Efficiency Enterprise Node EPUB ESP8266 Ethical Curation Eurovision Event Driven Asynchronous Express Face Recognition Facebook Fake News Fedora VirtualBox Fifth Doctor File transfer without iTunes FireFly Flash Flickr Fraud Freedom of Speech Front-end Development G Suite Gallifrey git Github GitKraken Gitlab GMAIL Google Google Chrome Google Gnome Google+ Government Spying Great Britain Green Transportation Hate Speech Heat Loss Hibernate High Technology Hoax Science Home Automation HTTP Security HTTPS Human ID I2C Protocol Image Analysis Image Conversion Image Processing ImageMagick In-memory Computing InfluxDB Infrared Thermometers Insulation Internet Internet Advertising Internet Law Internet of Things Internet Policy Internet Privacy iOS Devices iPad iPhone iPhone hacking Iron Man iShowU Audio Capture iTunes Janet Fielding Java JavaFX JavaScript JavaScript Injection JDBC John Simms Journalism Joyent Kaspersky Labs Kext Kindle Kindle Marketplace Large Hadron Collider Lets Encrypt LibreOffice Linux Linux Hints Linux Single Board Computers Logging Mac Mini Mac OS Mac OS X Machine Learning Machine Readable ID Macintosh macOS macOS High Sierra macOS Kext MacOS X setup Make Money Online March For Our Lives MariaDB Mars Mass Violence Matt Lucas MEADS Anti-Missile Mercurial MERN Stack Michele Gomez Micro Apartments Microsoft Military AI Military Hardware Minification Minimized CSS Minimized HTML Minimized JavaScript Missy Mobile Applications Mobile Computers MODBUS Mondas Monetary System MongoDB Mongoose Monty Python MQTT Music Player Music Streaming MySQL NanoPi Nardole NASA Net Neutrality Network Attached Storage Node Web Development Node.js Node.js Database Node.js Performance Node.js Testing Node.JS Web Development Node.x North Korea npm NVIDIA NY Times Online advertising Online Community Online Fraud Online Journalism Online Photography Online Video Open Media Vault Open Source Open Source and Patents Open Source Governance Open Source Licenses Open Source Software OpenAPI OpenJDK OpenVPN Palmtop PDA Patrick Troughton PayPal Paywalls Personal Flight Peter Capaldi Peter Davison Phishing Photography PHP Plex Plex Media Server Political Protest Politics Postal Service Power Control President Trump Privacy Production use Public Violence Raspberry Pi Raspberry Pi 3 Raspberry Pi Zero ReactJS Recaptcha Recycling Refurbished Computers Remote Desktop Removable Storage Republicans Retro Computing Retro-Technology Reviews RFID Rich Internet Applications Right to Repair River Song Robotics Robots Rocket Ships RSS News Readers rsync Russia Russia Troll Factory Russian Hacking Rust SCADA Scheme Science Fiction SD Cards Search Engine Ranking Season 1 Season 10 Season 11 Security Security Cameras Server-side JavaScript Serverless Framework Servers Shell Scripts Silence Simsimi Skype SmugMug Social Media Social Media Networks Social Media Warfare Social Network Management Social Networks Software Development Software Patents Space Flight Space Ship Reuse Space Ships SpaceX Spear Phishing Spring Spring Boot Spy Satellites SQLite3 SSD Drives SSD upgrade SSH SSH Key SSL Stand For Truth Strange Parts Swagger Synchronizing Files Tegan Jovanka Telescopes Terrorism The Cybermen The Daleks The Master Time-Series Database Tom Baker Torchwood Total Information Awareness Trump Trump Administration Trump Campaign Twitter Ubuntu Udemy UDOO US Department of Defense Virtual Private Networks VirtualBox VLC VNC VOIP Vue.js Walmart Weapons Systems Web Applications Web Developer Resources Web Development Web Development Tools Web Marketing Webpack Website Advertising Weeping Angels WhatsApp William Hartnell Window Insulation Windows Windows Alternatives Wordpress World Wide Web Yahoo YouTube YouTube Monetization