The Deep Learning Revolution

by Terrence J. Sejnowski

Overview

How deep learning—from Google Translate to driverless cars to personal cognitive assistants—is changing our lives and transforming every sector of the economy.

The deep learning revolution has brought us driverless cars, the greatly improved Google Translate, fluent conversations with Siri and Alexa, and enormous profits from automated trading on the New York Stock Exchange. Deep learning networks can play poker better than professional poker players and defeat a world champion at Go. In this book, Terry Sejnowski explains how deep learning went from being an arcane academic field to a disruptive technology in the information economy.

Sejnowski played an important role in the founding of deep learning, as one of a small group of researchers in the 1980s who challenged the prevailing logic-and-symbol based version of AI. The new version of AI Sejnowski and others developed, which became deep learning, is fueled instead by data. Deep networks learn from data in the same way that babies experience the world, starting with fresh eyes and gradually acquiring the skills needed to navigate novel environments. Learning algorithms extract information from raw data; information can be used to create knowledge; knowledge underlies understanding; understanding leads to wisdom. Someday a driverless car will know the road better than you do and drive with more skill; a deep learning network will diagnose your illness; a personal cognitive assistant will augment your puny human brain. It took nature many millions of years to evolve human intelligence; AI is on a trajectory measured in decades. Sejnowski prepares us for a deep learning future.

Product Details

ISBN-13:	9780262038034
Publisher:	MIT Press
Publication date:	10/23/2018
Series:	The MIT Press
Pages:	352
Sales rank:	1,109,403
Product dimensions:	6.10(w) x 9.10(h) x 1.10(d)
Age Range:	18 Years

About the Author

Terrence J. Sejnowski holds the Francis Crick Chair at the Salk Institute for Biological Studies and is a Distinguished Professor at the University of California, San Diego. He was a member of the advisory committee for the Obama administration's BRAIN initiative and is President of the Neural Information Processing (NIPS) Foundation. He is the author of The Deep Learning Revolution (MIT Press) and other books.

Table of Contents

Preface ix

Part I Intelligence Reimagined 1

1 The Rise of Machine Learning 3

2 The Rebirth of Artificial Intelligence 27

3 The Dawn of Neural Networks 37

4 Brain-style Computing 49

5 Insights from the Visual System 63

Part II Many Ways to Learn 79

6 The Cocktail Party Problem 81

7 The Hopfield Net and Boltzmann Machine 91

8 Backpropagating Errors 109

9 Convolutional Learning 127

10 Reward Learning 143

11 Neural Information Processing Systems 161

Part III Technological and Scientific Impact 169

12 The Future of Machine Learning 171

13 The Age of Algorithms 195

14 Hello, Mr. Chips 205

15 Inside Information 219

16 Consciousness 233

17 Nature Is Cleverer Than We Are 245

18 Deep Intelligence 261

Acknowledgments 269

Recommended Reading 275

Glossary 281

Notes 285

Index 321

What People are Saying About This

Endorsement

Sejnowski's intimate tour of the history and people who have led the deep learning revolution offers insights and anecdotes on every page. The Sturm und Drang of the story permeates the book as you partake of the author's personal involvement and excitement.

—Vint Cerf, internet pioneer

From the Publisher

AI is now awakening and transforming our world. Driving these breakthroughs is the deep learning revolution, with roots in thirty years of work by pioneers like Terry Sejnowski. If you want to understand AI, you need to read The Deep Learning Revolution.

—Erik Brynjolfsson, Schussel Family Professor of Management Science at MIT Sloan School of Management coauthor of The Second Machine Age

This is a fabulous, must-read book that makes a very complex subject come alive in a way that is understandable to all. It weaves together the worlds of neural networks and neuroscience, using the power of storytelling to explain the past, present and possible futures of artificial intelligence.

—Dame Wendy Hall, Regius Professor of Computer Science, University of Southampton, UK

Terry Sejnowski, one of the pioneers of deep learning, has now moved this important insight from a theoretical proposition to an empirical science. A major advance.

—Eric Kandel, Fred Kavli Professor, Department of Neuroscience, and Director, Kavli Institute for Brain Science, Columbia University, author of Reductionism in Art and Brain Science: Bridging the Two Cultures

Sejnowski's intimate tour of the history and people who have led the deep learning revolution offers insights and anecdotes on every page. The Sturm und Drang of the story permeates the book as you partake of the author's personal involvement and excitement.

—Vint Cerf, internet pioneer

Editorial Reviews

"Sejnowski’s book is part history lesson, part textbook and part memoir, with varying levels of accessibility. Those with an existing interest in the topic will be charmed and enlightened."
—The Washington Post

"The Deep Learning Revolution is an important and timely book, written by a gifted scientist at the cutting edge of the AI revolution."
—Nature

"If you're serious about deep learning, as either a researcher, practitioner or student, you should definitely consider consuming this book."
—InsideBigData

"Sejnowski, a pioneer in the study of learning algorithms, is the author of The Deep Learning Revolution. He argues that the hype about killer AI or robots making us obsolete ignores exciting possibilities happening in the fields of computer science and neuroscience, and what can happen when artificial intelligence meets human intelligence."
—The Verge

From the Publisher