Book Details

ISBN 139781787128422

Paperback318 pages

Book Description

This book starts by introducing you to supervised learning algorithms such as simple linear regression, the classical multilayer perceptron and more sophisticated deep convolutional networks. You will also explore image processing with recognition of hand written digit images, classification of images into different categories, and advanced objects recognition with related image annotations. An example of identification of salient points for face detection is also provided. Next you will be introduced to Recurrent Networks, which are optimized for processing sequence data such as text, audio or time series. Following that, you will learn about unsupervised learning algorithms such as Autoencoders and the very popular Generative Adversarial Networks (GAN). You will also explore non-traditional uses of neural networks as Style Transfer.

Finally, you will look at Reinforcement Learning and its application to AI game playing, another popular direction of research and application of neural networks.

Table of Contents

Chapter 1: Neural Networks Foundations

Perceptron

Multilayer perceptron — the first example of a network

A real example — recognizing handwritten digits

A practical overview of backpropagation

Towards a deep learning approach

Summary

Chapter 2: Keras Installation and API

Installing Keras

Configuring Keras

Installing Keras on Docker

Installing Keras on Google Cloud ML

Installing Keras on Amazon AWS

Installing Keras on Microsoft Azure

Keras API

Callbacks for customizing the training process

Summary

Chapter 3: Deep Learning with ConvNets

Deep convolutional neural network — DCNN

An example of DCNN — LeNet

Recognizing CIFAR-10 images with deep learning

Very deep convolutional networks for large-scale image recognition

Summary

Chapter 4: Generative Adversarial Networks and WaveNet

What is a GAN?

Deep convolutional generative adversarial networks

Keras adversarial GANs for forging MNIST

Keras adversarial GANs for forging CIFAR

WaveNet — a generative model for learning how to produce audio

Summary

Chapter 5: Word Embeddings

Distributed representations

word2vec

Exploring GloVe

Using pre-trained embeddings

Summary

Chapter 6: Recurrent Neural Network — RNN

SimpleRNN cells

RNN topologies

Vanishing and exploding gradients

Long short term memory — LSTM

Gated recurrent unit — GRU

Bidirectional RNNs

Stateful RNNs

Other RNN variants

Summary

Chapter 7: Additional Deep Learning Models

Keras functional API

Regression networks

Unsupervised learning — autoencoders

Composing deep networks

Customizing Keras

Generative models

Summary

Chapter 8: AI Game Playing

Reinforcement learning

Example - Keras deep Q-network for catch

The road ahead

Summary

Chapter 9: Conclusion

Keras 2.0 — what is new

What You Will Learn

Optimize step-by-step functions on a large neural network using the Backpropagation Algorithm

Authors

Antonio Gulli

Antonio Gulli is a software executive and business leader with a passion for establishing and managing global technological talent, innovation, and execution. He is an expert in search engines, online services, machine learning, information retrieval, analytics, and cloud computing. So far, he has been lucky enough to gain professional experience in four different countries in Europe and managed people in six different countries in Europe and America. Antonio served as CEO, GM, CTO, VP, director, and site lead in multiple fields spanning from publishing (Elsevier) to consumer internet (Ask.com and Tiscali) and high-tech R&D (Microsoft and Google).

Sujit Pal

Sujit Pal is a technology research director at Elsevier Labs, working on building intelligent systems around research content and metadata. His primary interests are information retrieval, ontologies, natural language processing, machine learning, and distributed processing. He is currently working on image classification and similarity using deep learning models. Prior to this, he worked in the consumer healthcare industry, where he helped build ontology-backed semantic search, contextual advertising, and EMR data processing platforms. He writes about technology on his blog at Salmon Run.

Alerts & Offers

Series & Level

We understand your time is important. Uniquely amongst the major publishers, we seek to develop and publish the broadest range of learning and information products on each technology. Every Packt product delivers a specific learning pathway, broadly defined by the Series type. This structured approach enables you to select the pathway which best suits your knowledge level, learning style and task objectives.

Learning

As a new user, these step-by-step tutorial guides will give you all the practical skills necessary to become competent and efficient.

Beginner's Guide

Friendly, informal tutorials that provide a practical introduction using examples, activities, and challenges.

Essentials

Fast paced, concentrated introductions showing the quickest way to put the tool to work in the real world.

Cookbook

A collection of practical self-contained recipes that all users of the technology will find useful for building more powerful and reliable systems.

Blueprints

Guides you through the most common types of project you'll encounter, giving you end-to-end guidance on how to build your specific solution quickly and reliably.

Mastering

Take your skills to the next level with advanced tutorials that will give you confidence to master the tool's most powerful features.

Starting

Accessible to readers adopting the topic, these titles get you into the tool or technology so that you can become an effective user.

Progressing

Building on core skills you already have, these titles share solutions and expertise so you become a highly productive power user.