Neural Network Toolbox User's Guide
[Pages:846]Neural Network Toolbox
For Use with MATLAB?
Howard Demuth Mark Beale
User's Guide
Version 4
How to Contact The MathWorks:
comp.soft-sys.matlab
Web Newsgroup
support@ suggest@ bugs@ doc@ service@ info@
508-647-7000
Technical support Product enhancement suggestions Bug reports Documentation error reports Order status, license renewals, passcodes Sales, pricing, and general information Phone
508-647-7001
Fax
The MathWorks, Inc. 3 Apple Hill Drive Natick, MA 01760-2098
Mail
For contact information about worldwide offices, see the MathWorks Web site.
Neural Network Toolbox User's Guide
? COPYRIGHT 1992 - 2004 by The MathWorks, Inc.
The software described in this document is furnished under a license agreement. The software may be used or copied only under the terms of the license agreement. No part of this manual may be photocopied or reproduced in any form without prior written consent from The MathWorks, Inc.
FEDERAL ACQUISITION: This provision applies to all acquisitions of the Program and Documentation by, for, or through the federal government of the United States. By accepting delivery of the Program or Documentation, the government hereby agrees that this software or documentation qualifies as commercial computer software or commercial computer software documentation as such terms are used or defined in FAR 12.212, DFARS Part 227.72, and DFARS 252.227-7014. Accordingly, the terms and conditions of this Agreement and only those rights specified in this Agreement, shall pertain to and govern the use, modification, reproduction, release, performance, display, and disclosure of the Program and Documentation by the federal government (or other entity acquiring for or through the federal government) and shall supersede any conflicting contractual terms or conditions. If this License fails to meet the government's needs or is inconsistent in any respect with federal procurement law, the government agrees to return the Program and Documentation, unused, to The MathWorks, Inc.
MATLAB, Simulink, Stateflow, Handle Graphics, and Real-Time Workshop are registered trademarks, and TargetBox is a trademark of The MathWorks, Inc.
Other product or brand names are trademarks or registered trademarks of their respective holders.
History:
June 1992 April 1993 January 1997 July 1997 January 1998 September 2000 June 2001 July 2002 January 2003 June 2004 October 2004
First printing Second printing Third printing Fourth printing Fifth printing Sixth printing Seventh printing Online only Online only Online only Online only
Revised for Version 3 (Release 11) Revised for Version 4 (Release 12) Minor revisions (Release 12.1) Minor revisions (Release 13) Minor revisions (Release 13SP1) Revised for Release 14 Revised for Version 4.0.4 (Release 14SP1)
Preface
Neural Networks (p. vi)
Defines and introduces Neural Networks
Basic Chapters (p. viii)
Identifies the chapters in the book with the basic, general knowledge needed to use the rest of the book
Mathematical Notation for Equations and Defines the mathematical notation used throughout
Figures (p. ix)
the book
Mathematics and Code Equivalents (p. xi) Provides simple rules for transforming equations to code and visa versa
Neural Network Design Book (p. xii)
Gives ordering information for a useful supplemental book
Acknowledgments (p. xiii)
Identifies and thanks people who helped make this book possible
Preface
Neural Networks
Neural networks are composed of simple elements operating in parallel. These elements are inspired by biological nervous systems. As in nature, the network function is determined largely by the connections between elements. We can train a neural network to perform a particular function by adjusting the values of the connections (weights) between elements.
Commonly neural networks are adjusted, or trained, so that a particular input leads to a specific target output. Such a situation is shown below. There, the network is adjusted, based on a comparison of the output and the target, until the network output matches the target. Typically many such input/target pairs are used, in this supervised learning, to train a network.
Target
Input
Neural Network including connections (called weights) between neurons
Output
Compare
Adjust weights
Batch training of a network proceeds by making weight and bias changes based on an entire set (batch) of input vectors. Incremental training changes the weights and biases of a network as needed after presentation of each individual input vector. Incremental training is sometimes referred to as "on line" or "adaptive" training.
Neural networks have been trained to perform complex functions in various fields of application including pattern recognition, identification, classification, speech, vision and control systems. A list of applications is given in Chapter 1.
Today neural networks can be trained to solve problems that are difficult for conventional computers or human beings. Throughout the toolbox emphasis is placed on neural network paradigms that build up to or are themselves used in engineering, financial and other practical applications.
vi
Neural Networks
The supervised training methods are commonly used, but other networks can be obtained from unsupervised training techniques or from direct design methods. Unsupervised networks can be used, for instance, to identify groups of data. Certain kinds of linear networks and Hopfield networks are designed directly. In summary, there are a variety of kinds of design and learning techniques that enrich the choices that a user can make. The field of neural networks has a history of some five decades but has found solid application only in the past fifteen years, and the field is still developing rapidly. Thus, it is distinctly different from the fields of control systems or optimization where the terminology, basic mathematics, and design procedures have been firmly established and applied for many years. We do not view the Neural Network Toolbox as simply a summary of established procedures that are known to work well. Rather, we hope that it will be a useful tool for industry, education and research, a tool that will help users find what works and what doesn't, and a tool that will help develop and extend the field of neural networks. Because the field and the material are so new, this toolbox will explain the procedures, tell how to apply them, and illustrate their successes and failures with examples. We believe that an understanding of the paradigms and their application is essential to the satisfactory and successful use of this toolbox, and that without such understanding user complaints and inquiries would bury us. So please be patient if we include a lot of explanatory material. We hope that such material will be helpful to you.
vii
Preface
Basic Chapters
The Neural Network Toolbox is written so that if you read Chapter 2, Chapter 3 and Chapter 4 you can proceed to a later chapter, read it and use its functions without difficulty. To make this possible, Chapter 2 presents the fundamentals of the neuron model, the architectures of neural networks. It also will discuss notation used in the architectures. All of this is basic material. It is to your advantage to understand this Chapter 2 material thoroughly. The neuron model and the architecture of a neural network describe how a network transforms its input into an output. This transformation can be viewed as a computation. The model and the architecture each place limitations on what a particular neural network can compute. The way a network computes its output must be understood before training methods for the network can be explained.
viii
................
................
In order to avoid copyright disputes, this page is only a partial summary.
To fulfill the demand for quickly locating and searching documents.
It is intelligent file search solution for home and business.
Related download
- 7 artificial neural networks mit
- chapter neural networks and neural language models
- single image crowd counting via multi column convolutional
- ieee transactions on xxxx vol x no x mm yyyy 1 a
- neural network toolbox user s guide
- the graph neural network model persagen consulting
- generating sequences with recurrent neural networks
- siamese neural networks for one shot image recognition
- weight uncertainty in neural networks
Related searches
- neural network online learning
- online neural network trainer
- neural network problems
- neural network in machine learning
- neural network vs ai
- neural network structure
- neural network examples
- neural network vs machine learning
- artificial neural network introduction
- neural network vs artificial intelligence
- types of neural network algorithms
- artificial neural network application