| ### Index
Neural Smithing: Supervised Learning in Feedforward Artificial Neural Networks
Russell D. Reed and Robert J. Marks II
Copyright © 1999 Massachusetts Institute of Technology

## Index

### O

OBD (optimal brain damage), 131, 223, 225, 235
Objective function. See also Error function
introduction to, 7, 9-11
penalty terms for, 10-11
selection of, 155-156
OBS (optimal brain surgeon), 223-225, 235
Off-line algorithms, 49, 62
One-hidden-layer networks, 33-41, 124
On-line learning, 59-62, 155
algorithm variations and, 147
eigenvalue estimation and, 82-84
error surface and, 117, 122-123
generalization and, 251
On-line learning (cont.)
pseudocode example for, 65-66
random initialization and, 105
training time and, 68, 80
Optimal brain damage (OBD), 131, 223, 225, 235
Optimal brain surgeon (OBS), 223-225, 235
Optimal perceptron, 26
Optimization
as cost minimization, 156
meta-, 157
Optimization methods
back-propagation (see Back-propagation algorithm)
classical (see Classical optimization methods)
classification of, 158
selection of, 156-158, 182
variety of, 57, 67, 155
OR function, 39, 109
Orthogonal vectors, 29
Orthonormal vectors, 29
Oscillation, 213-214
Outer-product approximation, 130-131
Output nodes, 31
derivative calculation for, 53-54
random initialization and, 102, 104
Overtraining
complexity and, 241-242
constructive methods and, 198
jitter and, 292
learning dynamics and, 249-251
pruning and, 237

Books24x7.com, Inc. © 1999-2001 – Feedback