A new multi-layer artificial neural network learning algorithm based on pattern search method is proposed. The learning model is designed to provide a very simple and effective means of searching the minima of objective function of a multi-layer neural network directly without any knowledge of...