FPGA IMPLEMENTATION OF ANN TRAINING USING LEVENBERG AND MARQUARDT ALGORITHMS


Creative Commons License

Cavuslu M. A., ŞAHİN S.

NEURAL NETWORK WORLD, vol.28, no.2, pp.161-178, 2018 (SCI-Expanded) identifier identifier

  • Publication Type: Article / Article
  • Volume: 28 Issue: 2
  • Publication Date: 2018
  • Doi Number: 10.14311/nnw.2018.28.010
  • Journal Name: NEURAL NETWORK WORLD
  • Journal Indexes: Science Citation Index Expanded (SCI-EXPANDED), Scopus
  • Page Numbers: pp.161-178
  • Keywords: Levenberg and Marquardt, FPGA, MLP and ANN training, NEURAL-NETWORKS, HARDWARE IMPLEMENTATION, IDENTIFICATION
  • Kocaeli University Affiliated: Yes

Abstract

Artificial Neural Network (ANN) training using gradient-based Levenberg & Marquardt (LM) algorithm has been implemented on FPGA for the solution of dynamic system identification problems within the scope of the study. In the implementation, IEEE 754 floating-point number format has been used because of the dynamism and sensitivity that it has provided. Mathematical approaches have been preferred to implement the activation function, which is the most critical phase of the study. ANN is tested by using input-output sample sets, which are shown or not shown to the network in the training phase, and success rates are given for every sample set. The obtained results demonstrate that implementation of FPGA-based ANN training is possible by using LM algorithm and as the result of the training, the ANN makes a good generalization.