Stochastic Weight Update in Neural Networks - Theoretical study of stochastic neural networks learning

This book is focused on the modification of the Backpropagation Through Time algorithm and its implementation on the Recurrent Neural Networks. Our work is inspired and motivated by the results of the Salvetti and Wilamowski experiment focused on the introduction of stochasticity into Backpropagation algorithm on experiments with the XOR problem. The stochasticity can be embedded into different parts of the BP algorithm. We introduced and implemented different types of BP algorithm modifications, which gradually add more stochasticity to the BP algorithm. The goal of this book is to prove, that this stochastic modification is able to learn efficiently and the results are comparable to classical implementation. This stochasticity also brings a simpler implementation of the algorithm, than the classical one, which is especially useful on the Recurrent Neural Networks.

About the author

Juraj Köcak works as Senior Developer commercially.He studied his Master in 2007 and finished Doctorate part-time in 2012from Technical University in Köice,Department of Cybernetic and Artificial Intelligence, Slovakia.

Product details

• Authors: Rudolf Jak a, Rudolf Jak¿a, Rudol Jaksa, Rudolf Jaksa, Juraj Ko ák, Juraj Ko¿¿ák, Jura Koscák, Juraj Koscák, Peter Sin ák, Peter Sin¿ák, Peter Sincák
• Publisher: LAP Lambert Academic Publishing
• Languages: English, German
• Product format: Paperback / Softback
• Released: 12.09.2012
• EAN: 9783659231025
• ISBN: 978-3-659-23102-5
• No. of pages: 104
• Dimensions: 150 mm x 220 mm x 6 mm
• Weight: 156 g
• Subjects: Guides; Natural sciences, medicine, IT, technology > IT, data processing > Miscellaneous