Skip to content

thisisamirv/Position-wise-optimizer

Repository files navigation

Position-wise-optimizer

Abstract

The human nervous system utilizes synaptic plasticity to solve optimization problems. Previous studies have tried to add the plasticity factor to the training process of artificial neural networks, but most of those models require complex external control over the network or complex novel rules. In this manuscript, a novel nature-inspired optimization algorithm is introduced that imitates biological neural plasticity. Furthermore, the model is tested on three datasets and the results are compared with gradient descent optimization.

Full-text

https://doi.org/10.48550/arXiv.2204.05312

Instructions

1- Make main.py file executable from terminal:

chmod +x main.py

2- Ryn it:

./main.py

3- Choose the dataset, number of layers in the network, number of neurons in each layer, learning rate, and the goal for the cost value.

NOTE: Download Breast Ultrasound Images Dataset from the following link:

https://www.kaggle.com/datasets/aryashah2k/breast-ultrasound-images-dataset

Output example

Figure

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages