Loss Functions Overview
This section documents the loss functions provided by NWAVE.
The losses are organized into two conceptual families:
-
Network-level losses
Losses that improve training stability, accuracy, or representational behavior. These are hardware-agnostic and can be used with any spiking or non-spiking network. -
Hardware-aware regularizers
Losses designed to account for non-idealities and constraints of the Neuronova neuromorphic chip H1. These losses help produce deployable networks whose parameters comply with hardware limits.
Important consideration
The losses described here represent one possible strategy to obtain hardware-compatible networks. There is no single correct solution: multiple training strategies and regularization schemes may lead to deployable models in an easier way, so is part of the research also to find strategies to reach a deployable configuration of the net.