SimpleNN
SimpleNN is a simplified framework for building and training neural networks models. Framework is build on modularity and flexibility to enable easy adoption and feature expansions.
Currently SimpleNN only supports sequential models. Only sequential execution graphs are supported. This means that the following operations are not supported:
- Concatenations of any kind (Residual gates or multiple inputs)
- Addition/Multiplications of layers
- Loops (RNNs)
Originally built as a learning excercise.
For complete examples check the /examples directory.
Getting Started
Install
pip install simple-neural
# Multi class classification
FEATURES = 5
N_CLASSES = 3
class DemoNetwork(Network):
def __init__(self, *args, **kwargs):
super().__init__(*args, **kwargs)
self.l1 = Dense(FEATURES, 64, W_l2=1e-3, b_l2=1e-3)
self.activation1 = ReLu()
self.l2 = Dense(32, N_CLASSES)
self.output = SoftMaxLoss(loss=CategoricalCrossEntropy())
def forward(self, x, targets): # define forward pass
x = self.l1(x)
x = self.activation1(x)
x = self.l2(x)
return self.output(x, targets)
optimizer = Adam(lr=0.03, decay=5e-7, b1=0.9, b2=0.999)
acc = Accuracy()
model = DemoNetwork(optimizer=optimizer)
model.fit(X, y, epochs=1000, metrics=[acc])
Saving/Loading Network
from simplenn import Network
# serialize
model.save('simplemodel.pkl')
# deserialize
m2 = Network.load('simplemodel.pkl')
yhat = m2.predict(X)
Features
Layers
- Dense : simplenn.layers.Dense
- Dropout : simplenn.layers.Dropout
Activations
- ReLu : simplenn.activation.ReLu
- Sigmoid : simplenn.activation.Sigmoid
- SoftMax : simplenn.activation.SoftMax
- Linear : simplenn.activation.Linear
Losses
- Binary cross entropy : simplenn.metrics.loss.BinaryCrossEntropy
- Categorical cross entropy : simplenn.metrics.loss.CategoricalCrossEntropy
- Mean absolute error : simplenn.metrics.loss.MeanAbsoluteError
- Mean squared error : simplenn.metrics.loss.MeanSquaredError
Optimizers
- Stochastic Gradient Descent : simplenn.optimizers.SGD
- Adaptive Gradient : simplenn.optimizers.AdaGrad
- Root Mean Squared Propagation : simplenn.optimizers.RMSProp
- Adaptive Moment Estimation : simplenn.optimizers.Adam
Metrics
- Accuracy : simplenn.metrics.Accuracy
- Mean absolute error : simplenn.metrics.loss.MeanAbsoluteError
- Mean squared error : simplenn.metrics.loss.MeanSquaredError
- Area under the curve - receiver operating characteristic : simplenn.metrics.AucROC
- Area under the curve - precision recall curve : simplenn.metrics.AucPRC
- TPR (Recall) : simplenn.metrics.TPR
- FPR : simplenn.metrics.FPR