Toolkit Reference - Pytorch/Matlab ML Toolbox                Home : www.sharetechnote.com

Followings are a kind of cheatsheet that I frequently refer to when I am writing/reading Pytorch code. These are not my own note. These would lead you to Pytorch and Matlab official document page or someone else note in internet.

• torch.nn (Pytorch)
• Activation Function/Transfer Function (Matlab ML Toolbox)
• compet - Competitive transfer function.
• elliotsig - Elliot sigmoid transfer function.
• hardlim - Positive hard limit transfer function.
• hardlims - Symmetric hard limit transfer function.
• logsig - Logarithmic sigmoid transfer function.
• netinv - Inverse transfer function.
• poslin - Positive linear transfer function.
• purelin - Linear transfer function.
• radbas - Radial basis transfer function.
• radbasn - Radial basis normalized transfer function.
• satlin - Positive saturating linear transfer function.
• satlins - Symmetric saturating linear transfer function.
• softmax - Soft max transfer function.
• tansig - Symmetric sigmoid transfer function.
• tribas - Triangular basis transfer function.
• Activation Functions (Pytorch)
• torch.nn.AdaptiveLogSoftmaxWithLoss
• torch.nn.ELU
• torch.nn.Hardshrink
• torch.nn.Hardtanh
• torch.nn.LeakyReLU
• torch.nn.LogSigmoid
• torch.nn.LogSoftmax
• torch.nn.MultiheadAttention
• torch.nn.PReLU
• torch.nn.ReLU
• torch.nn.ReLU6
• torch.nn.RReLU
• torch.nn.SELU
• torch.nn.Sigmoid
• torch.nn.Softmin
• torch.nn.Softmax
• torch.nn.Softmax2d
• torch.nn.Softplus
• torch.nn.Softshrink
• torch.nn.Softsign
• torch.nn.Tanh
• torch.nn.Tanhshrink
• torch.nn.Threshold
• Loss Functions (Pytorch)
• torch.nn.CrossEntropyLoss
• torch.nn.L1Loss (Mean Absolute Error)
• torch.nn.MSELoss(Mean Square Error)
• Perform Function/Loss Functions (Matlab ML Toolbox)
• mse / Mean squared normalized error performance function
• sae / Sum absolute error performance function
• sse / Sum squared error performance function
• torch.optim / Weight Update Algorithm
• torch.optim.Adagrad (Adaptive Subgradient Methods)
• torch.optim.Adadelta (Adaptive Learning Rate Method)
• torch.optim.SGD (Stochastic Gradient Descent)
• Training Function / Weight Update Algorithm (Matlab ML Toolbox)
• traingd / Gradient descent backpropagation
• trainlm / Levenberg-Marquardt backpropagation