peal.global_utils.orthogonal_initialization¶
- peal.global_utils.orthogonal_initialization(model)[source]¶
Orthogonally initialise all weights and zero all biases.
Every parameter with at least two dimensions gets
torch.nn.init.orthogonal_; one-dimensional parameters (biases, norm scales) are set to zero.- Parameters:
model (
torch.nn.Module) – Model modified in place.