He Normal¶
-
class
HeNormal
(RandomInitializer)¶ He normal initializer.
Reference: [HE-2015]
It draws samples from a truncated normal distribution centered on 0 with
- Real case:
stddev = sqrt(2 / fan_in)
- Complex case: real part stddev = complex part stddev =
1 / sqrt(fan_in)
where
fan_in
is the number of input units in the weight tensor.Standalone usage:
import cvnn initializer = cvnn.initializers.HeNormal() values = initializer(shape=(2, 2)) # Returns a complex He Normal tensor of shape (2, 2)
Usage in a cvnn layer:
import cvnn initializer = cvnn.initializers.HeNormal() layer = cvnn.layers.Dense(input_size=23, output_size=45, weight_initializer=initializer)
- Real case:
-
__call__
(self, shape, dtype=tf.dtypes.complex64)¶ - Returns a real-valued tensor object initialized as specified by the initializer.
- The complex dtype input will only be used to know the limits to be used. This result must be used for the real and imaginary part separately.
Parameters: - shape – Shape of the tensor.
- dtype – Optinal dtype of the tensor. Either floating or complex. ex:
tf.complex64
ortf.float32
[HE-2015] | He, Kaiming, et al. “Delving deep into rectifiers: Surpassing human-level performance on imagenet classification.” Proceedings of the IEEE international conference on computer vision. 2015. |