permutation_init
ReservoirComputing.permutation_init — Function
permutation_init([rng], [T], dims...;
weight=0.1, permutation_matrix=nothing, return_sparse=false,
radius=nothing, kwargs...)Creates a permutation reservoir as described in (Boedecker et al., 2009), by first initializing a scaled identity (self-loops) and then applying a column permutation.
This construction yields:
\[ \widehat{W} = \lambda P\]
Arguments
rng: Random number generator. Default isUtils.default_rng()from WeightInitializers.T: Type of the elements in the reservoir matrix. Default isFloat32.dims: Dimensions of the reservoir matrix.
Keyword arguments
weight: Weight used for the initial self-loop initialization (and the magnitude of the nonzeros after permutation). Default is 0.1.permutation_matrix: Optional permutation matrix to apply. Ifnothing, a random permutation is generated (usingrng) and applied.return_sparse: flag for returning asparsematrix.truerequiresSparseArraysto be loaded. Default isfalse.radius: The desired spectral radius of the reservoir. Ifnothingis passed, no scaling takes place. Defaults tonothing.signs: Controls sign flips. UseRandomSigns,RegularSigns, orIrrationalDigitSigns. Passnothingto leave signs unchanged. Default isnothing.
Examples
Default kwargs:
julia> reservoir_matrix = permutation_init(5, 5)
5×5 Matrix{Float32}:
0.0 0.0 0.1 0.0 0.0
0.0 0.0 0.0 0.1 0.0
0.0 0.1 0.0 0.0 0.0
0.1 0.0 0.0 0.0 0.0
0.0 0.0 0.0 0.0 0.1Changing the weights magnitudes to a different unique value:
julia> reservoir_matrix = permutation_init(5, 5; weight=0.99)
5×5 Matrix{Float32}:
0.0 0.0 0.99 0.0 0.0
0.0 0.0 0.0 0.99 0.0
0.0 0.99 0.0 0.0 0.0
0.99 0.0 0.0 0.0 0.0
0.0 0.0 0.0 0.0 0.99Changing the weights signs with different sign patterns:
julia> reservoir_matrix = permutation_init(5, 5; signs = RandomSigns())
5×5 Matrix{Float32}:
0.0 0.1 0.0 0.0 0.0
-0.1 0.0 0.0 0.0 0.0
0.0 0.0 0.0 0.0 0.1
0.0 0.0 0.0 -0.1 0.0
0.0 0.0 0.1 0.0 0.0Changing the weights to random numbers. Note that the length of the given array must be at least as long as the subdiagonal one wants to fill:
julia> weights = Float32[0.2, 0.4, 0.6, 0.8, 1.0];
julia> reservoir_matrix = permutation_init(MersenneTwister(123), 5, 5; weight=weights);
julia> size(reservoir_matrix) == (5, 5) && sort(reservoir_matrix[reservoir_matrix .!= 0]) == weights
trueReturning a sparse matrix:
julia> reservoir_matrix = permutation_init(5, 5; return_sparse=true)
5×5 SparseMatrixCSC{Float32, Int64} with 5 stored entries:
⋅ ⋅ 0.1 ⋅ ⋅
⋅ ⋅ ⋅ 0.1 ⋅
⋅ 0.1 ⋅ ⋅ ⋅
0.1 ⋅ ⋅ ⋅ ⋅
⋅ ⋅ ⋅ ⋅ 0.1References
- Boedecker, J.; Obst, O.; Mayer, N. M. and Asada, M. (2009). Studies on reservoir initialization and dynamics shaping in echo state networks. In: ESANN.