Currently, the inhibition gradient is computed in a way that it suppresses neighboring activations. Intuitively, we might instead want to suppress activations that lead to overlapping atoms in the reconstruction. Thus, another inhibition mode might make sense, that ensures pairwise orthogonality of the resulting partial reconstructions.
Currently, the inhibition gradient is computed in a way that it suppresses neighboring activations. Intuitively, we might instead want to suppress activations that lead to overlapping atoms in the reconstruction. Thus, another inhibition mode might make sense, that ensures pairwise orthogonality of the resulting partial reconstructions.