Radovan, guess what the answer is...
Because A is defined symbolically.
Each use of A calls the definition and produces new random numbers.
It does not help to switch optimization to numeric, because that first generates the random number and then adds it to the zero matrix. Thus A becomes singular (all identical numbers.)
One might wish to define more precisely, what adding a random number to a matrix should give. First picking the number and adding it or first adding the call to all elements and then picking the numbers.

Martin Kraska
Pre-configured portable distribution of SMath Studio: https://en.smath.info/wiki/SMath%20with%20Plugins.ashx