Series

Nullspace and solving Ax=0: special solutions, free variables, reduced row echelon form.

Echelon form and matrix rank: row elimination, leading elements, and solving linear systems.

Vector spaces, subspaces, column space: 8 axioms, subspace properties, and linear combinations.

Vanishing gradients in deep networks: causes (activation functions, initialization), solutions (ReLU, batch norm).

Intro to linear algebra: scalars, vectors, norms, matrices, transpose, and linear combinations.