So, if multiplication takes 3 cycles then saving 2/3 of them will give a performance increase. If your matrix is actually stored in a special sparse matrix data structure then you can do even better.

Sparse matrices underpin a vast range of scientific and engineering applications, from finite element analysis and computational fluid dynamics to graph processing and machine learning. By encoding ...