With the rapid development of artificial intelligence, the electronic system has fallen short of providing the needed computation speed. It is believed that silicon-based optoelectronic computation may be a solution, where Mach–Zehnder interferometer (MZI)-based matrix computation is the key due to its advantages of simple implementation and easy integration on a silicon wafer, but one of the concerns is the precision of the MZI method in the actual computation. This paper will identify the main hardware error sources of MZI-based matrix computation, summarize the available hardware error correction methods from the perspective of the entire MZI meshes and a single MZI device, and propose a new architecture that will largely improve the precision of MZI-based matrix computation without increasing the size of the MZI’s mesh, which may lead to a fast and accurate optoelectronic computing system.