Why would we look at a wall?  Does not God's spirit also dwell in each and every human being.  Again, in the liturgy, the altar represents the table of the Last Supper where Jesus sat with his disciples and shared a meal.

If the table was to be a CROSS of SACRIFICE, it would be shaped as a cross.