At my church most do hold hands, but if someone doesn't care to, it's not a big issue. We just hold our hands out (the prayer gesture used by the priest when praying) and the persons on either side are free to take the outstretched hand or not. It does not have to be a big issue.