"At My Most Beautiful" is performed in the key of F major. There are several main chord progressions in the song: the introduction is Fmaj7–D–G minor, while the verse follows a I–III–IV–II chord sequence and the chorus ascends using a II–III–IV–V progression. In the mix, tubular and sleigh bells are heard in the right channel (with their reverberation reaching into the left), piano and bass guitar (both played in quarter note patterns) as well as bass harmonica are heard in the left, and guitar and Mike Mills' backing vocals are centered. Additional instrumentation includes organ in the chorus and cellos in the song's coda. The notes Michael Stipe sings are typical of the vocalist, focusing on the first, third, and fourth notes of the scale he's performing.