According to Moore, Baltar wanted to sleep with Starbuck from the scene when they first met, in the earlier episode "Water", and only became more interested as she continued to spurn him in later episodes.
As stated by Moore, Baltar initially harbored a romantic inclination towards Starbuck when they first met in the episode "Water". His fascination with her grew stronger as she continued to rebuff him throughout the series.