I agree, and that is why the payment estimators on car websites include a Informational Rate which shows the effective rate when you forgo the cash discount on a finance or lease. In this way you can make an more informed decision of if the rate is right for you. 

However, most dealers will still give you the cash discount or more if you shop around.