(CNN) -- President Obama's friendly interactions with Venezuelan President Hugo Chavez has set off a wave of controversy, but analysts said the leaders' next steps will show if relations have truly improved or if Obama was overstepping boundaries. Venezuelan President Hugo Chavez presents a book to President Obama at the Summit of the Americas. Chavez and Obama were both at the Summit of the Americas, which ended Sunday in Trinidad and Tobago. On the first day, Obama reached out his hand to Chavez and was seen smiling and patting the Venezuelan leader on the shoulder as the two shook hands.
@highlight
President Obama, Venezuelan President Hugo Chavez shake hands at summit
@highlight
GOP senator: It's "irresponsible" to be seen "laughing and joking" with Chavez
@highlight
It's OK to shake hands, but Obama shouldn't seem too friendly, CNN analyst says
@highlight
Responding to critics, Obama says, "I don't worry about the politics"
@placeholder's senior adviser said Sunday the administration isn't worried about how the gesture is perceived.