Daisy had a hard time saying it because she wasn't really sure she would mean it and did not want to risk her relationship. She was financially secure with Tom and was not sure she wanted to risk losing that at that instance despite her love for Gatsby.
