The 40-year-old singer-turned-fashion designer enjoyed several nights of passion with The X Factor boss after joining the judging panel in 2007, according to a new unauthorised biography, Sweet Revenge: The Intimate Life of Simon Cowell.
But having just split with Kris Smith, the father of her 21-month-old son Ethan, the revelation is said to have pushed an already upset Dannii to breaking point.
A source said: "She's understandably distraught by all of this coming out just as she's struggling to cope with the breakdown of her relationship with Kris."
"It was all such a long time ago and to have to deal with it now in the wake of the last few weeks is just too much. She is incredibly raw and this is the last thing she wants to endure."
In the book, Simon, 52, is quoted as saying: "I had a crush on her. It was Dannii's hair, the sexy clothes and the tits. I was like a schoolboy. She was foxy. She was a real man's girl. Very feminine."
According to the Daily Mirror newspaper, Simon allowed the author Tom Bower hundreds of hours of access to his life, although the music mogul apparently claims to have had no control over what was included in the finished product.
He has so far kept quiet over the situation, only breaking his silence to tweet: "Just seen the TV ad for the unauthorised book on me. Yikes!"
24.com publishes all comments posted on articles provided that they adhere to our Comments Policy. Should you wish to report a comment for editorial review, please do so by clicking the 'Report Comment' button to the right of each comment.
Karrueche Tran can be seen breaking down in tears in the preview for her upcoming interview about ex-boyfriend Chris Brown on the Oprah Winfrey Network. Read More »
Madonna's entourage and controlling requests reportedly caused problems on The Ellen DeGeneres Show. Read More »
Day 4 in pics!
5 hyperlapse videos!
Day 2 in pics!
Day 1 in pics!
South AfricaR500 000 - R600 000 Per Year
South AfricaR11 000 - R12 000 Per Month
South AfricaR800 000 Per Year
HousesR 1 880 000
HousesR 3 200 000
HousesR 3 350 000