He said: "There are people who admonish me or attack me and use that as a constant spearhead to do that. It's a scab that never heals cause it's being picked at all the time by other people. My daughter, that's hurt her in a permanent way."
Back in April 2007 - when Ireland was only 11-years-old - he infamously left her a ranting voicemail after Ireland did not answer the phone when she knew he was due to call from New York.
The It's Complicated star called his daughter '"a rude, thoughtless little pig" and told her: "You don't have the brains or the decency as a human being."
READ MORE:
• Suge Knight 'was the real target of Tupac shooting'
• Heston Blumenthal's bizarre rant stuns The Project
He went on: "I don't give a damn that you're 12 years old, or 11 years old, or that you're a child, or that your mother is a thoughtless pain in the ass who doesn't care about what you do as far as I'm concerned.
"Once again I have made an a** of myself trying to get to a phone. You have humiliated me for the last time with this phone."
The message had surfaced during a bitter custody battle between he and ex wife Kim Basinger.
Since Alec and Ireland have mended their relationship and seem to be close as they have even poked fun at the incident on social media over the years.
Regardless of making amends, there certainly seems to be a few things that Ireland is trying to work on regarding her body image as she shared a selfie of herself in a thong on Saturday with an interesting lengthy caption.
She wrote: "Sometimes I get caught up in the opinions of others and I get really down on myself. I am pale white. I hardly tan. I have cellulite. I'm not petite. I'm around 6 ft. I drop weight rather quickly but gain it by eating one bagel. I'm a 36 D cup and I have a booty. I've got inner thigh fat. And outer thigh. And just straight up thigh fat."
The model said recently she has yo-yo'd both in size and with her eating: "I've gone from a size 00 to a size 6 to a size whatever to not knowing to not eating to eating boxes of pizza to starving myself to being gym obsessed to eating my way out of a sprinkles cupcakes bakery to now.
"I've been cloudy, unfocused and losing energy. I need to reset my mind and body. I now take this harsh world with a grain of salt and accept myself for who I am."
However, Ireland said she is happy and feels "mentally ready to work hard".
"Sure I could work a little bit harder. We all can. Or maybe you need to learn to love yourself before you can do anything."
Alec has since moved on romantically with yoga enthusiast Hilaria Baldwin as they have three young children together: three-year-old daughter Carmen, 20-month-old son Rafael, and six-month-old son Leonardo.
Baldwin opens up more about his relationship with Ireland, drug addiction past, relationships, and career in his memoir Nevertheless which releases on Tuesday.