Swift has dated a string of high-profile stars including John Mayer, Jake Gyllenhaal, Harry Styles and Taylor Lautner, some of whom are rumoured to have been the subject of the 24-year-old pop star's tracks.
Her 2010 track Dear John was thought to be about Mayer, while media are abuzz that her latest album, 1989, contains references to her failed 2013 relationship with One Direction band member Styles.
But Swift hit back on Monday, saying she has a "really strict personal policy that I never name names".
And she criticised anyone who assumes her songs are based on former flames, saying they're "purely speculating".
"You are going to have people who are going to see the depth at which you approached the song - the fact you put your real emotions into it," she told 2Day FM's breakfast radio show.
"And then you are going to have the people who are going to say, 'Oh you know like she just writes stories about her ex boyfriends', and I think frankly that's a very sexist angle to take."
Swift said she believes there's a double standard in the industry for male and female performers.
"No one says that about Ed Sheeran, no one says it about Bruno Mars. "They're all writing songs about their exes, their current girlfriends, their love life and no one raises a red flag there."
Swift says her new album is more positive than her last record.
"This album comes from a place of strength but subtly, it's not like 'I'm a strong independent woman' but you can kind of feel that as an undercurrent throughout the record," she said.
The pop star said she made a lot of changes to her life over the last two years including moving to New York, cutting her hair short and surrounding herself with her friends.
She reportedly lives with her BFF, Victoria's Secret model Karlie Kloss.
"I've been basically living my life on my own terms," she said.
The singer has experienced some pretty spectacular moments over her career.
She said reaching No.1 in the charts was a great feeling because her fans had gone out there and "done that for you".
She also said even she experiences "pinch me" moments and singing karaoke with Jon Bon Jovi and Prince William at a charity event last year was one of them.
The music that puts Swift in the spotlight sometimes comes to her on an airplane, or even in a dream.
"There are songs on this album that I started when I was on plane rides.
"Out of the Woods, I wrote that chorus when I was on a plane," she said.
There are times when she wakes up and she's heard a sound in her dream that she tries to remember so she can write a song.
"I've been able to do it a few times, where you remember," she said.
The singer showed she values her fans, recently, by inviting some over to her houses in LA, Nashville, New York and London to have the first listen to her new album.
She said she carefully selected people who had been supporting her for years because she wanted to thank them.
"I actually picked every single one of the people who came over to my houses in every single one of the sessions ... I wanted them to be people who had been dedicated for years and had really put in extra effort so I could surprise them and meet them for the first time and say thank you.
While she likes to make an event out of releasing an album - building the anticipation by releasing teaser lyrics and appearing in magazines - she hasn't ruled out just dropping an album some day.
"I try to stay really open minded about things like this because if you refuse to change with the industry it will change without you."
-AAP