Traffic was at a standstill in central Auckland as protestors, many wearing masks and waving signs, spilled across the streets.
Police were diverting traffic away from the area.
Labour Party leader David Shearer said it would be an "uphill battle" to stop the passage of the GCSB bill.
"It'll be difficult to do but we'll do everything we can to oppose it.
"There's now a lack of confidence by New Zealanders in our intelligence agencies," he said.
Kim Dotcom told the crowd spies had invaded his privacy and "if they can do that to me they can do that to any of you".
Another speaker at the Auckland march was Dr Rodney Harrison, QC, who called the planned legislation the "Dunne Deal" - referring to the United Future MP.
WELLINGTON
In Wellington, more than 500 protesters held up buses and cars as they marched in a crowd more than 200m long from Cuba St to the steps of Parliament.
Many wore masks or held signs aloft as they chanted "we don't want your spying state'' and "surveillance is for war" as they marched along Willis St and Lambton Quay.
They were met at the steps of Parliament by speakers including Green Party co-leader Russel Norman, Labour MP Chris Hipkins and Council of Trade Unions president Helen Kelly.
Vikram Kumar, the chief executive of Kim Dotcom's new Mega website and the former head of Internet NZ, was met with a resounding "no'' when he asked the crowd whether they should be spied on for marching today.
"This was a country that stood up and said no to nuclear power, it said no to apartheid. And what do we say today? No!
"The land of the long white cloud becoming the land of the NSA spy cloud? No!''
Dr Norman called on everyone at the protest to file an Official Information Act (OIA) request with the GCSB asking how many people were at the rallies across the country today.
"Maybe if they're so tied up dealing with 10s of thousands of OIA requests, it might give them less time to go around spying on us with their special powers.''
Civil liberties campaigner and Tech Liberty co-founder Thomas Beagle said the GCSB bill was about ``mass surveillance''.
"It's about spying on everyone, no matter what they've done, no matter what they're gong to do,'' he said.
"This sort of mass surveillance changes the balance of power in our society away from the people and towards the state.''
Mr Beagle said it was wrong to suggest people who had done no wrong had nothing to fear from surveillance.
"I believe in the right to privacy, I believe in the right to sit in my house and call my friends on the phone without the Government listening.
"I believe in freedom of expression and freedom of association, for people not being scared into silence because they are being watched by Government spies.''
PM DEFENDS BILL
Prime Minister John Key told reporters on his visit to South Korea that it was important to understand what was actually in the GCSB legislation.
He said the bill would give greater oversight and was "a strengthening of the previous legislation''.
"I accept there are some that will always feel a bit nervous about privacy and their own rights, but I can give you the best assurance I can that we're very careful and cautious about what we do as a state. But in the end we do have to protect the interests in New Zealanders.''
Asked about Kim Dotcom 's involvement in the protests, Mr Key said "he loves the limelight''.
"But you've got to remember he's got a long-term agenda here, and that is to try and convince people that he should be allowed to stay [in New Zealand] forever.''
However, Mr Key said Dotcom needed to make that case to the United States, which was seeking Dotcom's extradition.
SOCIAL MEDIA
#GCSB protest in Auckland. Easily a couple thousand here pic.twitter.com/TeSX8NLCx4
Quite a lot of ppl at GCSB protest in Wellington..... pic.twitter.com/iE43A9mroa
#GCSB protest, Christchurch pic.twitter.com/UMj3OQeUMk
Waiting for the stragglers - this goes a way back #gcsb pic.twitter.com/aJaDp6PtBI
#GCSB @KimDotcom gets big applause saying NSA directing lots of operations. Need independent inquiry pic.twitter.com/QLkLW0Dvg4
Fantastic turnout in Wellington against the #GCSB pic.twitter.com/FsrsdqCU3q
Quite a few hundred people at the anti GCSB bill really in Wellington already. pic.twitter.com/zENHJMT77b
GCSB don't spy on me" - pretty sizeable crowd for anti #GCSBBill protest in Nelson pic.twitter.com/7Joo77SZCr
The #GCSB protest is in Cuba Mall right now. RT @helenkellyctu: Wellington. pic.twitter.com/eC1k1EN0Pq
Looks like we're occupying Queen St. #GCSBBill #GCSB pic.twitter.com/jn0GwdsSRW
Actually I take it back - awesome turnout Wellington #gcsb pic.twitter.com/uAWojWezmO
Lots of citizens in Christchurch care about privacy and freedom #gcsb pic.twitter.com/PYQMlpjy2P
Spontaneous sign making at Hamilton GCSB protest. pic.twitter.com/X5yGYKHZhL
Kim Dotcom among the politicians and protestors #GCSB pic.twitter.com/BOKjNIQsrz
#GCSB #GCSBBill Placard. pic.twitter.com/WVdxCrdU2i
- nzherald.co.nz, APNZ, Newstalk ZB, Herald on Sunday
