Many of them had traveled from elsewhere to participate in the demonstration in the rural village, which serves as the headquarters of Muslims of America. A local NAACP chapter provided two charter buses to transport people from the Oneonta area, the Star reported.
"We're doing this in order to assure our neighbours in Islamberg that we are not going to be silent, and that we are not going to tolerate hatred," Regina Betts, vice president of Oneonta's chapter of the NAACP, said at an interfaith meeting earlier this month. "The main thing is that we fight discrimination and that we do it peacefully."
Islamberg Mayor Rashid Clark told the Guardian the idea for the peace rally came from community members who found out details of the biker protest and "they called us, and said they wanted to come and support. This turnout is not our doing."
"We just decided, 'OK, if you want to ride by, we're going to hold a peace rally,' " Clark said.
So as the bikers entered the community in Hancock, New York, they were met by demonstrators holding signs reading "Stop harassing American Muslims" and "Biker Bigots Begone."
The biker group's Facebook event page alleges that Islamberg is connected to Jamaat Ul Fuqra, which protesters wanted designated as a terrorist organisation. "Heavily armed, trained, and ready for violent jihad against innocent Americans, they prey on our prison populations and vulnerable youth to recruit, but the FBI's hands are tied," reads the description of the event.
The biker event organiser, Ram Lubranicki, told the Guardian that the event was "educational" and "there's certainly a lot of excitement about this idea".
"So far it's a little disappointing," Lubranicki told the Guardian about the turnout. "If we had great weather we could easily have a few hundred bikers here."
There were more state police troopers than bikers on site, the Daily Star reported.
"We were prepared for more bikers," New York State Police Captain Scott Heggelke told the newspaper. "I'm glad it was a peaceful event. We were most concerned with the safety of everyone and with maintaining the flow of traffic on such a rural road."
Islamberg has been the target of threats - and suspicion, including claims by several websites that it's the site of terrorist training camps.
In 2015, a Tennessee man and one-time congressional candidate pleaded guilty to plotting an attack on the community.