But Murray assured the couple that there was "definitely a heartbeat".
"Actually, there are three babies in there."
Marr's husband responded by turning pale and passing out.
It would be another week before the stunned pair learned there was yet another baby hiding in Marr's womb.
"Yet again, the sonographer got this weird look on her face," Marr said. "We asked her what was taking so long, and she told us that she wasn't supposed to say since she's not a doctor. But she ended up blurting it out anyway, something along the lines of: Ya'll, there are 100 per cent four babies in there."
"That's when three became four," said Marr's husband. "I told Jenny we shouldn't go to our next appointment because they'll just keep multiplying."
Marr's obstetrician, Lauren Murray, says the Marr quads - Harrison, Hardy, Henry and Hudson - are identical monochorionic quadruplets, an extremely rare occurrence with only 72 other cases recorded in medical literature, reports The Post.
And according to high-risk-pregnancy specialist, Brian Rinehart, the Marrs had a 1 in 11 million to 1 in 15 million chance of conceiving their babies.
While all pregnancies pose risk, multiples present increased chances of high blood pressure, gestational diabetes and other health issues, Rhinehart told The Post.
"Pregnancy, even with one baby, is hard on the body. Four is just ridiculous."
Because multiples share a placenta, it's crucial that everything from it - blood flow, nutrients and oxygen - is distributed evenly.
According to Murray, "The babies need to share the placenta evenly in order for all of them to survive."
While father-to-be, Chris, was said to be extremely worried during his wife's pregnancy, Jenny was "positive" and determined to face whatever challenges they might face.
But the pregnancy went smoothly and at 28 weeks, on March 15, Marr went into early labour - just when US hospitals were preparing to go in to battle with coronavirus.
Delivered by C-section, the Marrs' four boys, came into the world.
Murray shared that delivering one baby is "exhilarating", "to deliver identical quads was just incredible."
What are identical monochorionic quadruplets?
The rare occurrence of identical monochorionic quadruplets happens when a fertilised egg splits in two, and both cells split again.
Different to fraternal twins, which develop from separate eggs that happen to both be implanted, identical multiples develop together and share one placenta.
Rhinehart told The Post: "Put simply, non identical quads travel down separate lanes on a highway to get to the same parking lot, while monochorionic quads travel in the same lane, in the same car, and land in the same spot."