He later took his child to his parents home, who called for help, but it was too late.
The child was having seizures and convulsing by that point and died soon afterwards.
Curtis' father Collman was charged with neglect of a dependent causing death, pointing and firearm and theft, on Thursday, in addition to other charges relating to a sexual misconduct case.
"Anybody that is a parent, you know, would be emotionally upset. It kind of hits home if you have kids," detective Tom Barker said.
On Thursday he requested a bond reduction to spend time at home with his parents while awaiting trial, according to the News 4 Jax.
If convicted, he faces 20 to 40 years in prison. He goes to trial on December 4.
However, prosecutors are seeking a maximum penalty of 50 years.
"50 years would be nice," Jackson County Chief Deputy Prosecutor Jeffrey Chalfant said.