Shocking footage shows the horse clearly distressed and anxious as she is led to the gates.
As the animal kicks her head back, refusing to walk with the steward, Caboche jumps off and angrily assaults the filly, striking her rib cage.
The horse wilts in agony after he delivered the below.
Thoroughbred Racing SA stewards announced the rider's suspension in a tweet on Wednesday afternoon.
"Dylan Caboche was suspended under rule AR175(q) (misconduct) for striking his mount prior to loading. Suspended from midnight 17/11/17 to 1/12/17," it reads.
She's Reneldasgirl was the first of Caboche's seven rides at Port Lincoln on Wednesday, and the apprentice won the final race on Slide Of Hand.
People reacted with outrage to the footage, and some even said Caboche should be banned for life.
"Absolutely disgusting! Jockey should be punished more than that! Poor innocent horses in this cruel industry!" one person said.
"That's animal cruelty!!! Should be more then a 2 week ban," another replied.
"You don't deserve to be a jockey," one person tweeted directly to the under-fire rider.
"Two weeks? yeah, that's sending a strong message. Punch a horse and you can't ride for two weeks. How about you fine him $10,000 as a deterrent, and donate the money to the RSPCA,'" another man suggested.