Looked your boat up and looks like a very shallow draft center console.
Your not getting enough bite in reverse. The motor setup is probably high for max speed, and the prop is designed for forward only movement.
If you have or would install and jack plate, could get it lower for backing
Just...