I'd not cover a berm with gravel, and if I had only gravel to deal with, personally I'd think about covering teh gravel with dirt.
Beyond that, make it 2 times taller than you think... Ya know what i mean, try to get to 10 feet was my goal.
I wished now after seeing how bullets deflect, that I"d have made mine have sides too. But we did not.