A bit of a drive I think for you but about 17 miles south of Baker City you will be at Phillips Reservoir. Nice campground, great fishing and you can check out Sumpter which is down the road a bit. Or any of the other lakes in the area, super trout fishing in many of them!!
Found info here:
https://www.go-oregon.com/Phillips-Reservoir/#It looks like a great place to try!
All the area in NE Oregon is God's Country. Joseph Oregon is beautiful and Wallowa lake is popular, so maybe too many people there. I used to drive along all the rural roads within 100 miles of that corner of the state and find little campgrounds all over the place that were almost empty. Most along creeks or rivers of one size or another. One of my favorite places was along Hwy 395 north of Mt. Vernon Oregon. Little "town" called Ritter Hot Springs. Not much there. Camped along the river east of there a few miles and had bear come in at night to fish for the salmon that ran in the creek. Like I said, you really can't go wrong just hooking onto the trailer and driving NE Oregon. It's beautiful everywhere there.
