There's nothing wrong with checking in the afternoon.
Matter of fact, some critters are still roaming around at sunrise so you stand a chance of spooking one out of your area at that hour.
I'm retired so I check mine around 8-9 am.