I would have thought so, but according to this local newspaper article explaining the formation, the glaciers did not extend this far south.
The formation is just off of the Appalachian Trail in Berks County PA. Although not as bad as in this pic, these types of rocks make hiking the AT in PA a real "pain". Here is a link to the article. You might have to click past an ad:
Blue Rocks 
