Well, they didn't have the organized "Bible" but they certainly had the apostle's and Paul's individual letters to the churches and individuals on hand. They just weren't fully organized into the canon of scripture yet so to say they had no scriptures is not correct. The latest NT book to be written was probably Revelation and that was by the 90's AD.
So, all these books were circulating around to the first century churches.
