Guerilla wars require the support of the local populace so they can only work within the home territory of the guerilla force. There would have been no point to burning towns and fields of Southerners.
Raiding north of the Mason Dixon would just have amounted to small incursions through a hostile populace by quickly moving forces with little to no logistical support. Local townsfolk would have easily spotted the raiding parties and reported them to the Federal army who could have tracked their movement by telegraph and chased them down with equally mobile cavalry in superior numbers. It would have been a nuisance but with a tactical range only extending into Maryland, lower Pennsylvania and lower Ohio most Northerners wouldn't have been bothered in the least.
Guerilla wars are what you do when you don't have the strength to defeat the enemy in open battle. The Confederate States of America believed, rightly, that they did have the strength to defeat Northern forces in set battles. They just didn't have the production to maintain a protracted war, the latter is of course a real Capt. Obvious observation.
By the time Southern leadership would have concluded that a guerilla style war was the only means of resistance left to them the South was weary of warfare and depleted of treasury. Where would they get their powder and ball without a friendly Russia, China or Pakistan to supply them and provide safe havens? And as has already been stated, the womenfolk would not have been the only folks who wouldn't tolerate a guerilla force in their midst when threatened with the sort of harsh reprisals every invading army has used (sooner or later in one way or another) against a populace where the enemy looks like everyone else.
