The 243 will fill your 55-100 grain needs pretty well,and the 308,and 30-06 are close enough that it comes down to which rifle you like the best.You said you may want to fill a gap in your rifles,In the case that you were wanting to go heavier.I would keep the 243,and 264,and get a magnum that will handle 180s with ease,and speed.