Uniqueness Results For The Infinite Unitary, Orthogonal And Associated Groups