We show that the alternative theory of Lie groups and geometric structures proposed in the recent book [Or1] can be developed independently of connections. We show the details of this connection-free approach in the cases of absolute parallelism, affine and Riemannian structures and outline the method in the general case.