I will discuss and develop from first principles the differential-geometric theory of U-duality in four-dimensional supergravity, with the ultimate goal of proving that arithmetic U-duality transformations are nothing but automorphisms of the Siegel modular bundle determined by the underlying supergravity theory. This gives the novel geometric interpretation of U-duality transformations as gauge transformations.