When two drops come into contact they will rapidly merge and form a single drop. Here we address the coalescence of drops on a substrate, focussing on the initial dynamics just after contact. For very viscous drops we present similarity solutions for the bridge that connects the two drops, the size of which grows linearly with time. Both the dynamics and the self-similar bridge profiles are verified quantitatively by experiments. We then consider the coalescence of water drops, for which viscosity can be neglected and liquid inertia takes over. Once again, we find that experiments display a self-similar dynamics, but now the bridge size grows with a power-law $t^{2/3}$. We provide a scaling theory for this behavior, based on geometric arguments. The main result for both viscous and inertial drops is that the contact angle is important as it determines the geometry of coalescence -- yet, the contact line dynamics appears irrelevant for the early stages of coalescence.