The effect of electron-impurity scattering on momentum and spin relaxation times in graphene is studied by means of relativistic ab initio calculations. Assuming carbon and silicon adatoms as natural impurities in graphene, we are able to simulate fast spin relaxation observed experimentally. We investigate the dependence of the relaxation times on the impurity position and demonstrate that C or Si adatoms act as real-space spin hot spots inducing spin-flip rates about 5 orders of magnitude larger than those of in-plane impurities. This fact confirms the hypothesis that the adatom-induced spin-orbit coupling leads to fast spin relaxation in graphene.