Optically driven spin transport is the fastest and most efficient process to manipulate macroscopic magnetization as it does not rely on secondary mechanisms to dissipate angular momentum. In the present work, we show that such an optical inter-site spin transfer (OISTR) from Pt to Co emerges as a dominant mechanism governing the ultrafast magnetization dynamics of a CoPt alloy. To demonstrate this, we perform a joint theoretical and experimental investigation to determine the transient changes of the helicity dependent absorption in the extreme ultraviolet spectral range. We show that the helicity dependent absorption is directly related to changes of the transient spin-split density of states, allowing us to link the origin of OISTR to the available minority states above the Fermi level. This makes OISTR a general phenomenon in optical manipulation of multi-component magnetic systems.