Despite facing one of the league's struggling teams, the Spurs only managed to pull clear in the fourth quarter