I assume you have checked Uncle Mike's web site. As best as I can tell, it looks like the Sidekick 81011, 3-4", size 1 would work for you. Regarding a speed loader, last time I checked, Springfield Armory does not make a speed loader for the XD-S. You might want to check out Uplula speed loaders.
As a side note, not to disparage Uncle Mike's, but there are a lot of good holster makers out there and with a little research I think you would find one more specific to your needs in your price range and fit.