Sounds like he gets about like M'aiq! Saying that, he was always in Riften for me until I started the quest. So could be random placement every game you play.
Looking for people to join me in an epic Minecraft build once again. Its in creative, so if you are interested, message me for details.