Another thing about the Lt is when you are away adventuring he is not doing the same so as you continue to get stronger he is still staying back at the palace being 3-5 level depending on how long he is been around. If you want him to go up then you would have to take him adventuring and then you both would split your part of the Xp.