Home location not keeping direction?

Am I missing something or if I set a "Home Location" from a "favorite" the direction I am pointing to (in my case SE) should be kept as well? It always defaults to South.