At the moment its not possible to manually remove a location from your list.
But since you can only add 10 locations, older locations will be dropped automatically when you attempt to add more.

That way you can reorganize your list by having the important ones at the top.