The Magical Map will help you find those rare structures you could be searching for for ages. Simply craft the map and rename it with an anvil. The accepted structures are listed when you hover over the map in your inventory. So if you change the name to Mansion then you just need to right-click with it in your hand and it will guide you to the destination!
Maps can only be generated for one structure at a time so you’ll need to create multiple maps for multiple structures.