There is no blame on you if you enter vacant houses in which some of your property is placed. Allah knows what you do in public and in private.