You shouldn't be able to use flame altars to build next to the ancient city and unlock the bard

I believe in the future, there shouldn't be a way to build an alter to make a base right next to the bard. I didn't even think it would be a thing but I made a alter right next to the bard's resting place. upon building the foundation, I had a thought of dismantling the gates. and I could! I completely bypassed the entire area and did no buttons what so ever. This was a cheap way of getting the bard and I do feel bad in doing so. Please fix this little cheat so people can experience the city.