A lot of structures use categories of building materials rather than specific ones. For example, archaic building materials are stones, sticks, limestone, mud
It would be nice if there was a policy you could toggle for whether the specific item was included in the general category. I use sticks for fires and mud for pots, I don't want them used up by buildings. Make everything out of limestone instead!