How far from the outside face of chimney masonry must you keep headers, beams, joists or studs?

How far from the outside face of chimney masonry must you keep headers, beams, joists or studs?