You Have to Freeze Style Layers

To make a style entity turn off in an xref, you can’t just freeze the layer. An example is for alignment labels. You have to freeze C-ALGN in order to get the alignment line and layer to disappear, you can’t just turn it off.