Object and xref layers can get really cumbersome to deal with everytime you use the layer property manager. Use group filters for easy organization and selecting of layers. Using group filters also has the added benefit of reducing the lag time between layer edits you make.
Right click and select New Group Filter:
Drag the desired layers you'd like to use into the group filter you just created:
You're done:
