If a field where to be tied to a segment, then users tied to the same segments would only see the fields in the query editor, Excel export and other interface touchpoints that's connected to that segment, where they today see all the fields in the entire solution. No segment selected for a field, show the field for all segments.
The field or data should not be removed in any way, this would only control visibility of the field for users.
This would be good for setups where the Segments are used for different brands, product type, lifecycle steps (R&D, Active, Archived) or similar.