When Does Label-Free Deconfounding of Document Embeddings Work?

📅 👥 4 authors arXiv:2611.19350v1

Authors

Abstract

Document embeddings encode spurious attributes that can distort semantic comparisons; yet supervised erasure requires metadata that is often unavailable. We systematically investigate label-free deconfounding across corpora and embedding models. Our results show that label-free methods improve semantic utility over unprocessed embeddings, while simple geometric approaches recover much of the supervised benefit, sometimes matching metadata-supervised erasure in linear confounder recoverability and semantic utility. We identify two distinct causes of ineffective erasure: poor proxy-confounder alignment and insufficient intervention coverage. Crucially, confounder recoverability and semantic utility are distinct dimensions of deconfounding success: utility can improve despite residual confounder information, while stronger suppression does not necessarily improve utility. Moreover, reduced linear recoverability can coexist with substantial nonlinear recoverability. Together, these findings distinguish confounder discovery from intervention effectiveness and highlight the importance of evaluating nuisance suppression alongside semantic preservation.

Paper Information

arXiv ID:
2611.19350v1
Published:

Related Categories