【论文】Can Discrete Tokens Serve as Semantically Lossless Representations of Visual Signals?

arXiv 2610.37662 · 26 人推荐 · 附代码 hustvl/FVQ（8 stars）。Discrete visual tokens represent vision in a discrete form analogous to language, offering a native interface for multimodal modeling under a shared next-token prediction objective. However, quantization error is widely assumed to cause unavoidable semantic loss, fundamentally limiting the semantic fidelity of discrete visual tokens and positioning continuous visual representations as an intrinsic upper bound. Using multimodal understanding as a proxy for semantic fidelity, we revisit this assum