从 Transformer 到协调变换的形式语义学

View PDF HTML (experimental)

Abstract:We develop a formal semantics for a general class of coordinated systems of parameterized transformations, taking the Transformer as a paradigmatic starting point but abstracting from its particular mathematical instantiation. Representational vectors receive both extensional reference and ordered intensional interpretations, while parameter structures acquire relative, second-level interpretations that determine how argument properties are preserved, replaced, or combined. This yields the notion of a transforming concept: a parameterized transformation whose numerical action is coordinated with a corresponding property-level map. We then distinguish the common algebraic-semantic core of these systems from their architecture-specific functional organization, allowing different mathematical instantiations and mechanical realizations of the same abstract system type. The framework is applied to attention heads and residual connections, providing semantic explanations that depend only on the shared algebraic-semantic core and their local functional organization and therefore generalize beyond the standard Transformer. These analyses also reveal the modularity of the framework: complex architectures can be decomposed into simpler semantically coordinated subsystems whose organization may recur across different abstract system types.

Comments:	v1: 28 pages, 9 sections, this version incorporates revisions made after the first round of peer review
Subjects:	Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Logic in Computer Science (cs.LO)
Cite as:	arXiv:2610.39735 [cs.AI]
	(or arXiv:2610.39735v1 [cs.AI] for this version)
	https://doi.org/10.48550/arXiv.2610.39735 arXiv-issued DOI via DataCite

Submission history

From: Marco Giunti [view email]
[v1] Thu, 29 Oct 2026 10:00:08 UTC (31 KB)