Architectures for mathematical data

Source abstract

Mathematical objects rarely arrive as unstructured feature vectors. They arrive as sequences indexed by primes, as directed graphs closed under a combinatorial move, as functions constrained by a differential equation. Choosing a neural architecture is therefore not a matter of choosing the largest model, but of choosing an inductive bias that matches the structure the data already has. We develop this principle through three self-contained case studies, each implemented from scratch in JAX and each runnable on a laptop CPU. (i) Sequential data: A 1D CNN and a single-block transformer predict the rank of an elliptic curve [Formula: see text] from its normalized Frobenius traces [Formula: see text]; a saliency analysis tracked across training shows the network localizing the discriminative signal in the small primes, where the murmuration phenomenon lives. (ii) Graph data: A directed graph isomorphism network classifies quivers by Dynkin mutation type and is permutation equivariant to machine zero by construction; trained only on quivers with seven and eight vertices, it transfers to quivers on nine vertices. (iii) Continuous data: A physics-informed neural network solves a two-point boundary value problem, after which interval arithmetic bounds the residual rigorously over the entire domain rather than at the collocation points. Based on a tutorial delivered at DANGER: Data, Numbers, and Geometry (Banff, April 2026).