CAST: Canonical Approximate Schur Tree for Approximate Cholesky on Graphs
Abstract
Graph-data workloads such as diffusion estimation, ranking, semi-supervised learning, and network optimization often solve many Laplacian or symmetric diagonally dominant M-matrix (SDDM) systems with the same coefficient matrix. Approximate Cholesky preconditioners eliminate vertices one at a time and store the resulting sparse approximate factorization, the factor, whose construction cost is amortized across these solves. But eliminating a vertex, the pivot, creates a dense Schur-complement clique among its active neighbors. We introduce CAST (Canonical Approximate Schur Tree), which replaces this clique with a weighted random spanning tree sampled directly from it. Every realization is connected and contains exactly edges, while reweighting each selected edge by the reciprocal of its tree-inclusion probability makes the update unbiased. The distribution is independent of the ordering of the pivot neighbors, and we prove that its leverage-score marginals minimize the largest normalized reweighted-edge contribution among unbiased inverse-marginal one-tree estimators.
We also introduce CAST-, which replaces each pivot neighbor with copies, each carrying a share of that neighbor’s incident weight, samples a weighted random spanning tree on the expanded clique, and contracts the copies back to the original neighborhood. The resulting update remains unbiased and connected, can be sampled exactly in time, and satisfies a bound on the second moment of the normalized local Schur error. Increasing therefore reduces certified local sampling variability, but may increase construction cost and downstream fill.
We evaluate CAST on matrix systems, including Newton-step Laplacians from maximum-flow interior-point methods, constructing one factor and reusing it for right-hand sides. CAST- is – faster than the better of the state-of-the-art AC and AC2 baselines Gao et al. (2026). Overall, we observe that CAST-1 is the faster default, whereas CAST-2 is preferable when its additional edge contributions remain inexpensive.
1 Introduction
Many graph-data and network-optimization pipelines repeatedly solve linear systems defined by a fixed graph operator. Examples include ranking and diffusion estimation Page et al. (1999); Andersen et al. (2006), label propagation Zhu et al. (2003); Zhou et al. (2003), shift-and-invert spectral graph methods Huang et al. (2019), and network optimization Spielman and Teng (2004); Spielman and Srivastava (2008). These applications lead to Laplacian or symmetric diagonally dominant M-matrix (SDDM) systems in which the operator is reused across many right-hand sides. The relevant computational objective is therefore not only to solve one system quickly, but to construct a preconditioner whose cost can be amortized across repeated solves.
Approximate Cholesky factorization provides a practical approach to this problem. As in sparse Gaussian elimination, vertices are eliminated sequentially, but the dense fill created by exact elimination is replaced by sparse randomized updates Kyng and Sachdeva (2016); Gao et al. (2026). The resulting approximate factor is used as a conjugate-gradient preconditioner and reused across multiple right-hand sides. Eliminating a vertex of degree , with incident edge weights and total weight , creates the Schur-complement clique
where denotes the standard basis vector of the -th neighbor. This clique contains edges. Approximate Cholesky methods avoid this quadratic fill by replacing with a random surrogate containing only edges.
Kyng and Sachdeva sample clique edges independently and control the accumulated error through a matrix-martingale analysis Kyng and Sachdeva (2016). The practical AC and AC2 solvers Gao et al. (2026) take a complementary approach: every sampled local update has connected support, the graph on the pivot neighbors formed by its nonzero-weight edges. A graph Laplacian has nullspace exactly when its support is connected, matching the exact Schur clique. Since a spanning tree is the sparsest connected support, with exactly edges, we first study surrogates consisting of a single spanning tree of the clique.
For a clique edge with weight , let be its inclusion probability, and assign the weight whenever it is selected. This inverse-marginal reweighting makes the surrogate unbiased, since the expected contribution of is . The remaining choice is the distribution over trees. If is small, edge receives a correspondingly large weight when selected. Let be the leverage score of in the clique, equal to its weight times its effective resistance within Spielman and Srivastava (2008). The normalized size of the reweighted contribution—its size measured relative to the quadratic form of itself—is exactly ; see Section 2. A large ratio lets one selected edge dominate the local update and inflates the error bounds obtained from matrix-concentration analyses Kyng and Sachdeva (2016). We therefore ask:
Question 1.1.
Among unbiased inverse-marginal one-tree replacements of a Schur clique, which edge-inclusion probabilities minimize the worst normalized contribution ?
The connected updates of AC and AC2 are generated through randomized sequential edge pairing Gao et al. (2026). Although these methods perform strongly across many SDDM systems, their induced sampling distributions depend on the order in which the incident edges are processed and are not designed to minimize . The distinguishing feature of our method is therefore not connectivity alone, but the distribution used to generate the local update.
We introduce CAST (Canonical Approximate Schur Tree): at each elimination step, it samples a weighted random spanning tree of the Schur clique and applies inverse-marginal reweighting. By the transfer-current theorem Lyons (2003), each clique edge is then included with probability equal to its leverage score, . This answers Question 1.1: the leverage-score marginals are the unique locally minimax-optimal choice among unbiased inverse-marginal one-tree estimators (Theorem 4.5). We call the sampling rule canonical because it depends only on the weighted Schur clique and not on the ordering of the pivot neighbors.
We further introduce CAST-, with integer parameter , which splits each pivot neighbor into equal-share auxiliary copies, samples one weighted random spanning tree from the expanded Schur clique, and contracts the copies back to the original neighbors. For it coincides with CAST; for the contracted update need not be a tree, but it remains unbiased and connected and satisfies a local second-moment bound of order , reducing sampling variability at the cost of additional construction work and possible downstream fill. We write CAST-1 and CAST-2 for the and configurations used in our evaluation.
Our guarantees concern the estimator associated with a single Schur-clique replacement; we do not claim a worst-case spectral guarantee for the complete approximate factorization.
In summary, we make the following contributions:
- 1.
Canonical tree sampling and its splitting extension. We introduce CAST and CAST-. At a degree- pivot, a tree is sampled exactly from the target weighted spanning-tree distribution and contracted in time using weighted Prüfer codes, without materializing either the original or the expanded dense Schur clique.
- 2.
Local minimax and second-moment guarantees. For the base update, the leverage-score vector is the unique marginal vector minimizing the largest normalized reweighted-edge contribution among unbiased inverse-marginal one-tree estimators (Theorem 4.5). For general , CAST- remains unbiased and connected and satisfies a normalized local second-moment bound of order , quantifying the reduction in sampling variability obtained through splitting (Section 4).
- 3.
Reuse-aware evaluation. We evaluate CAST by constructing one preconditioner and reusing it across many right-hand sides. Across heterogeneous SDDM systems and max flow IPM sequences, our experiments identify when CAST reduces repeated-solve cost relative to AC and AC2. We further characterize when increasing improves convergence and when its additional edge contributions create excessive downstream fill.
Independent contemporaneous work.
We recently became aware of independent work by Baumann, Kyng, and Zöcklein Baumann et al. (2026), who propose, under the name VAC, the same base local sampling rule as CAST-1: a weighted random spanning tree of the product-form Schur clique sampled via a weighted Pr"ufer code and equipped with inverse-marginal reweighting. Their work was developed independently of ours and establishes linear-time sampling rule. Our work additionally gives a local minimax characterization of the leverage-score marginals, introduces the CAST- splitting construction and its local second-moment guarantee, and evaluates these estimators as reusable preconditioners across a broad collection of SDDM systems.
2 Preliminaries and Problem Setting
We formalize SDDM linear systems, the factor-reuse setting, and the local Schur-clique replacement problem underlying CAST. The preliminaries on Prüfer codes are provided in Appendix A.
Graph Laplacians and SDDM systems.
Let be an undirected weighted graph with vertices. For an oriented edge write , where is the -th standard basis vector. The Laplacian of is . If is connected, then . Since is symmetric, , so the system is solvable if and only if .
Throughout, denotes the coefficient matrix of the system to be solved: either a graph Laplacian or a symmetric diagonally dominant M-matrix (SDDM matrix), i.e. a symmetric positive-definite matrix with nonpositive off-diagonal entries satisfying . Equivalently, an SDDM matrix can be written as , where is a graph Laplacian and is a diagonal matrix. The matrix is positive definite provided that has at least one positive entry on each connected component of . This class of matrices includes many shifted and regularized graph operators. For example, let be a symmetric, nonnegative weighted adjacency matrix, let be its degree matrix, and let be a graph Laplacian. For a damping parameter and a seed distribution , the personalized PageRank vector satisfies . The coefficient matrix is SDDM because is symmetric, has nonpositive off-diagonal entries, and is diagonally dominant Gleich (2015). If every vertex has positive weighted degree, the matrix is also positive definite. In repeated-query settings, the operator remains fixed while the seed distribution varies across queries.
The factor-reuse setting.
Many applications solve a sequence of linear systems , for , in which the coefficient matrix remains fixed while the right-hand side changes: diffusion from different seed sets, label propagation across classes, effective-resistance queries for many source–sink pairs, and inner systems in iterative optimization. An approximate Cholesky method performs the elimination once and stores the result as a sparse approximate factorization. Recall that the exact Cholesky decomposition of a positive-definite matrix is with lower triangular; approximate elimination instead produces a sparse with , which we call the factor. The factor is stored implicitly as the elimination data recorded at each pivot and is applied through forward and backward substitutions as a preconditioner for each right-hand side. The factor is constructed at cost and reused for all solves. Writing for the average time of one preconditioned-CG solve using the factor, the total and amortized workload costs are
Thus measures one-shot performance, while increasing amortizes construction and captures the benefit of factor reuse.
Exact elimination and Schur cliques
For the local elimination analysis, we work with a Laplacian representation; general SDDM systems can be reduced to this form using the standard Gremban expansion Gremban (1996). Approximate Cholesky methods eliminate vertices one at a time. Suppose a pivot has active neighbors with and . Eliminating exactly removes the star at and adds the Schur clique
| (1) |
to the remaining graph, where denotes the -th standard basis vector in the coordinate system indexed by ; edges already present among the neighbors simply accumulate the corresponding weight. The clique contains edges, even when the original graph is sparse. To avoid “filling up” the matrix, approximate Cholesky methods replace by a sparse randomly-sampled update satisfying Kyng and Sachdeva (2016); Gao et al. (2026). The AC and AC2 solvers construct unbiased connected local updates by randomized edge pairing, with AC2 doubling the per-edge sampling budget for robustness Gao et al. (2026). These sampling distributions, which have been empirically studied, depend on the order in which the neighbor edges are processed. In contrast, the sampling distribution in CAST is determined by the weighted Schur clique and admits the local minimax and second-moment guarantees established in Section 4.
The local Schur-clique replacement problem.
We write for the Moore–Penrose pseudoinverse and . Let be a connected local graph Laplacian: a matrix indexed by the active neighbors of a pivot rather than by all vertices, with edge set and weights . Its support graph is , the graph formed by its positive-weight edges; since it is connected, and . We measure a positive-semidefinite local contribution relative to by , the largest ratio of -energy to -energy, and call this normalization the energy geometry of . The leverage score of edge is , which is exactly the size of that edge’s own term in this geometry Spielman and Srivastava (2008); Kyng and Sachdeva (2016); leverage scores satisfy .
For a distribution over spanning trees of the support graph of , let , and assume for every . The inverse-marginal estimator
is unbiased, since . We measure the local risk of by the largest normalized contribution of any sampled edge,
| (2) |
where the second equality holds because each normalized edge contribution is rank one. Question 1.1 is then the following general design problem: among such , which minimizes ? Since depends on only through its marginals , this is equivalently a question about the feasible marginal vectors of spanning-tree distributions. CAST uses the weighted random spanning-tree distribution of , whose marginals satisfy by the transfer-current theorem Lyons (2003); this equalizes the normalized size of every sampled edge and, as we show in Theorem 4.5, minimizes .
3 CAST: Canonical Approximate Schur Trees
In this section we define the local CAST- update and the approximate-Cholesky preconditioner obtained by applying it at each pivot. The construction replaces the Schur clique of Eq. (1) with a sparse random update derived from a weighted spanning tree on a temporarily expanded neighborhood.
3.1 The CAST update
Consider an elimination step with pivot , active neighbors , and incident edge weights , where . We interpret these edge weights as electrical conductances, and refer to the pivot neighbors as terminals. Exact elimination of adds the Schur clique of Eq. (1), which contains edges.
For an integer splitting factor , CAST- temporarily replaces each terminal by , a block of auxiliary copies, each carrying conductance . Let , and let denote the terminal associated with , so that and . On , CAST- defines the complete weighted expanded Schur clique with edge conductances for , and samples a weighted random spanning tree according to
| (3) |
Sampling from such a distribution is not straightforward for general edge weights; Section 3.2 shows that the product form of admits exact sampling in time. The expanded clique is therefore used only to define the distribution and is never materialized explicitly.
Each sampled auxiliary edge is assigned conductance , which is precisely its inverse-marginal reweighting on the expanded clique (see Lemma 4.1). The auxiliary-copy blocks are then contracted back to their terminals. If , the edge contributes this conductance to the terminal edge ; if , it becomes a self-loop after contraction and contributes nothing to the terminal Laplacian. Writing for the random Laplacian on the pivot neighborhood obtained after contracting the blocks and discarding self-loops,
| (4) |
where denotes the basis vector associated with terminal . The auxiliary tree contains exactly edges, so after discarding within-block edges and aggregating parallel contracted edges, the update contains at most nonzero terminal-edge contributions. For it need not itself be a tree on the terminals, although its support is always connected (Theorem 4.3).
CAST-1: the base update.
When , each block holds a single copy carrying its terminal’s full conductance, so the expanded clique is the Schur clique itself and contraction is the identity: CAST- reduces to sampling one weighted random spanning tree of . Because Schur complementation preserves effective resistances among the retained vertices, the effective resistance between terminals and in equals the series resistance of the path –– before elimination, . The leverage score of edge is, By the transfer-current theorem the weighted random spanning tree selects edge with probability , and inverse-marginal reweighting assigns it conductance ,
exactly the series conductance of the two-hop path –– that the edge replaces. Thus CAST-1 is an order-independent one-tree replacement whose edge marginals equal the clique leverage scores; Theorem 4.5 shows that these marginals uniquely minimize the local risk .
3.2 Exact sampling in time via Prüfer codes
Sampling the update requires a weighted random spanning tree of the expanded Schur clique, a complete graph on auxiliary copies. Its conductances have the product form , and this structure permits exact sampling from (3) using an i.i.d. weighted Prüfer code, without materializing the dense clique. Background on Prüfer codes is provided in Appendix A.
Fix a spanning tree on the auxiliary-copy set . Since has edges,
so, up to a factor independent of , the target probability is determined entirely by the vertex degrees. For the Prüfer correspondence is a bijection between labeled trees on and sequences in , under which appears exactly times in the code of Aigner and Ziegler (1999); West (2001). Drawing the symbols independently with therefore generates with probability
The ratio of this probability to the unnormalized target weight is , independent of . Hence the i.i.d. Prüfer construction samples exactly from the weighted random spanning-tree distribution of the expanded Schur clique.
The sampler needs neither the expanded clique nor an explicit array of auxiliary-copy weights. All copies in carry conductance , so each symbol can be drawn hierarchically: sample terminal with probability , then one of its copies uniformly. An alias table for the terminal distribution is built once in time, after which each of the symbols costs . Decoding the code into a tree takes time by the standard leaf-pointer algorithm. Contraction is a single pass over the auxiliary edges: cross-block edges are placed on the corresponding terminal edge with conductance , within-block edges become self-loops and are discarded, and parallel terminal edges are aggregated by summing conductances. Sampling, decoding, and contraction therefore cost in total.
Proposition 3.1 (Sampling cost).
For every pivot with active neighbors and every integer , CAST-SchurTree samples the exact weighted random spanning-tree distribution of the expanded Schur clique and contracts the sampled tree onto the original pivot neighborhood in time, without materializing either the -edge Schur clique or the expanded clique.
Proof.
See Appendix B.1. ∎
Summing Proposition 3.1 over pivots, the elimination takes time, where is the degree of in the residual graph when it is eliminated. The residual degrees depend on the fill realized by earlier updates, which is why we study the effect of on downstream fill empirically (Section 5).
Two structural features of the Schur clique make this possible. For , its star origin gives the leverage scores in closed form (Section 3.1), identifying the target distribution without any resistance computation. Under -way splitting, the expanded clique retains product-form conductances, so the same Prüfer argument applies verbatim. Splitting thus refines the update while preserving both the algebraic structure needed for exact sampling and the order-independence that makes the rule canonical.
The CAST preconditioner.
Applying the local CAST- update at every pivot yields an approximate Cholesky factorization, CAST-Chol (Algorithms 1–2). The method maintains a residual graph, the weighted graph on the not-yet-eliminated vertices, initialized to . At each step it selects a pivot , records the pivot star—the pivot, its active neighbors, and their incident conductances, which together form the column of associated with —then deletes from the residual graph and inserts the contracted terminal-edge contributions returned by Algorithm CAST-SchurTree. In the reuse setting, the resulting factor is built once for the fixed operator and applied within PCG for the right-hand sides .
4 Local Theory of the CAST Update
We analyze the CAST- update at a single elimination step. For the base update, we prove that the weighted spanning-tree distribution uniquely minimizes the local risk defined in Eq. (2) among unbiased inverse-marginal one-tree estimators. For general integer , we establish unbiasedness, connected support, and a normalized local second-moment bound of order , quantifying the reduction in local sampling variability obtained through finer splitting.
Fix a pivot with active neighbors , where , and let , . Exact elimination of creates the Schur clique of (1). We identify the pivot neighborhood with , and all Loewner-order comparisons between local Laplacians on the pivot neighborhood are understood on .
Auxiliary-copy notation.
We use the notation of Section 3.1: the blocks of auxiliary copies with conductances , the set , the map , the expanded Schur clique with conductances , and the tree drawn from (3). For an auxiliary edge we write for its contracted contribution to the terminal Laplacian: setting and ,
where is the basis vector of terminal , so that as in (4). Throughout this section denotes the inclusion probability of an edge of the expanded clique; when the expanded clique is itself, and agrees with the clique-edge marginals of Section 2.
Unbiasedness.
We first show that contracting the sampled auxiliary tree preserves the exact Schur update in expectation.
Lemma 4.1 (Auxiliary-edge marginals).
For every auxiliary edge of the expanded Schur clique, .
Proof.
See Appendix B.2. ∎
In particular, the conductance assigned to a selected auxiliary edge is exactly its inverse-marginal reweighting:
Theorem 4.2 (Unbiasedness).
For every pivot and every integer , .
Proof.
See Appendix B.3. ∎
Connected support and correct local nullspace.
Unbiasedness controls the local update in expectation. CAST- also has a deterministic structural property: every realization has connected support on the pivot neighborhood.
Theorem 4.3 (Connected local support).
For every integer , the terminal support graph of is connected on .
Proof.
See Appendix B.4. ∎
Corollary 4.4 (Correct local nullspace and rank).
For every integer , and .
Proof.
See Appendix B.5. ∎
Connectivity alone does not distinguish CAST from the practical AC and AC2 updates, which are also connected; the distinction lies in the distribution from which the local update is drawn. We turn to that distribution.
4.1 Local minimax optimality of the base update
When , CAST samples a weighted random spanning tree directly from the Schur clique, so the update is an inverse-marginal one-tree estimator (Section 2). We now answer Question 1.1: which edge marginals minimize the local risk , the largest normalized contribution of any sampled edge? We answer it for an arbitrary connected local Laplacian ; the Schur clique is the case relevant to CAST.
Theorem 4.5 (Local minimax optimality of leverage-score marginals).
For every spanning-tree distribution satisfying for all , , with equality if and only if for every . In particular, the weighted random spanning-tree distribution of , whose edge marginals satisfy , is locally minimax-optimal among unbiased inverse-marginal one-tree estimators.
Proof.
See Appendix B.6. ∎
The proof is a short averaging argument: every spanning tree has edges, so , and a maximum is at least a weighted average.
Theorem 4.5 identifies the optimal edge-marginal vector uniquely, namely ; it does not assert uniqueness of the full distribution over spanning trees. CAST-1 realizes these marginals with the weighted random spanning-tree distribution of the clique, which for the Schur clique has the closed form derived in Section 3.1: edge is included with probability and reweighted to conductance . Hence CAST-1 attains , the smallest value achievable in this class.
4.2 Local second-moment certificate for CAST-
Theorem 4.5 concerns estimators supported on a single spanning tree of the terminal clique, and so applies directly to the base update. For , CAST- samples one spanning tree on the expanded Schur clique and contracts the auxiliary-copy blocks back to the terminals; the resulting terminal update need not itself be a tree, and is therefore not a competing tree distribution on .
We analyze the general construction through a different local certificate: the normalized second moment of the one-pivot Schur error. The bound below scales as , quantifying how splitting decomposes the local estimator into smaller normalized contributions.
Let denote the edge set of the expanded Schur clique. For each auxiliary edge , let be its contracted terminal contribution, with when , and set , its size in the energy geometry of . Let be the orthogonal projection onto .
Lemma 4.6 (Normalized auxiliary-edge contribution).
For every auxiliary edge , . Moreover, .
Proof.
See Appendix B.7. ∎
Each auxiliary edge therefore contributes at most in the energy geometry of , independently of the pivot degree and of the incident weights: splitting shrinks the largest possible single contribution in direct proportion to . The second-moment analysis combines this with the determinantal negative dependence of weighted random spanning-tree edge indicators.
Lemma 4.7 (Covariance domination for spanning-tree indicators).
Let be a weighted random spanning tree of a connected weighted graph, and for each edge let and . If is the covariance matrix of , then .
Proof.
See Appendix B.8. ∎
Negative dependence is what makes the tree structure work in our favor: the sampled edges are not independent, but their covariance never exceeds what independent sampling with the same marginals would give, so the second moment can be bounded edgewise.
Theorem 4.8 (Local second-moment bound for CAST-).
Let be the normalized local Schur error of the CAST- update. For every integer ,
Proof.
See Appendix B.9. ∎
At the bound reads , matching the unit local risk attained by CAST-1 (Theorem 4.5); each further doubling of halves the certified bound.
Scope of the guarantees.
The results above certify the CAST primitive at a single elimination step: for every the update is unbiased with connected support, at its marginals uniquely minimize the local risk, and for general its normalized second moment obeys a bound. The second moment is the quantity that matrix-concentration analyses of approximate elimination control alongside the largest single increment, so the bound identifies as a principled control on sampling variability, uniform over pivot degrees and incident weights. It remains a local certificate: it does not track how these errors accumulate across eliminations, and it says nothing about the magnitude of the resulting gain or about the construction cost and downstream fill that splitting introduces. Section 5 measures these effects across four benchmark families.
5 Experimental Evaluation
Methods.
We compare four preconditioners within a common elimination and PCG framework. AC Gao et al. (2026) is the practical approximate Cholesky factorization based on the elimination estimator of Kyng and Sachdeva Kyng and Sachdeva (2016), implemented in Laplacians.jl11 1 https://github.com/danspielman/Laplacians.jl; at each pivot it replaces the exact Schur-complement clique by a connected update generated through randomized sequential edge pairing. AC2 is its doubled-budget variant (split merge ): each edge is represented by up to two half-weight multiedges, with fill multiplicity capped at two. These are the state of the art on the families our corpus is drawn from, where multigrid and incomplete-Cholesky solvers Koutis et al. (2011b); Falgout and Yang (2002); Balay et al. (2019); Livne and Brandt (2012); Meijerink and van der Vorst (1977) each fail on some instance while AC and AC2 converge throughout Gao et al. (2026), as our own runs on these collections confirmed; we therefore confine the comparison to the randomized approximate-elimination family.
CAST-1 applies the base update, replacing each elimination clique by a weighted random spanning tree whose edge marginals equal the clique leverage scores (Section 3.1). CAST-2 applies two-way splitting: each pivot neighbor is temporarily replaced by two equal-conductance auxiliary copies, one weighted random spanning tree is sampled from the resulting expanded Schur clique, and the copies are contracted back to the original neighborhood. We compare AC with CAST-1 as the base-granularity methods and AC2 with CAST-2 as their doubled-granularity variants; all four share the same elimination ordering (greedy on approximate minimum unweighted degree, following Gao et al. (2026)), factor representation, and PCG implementation, so the comparison isolates the local update.
AC2 versus CAST-2.
The two robustness variants increase sampling granularity in different ways. In AC2, edge replication persists throughout the factorization: the residual operator is represented as a multigraph with at most two multiedges per vertex pair, and a current neighbor represented by multiedges contributes samples to the sequential clique update. Thus AC2 is not equivalent to averaging two independent AC factorizations.
In CAST-2, splitting is local to the current pivot. Eliminating a degree- pivot creates temporary auxiliary copies, one weighted random spanning tree is sampled on the expanded Schur clique, and its copy blocks are contracted onto the original neighbors. The auxiliary copies are then discarded, although the contracted terminal edges remain in the residual graph and may increase downstream fill. Hence AC2 and CAST-2 are comparable doubled-granularity variants, but they differ in sample dependence, persistence, and the distribution of fill.
Metrics.
For right-hand sides, we report the total reuse workload
The two primary paired speedups are
where values greater than one favor the corresponding CAST variant. Aggregate speedups are arithmetic means of per-system ratios, computed in the direction stated for each comparison; we also report the number of systems on which each CAST variant is faster, which is independent of this convention. Following Gao et al. (2026), we also report factor-construction and per-right-hand-side solve costs normalized by the number of input nonzeros,
with the average per-solve time of Section 2. Both normalized costs are reported in .
Setup.
Unless otherwise stated, every factorization is evaluated only as a preconditioner for the same PCG implementation, which uses a recurrence-based relative-residual stopping threshold of and an iteration cap of . After each solve, we explicitly compute to verify the requested tolerance. We report any discrepancy between the recurrence-based stopping test and this explicit residual check; the treatment of failed solves in each aggregate is stated alongside the corresponding result.
For each matrix and method, one factor is constructed and reused for right-hand sides. The right-hand sides are independent standard Gaussian vectors projected onto , as required for Laplacian compatibility. A fixed right-hand-side sequence, generated independently of the factor-sampling seeds, is presented to every method and every factor draw, so comparisons are paired at the level of individual right-hand sides. The number of independently seeded factor draws and the aggregation rule are stated for each collection in the corresponding appendix; all methods entering a paired comparison use the same right-hand-side sequence and the same number of factor draws.
Matrix collections.
The evaluation corpus contains SDDM and Laplacian systems from the SDDM2023 benchmark suite22 2 https://rjkyng.github.io/SDDM2023/ of Gao, Kyng, and Spielman: SuiteSparse matrices, Chimera-IPM systems, Spielman-IPM systems, and five Sachdeva-star instances. Eleven SuiteSparse matrices are excluded from the comparative aggregates as described below, leaving systems with paired measurements. Collection-specific protocols and per-system results appear in the appendix. All experiments run in a single process on an Apple Silicon MacBook Pro with GB of RAM under Julia 1.12. Preconditioner construction and application are single-threaded, and dense operations in the shared PCG implementation use the same OpenBLAS configuration for all methods.
The reported Spielman corpus contains the four scales . The larger sequences, containing approximately and nonzeros, exceed the memory capacity of the benchmark machine under the multi-solve protocol and are not included.
Within the SuiteSparse collection, ten matrices are retained as correctness checks but excluded from comparative aggregates because all four methods solve them in one PCG iteration and their timings are dominated by fixed construction and application overhead. We also exclude bcsstm25: at the requested tolerance of , all methods reach the iteration cap for at least some right-hand sides, whereas at tolerance every method converges in one iteration, indicating that the failure is associated with the matrix–tolerance pair rather than a particular preconditioner. The SuiteSparse comparative aggregate therefore contains the remaining matrices.
5.1 Cross-collection results
Table 1 summarizes the paired comparative subsets at right-hand sides per factor. Across the systems with paired measurements, selecting the faster of CAST-1 and CAST-2 for each system in hindsight gives an arithmetic-mean speedup of over the correspondingly faster of AC and AC2, with CAST faster on systems. Per-system results are in Appendix C.
Base granularity.
CAST-1 improves on AC across every collection, and does so uniformly rather than on average: it is faster on all Chimera-IPM systems, with per-system ratios between and and a mean of , and on of SuiteSparse matrices with a mean of . Against a tuned implementation that is the most reliable available solver on these families, a consistent – speedup in total reuse workload—concentrated in the solve phase, and therefore compounding with the number of right-hand sides—is a substantive gain from changing only the local sampling distribution. On the Sachdeva-star ladder the margin instead grows with instance size, from at to at ( on average), as AC’s iteration count degrades faster than CAST-1’s.
Doubled granularity.
The comparison is bimodal, and the elimination-degree profile predicts which regime holds. When pivot degrees are uniformly small, splitting is nearly free and the gain is large: on the Spielman-IPM systems, where every pivot has degree at most five, CAST-2 reaches the verified tolerance in one to two PCG iterations and is faster than AC2. The Sachdeva-star family benefits through a different mechanism. Its neighborhoods are clique-dominated rather than low-degree and CAST-2 needs multiple iterations for convergence, but it holds iteration growth to – across the ladder against – for AC2. When elimination produces a heavy tail of high-degree pivots the additional contributions instead dominate: on the Chimera collection AC2 is faster on of systems, CAST-2 is faster only on instance , whose maximum pivot degree of is the smallest in the family. On SuiteSparse both are close, CAST-2 leading by on of matrices.
| Collection | Elimination profile | |||
|---|---|---|---|---|
| SuiteSparse | mostly low-degree, | (14/17) | (11/17) | (12/17) |
| Chimera-IPM | –, – | (128/128) | (27/128) | (121/128) |
| Spielman-IPM | all pivots satisfy | (38/40) | (40/40) | (40/40) |
| Sachdeva-star | clique-dominated | (5/5) | (5/5) | (5/5) |
Choosing .
Two conclusions follow. First, the sampling distribution matters on its own. All four methods share an elimination ordering, factor format, and PCG path; AC and CAST-1 differ only in how the local update is drawn. That difference alone cuts total reuse workload by – on the heterogeneous collections, almost entirely in the solve phase.
Second, is a structural choice, not a strictly better setting. Splitting pays when its extra terminal-edge contributions stay confined: under small pivot degrees, as on Spielman-IPM, or in clique-dominated neighborhoods where iterations would otherwise grow, as on Sachdeva-star. It costs when a heavy degree tail carries them into later eliminations, compounding as downstream fill. Degree alone does not decide this; the clique-dominated case shows why. What matters is whether the contributions propagate. A CAST-1 elimination profile predicts this on our corpus, but reading it requires a first factorization, and we do not evaluate it as an adaptive rule. The post hoc column of Table 1 therefore bounds what any per-system choice between and could achieve.
6 Related Work
Laplacian and SDDM solvers.
Nearly-linear-time Laplacian solvers originated from support-graph preconditioning, low-stretch graph constructions, and spectral sparsification Spielman and Teng (2004); Koutis et al. (2011a); Cohen et al. (2014); Jambulapati and Sidford (2025), with effective-resistance sampling an especially influential route to the last Spielman and Srivastava (2008). These works give strong global approximation and running-time guarantees, but their recursive preconditioning structures differ from the sparse approximate factorizations studied here. Practical solvers for these systems also include incomplete Cholesky and algebraic multigrid, among them graph-specialized variants such as LAMG Livne and Brandt (2012). CAST belongs instead to the randomized approximate-elimination line, which builds a sparse factor by eliminating vertices sequentially and replacing each dense Schur-complement clique by a sparse random update.
Randomized approximate elimination.
Kyng and Sachdeva introduced a nearly-linear-time approximate Gaussian elimination algorithm for graph Laplacians, replacing elimination fill by unbiased random samples and controlling the accumulated error through a matrix-martingale analysis Kyng and Sachdeva (2016). Related sparsified-Cholesky constructions extend the approach to connection Laplacians Kyng et al. (2016). On the practical side, RCHOL adds shared-memory parallelization Chen et al. (2021), and more recent work studies parallel frameworks and CPU/GPU construction of randomized approximate-Cholesky preconditioners Baumann and Kyng (2024); Liang et al. (2025). These address global guarantees, alternative sampling schemes, or parallel implementation. CAST instead studies the distribution used for a single local Schur-clique replacement, then applies that primitive within a sequential factorization.
Practical approximate-Cholesky solvers.
The closest predecessor is the AC() framework of Gao, Kyng, and Spielman Gao et al. (2026), which turns randomized approximate elimination into a practical SDDM solver in Laplacians.jl. Its local updates preserve connected support, and its configurations AC and AC2 use one and two samples per entry to trade construction cost against robustness. CAST adopts the same connected-update principle but differs in the distribution. AC() generates its trees by randomized sequential edge pairing, so the induced edge marginals depend on the order in which incident edges are processed. CAST samples from the weighted random spanning-tree distribution of the clique itself, which is order-independent and attains the minimax edge marginals of Theorem 4.5.
Leverage scores and random spanning trees.
Edge leverage scores—equivalently, edge conductance times effective resistance—are central to spectral sparsification Spielman and Srivastava (2008). For a weighted random spanning tree, the transfer-current theorem identifies the inclusion probability of each edge with its leverage score Lyons (2003), and random spanning trees have accordingly been studied as spectral sparsifiers, including from unions of a few independent trees Kyng and Song (2018). Sampling such trees on general graphs requires nontrivial graph-algorithmic machinery Durfee et al. (2017).
CAST uses this distribution locally rather than globally, which is what makes it cheap. Sampling one tree per elimination clique avoids the general machinery entirely: the star origin of the clique gives its leverage scores in closed form, and the product-form conductances of the expanded clique admit exact sampling in time via weighted Prüfer codes Aigner and Ziegler (1999); West (2001). The union-of-trees results of Kyng and Song (2018) are also not the right analogy for : CAST- samples a single tree on an expanded vertex set, not independent trees on the original terminals.
Conclusion
We introduced CAST, a canonical sparse replacement for the Schur clique created during approximate Cholesky elimination. We show that among unbiased inverse-marginal one-tree estimators, leverage-score marginals uniquely minimize the largest normalized sampled-edge contribution. Because the clique is induced by a star, CAST samples the corresponding weighted random spanning tree exactly in time. Empirically, CAST-1 reduces total reuse workload by – relative to AC on SuiteSparse and Chimera-IPM systems. When additional fill remains controlled, CAST-2 improves robustness: on Spielman-IPM systems it reaches the verified residual tolerance in one to two PCG iterations and is, on average, faster than AC2.
References
- [1] (1999) Proofs from the book. Vol. 1, Springer. Cited by: Appendix A, §3.2, §6.
- [2] (2006) Local graph partitioning using pagerank vectors. In 2006 47th annual IEEE symposium on foundations of computer science (FOCS’06), pp. 475–486. Cited by: §1.
- [3] (2019) PETSc users manual. Technical report Argonne National Laboratory. Cited by: §5.
- [4] (2026) VAC: a volume-sampling-based elimination rule for approximate cholesky factorization. Note: Manuscript, July 28, 2026 Cited by: §1.
- [5] (2024) A framework for parallelizing approximate gaussian elimination. In Proceedings of the 36th ACM Symposium on Parallelism in Algorithms and Architectures, pp. 195–206. Cited by: §6.
- [6] (2021) RCHOL: randomized cholesky factorization for solving sdd linear systems. SIAM Journal on Scientific Computing 43 (6), pp. C411–C438. Cited by: §6.
- [7] (2014) Solving sdd linear systems in nearly m log1/2 n time. In Proceedings of the forty-sixth annual ACM symposium on Theory of computing, pp. 343–352. Cited by: §6.
- [8] (2017) Sampling random spanning trees faster than matrix multiplication. In Proceedings of the 49th Annual ACM SIGACT Symposium on Theory of Computing, pp. 730–742. Cited by: §6.
- [9] (2002) Hypre: a library of high performance preconditioners. In International Conference on computational science, pp. 632–641. Cited by: §5.
- [10] (2026) AC(k): robust solution of laplacian equations by randomized approximate cholesky factorization. SIAM Journal on Scientific Computing. Cited by: §C.1, §C.2, §C.3, §C.4, §C.4, §1, §1, §1, §2, §5, §5, §5, §6, Abstract.
- [11] (2015) PageRank beyond the web. siam REVIEW 57 (3), pp. 321–363. Cited by: §2.
- [12] (1996) Combinatorial preconditioners for sparse, symmetric, diagonally dominant linear systems. Ph.D. Thesis, Carnegie Mellon University Pittsburgh. Cited by: §C.1, §2.
- [13] (2019) ISIRA: integrated shift–invert residual arnoldi method for graph laplacian matrices from big data. Journal of Computational and Applied Mathematics 346, pp. 518–531. Cited by: §1.
- [14] (2025) Ultrasparse ultrasparsifiers and faster laplacian system solvers. ACM Transactions on Algorithms 21 (3), pp. 1–49. Cited by: §6.
- [15] (2011) A nearly-m log n time solver for sdd linear systems. In 2011 IEEE 52nd Annual Symposium on Foundations of Computer Science, pp. 590–598. Cited by: §6.
- [16] (2011) Combinatorial preconditioners and multilevel solvers for problems in computer vision and image processing. Computer Vision and Image Understanding 115 (12), pp. 1638–1646. Cited by: §5.
- [17] (2016) Sparsified cholesky and multigrid solvers for connection laplacians. In Proceedings of the forty-eighth annual ACM symposium on Theory of Computing, pp. 842–850. Cited by: §6.
- [18] (2016) Approximate gaussian elimination for laplacians-fast, sparse, and simple. In 2016 IEEE 57th Annual Symposium on Foundations of Computer Science (FOCS), pp. 573–582. Cited by: §1, §1, §1, §2, §2, §5, §6.
- [19] (2018) A matrix chernoff bound for strongly rayleigh distributions and spectral sparsifiers from a few random spanning trees. In 2018 IEEE 59th Annual Symposium on Foundations of Computer Science (FOCS), pp. 373–384. Cited by: §6, §6.
- [20] (2025) Parallel gpu-accelerated randomized construction of approximate cholesky preconditioners. arXiv preprint arXiv:2505.02977. Cited by: §6.
- [21] (2012) Lean algebraic multigrid (lamg): fast graph laplacian linear solver. SIAM Journal on Scientific Computing 34 (4), pp. B499–B522. Cited by: §5, §6.
- [22] (2003) Determinantal probability measures. Publications Mathématiques de l’IHÉS 98, pp. 167–212. Cited by: §B.2, §B.6, §B.8, §1, §2, §6.
- [23] (1977) An iterative solution method for linear systems of which the coefficient matrix is a symmetric M-matrix. Mathematics of Computation 31 (137), pp. 148–162. Cited by: §5.
- [24] (1999) The pagerank citation ranking: bring order to the web. In Proc. of the 7th International World Wide Web Conf.–1998, Cited by: §1.
- [25] (2008) Graph sparsification by effective resistances. In Proceedings of the fortieth annual ACM symposium on Theory of computing, pp. 563–568. Cited by: §1, §1, §2, §6, §6.
- [26] (2004) Nearly-linear time algorithms for graph partitioning, graph sparsification, and solving linear systems. In Proceedings of the thirty-sixth annual ACM symposium on Theory of computing, pp. 81–90. Cited by: §1, §6.
- [27] (2001) Introduction to graph theory. 2nd edition, Prentice Hall. Cited by: Appendix A, §3.2, §6.
- [28] (2003) Learning with local and global consistency. Advances in neural information processing systems 16. Cited by: §1.
- [29] (2003) Semi-supervised learning using gaussian fields and harmonic functions. In Proceedings of the 20th International conference on Machine learning (ICML-03), pp. 912–919. Cited by: §1.
Appendix A Background on Prüfer Codes
This appendix collects the facts about Prüfer codes underlying the exact sampler of Section 3.2.
The Prüfer correspondence.
Let be a set of labeled vertices with an arbitrary total ordering. A Prüfer code is a sequence . The Prüfer correspondence is a bijection between such sequences and labeled spanning trees on [1, 27]: every labeled tree has a unique code, and every sequence of length decodes to a unique tree. To encode a tree, repeatedly remove the smallest-labeled leaf and append its unique neighbor to the sequence, stopping when two vertices remain; one vertex is removed per step, so the code has exactly symbols.
For example, the tree on with edges has smallest leaf , whose neighbor is , so the first symbol is . After removing the smallest leaf is , again with neighbor ; after removing it is , whose remaining neighbor is . The code is .
The inverse procedure reconstructs the tree. For each label initialize . At each step choose the smallest label with , connect to the next code symbol , remove , and decrease by one. Two labels remain once all symbols are processed; connecting them completes the tree. When the code is empty and the tree is the single edge between the two labels.
Degrees from code multiplicities.
The property CAST relies on is that appears in the code exactly times, i.e.
Intuitively, is recorded whenever a neighboring leaf is removed while remains, which happens once per incident edge except the edge through which is itself removed, or the final edge if is one of the last two vertices. Consistently, , the length of the code.
Nonuniform Prüfer sampling.
The correspondence is purely combinatorial. A weighted tree distribution can nonetheless be induced by drawing the code symbols nonuniformly: if are independent with , then, because the correspondence is a bijection, the decoded tree has probability , which depends on only through its degree sequence. This matches the structure of complete graphs whose edge weights factor over endpoints.
Lemma A.1 (Weighted Prüfer sampling).
Let the complete graph on have edge weights for , with and . Draw independently with and let be the decoded tree. Then follows the weighted random spanning-tree distribution, .
Proof.
A spanning tree has edges and each appears in of them, so . By the degree-multiplicity property,
The ratio of the two expressions is , which does not depend on . Both are distributions over the same finite set, so they coincide. ∎
The endpoint-product form is essential: independent Prüfer symbols do not sample the correct weighted spanning-tree distribution for general edge weights.
Application to CAST-.
At a pivot with terminals, the expanded Schur clique is the complete graph on the auxiliary copies with conductances . This is Lemma A.1 with and , and since , the symbol distribution is . Because every copy of terminal carries the same conductance , a symbol can be drawn hierarchically: sample with probability , then one of its copies uniformly. Section 3.2 gives the resulting sampler and its cost.
Appendix B Proofs
B.1 Proof of Proposition 3.1
Proof.
Let . A spanning tree of the expanded Schur clique has edges, and each copy appears in of them, so
The Prüfer correspondence is a bijection between spanning trees of the complete graph on and sequences in , under which appears exactly times in the code of . Hence drawing the symbols independently with generates with probability
where we used . The ratio of this probability to the unnormalized tree weight above is , independent of . Two probability distributions on the same finite set whose ratio is constant are equal, so the sampler is exact.
For the running time, all copies of terminal carry the same conductance , so a symbol is drawn by sampling a terminal from an alias table for and then one of its copies uniformly. The table is built once in time, after which each of the symbols costs . Decoding takes time by the standard leaf-pointer algorithm. Contraction is one pass over the auxiliary edges with work each: a cross-block edge is emitted as the terminal-edge contribution , and a within-block edge is discarded. The total is .
Finally, the only structures allocated are the alias table over the terminals, the code of length , and the decoded tree on copies. Neither the -edge Schur clique nor the expanded clique is ever formed. ∎
B.2 Proof of Lemma 4.1
Proof.
Let be the star on in which the center is joined to each auxiliary copy by an edge of conductance , so that the total conductance at is . Eliminating from produces, by Eq. (1), the clique on with edge conductances . The expanded Schur clique is therefore the Schur complement of onto .
Schur complementation preserves effective resistances among the retained vertices, so the effective resistance between and in the expanded clique equals their effective resistance in . Since is a tree, the unique – path –– determines this resistance, giving
By the transfer-current theorem [22], the inclusion probability of an edge in a weighted random spanning tree is its conductance times its effective resistance, whence
B.3 Proof of Theorem 4.2
Proof.
Write with , so that by linearity . Within-block edges contract to self-loops and contribute , so only pairs with endpoints in distinct blocks remain.
Fix distinct terminals . Collecting the terms carrying and applying Lemma 4.1,
using . This is exactly the coefficient of the terminal edge in . Both and are graph Laplacians on , and a graph Laplacian is determined by its edge coefficients, so
∎
B.4 Proof of Theorem 4.3
Proof.
The sampled tree is connected on the auxiliary-copy set . Contract each block to its terminal . Contraction preserves connectedness: given terminals and , pick and ; the – path in maps to a walk from to in the quotient graph.
It remains to check that the quotient edges are exactly the edges of the support graph of . An auxiliary edge with both endpoints in one block becomes a self-loop and is discarded, which does not affect connectivity. A cross-block edge with contributes conductance to the terminal edge , and parallel contributions are summed. Since all , every such contribution is strictly positive and no cancellation occurs, so each quotient edge carries positive weight in . The support graph of is therefore the quotient graph with self-loops removed, and is connected.
When each block is a single copy, so the contraction is the identity and is itself a spanning tree of the terminal neighborhood; for it need not be a tree. ∎
B.5 Proof of Corollary 4.4
Proof.
The nullspace of a weighted graph Laplacian has dimension equal to the number of connected components of its support graph, and is spanned by the indicator vectors of those components. By Theorem 4.3 the support graph of is connected on , so and, by rank–nullity, . ∎
B.6 Proof of Theorem 4.5
Proof.
Every spanning tree of the support graph of has exactly edges, so for every realization; taking expectations gives . The leverage scores satisfy as well, so
since the middle expression is a weighted average of the ratios with positive weights . Hence .
A weighted average with positive weights attains its maximum only when every term equals that maximum. Equality therefore forces , i.e. , for every ; conversely, if throughout then . Finally, for the weighted random spanning-tree distribution of the transfer-current theorem [22] gives , so this distribution attains the bound. ∎
B.7 Proof of Lemma 4.6
Proof.
If is a within-block edge then , hence and both claims hold trivially. Otherwise let with , and write , so that and . Thus is positive semidefinite and rank one, and its only nonzero eigenvalue is
By the argument of Lemma 4.1 applied to the pivot star, the effective resistance between and in is . Substituting and ,
independently of and of the incident weights.
Write with . Since and is the orthogonal projection onto that subspace, , giving . Finally, a rank-one matrix with satisfies , so . ∎
B.8 Proof of Lemma 4.7
Proof.
Fix an arbitrary orientation of the edges. The edge indicators of a weighted random spanning tree then form a determinantal point process whose kernel is the transfer-current matrix , which is symmetric and positive semidefinite, with [22]. Determinantal pair correlations give, for ,
so . On the diagonal, is a Bernoulli indicator, so . Hence
where is the entrywise product; note that does not depend on the chosen orientation, since only the squares appear. Since , the Schur product theorem gives , and therefore . ∎
B.9 Proof of Theorem 4.8
Proof.
The mean-zero statement follows from Theorem 4.2:
For let and . Since and, by unbiasedness, , conjugating by gives
Fix . As is symmetric, , and expanding the square,
where is the Gram matrix of the vectors and is therefore positive semidefinite. The right-hand side is the Frobenius inner product .
By Lemma 4.7, . For positive-semidefinite and one has , so and hence
the last equality because each is symmetric. As was arbitrary, .
Appendix C Empirical Evaluation
C.1 SuiteSparse benchmark
Benchmark.
We evaluate on 28 symmetric diagonally dominant M-matrices from the SuiteSparse Matrix Collection, following the benchmark selection of Gao, Kyng, and Spielman [10]. The collection includes grid and mesh Laplacians, finite-element and finite-volume discretizations, shallow-water models, ill-conditioned structural systems, and irregular graph problems, with the largest matrices containing up to million nonzeros.
Ten matrices are diagonal or effectively diagonal, and every method converges in one PCG iteration for every right-hand side. These instances do not exercise the randomized clique estimator; their timings primarily reflect fixed construction and application overhead. We therefore retain them as correctness checks but exclude them from aggregate performance comparisons.
Of the remaining 18 matrices, bcsstm25 is reported as did not finish (DNF) and excluded from the aggregates. Its conditioning places the requested tolerance of below the attainable double-precision accuracy for some right-hand sides, causing every method to reach the iteration limit on those right-hand sides. At tolerance , all methods converge in one iteration, indicating that the failure is attributable to the matrix–tolerance pair rather than to a particular solver. The aggregate comparison therefore contains matrices.
The SDDM inputs are reduced to Laplacian form using the standard Gremban expansion [12]. This preprocessing is applied once per matrix and shared identically by all methods.
Results.
Base-granularity comparison.
CAST-1 is faster than AC on 14 of the 17 matrices, with an average speedup of . The largest gains occur on nos7 (), shallow_water2 (), and nos6 (). On the two largest matrices, ecology1 and ecology2, CAST-1 is and faster, respectively.
Build costs are similar for the two methods on most matrices, whereas solve costs generally favor CAST-1. The aggregate improvement therefore arises primarily from the solve phase rather than from cheaper factor construction. The exceptions are apache1 (), jnlbrng1 (), and bcsstm24 (). On apache1 and jnlbrng1, CAST-1 requires more PCG iterations; CAST-1 requires 54 iterations per solve on apache1, compared with 28 for AC.
Doubled-granularity comparison.
CAST-2 is faster than AC2 on 11 of the 17 matrices, with an average speedup of . It performs particularly well on shallow_water2 (), the two ecology matrices (–), and apache1 (). Thus, the construction recovers the loss observed for CAST-1 on apache1, consistent with improved robustness under finer splitting.
On jnlbrng1, AC2 requires 14 iterations per solve, compared with 27 for CAST-2, yielding a speedup ratio of . The largest loss occurs on Andrews (), whose highly skewed degree distribution leads to a CAST-2 build cost of , compared with for AC2. This construction overhead makes CAST-1, rather than CAST-2, the preferable CAST configuration on this matrix.
Cost decomposition and factor reuse.
The performance differences reflect both iteration count and preconditioner-application cost. On ecology1, for example, CAST-2 requires 26.3 iterations per solve, compared with 29.5 for AC2, while also having a lower per-iteration application cost. Together, these effects produce the observed total-time speedup.
Factor reuse is particularly important for the doubled-granularity variants. In a separate solve-count sweep, at , AC2 is more expensive than AC and is slower on all 17 matrices, while each CAST variant remains within a few percent of its corresponding baseline. The additional construction cost is amortized as the number of right-hand sides increases; at , the aggregate comparison modestly favors CAST-2.
| (s) | solve s/nnz | build s/nnz | ||||||
| Matrix | nnz | AC | CAST-1 | speedup | AC | CAST-1 | AC | CAST-1 |
| ecology2 | 4,995,991 | 227.96 | 181.51 | 1.26 | 0.174 | 0.139 | 0.12 | 0.12 |
| ecology1 | 4,996,000 | 226.49 | 181.90 | 1.25 | 0.171 | 0.138 | 0.12 | 0.12 |
| apache1 | 542,184 | 14.26 | 19.59 | 0.73 | 0.097 | 0.137 | 0.09 | 0.09 |
| Andrews | 760,154 | 13.84 | 11.29 | 1.23 | 0.070 | 0.059 | 0.19 | 0.23 |
| shallow_water2 | 327,680 | 5.46 | 3.55 | 1.54 | 0.059 | 0.044 | 0.07 | 0.10 |
| torsion1 | 197,608 | 3.80 | 3.29 | 1.16 | 0.074 | 0.066 | 0.07 | 0.08 |
| obstclae | 197,608 | 3.79 | 3.24 | 1.17 | 0.073 | 0.065 | 0.07 | 0.08 |
| shallow_water1 | 327,680 | 3.46 | 2.43 | 1.42 | 0.039 | 0.029 | 0.06 | 0.10 |
| jnlbrng1 | 199,200 | 3.35 | 4.36 | 0.77 | 0.067 | 0.087 | 0.07 | 0.07 |
| nopoly | 70,842 | 1.48 | 1.29 | 1.14 | 0.081 | 0.073 | 0.05 | 0.06 |
| fv3 | 87,025 | 1.26 | 1.23 | 1.03 | 0.057 | 0.056 | 0.05 | 0.06 |
| fv2 | 87,025 | 0.72 | 0.64 | 1.12 | 0.033 | 0.029 | 0.05 | 0.05 |
| fv1 | 85,264 | 0.71 | 0.62 | 1.14 | 0.033 | 0.029 | 0.05 | 0.05 |
| nos7 | 4,617 | 0.102 | 0.066 | 1.55 | 0.086 | 0.055 | 0.07 | 0.08 |
| gr_30_30 | 7,744 | 0.085 | 0.078 | 1.09 | 0.043 | 0.039 | 0.05 | 0.06 |
| bcsstm24 | 3,562 | 0.084 | 0.100 | 0.85 | 0.087 | 0.103 | 0.04 | 0.07 |
| nos6 | 3,255 | 0.076 | 0.051 | 1.48 | 0.092 | 0.062 | 0.06 | 0.07 |
| Arithmetic mean of speedups | 1.172 | wins 14/17 | ||||||
| Excluded (DNF): bcsstm25 — its conditioning places the target below attainable double-precision accuracy, | ||||||||
| so a subset of right-hand sides never converges for any method. | ||||||||
| (s) | solve s/nnz | build s/nnz | ||||||
| Matrix | nnz | AC2 | CAST-2 | speedup | AC2 | CAST-2 | AC2 | CAST-2 |
| ecology1 | 4,996,000 | 164.76 | 125.98 | 1.31 | 0.124 | 0.095 | 0.25 | 0.28 |
| ecology2 | 4,995,991 | 163.20 | 128.32 | 1.27 | 0.124 | 0.097 | 0.27 | 0.28 |
| Andrews | 760,154 | 14.77 | 29.58 | 0.50 | 0.075 | 0.144 | 0.63 | 2.09 |
| apache1 | 542,184 | 12.01 | 9.85 | 1.22 | 0.082 | 0.069 | 0.24 | 0.23 |
| shallow_water2 | 327,680 | 4.71 | 3.31 | 1.42 | 0.051 | 0.040 | 0.14 | 0.12 |
| obstclae | 197,608 | 3.24 | 2.92 | 1.11 | 0.065 | 0.058 | 0.18 | 0.15 |
| torsion1 | 197,608 | 3.23 | 2.92 | 1.11 | 0.065 | 0.058 | 0.18 | 0.15 |
| shallow_water1 | 327,680 | 2.95 | 2.45 | 1.21 | 0.035 | 0.030 | 0.10 | 0.12 |
| jnlbrng1 | 199,200 | 2.70 | 4.21 | 0.64 | 0.053 | 0.083 | 0.19 | 0.14 |
| nopoly | 70,842 | 1.06 | 1.03 | 1.02 | 0.059 | 0.058 | 0.10 | 0.11 |
| fv3 | 87,025 | 0.94 | 0.98 | 0.96 | 0.043 | 0.044 | 0.12 | 0.15 |
| fv2 | 87,025 | 0.61 | 0.63 | 0.97 | 0.027 | 0.029 | 0.11 | 0.11 |
| fv1 | 85,264 | 0.60 | 0.61 | 0.99 | 0.027 | 0.028 | 0.12 | 0.11 |
| bcsstm24 | 3,562 | 0.085 | 0.099 | 0.85 | 0.086 | 0.103 | 0.07 | 0.07 |
| nos7 | 4,617 | 0.077 | 0.061 | 1.26 | 0.065 | 0.051 | 0.14 | 0.16 |
| gr_30_30 | 7,744 | 0.068 | 0.063 | 1.09 | 0.034 | 0.032 | 0.12 | 0.13 |
| nos6 | 3,255 | 0.061 | 0.049 | 1.25 | 0.074 | 0.059 | 0.08 | 0.10 |
| Arithmetic mean of speedups | 1.069 | wins 11/17 | ||||||
| Excluded (DNF): bcsstm25 — its conditioning places the target below attainable double-precision accuracy, | ||||||||
| so a subset of right-hand sides never converges for any method. | ||||||||
| Matrix | nnz | AC | AC2 | CAST-1 | CAST-2 |
|---|---|---|---|---|---|
| bcsstm39 | 46,772 | 0.141 | 0.142 | 0.153 | 0.153 |
| t3dl_e | 20,360 | 0.058 | 0.059 | 0.063 | 0.063 |
| t2dal_e | 4,257 | 0.012 | 0.012 | 0.013 | 0.013 |
| bcsstm21 | 3,600 | 0.012 | 0.012 | 0.012 | 0.012 |
| bibd_81_2 | 3,240 | 0.010 | 0.010 | 0.011 | 0.011 |
| bcsstm23 | 3,134 | 0.009 | 0.008 | 0.009 | 0.010 |
| bcsstm26 | 1,922 | 0.006 | 0.006 | 0.006 | 0.006 |
| bcsstm11 | 1,473 | 0.005 | 0.004 | 0.005 | 0.005 |
| bcsstm08 | 1,074 | 0.003 | 0.003 | 0.003 | 0.003 |
| bcsstm09 | 1,083 | 0.003 | 0.003 | 0.004 | 0.004 |
C.2 IPM Sequences on Chimera Graphs
Collection.
We evaluate on the maximum-flow interior-point-method sequences from the SDDM2023 benchmark suite of Gao, Kyng, and Spielman [10]. Each system is a weighted graph Laplacian with vertices and arises from a Newton step of an interior-point method for undirected maximum flow. The underlying graphs are five independent draws, denoted , from the Chimera generator in Laplacians.jl 33 3 https://github.com/danspielman/Laplacians.jl. Chimera graphs combine heterogeneous structures, including grid-like components, star joins, and graph products, and are designed to stress Laplacian solvers.
The five graph instances differ in their elimination geometry. Under CAST-1 elimination, instance has mean pivot degree and maximum pivot degree , whereas has and (Table 5). For each instance, the benchmark provides IPM runs at five duality-gap targets,
with each run contributing between three and six Newton-step systems. The resulting collection contains – matrix systems per instance and systems in total. Relative performance is stable across the duality-gap targets. We therefore aggregate over Newton steps and targets within each underlying graph instance.
Configuration.
We use the same protocol, metrics, and hardware described in Section 5. Every timed solve satisfies the explicitly verified residual criterion
and no method reaches the iteration cap. Within each instance we report the mean total workload over its systems and take speedups as ratios of these means, which measures the aggregate cost of processing an entire IPM sequence. Win counts give the complementary per-system view (Table 5).
Results.
CAST-1 is faster than AC on all systems (Tables 5 and 6.). The per-instance speedups range from to , and the per-system ratios range from to . The normalized solve cost is lower for CAST-1 on all five instances. Build costs are equal or nearly equal on and and higher for CAST-1 on –; at , however, the reduction in solve cost dominates these construction differences.
The behavior of CAST-2 depends more strongly on the elimination-degree profile. On , which has the smallest mean and maximum pivot degrees, CAST-2 is the fastest method: it is faster than AC2 and wins on all systems. On the other four instances, the AC2/CAST-2 ratios are , , , and , respectively.
This difference is associated with construction fill. At a degree- pivot, CAST-2 samples one spanning tree on auxiliary copies. The tree contains auxiliary edges before within-block edges are discarded and parallel terminal-edge contributions are aggregated, compared with edges for CAST-1. On instances with high-degree pivots, the additional terminal-edge contributions propagate through subsequent eliminations. Accordingly, the median CAST-2 build cost relative to CAST-1 increases from on and on to approximately on and , and on . The doubled-granularity baseline is also structure dependent: AC2 has lower mean total cost than AC on and , but higher cost on , , and .
Choosing the splitting factor.
At , CAST-2 outperforms CAST-1 only on . Its factor is more expensive to construct on this instance, so CAST-1 remains faster at . The two variants cross between and , and CAST-2 is faster by . On the four instances with , CAST-2 is – slower than CAST-1 at . Within this collection, the results support a degree-aware empirical choice of . A light upper tail in the pivot-degree distribution favors when the factor is reused sufficiently to amortize its higher construction cost. In contrast, is preferable when high-degree pivots make downstream fill and factor construction dominant. The pivot-degree profile observed during a CAST-1 construction may inform this choice, although we treat this as an empirical heuristic rather than as an evaluated adaptive selection algorithm.
| (s) | Speedup (mean) | ||||||||
| Instance | nnz | AC | AC2 | CAST-1 | CAST-2 | ||||
| 1,100,592 | 26.7 | 363 | 30.6 | 40.1 | 24.6 | 113.8 | (28/28) | (0/28) | |
| 797,974 | 9.5 | 92 | 19.8 | 17.6 | 17.5 | 23.1 | (24/24) | (0/24) | |
| 499,696 | 6.4 | 48 | 17.9 | 15.5 | 15.7 | 13.4 | (27/27) | (27/27) | |
| 814,436 | 15.2 | 229 | 23.1 | 25.8 | 19.5 | 57.4 | (26/26) | (0/26) | |
| 499,982 | 10.7 | 246 | 13.9 | 15.6 | 11.9 | 30.1 | (23/23) | (0/23) | |
| Across instances: AC/CAST-1 arithmetic mean ; CAST-1 is faster on systems. | |||||||||
| Solve () | Build () | |||||||
|---|---|---|---|---|---|---|---|---|
| Instance | AC | AC2 | CAST-1 | CAST-2 | AC | AC2 | CAST-1 | CAST-2 |
| 0.105 | 0.139 | 0.087 | 0.392 | 0.40 | 1.15 | 0.41 | 5.37 | |
| 0.093 | 0.083 | 0.083 | 0.110 | 0.16 | 0.37 | 0.16 | 0.73 | |
| 0.133 | 0.115 | 0.116 | 0.099 | 0.10 | 0.32 | 0.15 | 0.45 | |
| 0.109 | 0.119 | 0.091 | 0.269 | 0.25 | 0.68 | 0.28 | 2.85 | |
| 0.101 | 0.114 | 0.089 | 0.230 | 0.18 | 0.59 | 0.28 | 2.80 | |
| (s) | Speedup | ||||||
| Scale | nnz | AC | AC2 | CAST-1 | CAST-2 | ||
| 1,025,404 | 7.35 | 6.84 | 8.23 | 1.45 | (9/10) | (10/10) | |
| 8,080,604 | 59.68 | 54.65 | 48.19 | 12.30 | (9/10) | (10/10) | |
| 27,226,204 | 204.60 | 182.78 | 132.75 | 40.42 | (10/10) | (10/10) | |
| 64,321,604 | 409.21 | 403.72 | 290.87 | 99.81 | (10/10) | (10/10) | |
| Across scales: mean ; mean , with CAST-2 faster on systems. | |||||||
| solve s/nnz | build s/nnz | |||||||
|---|---|---|---|---|---|---|---|---|
| Scale | AC | AC2 | CAST-1 | CAST-2 | AC | AC2 | CAST-1 | CAST-2 |
| 0.0248 | 0.0247 | 0.0204 | 0.0054 | 0.032 | 0.061 | 0.049 | 0.049 | |
| 0.0248 | 0.0247 | 0.0157 | 0.0055 | 0.043 | 0.072 | 0.070 | 0.069 | |
| 0.0247 | 0.0246 | 0.0161 | 0.0055 | 0.042 | 0.103 | 0.073 | 0.077 | |
| 0.0247 | 0.0248 | 0.0168 | 0.0055 | 0.044 | 0.121 | 0.076 | 0.081 | |
| Iterations per solve | (s) | Speedup | |||||||||
| Scale | nnz | AC | AC2 | CAST-1 | CAST-2 | AC | AC2 | CAST-1 | CAST-2 | ||
| 62,551 | 50.8 | 27.6 | 37.9 | 25.2 | 0.88 | 0.46 | 0.55 | 0.37 | |||
| 500,101 | 108.9 | 37.9 | 68.3 | 28.9 | 15.8 | 5.49 | 7.77 | 3.32 | |||
| 4,000,201 | 279.1 | 51.9 | 139.0 | 36.3 | 349 | 66.6 | 127 | 33.2 | |||
| 32,000,401 | 693.4 | 58.6 | 287.9 | 42.8 | 7,519 | 638 | 1,986 | 298 | |||
| 108,000,601 | 1,120.8 | 65.0 | 352.9 | 44.7 | 42,804 | 2,539 | 8,072 | 1,033 | |||
| CAST-2 is the fastest method on every instance and every solve count measured. | |||||||||||
C.3 IPM Sequences on Spielman Graphs
Collection.
The second IPM family from the SDDM2023 benchmark suite [10] forms a scaling ladder with one Spielman graph for each size parameter . Each graph contributes the Laplacians from the ten Newton steps of a maximum-flow interior-point-method run, yielding systems in total. The systems range from to vertices and contain up to nonzeros.
These graphs are structurally close to trees but have highly heterogeneous edge weights. Most of their vertices have degree at most two, while the number of edges beyond a spanning tree ranges from to . Each graph also contains hub vertices of input degree . Across the IPM trajectory, edge weights span between and orders of magnitude, increasing primarily during the first approximately four Newton steps and then stabilizing.
Despite the high input degrees of the hubs, minimum-degree elimination produces no large pivots. Path vertices are eliminated first, and every hub has degree at most five when it is eventually eliminated. The mean pivot degree is at every scale. Both CAST variants produce factors of the same measured size.
Configuration.
We use the protocol and metrics of Section 5. Unless otherwise stated, each factor is evaluated on right-hand sides. For every system–method pair, the reported value is the median over five independently seeded factor draws. For each scale ( systems) we report the mean total workload over its systems and take speedups as ratios of these means, which measures the aggregate cost of processing an entire IPM sequence. Win counts give the complementary per-system view. The larger sequences, containing approximately and nonzeros, exceed the memory capacity of the benchmark machine for every method under the multi-solve protocol and are therefore excluded.
: fast iteration convergence.
CAST-2 converges in one to two PCG iterations on every recorded solve across all four problem scales. The worst verified relative residual is , which is below the requested tolerance of . At , the available comparisons give mean speedups of – over AC2.
The normalized solve cost of CAST-2 remains between and on the reported scales. The improved convergence does not increase the measured factor size: CAST-1 and CAST-2 both produce factors containing approximately times as many nonzeros as the input, and their construction costs are similar at the reported scales.
This behavior is associated with the uniformly small pivot degrees. At a degree- pivot, where throughout this family, CAST-1 samples a spanning tree with edges. In contrast, CAST-2 samples one spanning tree on auxiliary copies, containing auxiliary edges before within-block edges are discarded and parallel terminal-edge contributions are aggregated. Two-way splitting therefore increases local sampling granularity while remaining inexpensive when is small.
The low-iteration convergence is an empirical property of this graph family. It does not imply that CAST-2 reproduces every Schur clique exactly, nor is CAST-2 the union of two independent trees on the original terminal neighborhood. Rather, the resulting factor is sufficiently accurate for PCG to satisfy the requested tolerance after one to two iterations on every tested Spielman system.
: reliability on extreme-weight systems.
The base estimator is less consistent on these extreme-weight, near-tree systems, where an unlucky draw can produce a noticeably worse factor. At this is visible in the aggregate, which favors AC despite CAST-1 being faster on nine of ten systems: one system dominates the scale total (Table 7).
Comparison with Chimera-IPM.
The Spielman and Chimera families exhibit complementary behavior. On the Chimera instances with heavy elimination-degree tails (Section C.2), the additional local contributions introduced by propagate through subsequent eliminations and substantially increase construction cost. On the Spielman family, every pivot has degree at most five, so the same increase in local sampling granularity remains inexpensive and yields convergence in one to two iterations.
Together, these results support a degree-aware empirical choice of the splitting factor. A uniformly light elimination-degree distribution favors when the factor is reused, whereas is preferable when high-degree pivots make downstream fill and construction cost dominant. We treat this as an empirical selection heuristic rather than as an evaluated adaptive algorithm.
C.4 Sachdeva-star stress tests
Collection.
The Sachdeva-star family is a synthetic construction on which the AC estimator is known to require rapidly increasing iteration counts [10]. For an even parameter , each instance consists of a hub connected by unit-weight gateway edges to disjoint cliques of size . All edges have unit weight. The resulting Laplacian has
We evaluate
corresponding to through vertices and up to stored nonzeros.
Unlike the Spielman family, whose difficulty arises from extreme weights on near-tree graphs, the Sachdeva-star instances are unweighted and structurally challenging. Eliminations within the clique blocks create dense local neighborhoods, and the quality of the base-granularity estimators deteriorates as increases.
Configuration.
We use the protocol and metrics of Section 5. Each factor is evaluated on right-hand sides, and for every instance–method pair the reported value is the median over three independently seeded factor draws. Because iteration growth is a primary quantity of interest on this family, we raise the PCG iteration cap from to . No method reaches this cap. Every solve satisfies the verified residual criterion
Results.
Table 9 shows a clear separation between the base- and doubled-granularity variants. The mean iteration count of AC increases from at to at . CAST-1 also becomes less effective as the instances grow, but its iteration count increases more slowly, from to . The doubled-granularity variants are substantially more stable. Across the same range, AC2 increases from to iterations per solve, while CAST-2 increases from to . At , CAST-2 is faster than AC2 on every instance, with speedup increasing monotonically from at to at . Relative to AC, its total-time advantage at the largest instance is
A separate solve-count sweep shows that CAST-2 is already the fastest method at , so its advantage on this family does not depend on amortizing construction cost.
Interpretation.
Unlike on the Spielman family, CAST-2 does not reduce these systems to one or two PCG iterations. The clique-dominated elimination structure remains nontrivial after contraction, and its mean iteration count grows from to along the ladder. Nevertheless, the growth is mild compared with the base-granularity methods. Although clique blocks produce high-degree pivots, the additional contributions of fall within blocks that are already dense, so they do not propagate as new fill — the opposite of the Chimera instances with heavy degree tails, where the extra contributions land on sparse neighborhoods and compound through later eliminations. This behavior is consistent with the local second-moment improvement of the construction: finer splitting reduces local sampling variability, although the theory does not by itself imply a global iteration bound. The Spielman and Sachdeva families therefore illustrate two distinct benefits of . On the low-degree Spielman eliminations, CAST-2 empirically produces an almost exact preconditioner and converges in one to two iterations. On the clique-dominated Sachdeva instances, it does not eliminate iteration growth, but it limits that growth sufficiently to provide the best total time throughout the tested ladder. These results agree qualitatively with those reported in [10]: the method ordering and the growth of the base-granularity iteration counts are unchanged, although absolute iteration counts here are approximately – higher, since our right-hand sides are Gaussians projected onto rather than the range-restricted vectors used there.