close
arXiv is now an independent nonprofit! Learn more
License: CC BY 4.0
arXiv:2609.09255v1 [stat.ML] 08 Sep 2026

CAST: Canonical Approximate Schur Tree for Approximate Cholesky on Graphs

Meher Chaitanya Email: mcpi@kth.se Affiliation: KTH Royal Institute of Technology Affiliation: Stockholm, Sweden    Cameron Musco Email: cmusco@cs.umass.edu Affiliation: University of Massachusetts Amherst Affiliation: Amherst, Massachusetts, USA    Aristides Gionis Email: argioni@kth.se Affiliation: KTH Royal Institute of Technology Affiliation: Stockholm, Sweden
Abstract

Graph-data workloads such as diffusion estimation, ranking, semi-supervised learning, and network optimization often solve many Laplacian or symmetric diagonally dominant M-matrix (SDDM) systems with the same coefficient matrix. Approximate Cholesky preconditioners eliminate vertices one at a time and store the resulting sparse approximate factorization, the factor, whose construction cost is amortized across these solves. But eliminating a vertex, the pivot, creates a dense Schur-complement clique among its dd active neighbors. We introduce CAST (Canonical Approximate Schur Tree), which replaces this clique with a weighted random spanning tree sampled directly from it. Every realization is connected and contains exactly d1d-1 edges, while reweighting each selected edge by the reciprocal of its tree-inclusion probability makes the update unbiased. The distribution is independent of the ordering of the pivot neighbors, and we prove that its leverage-score marginals minimize the largest normalized reweighted-edge contribution among unbiased inverse-marginal one-tree estimators.

We also introduce CAST-ρ\rho, which replaces each pivot neighbor with ρ\rho copies, each carrying a 1/ρ1/\rho share of that neighbor’s incident weight, samples a weighted random spanning tree on the expanded clique, and contracts the copies back to the original neighborhood. The resulting update remains unbiased and connected, can be sampled exactly in O(ρd)O(\rho d) time, and satisfies a 1/ρ1/\rho bound on the second moment of the normalized local Schur error. Increasing ρ\rho therefore reduces certified local sampling variability, but may increase construction cost and downstream fill.

We evaluate CAST on 201201 matrix systems, including 168168 Newton-step Laplacians from maximum-flow interior-point methods, constructing one factor and reusing it for 250250 right-hand sides. CAST-ρ\rho is 1.111.114.43×4.43\times faster than the better of the state-of-the-art AC and AC2 baselines Gao et al. (2026). Overall, we observe that CAST-1 is the faster default, whereas CAST-2 is preferable when its additional edge contributions remain inexpensive.

1 Introduction

Many graph-data and network-optimization pipelines repeatedly solve linear systems defined by a fixed graph operator. Examples include ranking and diffusion estimation Page et al. (1999); Andersen et al. (2006), label propagation Zhu et al. (2003); Zhou et al. (2003), shift-and-invert spectral graph methods Huang et al. (2019), and network optimization Spielman and Teng (2004); Spielman and Srivastava (2008). These applications lead to Laplacian or symmetric diagonally dominant M-matrix (SDDM) systems in which the operator is reused across many right-hand sides. The relevant computational objective is therefore not only to solve one system quickly, but to construct a preconditioner whose cost can be amortized across repeated solves.

Approximate Cholesky factorization provides a practical approach to this problem. As in sparse Gaussian elimination, vertices are eliminated sequentially, but the dense fill created by exact elimination is replaced by sparse randomized updates Kyng and Sachdeva (2016); Gao et al. (2026). The resulting approximate factor is used as a conjugate-gradient preconditioner and reused across multiple right-hand sides. Eliminating a vertex vv of degree dd, with incident edge weights a1,,ada_{1},\ldots,a_{d} and total weight a=i=1daia=\sum_{i=1}^{d}a_{i}, creates the Schur-complement clique

Kv=1i<jdaiaja(𝐞i𝐞j)(𝐞i𝐞j),K_{v}\;=\;\sum_{1\leq i<j\leq d}\frac{a_{i}a_{j}}{a}\,(\mathbf{e}_{i}-\mathbf{e}_{j})(\mathbf{e}_{i}-\mathbf{e}_{j})^{\top},

where 𝐞i\mathbf{e}_{i} denotes the standard basis vector of the ii-th neighbor. This clique contains Θ(d2)\Theta(d^{2}) edges. Approximate Cholesky methods avoid this quadratic fill by replacing KvK_{v} with a random surrogate containing only 𝒪(d)\mathcal{O}(d) edges.

Kyng and Sachdeva sample clique edges independently and control the accumulated error through a matrix-martingale analysis Kyng and Sachdeva (2016). The practical AC and AC2 solvers Gao et al. (2026) take a complementary approach: every sampled local update has connected support, the graph on the dd pivot neighbors formed by its nonzero-weight edges. A graph Laplacian has nullspace span{𝟏}\operatorname{span}\{\mathbf{1}\} exactly when its support is connected, matching the exact Schur clique. Since a spanning tree is the sparsest connected support, with exactly d1d-1 edges, we first study surrogates consisting of a single spanning tree TT of the clique.

For a clique edge ee with weight wew_{e}, let pe=(eT)>0p_{e}=\mathbb{P}\left(e\in T\right)>0 be its inclusion probability, and assign ee the weight we/pew_{e}/p_{e} whenever it is selected. This inverse-marginal reweighting makes the surrogate unbiased, since the expected contribution of ee is pe(we/pe)=wep_{e}(w_{e}/p_{e})=w_{e}. The remaining choice is the distribution over trees. If pep_{e} is small, edge ee receives a correspondingly large weight when selected. Let τe\tau_{e} be the leverage score of ee in the clique, equal to its weight times its effective resistance within KvK_{v} Spielman and Srivastava (2008). The normalized size of the reweighted contribution—its size measured relative to the quadratic form of KvK_{v} itself—is exactly τe/pe\tau_{e}/p_{e}; see Section 2. A large ratio lets one selected edge dominate the local update and inflates the error bounds obtained from matrix-concentration analyses Kyng and Sachdeva (2016). We therefore ask:

Question 1.1.

Among unbiased inverse-marginal one-tree replacements of a Schur clique, which edge-inclusion probabilities minimize the worst normalized contribution maxeτe/pe\max_{e}\tau_{e}/p_{e}?

The connected updates of AC and AC2 are generated through randomized sequential edge pairing Gao et al. (2026). Although these methods perform strongly across many SDDM systems, their induced sampling distributions depend on the order in which the incident edges are processed and are not designed to minimize maxeτe/pe\max_{e}\tau_{e}/p_{e}. The distinguishing feature of our method is therefore not connectivity alone, but the distribution used to generate the local update.

We introduce CAST (Canonical Approximate Schur Tree): at each elimination step, it samples a weighted random spanning tree of the Schur clique and applies inverse-marginal reweighting. By the transfer-current theorem Lyons (2003), each clique edge is then included with probability equal to its leverage score, pe=τep_{e}=\tau_{e}. This answers Question 1.1: the leverage-score marginals are the unique locally minimax-optimal choice among unbiased inverse-marginal one-tree estimators (Theorem 4.5). We call the sampling rule canonical because it depends only on the weighted Schur clique and not on the ordering of the pivot neighbors.

We further introduce CAST-ρ\rho, with integer parameter ρ1\rho\geq 1, which splits each pivot neighbor into ρ\rho equal-share auxiliary copies, samples one weighted random spanning tree from the expanded Schur clique, and contracts the copies back to the original neighbors. For ρ=1\rho=1 it coincides with CAST; for ρ>1\rho>1 the contracted update need not be a tree, but it remains unbiased and connected and satisfies a local second-moment bound of order 1/ρ1/\rho, reducing sampling variability at the cost of additional construction work and possible downstream fill. We write CAST-1 and CAST-2 for the ρ=1\rho=1 and ρ=2\rho=2 configurations used in our evaluation.

Our guarantees concern the estimator associated with a single Schur-clique replacement; we do not claim a worst-case spectral guarantee for the complete approximate factorization.

In summary, we make the following contributions:

  1. 1.

    Canonical tree sampling and its splitting extension. We introduce CAST and CAST-ρ\rho. At a degree-dd pivot, a tree is sampled exactly from the target weighted spanning-tree distribution and contracted in 𝒪(ρd)\mathcal{O}(\rho d) time using weighted Prüfer codes, without materializing either the original or the expanded dense Schur clique.

  2. 2.

    Local minimax and second-moment guarantees. For the base ρ=1\rho=1 update, the leverage-score vector is the unique marginal vector minimizing the largest normalized reweighted-edge contribution among unbiased inverse-marginal one-tree estimators (Theorem 4.5). For general ρ\rho, CAST-ρ\rho remains unbiased and connected and satisfies a normalized local second-moment bound of order 1/ρ1/\rho, quantifying the reduction in sampling variability obtained through splitting (Section 4).

  3. 3.

    Reuse-aware evaluation. We evaluate CAST by constructing one preconditioner and reusing it across many right-hand sides. Across heterogeneous SDDM systems and max flow IPM sequences, our experiments identify when CAST reduces repeated-solve cost relative to AC and AC2. We further characterize when increasing ρ\rho improves convergence and when its additional edge contributions create excessive downstream fill.

Independent contemporaneous work.

We recently became aware of independent work by Baumann, Kyng, and Zöcklein Baumann et al. (2026), who propose, under the name VAC, the same base ρ=1\rho=1 local sampling rule as CAST-1: a weighted random spanning tree of the product-form Schur clique sampled via a weighted Pr"ufer code and equipped with inverse-marginal reweighting. Their work was developed independently of ours and establishes linear-time sampling rule. Our work additionally gives a local minimax characterization of the leverage-score marginals, introduces the CAST-ρ\rho splitting construction and its 1/ρ1/\rho local second-moment guarantee, and evaluates these estimators as reusable preconditioners across a broad collection of SDDM systems.

2 Preliminaries and Problem Setting

We formalize SDDM linear systems, the factor-reuse setting, and the local Schur-clique replacement problem underlying CAST. The preliminaries on Prüfer codes are provided in Appendix A.

Graph Laplacians and SDDM systems.

Let G=(V,E,w)G=(V,E,w) be an undirected weighted graph with n=|V|n=|V| vertices. For an oriented edge e=(u,v)e=(u,v) write 𝐛e=𝐞u𝐞v\mathbf{b}_{e}=\mathbf{e}_{u}-\mathbf{e}_{v}, where 𝐞u\mathbf{e}_{u} is the uu-th standard basis vector. The Laplacian of GG is LG=eEwe𝐛e𝐛eL_{G}=\sum_{e\in E}w_{e}\,\mathbf{b}_{e}\mathbf{b}_{e}^{\top}. If GG is connected, then ker(LG)=span{𝟏}\ker(L_{G})=\operatorname{span}\{\mathbf{1}\}. Since LGL_{G} is symmetric, range(LG)=ker(LG)=𝟏\operatorname{range}(L_{G})=\ker(L_{G})^{\perp}=\mathbf{1}^{\perp}, so the system LG𝐱=𝐛L_{G}\mathbf{x}=\mathbf{b} is solvable if and only if 𝐛𝟏\mathbf{b}\perp\mathbf{1}.

Throughout, AA denotes the coefficient matrix of the system to be solved: either a graph Laplacian LGL_{G} or a symmetric diagonally dominant M-matrix (SDDM matrix), i.e. a symmetric positive-definite matrix with nonpositive off-diagonal entries satisfying Aiiji|Aij|A_{ii}\geq\sum_{j\neq i}|A_{ij}|. Equivalently, an SDDM matrix can be written as A=LG+ΓA=L_{G}+\Gamma, where LGL_{G} is a graph Laplacian and Γ0\Gamma\succeq 0 is a diagonal matrix. The matrix AA is positive definite provided that Γ\Gamma has at least one positive entry on each connected component of GG. This class of matrices includes many shifted and regularized graph operators. For example, let Wn×nW\in\mathbb{R}^{n\times n} be a symmetric, nonnegative weighted adjacency matrix, let D=diag(W𝟏)D=\operatorname{diag}(W\mathbf{1}) be its degree matrix, and let L=DWL=D-W be a graph Laplacian. For a damping parameter α(0,1)\alpha\in(0,1) and a seed distribution 𝐬n\mathbf{s}\in\mathbb{R}^{n}, the personalized PageRank vector 𝐱\mathbf{x} satisfies (DαW)𝐱=(1α)D𝐬(D-\alpha W)\mathbf{x}=(1-\alpha)D\mathbf{s}. The coefficient matrix is SDDM because DαW=α(DW)+(1α)D=αL+(1α)DD-\alpha W=\alpha(D-W)+(1-\alpha)D=\alpha L+(1-\alpha)D is symmetric, has nonpositive off-diagonal entries, and is diagonally dominant Gleich (2015). If every vertex has positive weighted degree, the matrix is also positive definite. In repeated-query settings, the operator DαWD-\alpha W remains fixed while the seed distribution 𝐬\mathbf{s} varies across queries.

The factor-reuse setting.

Many applications solve a sequence of linear systems A𝐱(r)=𝐛(r)A\,\mathbf{x}^{(r)}=\mathbf{b}^{(r)}, for r=1,,qr=1,\ldots,q, in which the coefficient matrix AA remains fixed while the right-hand side changes: diffusion from different seed sets, label propagation across classes, effective-resistance queries for many source–sink pairs, and inner systems in iterative optimization. An approximate Cholesky method performs the elimination once and stores the result as a sparse approximate factorization. Recall that the exact Cholesky decomposition of a positive-definite matrix is A=𝒞𝒞A=\mathcal{C}\mathcal{C}^{\top} with 𝒞\mathcal{C} lower triangular; approximate elimination instead produces a sparse 𝒞^\widehat{\mathcal{C}} with 𝒞^𝒞^A\widehat{\mathcal{C}}\widehat{\mathcal{C}}^{\top}\approx A, which we call the factor. The factor is stored implicitly as the elimination data recorded at each pivot and is applied through forward and backward substitutions as a preconditioner for each right-hand side. The factor is constructed at cost TbuildT_{\mathrm{build}} and reused for all qq solves. Writing T¯solve\overline{T}_{\mathrm{solve}} for the average time of one preconditioned-CG solve using the factor, the total and amortized workload costs are

Tqtotal=Tbuild+qT¯solve, and Tqamort=Tqtotalq=Tbuildq+T¯solve.T_{q}^{\mathrm{total}}=T_{\mathrm{build}}+q\,\overline{T}_{\mathrm{solve}},\text{ and }T_{q}^{\mathrm{amort}}=\frac{T_{q}^{\mathrm{total}}}{q}=\frac{T_{\mathrm{build}}}{q}+\overline{T}_{\mathrm{solve}}.

Thus q=1q=1 measures one-shot performance, while increasing qq amortizes construction and captures the benefit of factor reuse.

Exact elimination and Schur cliques

For the local elimination analysis, we work with a Laplacian representation; general SDDM systems can be reduced to this form using the standard Gremban expansion Gremban (1996). Approximate Cholesky methods eliminate vertices one at a time. Suppose a pivot vv has active neighbors u1,,udu_{1},\ldots,u_{d} with ai=wvuia_{i}=w_{vu_{i}} and a=iaia=\sum_{i}a_{i}. Eliminating vv exactly removes the star at vv and adds the Schur clique

Kv=1i<jdaiaja(𝐞i𝐞j)(𝐞i𝐞j)K_{v}=\sum_{1\leq i<j\leq d}\frac{a_{i}a_{j}}{a}\,(\mathbf{e}_{i}-\mathbf{e}_{j})(\mathbf{e}_{i}-\mathbf{e}_{j})^{\top} (1)

to the remaining graph, where 𝐞i\mathbf{e}_{i} denotes the ii-th standard basis vector in the coordinate system indexed by u1,,udu_{1},\ldots,u_{d}; edges already present among the neighbors simply accumulate the corresponding weight. The clique contains (d2)=Θ(d2)\binom{d}{2}=\Theta(d^{2}) edges, even when the original graph is sparse. To avoid “filling up” the matrix, approximate Cholesky methods replace KvK_{v} by a sparse randomly-sampled update K^v\widehat{K}_{v} satisfying 𝔼[K^v]=Kv\mathbb{E}[\widehat{K}_{v}]=K_{v} Kyng and Sachdeva (2016); Gao et al. (2026). The AC and AC2 solvers construct unbiased connected local updates by randomized edge pairing, with AC2 doubling the per-edge sampling budget for robustness Gao et al. (2026). These sampling distributions, which have been empirically studied, depend on the order in which the neighbor edges are processed. In contrast, the sampling distribution in CAST is determined by the weighted Schur clique and admits the local minimax and second-moment guarantees established in Section 4.

The local Schur-clique replacement problem.

We write K+K^{+} for the Moore–Penrose pseudoinverse and K+/2=(K+)1/2K^{+/2}=(K^{+})^{1/2}. Let K=eEKwe𝐛e𝐛eK=\sum_{e\in E_{K}}w_{e}\,\mathbf{b}_{e}\mathbf{b}_{e}^{\top} be a connected local graph Laplacian: a d×dd\times d matrix indexed by the dd active neighbors of a pivot rather than by all nn vertices, with edge set EKE_{K} and weights we>0w_{e}>0. Its support graph is ([d],EK)([d],E_{K}), the graph formed by its positive-weight edges; since it is connected, ker(K)=span{𝟏}\ker(K)=\operatorname{span}\{\mathbf{1}\} and rank(K)=d1\operatorname{rank}(K)=d-1. We measure a positive-semidefinite local contribution HH relative to KK by K+/2HK+/2=max𝐱𝟏(𝐱H𝐱)/(𝐱K𝐱)\lVert K^{+/2}HK^{+/2}\rVert=\max_{\mathbf{x}\perp\mathbf{1}}(\mathbf{x}^{\top}H\mathbf{x})/(\mathbf{x}^{\top}K\mathbf{x}), the largest ratio of HH-energy to KK-energy, and call this normalization the energy geometry of KK. The leverage score of edge ee is τe=we𝐛eK+𝐛e\tau_{e}=w_{e}\,\mathbf{b}_{e}^{\top}K^{+}\mathbf{b}_{e}, which is exactly the size of that edge’s own term we𝐛e𝐛ew_{e}\mathbf{b}_{e}\mathbf{b}_{e}^{\top} in this geometry Spielman and Srivastava (2008); Kyng and Sachdeva (2016); leverage scores satisfy eτe=rank(K)=d1\sum_{e}\tau_{e}=\operatorname{rank}(K)=d-1.

For a distribution 𝒟\mathcal{D} over spanning trees of the support graph of KK, let pe=T𝒟(eT)p_{e}=\mathbb{P}_{T\sim\mathcal{D}}(e\in T), and assume pe>0p_{e}>0 for every eEKe\in E_{K}. The inverse-marginal estimator

K^𝒟(T)=eTwepe𝐛e𝐛e\widehat{K}_{\mathcal{D}}(T)=\sum_{e\in T}\frac{w_{e}}{p_{e}}\,\mathbf{b}_{e}\mathbf{b}_{e}^{\top}

is unbiased, since 𝔼[K^𝒟(T)]=epe(we/pe)𝐛e𝐛e=K\mathbb{E}[\widehat{K}_{\mathcal{D}}(T)]=\sum_{e}p_{e}(w_{e}/p_{e})\,\mathbf{b}_{e}\mathbf{b}_{e}^{\top}=K. We measure the local risk of 𝒟\mathcal{D} by the largest normalized contribution of any sampled edge,

RK(𝒟)=maxeEKK+/2(wepe𝐛e𝐛e)K+/2=maxeEKτepe,R_{K}(\mathcal{D})=\max_{e\in E_{K}}\left\lVert K^{+/2}\!\left(\frac{w_{e}}{p_{e}}\mathbf{b}_{e}\mathbf{b}_{e}^{\top}\right)\!K^{+/2}\right\rVert=\max_{e\in E_{K}}\frac{\tau_{e}}{p_{e}}, (2)

where the second equality holds because each normalized edge contribution is rank one. Question 1.1 is then the following general design problem: among such 𝒟\mathcal{D}, which minimizes RK(𝒟)R_{K}(\mathcal{D})? Since RKR_{K} depends on 𝒟\mathcal{D} only through its marginals (pe)eEK(p_{e})_{e\in E_{K}}, this is equivalently a question about the feasible marginal vectors of spanning-tree distributions. CAST uses the weighted random spanning-tree distribution of KK, whose marginals satisfy pe=τep_{e}=\tau_{e} by the transfer-current theorem Lyons (2003); this equalizes the normalized size of every sampled edge and, as we show in Theorem 4.5, minimizes RKR_{K}.

3 CAST: Canonical Approximate Schur Trees

In this section we define the local CAST-ρ\rho update and the approximate-Cholesky preconditioner obtained by applying it at each pivot. The construction replaces the Schur clique of Eq. (1) with a sparse random update derived from a weighted spanning tree on a temporarily expanded neighborhood.

3.1 The CAST update

Consider an elimination step with pivot vv, active neighbors u1,,udu_{1},\ldots,u_{d}, and incident edge weights ai=wvui>0a_{i}=w_{vu_{i}}>0, where a=i=1daia=\sum_{i=1}^{d}a_{i}. We interpret these edge weights as electrical conductances, and refer to the pivot neighbors as terminals. Exact elimination of vv adds the Schur clique KvK_{v} of Eq. (1), which contains Θ(d2)\Theta(d^{2}) edges.

For an integer splitting factor ρ1\rho\geq 1, CAST-ρ\rho temporarily replaces each terminal uiu_{i} by Pi={(i,1),,(i,ρ)}P_{i}=\{(i,1),\ldots,(i,\rho)\}, a block of ρ\rho auxiliary copies, each carrying conductance cp=ai/ρc_{p}=a_{i}/\rho. Let P=i=1dPiP=\bigcup_{i=1}^{d}P_{i}, and let ϕ(p)=i\phi(p)=i denote the terminal associated with pPip\in P_{i}, so that pPicp=ai\sum_{p\in P_{i}}c_{p}=a_{i} and pPcp=a\sum_{p\in P}c_{p}=a. On PP, CAST-ρ\rho defines the complete weighted expanded Schur clique with edge conductances wpqexp=cpcq/aw^{\mathrm{exp}}_{pq}=c_{p}c_{q}/a for pqp\neq q, and samples a weighted random spanning tree TT according to

(T)(p,q)Twpqexp.\mathbb{P}(T)\propto\prod_{(p,q)\in T}w_{pq}^{\mathrm{exp}}. (3)

Sampling from such a distribution is not straightforward for general edge weights; Section 3.2 shows that the product form of wpqexpw^{\mathrm{exp}}_{pq} admits exact sampling in 𝒪(ρd)\mathcal{O}(\rho d) time. The expanded clique is therefore used only to define the distribution and is never materialized explicitly.

Each sampled auxiliary edge (p,q)T(p,q)\in T is assigned conductance cpcq/(cp+cq)c_{p}c_{q}/(c_{p}+c_{q}), which is precisely its inverse-marginal reweighting on the expanded clique (see Lemma 4.1). The auxiliary-copy blocks are then contracted back to their terminals. If ϕ(p)=ij=ϕ(q)\phi(p)=i\neq j=\phi(q), the edge (p,q)(p,q) contributes this conductance to the terminal edge (ui,uj)(u_{i},u_{j}); if ϕ(p)=ϕ(q)\phi(p)=\phi(q), it becomes a self-loop after contraction and contributes nothing to the terminal Laplacian. Writing K^v\widehat{K}_{v} for the random Laplacian on the pivot neighborhood obtained after contracting the blocks and discarding self-loops,

K^v=(p,q)Tϕ(p)ϕ(q)cpcqcp+cq(𝐞ϕ(p)𝐞ϕ(q))(𝐞ϕ(p)𝐞ϕ(q)),\widehat{K}_{v}=\sum_{\begin{subarray}{c}(p,q)\in T\\ \phi(p)\neq\phi(q)\end{subarray}}\frac{c_{p}c_{q}}{c_{p}+c_{q}}\bigl(\mathbf{e}_{\phi(p)}-\mathbf{e}_{\phi(q)}\bigr)\bigl(\mathbf{e}_{\phi(p)}-\mathbf{e}_{\phi(q)}\bigr)^{\top}, (4)

where 𝐞i\mathbf{e}_{i} denotes the basis vector associated with terminal uiu_{i}. The auxiliary tree contains exactly ρd1\rho d-1 edges, so after discarding within-block edges and aggregating parallel contracted edges, the update contains at most ρd1\rho d-1 nonzero terminal-edge contributions. For ρ>1\rho>1 it need not itself be a tree on the terminals, although its support is always connected (Theorem 4.3).

CAST-1: the base ρ=1\rho=1 update.

When ρ=1\rho=1, each block holds a single copy carrying its terminal’s full conductance, so the expanded clique is the Schur clique itself and contraction is the identity: CAST-ρ\rho reduces to sampling one weighted random spanning tree of KvK_{v}. Because Schur complementation preserves effective resistances among the retained vertices, the effective resistance between terminals uiu_{i} and uju_{j} in KvK_{v} equals the series resistance of the path uiu_{i}vvuju_{j} before elimination, Rij=1/ai+1/ajR_{ij}=1/a_{i}+1/a_{j}. The leverage score of edge (i,j)(i,j) is, τij=aiaja(1ai+1aj)=ai+aja.\tau_{ij}=\frac{a_{i}a_{j}}{a}\left(\frac{1}{a_{i}}+\frac{1}{a_{j}}\right)=\frac{a_{i}+a_{j}}{a}. By the transfer-current theorem the weighted random spanning tree selects edge (i,j)(i,j) with probability τij\tau_{ij}, and inverse-marginal reweighting assigns it conductance aiaj/aτij=aiajai+aj\frac{a_{i}a_{j}/a}{\tau_{ij}}=\frac{a_{i}a_{j}}{a_{i}+a_{j}},

exactly the series conductance of the two-hop path uiu_{i}vvuju_{j} that the edge replaces. Thus CAST-1 is an order-independent one-tree replacement whose edge marginals equal the clique leverage scores; Theorem 4.5 shows that these marginals uniquely minimize the local risk RKvR_{K_{v}}.

3.2 Exact sampling in 𝒪(ρd)\mathcal{O}(\rho d) time via Prüfer codes

Sampling the update requires a weighted random spanning tree of the expanded Schur clique, a complete graph on m=ρdm=\rho d auxiliary copies. Its conductances have the product form wpqexp=cpcq/aw^{\mathrm{exp}}_{pq}=c_{p}c_{q}/a, and this structure permits exact sampling from (3) using an i.i.d. weighted Prüfer code, without materializing the dense clique. Background on Prüfer codes is provided in Appendix A.

Fix a spanning tree TT on the auxiliary-copy set PP. Since TT has m1m-1 edges,

(p,q)Twpqexp=a(m1)pPcpdegT(p),\prod_{(p,q)\in T}w_{pq}^{\mathrm{exp}}=a^{-(m-1)}\prod_{p\in P}c_{p}^{\deg_{T}(p)},

so, up to a factor independent of TT, the target probability is determined entirely by the vertex degrees. For m2m\geq 2 the Prüfer correspondence is a bijection between labeled trees on PP and sequences in Pm2P^{m-2}, under which pp appears exactly degT(p)1\deg_{T}(p)-1 times in the code of TT Aigner and Ziegler (1999); West (2001). Drawing the m2m-2 symbols independently with (symbol=p)=cp/a\mathbb{P}\left(\text{symbol}=p\right)=c_{p}/a therefore generates TT with probability

pP(cpa)degT(p)1=a(m2)pPcpdegT(p)1.\prod_{p\in P}\left(\frac{c_{p}}{a}\right)^{\deg_{T}(p)-1}=a^{-(m-2)}\prod_{p\in P}c_{p}^{\deg_{T}(p)-1}.

The ratio of this probability to the unnormalized target weight is apPcp1a\prod_{p\in P}c_{p}^{-1}, independent of TT. Hence the i.i.d. Prüfer construction samples exactly from the weighted random spanning-tree distribution of the expanded Schur clique.

The sampler needs neither the expanded clique nor an explicit array of auxiliary-copy weights. All copies in PiP_{i} carry conductance ai/ρa_{i}/\rho, so each symbol can be drawn hierarchically: sample terminal ii with probability ai/aa_{i}/a, then one of its ρ\rho copies uniformly. An alias table for the terminal distribution is built once in 𝒪(d)\mathcal{O}(d) time, after which each of the m2m-2 symbols costs 𝒪(1)\mathcal{O}(1). Decoding the code into a tree takes 𝒪(m)\mathcal{O}(m) time by the standard leaf-pointer algorithm. Contraction is a single pass over the m1m-1 auxiliary edges: cross-block edges are placed on the corresponding terminal edge with conductance cpcq/(cp+cq)c_{p}c_{q}/(c_{p}+c_{q}), within-block edges become self-loops and are discarded, and parallel terminal edges are aggregated by summing conductances. Sampling, decoding, and contraction therefore cost 𝒪(d+m)=𝒪(ρd)\mathcal{O}(d+m)=\mathcal{O}(\rho d) in total.

Proposition 3.1 (Sampling cost).

For every pivot with d2d\geq 2 active neighbors and every integer ρ1\rho\geq 1, CAST-SchurTree(a1,,ad,ρ)(a_{1},\ldots,a_{d},\rho) samples the exact weighted random spanning-tree distribution of the expanded Schur clique and contracts the sampled tree onto the original pivot neighborhood in 𝒪(ρd)\mathcal{O}(\rho d) time, without materializing either the Θ(d2)\Theta(d^{2})-edge Schur clique or the expanded clique.

Proof.

See Appendix B.1. ∎

Summing Proposition 3.1 over pivots, the elimination takes 𝒪(ρvdv)\mathcal{O}\!\left(\rho\sum_{v}d_{v}\right) time, where dvd_{v} is the degree of vv in the residual graph when it is eliminated. The residual degrees depend on the fill realized by earlier updates, which is why we study the effect of ρ\rho on downstream fill empirically (Section 5).

Two structural features of the Schur clique make this possible. For ρ=1\rho=1, its star origin gives the leverage scores in closed form (Section 3.1), identifying the target distribution without any resistance computation. Under ρ\rho-way splitting, the expanded clique retains product-form conductances, so the same Prüfer argument applies verbatim. Splitting thus refines the update while preserving both the algebraic structure needed for exact sampling and the order-independence that makes the rule canonical.

The CAST preconditioner.

Applying the local CAST-ρ\rho update at every pivot yields an approximate Cholesky factorization, CAST-Chol (Algorithms 12). The method maintains a residual graph, the weighted graph on the not-yet-eliminated vertices, initialized to AA. At each step it selects a pivot vv, records the pivot star—the pivot, its active neighbors, and their incident conductances, which together form the column of 𝒞^\widehat{\mathcal{C}} associated with vv—then deletes vv from the residual graph and inserts the contracted terminal-edge contributions returned by Algorithm CAST-SchurTree. In the reuse setting, the resulting factor is built once for the fixed operator AA and applied within PCG for the right-hand sides 𝐛(1),,𝐛(q)\mathbf{b}^{(1)},\ldots,\mathbf{b}^{(q)}.

Algorithm 1 CAST-SchurTree(a1,,ad,ρ)(a_{1},\ldots,a_{d},\rho)
1: if d1d\leq 1 then
2:   return an empty terminal-edge multiset
3: end if
4: ai=1daia\leftarrow\sum_{i=1}^{d}a_{i},  mρdm\leftarrow\rho d
5: Build an alias table for πi=ai/a\pi_{i}=a_{i}/a, i[d]i\in[d] \triangleright 𝒪(d)\mathcal{O}(d)
6: Initialize an empty Prüfer sequence SS
7: for t=1,,m2t=1,\ldots,m-2 do
8:   Sample iπi\sim\pi and kUnif([ρ])k\sim\operatorname{Unif}([\rho])
9:   Append the auxiliary copy p=(i,k)p=(i,k) to SS \triangleright ϕ(p)=i\phi(p)=i
10: end for
11: Decode SS into its spanning tree TT on the auxiliary-copy set \triangleright 𝒪(m)\mathcal{O}(m)
12: Initialize an empty multiset \mathcal{E}
13: for each auxiliary-tree edge (p,q)T(p,q)\in T with i=ϕ(p)ϕ(q)=ji=\phi(p)\neq\phi(q)=j do
14:   Insert (i,j,aiaj/(ρ(ai+aj)))\bigl(i,\,j,\;a_{i}a_{j}/(\rho(a_{i}+a_{j}))\bigr) into \mathcal{E}
15: end for
16: return \mathcal{E}
Algorithm 2 CAST-Chol(A,ρ)(A,\rho)
1: Initialize the residual graph to AA and the factor FF to empty
2: while active vertices remain do
3:   Select the next pivot vv by the elimination-ordering rule
4:   Read its active neighbors u1,,udu_{1},\ldots,u_{d} and incident conductances a1,,ada_{1},\ldots,a_{d}
5:   Record the pivot star of vv in FF
6:   Delete vv and its incident edges from the residual graph
7:   vCAST-SchurTree(a1,,ad,ρ)\mathcal{E}_{v}\leftarrow\textsc{CAST-SchurTree}(a_{1},\ldots,a_{d},\rho)
8:   for each (i,j,h)v(i,j,h)\in\mathcal{E}_{v} do
9:    Add conductance hh to the residual edge (ui,uj)(u_{i},u_{j}) \triangleright parallel contributions accumulate
10:   end for
11: end while
12: return FF

4 Local Theory of the CAST Update

We analyze the CAST-ρ\rho update at a single elimination step. For the base ρ=1\rho=1 update, we prove that the weighted spanning-tree distribution uniquely minimizes the local risk defined in Eq. (2) among unbiased inverse-marginal one-tree estimators. For general integer ρ1\rho\geq 1, we establish unbiasedness, connected support, and a normalized local second-moment bound of order 1/ρ1/\rho, quantifying the reduction in local sampling variability obtained through finer splitting.

Fix a pivot vv with active neighbors u1,,udu_{1},\ldots,u_{d}, where d2d\geq 2, and let ai=wvui>0a_{i}=w_{vu_{i}}>0, a=i=1daia=\sum_{i=1}^{d}a_{i}. Exact elimination of vv creates the Schur clique KvK_{v} of (1). We identify the pivot neighborhood with [d][d], and all Loewner-order comparisons between local Laplacians on the pivot neighborhood are understood on 𝟏d={𝐱d:𝐱𝟏d=0}\mathbf{1}_{d}^{\perp}=\{\mathbf{x}\in\mathbb{R}^{d}:\mathbf{x}^{\top}\mathbf{1}_{d}=0\}.

Auxiliary-copy notation.

We use the notation of Section 3.1: the blocks Pi={(i,1),,(i,ρ)}P_{i}=\{(i,1),\ldots,(i,\rho)\} of auxiliary copies with conductances cp=ai/ρc_{p}=a_{i}/\rho, the set P=i=1dPiP=\bigcup_{i=1}^{d}P_{i}, the map ϕ(p)=i\phi(p)=i, the expanded Schur clique with conductances wpqexp=cpcq/aw^{\mathrm{exp}}_{pq}=c_{p}c_{q}/a, and the tree TT drawn from (3). For an auxiliary edge e=(p,q)e=(p,q) we write He=HpqH_{e}=H_{pq} for its contracted contribution to the terminal Laplacian: setting i=ϕ(p)i=\phi(p) and j=ϕ(q)j=\phi(q),

Hpq=cpcqcp+cq(𝐞i𝐞j)(𝐞i𝐞j)if ij,Hpq=0if i=j,H_{pq}=\frac{c_{p}c_{q}}{c_{p}+c_{q}}(\mathbf{e}_{i}-\mathbf{e}_{j})(\mathbf{e}_{i}-\mathbf{e}_{j})^{\top}\quad\text{if }i\neq j,\qquad H_{pq}=0\quad\text{if }i=j,

where 𝐞i\mathbf{e}_{i} is the basis vector of terminal uiu_{i}, so that K^v=(p,q)THpq\widehat{K}_{v}=\sum_{(p,q)\in T}H_{pq} as in (4). Throughout this section pe=(eT)p_{e}=\mathbb{P}\left(e\in T\right) denotes the inclusion probability of an edge ee of the expanded clique; when ρ=1\rho=1 the expanded clique is KvK_{v} itself, and pep_{e} agrees with the clique-edge marginals of Section 2.

Unbiasedness.

We first show that contracting the sampled auxiliary tree preserves the exact Schur update in expectation.

Lemma 4.1 (Auxiliary-edge marginals).

For every auxiliary edge (p,q)(p,q) of the expanded Schur clique, ((p,q)T)=cp+cqa\mathbb{P}\left((p,q)\in T\right)=\frac{c_{p}+c_{q}}{a}.

Proof.

See Appendix B.2. ∎

In particular, the conductance assigned to a selected auxiliary edge is exactly its inverse-marginal reweighting:

wpqexp((p,q)T)=cpcq/a(cp+cq)/a=cpcqcp+cq.\frac{w^{\mathrm{exp}}_{pq}}{\mathbb{P}\left((p,q)\in T\right)}=\frac{c_{p}c_{q}/a}{(c_{p}+c_{q})/a}=\frac{c_{p}c_{q}}{c_{p}+c_{q}}.
Theorem 4.2 (Unbiasedness).

For every pivot vv and every integer ρ1\rho\geq 1, 𝔼[K^v]=Kv\mathbb{E}[\widehat{K}_{v}]=K_{v}.

Proof.

See Appendix B.3. ∎

Connected support and correct local nullspace.

Unbiasedness controls the local update in expectation. CAST-ρ\rho also has a deterministic structural property: every realization has connected support on the pivot neighborhood.

Theorem 4.3 (Connected local support).

For every integer ρ1\rho\geq 1, the terminal support graph of K^v\widehat{K}_{v} is connected on {u1,,ud}\{u_{1},\ldots,u_{d}\}.

Proof.

See Appendix B.4. ∎

Corollary 4.4 (Correct local nullspace and rank).

For every integer ρ1\rho\geq 1, ker(K^v)=span{𝟏d}\ker(\widehat{K}_{v})=\operatorname{span}\{\mathbf{1}_{d}\} and rank(K^v)=d1\operatorname{rank}(\widehat{K}_{v})=d-1.

Proof.

See Appendix B.5. ∎

Connectivity alone does not distinguish CAST from the practical AC and AC2 updates, which are also connected; the distinction lies in the distribution from which the local update is drawn. We turn to that distribution.

4.1 Local minimax optimality of the base ρ=1\rho=1 update

When ρ=1\rho=1, CAST samples a weighted random spanning tree directly from the Schur clique, so the update is an inverse-marginal one-tree estimator (Section 2). We now answer Question 1.1: which edge marginals minimize the local risk RK(𝒟)=maxeEKτe/peR_{K}(\mathcal{D})=\max_{e\in E_{K}}\tau_{e}/p_{e}, the largest normalized contribution of any sampled edge? We answer it for an arbitrary connected local Laplacian KK; the Schur clique KvK_{v} is the case relevant to CAST.

Theorem 4.5 (Local minimax optimality of leverage-score marginals).

For every spanning-tree distribution 𝒟\mathcal{D} satisfying pe>0p_{e}>0 for all eEKe\in E_{K}, RK(𝒟)1R_{K}(\mathcal{D})\geq 1, with equality if and only if pe=τep_{e}=\tau_{e} for every eEKe\in E_{K}. In particular, the weighted random spanning-tree distribution of KK, whose edge marginals satisfy pe=τep_{e}=\tau_{e}, is locally minimax-optimal among unbiased inverse-marginal one-tree estimators.

Proof.

See Appendix B.6. ∎

The proof is a short averaging argument: every spanning tree has d1d-1 edges, so epe=d1=eτe\sum_{e}p_{e}=d-1=\sum_{e}\tau_{e}, and a maximum is at least a weighted average.

Theorem 4.5 identifies the optimal edge-marginal vector uniquely, namely pe=τep_{e}=\tau_{e}; it does not assert uniqueness of the full distribution over spanning trees. CAST-1 realizes these marginals with the weighted random spanning-tree distribution of the clique, which for the Schur clique KvK_{v} has the closed form derived in Section 3.1: edge (i,j)(i,j) is included with probability τij=(ai+aj)/a\tau_{ij}=(a_{i}+a_{j})/a and reweighted to conductance aiaj/(ai+aj)a_{i}a_{j}/(a_{i}+a_{j}). Hence CAST-1 attains RKv=1R_{K_{v}}=1, the smallest value achievable in this class.

4.2 Local second-moment certificate for CAST-ρ\rho

Theorem 4.5 concerns estimators supported on a single spanning tree of the terminal clique, and so applies directly to the base ρ=1\rho=1 update. For ρ>1\rho>1, CAST-ρ\rho samples one spanning tree on the expanded Schur clique and contracts the auxiliary-copy blocks back to the terminals; the resulting terminal update need not itself be a tree, and is therefore not a competing tree distribution on KvK_{v}.

We analyze the general ρ\rho construction through a different local certificate: the normalized second moment of the one-pivot Schur error. The bound below scales as 1/ρ1/\rho, quantifying how splitting decomposes the local estimator into smaller normalized contributions.

Let EexpE^{\mathrm{exp}} denote the edge set of the expanded Schur clique. For each auxiliary edge e=(p,q)Eexpe=(p,q)\in E^{\mathrm{exp}}, let HeH_{e} be its contracted terminal contribution, with He=0H_{e}=0 when ϕ(p)=ϕ(q)\phi(p)=\phi(q), and set Ae=Kv+/2HeKv+/2A_{e}=K_{v}^{+/2}H_{e}K_{v}^{+/2}, its size in the energy geometry of KvK_{v}. Let ΠKv=Kv+/2KvKv+/2\Pi_{K_{v}}=K_{v}^{+/2}K_{v}K_{v}^{+/2} be the orthogonal projection onto range(Kv)=𝟏d\operatorname{range}(K_{v})=\mathbf{1}_{d}^{\perp}.

Lemma 4.6 (Normalized auxiliary-edge contribution).

For every auxiliary edge eEexpe\in E^{\mathrm{exp}}, 0Ae1ρΠKv0\preceq A_{e}\preceq\frac{1}{\rho}\Pi_{K_{v}}. Moreover, Ae2=1ρAeA_{e}^{2}=\frac{1}{\rho}A_{e}.

Proof.

See Appendix B.7. ∎

Each auxiliary edge therefore contributes at most 1/ρ1/\rho in the energy geometry of KvK_{v}, independently of the pivot degree and of the incident weights: splitting shrinks the largest possible single contribution in direct proportion to ρ\rho. The second-moment analysis combines this with the determinantal negative dependence of weighted random spanning-tree edge indicators.

Lemma 4.7 (Covariance domination for spanning-tree indicators).

Let TT be a weighted random spanning tree of a connected weighted graph, and for each edge ee let Xe=𝟏{eT}X_{e}=\mathbf{1}_{\{e\in T\}} and pe=𝔼[Xe]p_{e}=\mathbb{E}[X_{e}]. If CC is the covariance matrix of XX, then Cdiag(p)C\preceq\operatorname{diag}(p).

Proof.

See Appendix B.8. ∎

Negative dependence is what makes the tree structure work in our favor: the sampled edges are not independent, but their covariance never exceeds what independent sampling with the same marginals would give, so the second moment can be bounded edgewise.

Theorem 4.8 (Local second-moment bound for CAST-ρ\rho).

Let Yv=Kv+/2(K^vKv)Kv+/2Y_{v}=K_{v}^{+/2}(\widehat{K}_{v}-K_{v})K_{v}^{+/2} be the normalized local Schur error of the CAST-ρ\rho update. For every integer ρ1\rho\geq 1,

𝔼[Yv]=0,𝔼[Yv2]1ρΠKv.\mathbb{E}[Y_{v}]=0,\qquad\mathbb{E}[Y_{v}^{2}]\preceq\frac{1}{\rho}\,\Pi_{K_{v}}.
Proof.

See Appendix B.9. ∎

At ρ=1\rho=1 the bound reads 𝔼[Yv2]ΠKv\mathbb{E}[Y_{v}^{2}]\preceq\Pi_{K_{v}}, matching the unit local risk attained by CAST-1 (Theorem 4.5); each further doubling of ρ\rho halves the certified bound.

Scope of the guarantees.

The results above certify the CAST primitive at a single elimination step: for every ρ\rho the update is unbiased with connected support, at ρ=1\rho=1 its marginals uniquely minimize the local risk, and for general ρ\rho its normalized second moment obeys a 1/ρ1/\rho bound. The second moment is the quantity that matrix-concentration analyses of approximate elimination control alongside the largest single increment, so the bound identifies ρ\rho as a principled control on sampling variability, uniform over pivot degrees and incident weights. It remains a local certificate: it does not track how these errors accumulate across eliminations, and it says nothing about the magnitude of the resulting gain or about the construction cost and downstream fill that splitting introduces. Section 5 measures these effects across four benchmark families.

5 Experimental Evaluation

Methods.

We compare four preconditioners within a common elimination and PCG framework. AC Gao et al. (2026) is the practical approximate Cholesky factorization based on the elimination estimator of Kyng and Sachdeva Kyng and Sachdeva (2016), implemented in Laplacians.jl11 1 https://github.com/danspielman/Laplacians.jl; at each pivot it replaces the exact Schur-complement clique by a connected update generated through randomized sequential edge pairing. AC2 is its doubled-budget variant (split == merge =2=2): each edge is represented by up to two half-weight multiedges, with fill multiplicity capped at two. These are the state of the art on the families our corpus is drawn from, where multigrid and incomplete-Cholesky solvers Koutis et al. (2011b); Falgout and Yang (2002); Balay et al. (2019); Livne and Brandt (2012); Meijerink and van der Vorst (1977) each fail on some instance while AC and AC2 converge throughout Gao et al. (2026), as our own runs on these collections confirmed; we therefore confine the comparison to the randomized approximate-elimination family.

CAST-1 applies the base ρ=1\rho=1 update, replacing each elimination clique by a weighted random spanning tree whose edge marginals equal the clique leverage scores (Section 3.1). CAST-2 applies two-way splitting: each pivot neighbor is temporarily replaced by two equal-conductance auxiliary copies, one weighted random spanning tree is sampled from the resulting expanded Schur clique, and the copies are contracted back to the original neighborhood. We compare AC with CAST-1 as the base-granularity methods and AC2 with CAST-2 as their doubled-granularity variants; all four share the same elimination ordering (greedy on approximate minimum unweighted degree, following Gao et al. (2026)), factor representation, and PCG implementation, so the comparison isolates the local update.

AC2 versus CAST-2.

The two robustness variants increase sampling granularity in different ways. In AC2, edge replication persists throughout the factorization: the residual operator is represented as a multigraph with at most two multiedges per vertex pair, and a current neighbor represented by t{1,2}t\in\{1,2\} multiedges contributes tt samples to the sequential clique update. Thus AC2 is not equivalent to averaging two independent AC factorizations.

In CAST-2, splitting is local to the current pivot. Eliminating a degree-dd pivot creates 2d2d temporary auxiliary copies, one weighted random spanning tree is sampled on the expanded Schur clique, and its copy blocks are contracted onto the dd original neighbors. The auxiliary copies are then discarded, although the contracted terminal edges remain in the residual graph and may increase downstream fill. Hence AC2 and CAST-2 are comparable doubled-granularity variants, but they differ in sample dependence, persistence, and the distribution of fill.

Metrics.

For q=250q=250 right-hand sides, we report the total reuse workload

T250=Tbuild+r=1250Tsolve,r.T_{250}=T_{\mathrm{build}}+\sum_{r=1}^{250}T_{\mathrm{solve},r}.

The two primary paired speedups are

S1=T250(AC)T250(CAST-1),S2=T250(AC2)T250(CAST-2),S_{1}=\frac{T_{250}(\textit{AC})}{T_{250}(\textit{CAST-1})},\qquad S_{2}=\frac{T_{250}(\textit{AC2})}{T_{250}(\textit{CAST-2})},

where values greater than one favor the corresponding CAST variant. Aggregate speedups are arithmetic means of per-system ratios, computed in the direction stated for each comparison; we also report the number of systems on which each CAST variant is faster, which is independent of this convention. Following Gao et al. (2026), we also report factor-construction and per-right-hand-side solve costs normalized by the number of input nonzeros,

Cbuild=106Tbuildnnz(A),Csolve=106T¯solvennz(A),C_{\mathrm{build}}=10^{6}\,\frac{T_{\mathrm{build}}}{\operatorname{nnz}(A)},\qquad C_{\mathrm{solve}}=10^{6}\,\frac{\overline{T}_{\mathrm{solve}}}{\operatorname{nnz}(A)},

with T¯solve\overline{T}_{\mathrm{solve}} the average per-solve time of Section 2. Both normalized costs are reported in μs/nnz\mu\mathrm{s}/\mathrm{nnz}.

Setup.

Unless otherwise stated, every factorization is evaluated only as a preconditioner for the same PCG implementation, which uses a recurrence-based relative-residual stopping threshold of 10810^{-8} and an iteration cap of 10310^{3}. After each solve, we explicitly compute A𝐱𝐛2/𝐛2\|A\mathbf{x}-\mathbf{b}\|_{2}/\|\mathbf{b}\|_{2} to verify the requested tolerance. We report any discrepancy between the recurrence-based stopping test and this explicit residual check; the treatment of failed solves in each aggregate is stated alongside the corresponding result.

For each matrix and method, one factor is constructed and reused for q=250q=250 right-hand sides. The right-hand sides are independent standard Gaussian vectors projected onto 𝟏\mathbf{1}^{\perp}, as required for Laplacian compatibility. A fixed right-hand-side sequence, generated independently of the factor-sampling seeds, is presented to every method and every factor draw, so comparisons are paired at the level of individual right-hand sides. The number of independently seeded factor draws and the aggregation rule are stated for each collection in the corresponding appendix; all methods entering a paired comparison use the same right-hand-side sequence and the same number of factor draws.

Matrix collections.

The evaluation corpus contains 201201 SDDM and Laplacian systems from the SDDM2023 benchmark suite22 2 https://rjkyng.github.io/SDDM2023/ of Gao, Kyng, and Spielman: 2828 SuiteSparse matrices, 128128 Chimera-IPM systems, 4040 Spielman-IPM systems, and five Sachdeva-star instances. Eleven SuiteSparse matrices are excluded from the comparative aggregates as described below, leaving 190190 systems with paired measurements. Collection-specific protocols and per-system results appear in the appendix. All experiments run in a single process on an Apple Silicon MacBook Pro with 2424 GB of RAM under Julia 1.12. Preconditioner construction and application are single-threaded, and dense operations in the shared PCG implementation use the same OpenBLAS configuration for all methods.

The reported Spielman corpus contains the four scales k{100,200,300,400}k\in\{100,200,300,400\}. The larger k{500,600}k\in\{500,600\} sequences, containing approximately 1.5×1081.5\times 10^{8} and 2.2×1082.2\times 10^{8} nonzeros, exceed the memory capacity of the benchmark machine under the multi-solve protocol and are not included.

Within the SuiteSparse collection, ten matrices are retained as correctness checks but excluded from comparative aggregates because all four methods solve them in one PCG iteration and their timings are dominated by fixed construction and application overhead. We also exclude bcsstm25: at the requested tolerance of 10810^{-8}, all methods reach the iteration cap for at least some right-hand sides, whereas at tolerance 10510^{-5} every method converges in one iteration, indicating that the failure is associated with the matrix–tolerance pair rather than a particular preconditioner. The SuiteSparse comparative aggregate therefore contains the remaining 1717 matrices.

5.1 Cross-collection results

Table 1 summarizes the paired comparative subsets at q=250q=250 right-hand sides per factor. Across the 190190 systems with paired measurements, selecting the faster of CAST-1 and CAST-2 for each system in hindsight gives an arithmetic-mean speedup of 1.9×1.9\times over the correspondingly faster of AC and AC2, with CAST faster on 178178 systems. Per-system results are in Appendix  C.

Base granularity.

CAST-1 improves on AC across every collection, and does so uniformly rather than on average: it is faster on all 128128 Chimera-IPM systems, with per-system ratios between 1.08×1.08\times and 1.31×1.31\times and a mean of 1.18×1.18\times, and on 1414 of 1717 SuiteSparse matrices with a mean of 1.17×1.17\times. Against a tuned implementation that is the most reliable available solver on these families, a consistent 1.171.171.18×1.18\times speedup in total reuse workload—concentrated in the solve phase, and therefore compounding with the number of right-hand sides—is a substantive gain from changing only the local sampling distribution. On the Sachdeva-star ladder the margin instead grows with instance size, from 1.58×1.58\times at k=50k=50 to 5.30×5.30\times at k=600k=600 (3.09×3.09\times on average), as AC’s iteration count degrades faster than CAST-1’s.

Doubled granularity.

The ρ=2\rho=2 comparison is bimodal, and the elimination-degree profile predicts which regime holds. When pivot degrees are uniformly small, splitting is nearly free and the gain is large: on the Spielman-IPM systems, where every pivot has degree at most five, CAST-2 reaches the verified 10810^{-8} tolerance in one to two PCG iterations and is 4.43×4.43\times faster than AC2. The Sachdeva-star family benefits through a different mechanism. Its neighborhoods are clique-dominated rather than low-degree and CAST-2 needs multiple iterations for convergence, but it holds iteration growth to 25254545 across the ladder against 28286565 for AC2. When elimination produces a heavy tail of high-degree pivots the additional contributions instead dominate: on the Chimera collection AC2 is faster on 101101 of 128128 systems, CAST-2 is faster only on instance i3i_{3}, whose maximum pivot degree of 4848 is the smallest in the family. On SuiteSparse both are close, CAST-2 leading by 1.07×1.07\times on 1111 of 1717 matrices.

Table 1: Cross-collection performance at q=250q=250 right-hand sides per factor. Entries are per-collection aggregate speedups; the aggregation rule is stated in the corresponding Appendix C. Parentheses give the number of systems on which the CAST variant is faster. The final column is a post hoc comparison that selects the faster configuration within each method family separately for each system: min(TAC,TAC2)/min(TCAST-1,TCAST-2)\min(T_{\textit{AC}},T_{\textit{AC2}})/\min(T_{\textit{CAST-1}},T_{\textit{CAST-2}}).
Collection Elimination profile ACCAST-1\frac{\textit{AC}}{\textit{CAST-1}} AC2CAST-2\frac{\textit{AC2}}{\textit{CAST-2}} min(AC,AC2)min(CAST-1,CAST-2)\frac{\min(\textit{AC},\textit{AC2})}{\min(\textit{CAST-1},\textit{CAST-2})}
SuiteSparse mostly low-degree, d¯7\bar{d}\lesssim 7 1.17×1.17\times (14/17) 1.07×1.07\times (11/17) 1.11×1.11\times (12/17)
Chimera-IPM d¯=6\bar{d}=62727, dmax=48d_{\max}=48363363 1.18×1.18\times (128/128) 0.65×0.65\times (27/128) 1.16×1.16\times (121/128)
Spielman-IPM all pivots satisfy d5d\leq 5 1.27×1.27\times (38/40) 4.43×4.43\times (40/40) 4.43×4.43\times (40/40)
Sachdeva-star clique-dominated 3.09×3.09\times (5/5) 1.90×1.90\times (5/5) 1.90×1.90\times (5/5)

Choosing ρ\rho.

Two conclusions follow. First, the sampling distribution matters on its own. All four methods share an elimination ordering, factor format, and PCG path; AC and CAST-1 differ only in how the local update is drawn. That difference alone cuts total reuse workload by 141415%15\% on the heterogeneous collections, almost entirely in the solve phase.

Second, ρ\rho is a structural choice, not a strictly better setting. Splitting pays when its extra terminal-edge contributions stay confined: under small pivot degrees, as on Spielman-IPM, or in clique-dominated neighborhoods where iterations would otherwise grow, as on Sachdeva-star. It costs when a heavy degree tail carries them into later eliminations, compounding as downstream fill. Degree alone does not decide this; the clique-dominated case shows why. What matters is whether the contributions propagate. A CAST-1 elimination profile predicts this on our corpus, but reading it requires a first factorization, and we do not evaluate it as an adaptive rule. The post hoc column of Table 1 therefore bounds what any per-system choice between ρ=1\rho=1 and ρ=2\rho=2 could achieve.

6 Related Work

Laplacian and SDDM solvers.

Nearly-linear-time Laplacian solvers originated from support-graph preconditioning, low-stretch graph constructions, and spectral sparsification Spielman and Teng (2004); Koutis et al. (2011a); Cohen et al. (2014); Jambulapati and Sidford (2025), with effective-resistance sampling an especially influential route to the last Spielman and Srivastava (2008). These works give strong global approximation and running-time guarantees, but their recursive preconditioning structures differ from the sparse approximate factorizations studied here. Practical solvers for these systems also include incomplete Cholesky and algebraic multigrid, among them graph-specialized variants such as LAMG Livne and Brandt (2012). CAST belongs instead to the randomized approximate-elimination line, which builds a sparse factor by eliminating vertices sequentially and replacing each dense Schur-complement clique by a sparse random update.

Randomized approximate elimination.

Kyng and Sachdeva introduced a nearly-linear-time approximate Gaussian elimination algorithm for graph Laplacians, replacing elimination fill by unbiased random samples and controlling the accumulated error through a matrix-martingale analysis Kyng and Sachdeva (2016). Related sparsified-Cholesky constructions extend the approach to connection Laplacians Kyng et al. (2016). On the practical side, RCHOL adds shared-memory parallelization Chen et al. (2021), and more recent work studies parallel frameworks and CPU/GPU construction of randomized approximate-Cholesky preconditioners Baumann and Kyng (2024); Liang et al. (2025). These address global guarantees, alternative sampling schemes, or parallel implementation. CAST instead studies the distribution used for a single local Schur-clique replacement, then applies that primitive within a sequential factorization.

Practical approximate-Cholesky solvers.

The closest predecessor is the AC(kk) framework of Gao, Kyng, and Spielman Gao et al. (2026), which turns randomized approximate elimination into a practical SDDM solver in Laplacians.jl. Its local updates preserve connected support, and its configurations AC and AC2 use one and two samples per entry to trade construction cost against robustness. CAST adopts the same connected-update principle but differs in the distribution. AC(kk) generates its trees by randomized sequential edge pairing, so the induced edge marginals depend on the order in which incident edges are processed. CAST samples from the weighted random spanning-tree distribution of the clique itself, which is order-independent and attains the minimax edge marginals of Theorem 4.5.

Leverage scores and random spanning trees.

Edge leverage scores—equivalently, edge conductance times effective resistance—are central to spectral sparsification Spielman and Srivastava (2008). For a weighted random spanning tree, the transfer-current theorem identifies the inclusion probability of each edge with its leverage score Lyons (2003), and random spanning trees have accordingly been studied as spectral sparsifiers, including from unions of a few independent trees Kyng and Song (2018). Sampling such trees on general graphs requires nontrivial graph-algorithmic machinery Durfee et al. (2017).

CAST uses this distribution locally rather than globally, which is what makes it cheap. Sampling one tree per elimination clique avoids the general machinery entirely: the star origin of the clique gives its leverage scores in closed form, and the product-form conductances of the expanded clique admit exact sampling in 𝒪(ρd)\mathcal{O}(\rho d) time via weighted Prüfer codes Aigner and Ziegler (1999); West (2001). The union-of-trees results of Kyng and Song (2018) are also not the right analogy for ρ>1\rho>1: CAST-ρ\rho samples a single tree on an expanded vertex set, not ρ\rho independent trees on the original terminals.

Conclusion

We introduced CAST, a canonical sparse replacement for the Schur clique created during approximate Cholesky elimination. We show that among unbiased inverse-marginal one-tree estimators, leverage-score marginals uniquely minimize the largest normalized sampled-edge contribution. Because the clique is induced by a star, CAST samples the corresponding weighted random spanning tree exactly in 𝒪(ρd)\mathcal{O}(\rho d) time. Empirically, CAST-1 reduces total reuse workload by 141415%15\% relative to AC on SuiteSparse and Chimera-IPM systems. When additional fill remains controlled, CAST-2 improves robustness: on Spielman-IPM systems it reaches the verified 10810^{-8} residual tolerance in one to two PCG iterations and is, on average, 4.43×4.43\times faster than AC2.

References

  • [1] M. Aigner and G. M. Ziegler (1999) Proofs from the book. Vol. 1, Springer. Cited by: Appendix A, §3.2, §6.
  • [2] R. Andersen, F. Chung, and K. Lang (2006) Local graph partitioning using pagerank vectors. In 2006 47th annual IEEE symposium on foundations of computer science (FOCS’06), pp. 475–486. Cited by: §1.
  • [3] S. Balay, S. Abhyankar, M. Adams, J. Brown, P. Brune, K. Buschelman, L. Dalcin, A. Dener, V. Eijkhout, W. Gropp, et al. (2019) PETSc users manual. Technical report Argonne National Laboratory. Cited by: §5.
  • [4] Y. Baumann, R. Kyng, and G. Zöcklein (2026) VAC: a volume-sampling-based elimination rule for approximate cholesky factorization. Note: Manuscript, July 28, 2026 Cited by: §1.
  • [5] Y. Baumann and R. Kyng (2024) A framework for parallelizing approximate gaussian elimination. In Proceedings of the 36th ACM Symposium on Parallelism in Algorithms and Architectures, pp. 195–206. Cited by: §6.
  • [6] C. Chen, T. Liang, and G. Biros (2021) RCHOL: randomized cholesky factorization for solving sdd linear systems. SIAM Journal on Scientific Computing 43 (6), pp. C411–C438. Cited by: §6.
  • [7] M. B. Cohen, R. Kyng, G. L. Miller, J. W. Pachocki, R. Peng, A. B. Rao, and S. C. Xu (2014) Solving sdd linear systems in nearly m log1/2 n time. In Proceedings of the forty-sixth annual ACM symposium on Theory of computing, pp. 343–352. Cited by: §6.
  • [8] D. Durfee, R. Kyng, J. Peebles, A. B. Rao, and S. Sachdeva (2017) Sampling random spanning trees faster than matrix multiplication. In Proceedings of the 49th Annual ACM SIGACT Symposium on Theory of Computing, pp. 730–742. Cited by: §6.
  • [9] R. D. Falgout and U. M. Yang (2002) Hypre: a library of high performance preconditioners. In International Conference on computational science, pp. 632–641. Cited by: §5.
  • [10] Y. Gao, R. Kyng, and D. A. Spielman (2026) AC(k): robust solution of laplacian equations by randomized approximate cholesky factorization. SIAM Journal on Scientific Computing. Cited by: §C.1, §C.2, §C.3, §C.4, §C.4, §1, §1, §1, §2, §5, §5, §5, §6, Abstract.
  • [11] D. F. Gleich (2015) PageRank beyond the web. siam REVIEW 57 (3), pp. 321–363. Cited by: §2.
  • [12] K. D. Gremban (1996) Combinatorial preconditioners for sparse, symmetric, diagonally dominant linear systems. Ph.D. Thesis, Carnegie Mellon University Pittsburgh. Cited by: §C.1, §2.
  • [13] W. Huang, W. Lin, H. H. Lu, and S. Yau (2019) ISIRA: integrated shift–invert residual arnoldi method for graph laplacian matrices from big data. Journal of Computational and Applied Mathematics 346, pp. 518–531. Cited by: §1.
  • [14] A. Jambulapati and A. Sidford (2025) Ultrasparse ultrasparsifiers and faster laplacian system solvers. ACM Transactions on Algorithms 21 (3), pp. 1–49. Cited by: §6.
  • [15] I. Koutis, G. L. Miller, and R. Peng (2011) A nearly-m log n time solver for sdd linear systems. In 2011 IEEE 52nd Annual Symposium on Foundations of Computer Science, pp. 590–598. Cited by: §6.
  • [16] I. Koutis, G. L. Miller, and D. Tolliver (2011) Combinatorial preconditioners and multilevel solvers for problems in computer vision and image processing. Computer Vision and Image Understanding 115 (12), pp. 1638–1646. Cited by: §5.
  • [17] R. Kyng, Y. T. Lee, R. Peng, S. Sachdeva, and D. A. Spielman (2016) Sparsified cholesky and multigrid solvers for connection laplacians. In Proceedings of the forty-eighth annual ACM symposium on Theory of Computing, pp. 842–850. Cited by: §6.
  • [18] R. Kyng and S. Sachdeva (2016) Approximate gaussian elimination for laplacians-fast, sparse, and simple. In 2016 IEEE 57th Annual Symposium on Foundations of Computer Science (FOCS), pp. 573–582. Cited by: §1, §1, §1, §2, §2, §5, §6.
  • [19] R. Kyng and Z. Song (2018) A matrix chernoff bound for strongly rayleigh distributions and spectral sparsifiers from a few random spanning trees. In 2018 IEEE 59th Annual Symposium on Foundations of Computer Science (FOCS), pp. 373–384. Cited by: §6, §6.
  • [20] T. Liang, C. Chen, Y. Yaniv, H. Luo, D. Tench, X. S. Li, A. Buluc, and J. Demmel (2025) Parallel gpu-accelerated randomized construction of approximate cholesky preconditioners. arXiv preprint arXiv:2505.02977. Cited by: §6.
  • [21] O. E. Livne and A. Brandt (2012) Lean algebraic multigrid (lamg): fast graph laplacian linear solver. SIAM Journal on Scientific Computing 34 (4), pp. B499–B522. Cited by: §5, §6.
  • [22] R. Lyons (2003) Determinantal probability measures. Publications Mathématiques de l’IHÉS 98, pp. 167–212. Cited by: §B.2, §B.6, §B.8, §1, §2, §6.
  • [23] J. A. Meijerink and H. A. van der Vorst (1977) An iterative solution method for linear systems of which the coefficient matrix is a symmetric M-matrix. Mathematics of Computation 31 (137), pp. 148–162. Cited by: §5.
  • [24] L. Page, S. Brin, R. Motwani, and T. Winograd (1999) The pagerank citation ranking: bring order to the web. In Proc. of the 7th International World Wide Web Conf.–1998, Cited by: §1.
  • [25] D. A. Spielman and N. Srivastava (2008) Graph sparsification by effective resistances. In Proceedings of the fortieth annual ACM symposium on Theory of computing, pp. 563–568. Cited by: §1, §1, §2, §6, §6.
  • [26] D. A. Spielman and S. Teng (2004) Nearly-linear time algorithms for graph partitioning, graph sparsification, and solving linear systems. In Proceedings of the thirty-sixth annual ACM symposium on Theory of computing, pp. 81–90. Cited by: §1, §6.
  • [27] D. B. West (2001) Introduction to graph theory. 2nd edition, Prentice Hall. Cited by: Appendix A, §3.2, §6.
  • [28] D. Zhou, O. Bousquet, T. Lal, J. Weston, and B. Schölkopf (2003) Learning with local and global consistency. Advances in neural information processing systems 16. Cited by: §1.
  • [29] X. Zhu, Z. Ghahramani, and J. D. Lafferty (2003) Semi-supervised learning using gaussian fields and harmonic functions. In Proceedings of the 20th International conference on Machine learning (ICML-03), pp. 912–919. Cited by: §1.

Appendix A Background on Prüfer Codes

This appendix collects the facts about Prüfer codes underlying the exact sampler of Section 3.2.

The Prüfer correspondence.

Let PP be a set of m2m\geq 2 labeled vertices with an arbitrary total ordering. A Prüfer code is a sequence S=(S1,,Sm2)Pm2S=(S_{1},\ldots,S_{m-2})\in P^{m-2}. The Prüfer correspondence is a bijection between such sequences and labeled spanning trees on PP [1, 27]: every labeled tree has a unique code, and every sequence of length m2m-2 decodes to a unique tree. To encode a tree, repeatedly remove the smallest-labeled leaf and append its unique neighbor to the sequence, stopping when two vertices remain; one vertex is removed per step, so the code has exactly m2m-2 symbols.

For example, the tree on {1,2,3,4,5}\{1,2,3,4,5\} with edges {(1,3),(2,3),(3,4),(4,5)}\{(1,3),(2,3)\\ ,(3,4),(4,5)\} has smallest leaf 11, whose neighbor is 33, so the first symbol is 33. After removing 11 the smallest leaf is 22, again with neighbor 33; after removing 22 it is 33, whose remaining neighbor is 44. The code is (3,3,4)(3,3,4).

The inverse procedure reconstructs the tree. For each label pp initialize rp=1+|{t:St=p}|r_{p}=1+\lvert\{t:S_{t}=p\}\rvert. At each step choose the smallest label \ell with r=1r_{\ell}=1, connect \ell to the next code symbol StS_{t}, remove \ell, and decrease rStr_{S_{t}} by one. Two labels remain once all symbols are processed; connecting them completes the tree. When m=2m=2 the code is empty and the tree is the single edge between the two labels.

Degrees from code multiplicities.

The property CAST relies on is that pp appears in the code exactly degT(p)1\deg_{T}(p)-1 times, i.e.

degT(p)=1+|{t:St=p}|.\deg_{T}(p)=1+\bigl\lvert\{t:S_{t}=p\}\bigr\rvert.

Intuitively, pp is recorded whenever a neighboring leaf is removed while pp remains, which happens once per incident edge except the edge through which pp is itself removed, or the final edge if pp is one of the last two vertices. Consistently, pP(degT(p)1)=2(m1)m=m2\sum_{p\in P}(\deg_{T}(p)-1)=2(m-1)-m=m-2, the length of the code.

Nonuniform Prüfer sampling.

The correspondence is purely combinatorial. A weighted tree distribution can nonetheless be induced by drawing the code symbols nonuniformly: if S1,,Sm2S_{1},\ldots,S_{m-2} are independent with (St=p)=πp\mathbb{P}\left(S_{t}=p\right)=\pi_{p}, then, because the correspondence is a bijection, the decoded tree TT has probability (T)=pPπpdegT(p)1\mathbb{P}\left(T\right)=\prod_{p\in P}\pi_{p}^{\deg_{T}(p)-1}, which depends on TT only through its degree sequence. This matches the structure of complete graphs whose edge weights factor over endpoints.

Lemma A.1 (Weighted Prüfer sampling).

Let the complete graph on PP have edge weights wpq=βθpθqw_{pq}=\beta\,\theta_{p}\theta_{q} for pqp\neq q, with β>0\beta>0 and θp>0\theta_{p}>0. Draw S1,,Sm2S_{1},\ldots,S_{m-2} independently with (St=p)=θp/rPθr\mathbb{P}\left(S_{t}=p\right)=\theta_{p}/\sum_{r\in P}\theta_{r} and let TT be the decoded tree. Then TT follows the weighted random spanning-tree distribution, (T)(p,q)Twpq\mathbb{P}\left(T\right)\propto\prod_{(p,q)\in T}w_{pq}.

Proof.

A spanning tree has m1m-1 edges and each pp appears in degT(p)\deg_{T}(p) of them, so (p,q)Twpq=βm1pPθpdegT(p)\prod_{(p,q)\in T}w_{pq}=\beta^{m-1}\prod_{p\in P}\theta_{p}^{\deg_{T}(p)}. By the degree-multiplicity property,

(T)=pP(θprθr)degT(p)1=(rθr)(m2)pPθpdegT(p)1.\mathbb{P}\left(T\right)=\prod_{p\in P}\left(\frac{\theta_{p}}{\sum_{r}\theta_{r}}\right)^{\deg_{T}(p)-1}=\Bigl(\sum_{r}\theta_{r}\Bigr)^{-(m-2)}\prod_{p\in P}\theta_{p}^{\deg_{T}(p)-1}.

The ratio of the two expressions is βm1(rθr)m2pθp\beta^{m-1}\bigl(\sum_{r}\theta_{r}\bigr)^{m-2}\prod_{p}\theta_{p}, which does not depend on TT. Both are distributions over the same finite set, so they coincide. ∎

The endpoint-product form is essential: independent Prüfer symbols do not sample the correct weighted spanning-tree distribution for general edge weights.

Application to CAST-ρ\rho.

At a pivot with dd terminals, the expanded Schur clique is the complete graph on the m=ρdm=\rho d auxiliary copies with conductances wpqexp=cpcq/aw^{\mathrm{exp}}_{pq}=c_{p}c_{q}/a. This is Lemma A.1 with θp=cp\theta_{p}=c_{p} and β=1/a\beta=1/a, and since pPcp=a\sum_{p\in P}c_{p}=a, the symbol distribution is (St=p)=cp/a\mathbb{P}\left(S_{t}=p\right)=c_{p}/a. Because every copy of terminal ii carries the same conductance ai/ρa_{i}/\rho, a symbol can be drawn hierarchically: sample ii with probability ai/aa_{i}/a, then one of its ρ\rho copies uniformly. Section 3.2 gives the resulting sampler and its 𝒪(ρd)\mathcal{O}(\rho d) cost.

Appendix B Proofs

B.1 Proof of Proposition 3.1

Proof.

Let m=ρdm=\rho d. A spanning tree TT of the expanded Schur clique has m1m-1 edges, and each copy pp appears in degT(p)\deg_{T}(p) of them, so

(p,q)Twpqexp=a(m1)pPcpdegT(p).\prod_{(p,q)\in T}w_{pq}^{\mathrm{exp}}=a^{-(m-1)}\prod_{p\in P}c_{p}^{\deg_{T}(p)}.

The Prüfer correspondence is a bijection between spanning trees of the complete graph on PP and sequences in Pm2P^{m-2}, under which pp appears exactly degT(p)1\deg_{T}(p)-1 times in the code of TT. Hence drawing the m2m-2 symbols independently with (symbol=p)=cp/a\mathbb{P}\left(\text{symbol}=p\right)=c_{p}/a generates TT with probability

pP(cpa)degT(p)1=a(m2)pPcpdegT(p)1,\prod_{p\in P}\left(\frac{c_{p}}{a}\right)^{\deg_{T}(p)-1}=a^{-(m-2)}\prod_{p\in P}c_{p}^{\deg_{T}(p)-1},

where we used pP(degT(p)1)=m2\sum_{p\in P}\bigl(\deg_{T}(p)-1\bigr)=m-2. The ratio of this probability to the unnormalized tree weight above is apPcp1a\prod_{p\in P}c_{p}^{-1}, independent of TT. Two probability distributions on the same finite set whose ratio is constant are equal, so the sampler is exact.

For the running time, all copies of terminal ii carry the same conductance ai/ρa_{i}/\rho, so a symbol is drawn by sampling a terminal from an alias table for (a1/a,,ad/a)(a_{1}/a,\ldots,a_{d}/a) and then one of its ρ\rho copies uniformly. The table is built once in 𝒪(d)\mathcal{O}(d) time, after which each of the m2m-2 symbols costs 𝒪(1)\mathcal{O}(1). Decoding takes 𝒪(m)\mathcal{O}(m) time by the standard leaf-pointer algorithm. Contraction is one pass over the m1m-1 auxiliary edges with 𝒪(1)\mathcal{O}(1) work each: a cross-block edge (p,q)(p,q) is emitted as the terminal-edge contribution (ϕ(p),ϕ(q),cpcq/(cp+cq))(\phi(p),\phi(q),c_{p}c_{q}/(c_{p}+c_{q})), and a within-block edge is discarded. The total is 𝒪(d+m)=𝒪(ρd)\mathcal{O}(d+m)=\mathcal{O}(\rho d).

Finally, the only structures allocated are the alias table over the dd terminals, the code of length m2m-2, and the decoded tree on mm copies. Neither the Θ(d2)\Theta(d^{2})-edge Schur clique nor the expanded clique is ever formed. ∎

B.2 Proof of Lemma 4.1

Proof.

Let S\mathrm{S} be the star on P{z}P\cup\{z\} in which the center zz is joined to each auxiliary copy rPr\in P by an edge of conductance crc_{r}, so that the total conductance at zz is rPcr=a\sum_{r\in P}c_{r}=a. Eliminating zz from S\mathrm{S} produces, by Eq. (1), the clique on PP with edge conductances cpcq/a=wpqexpc_{p}c_{q}/a=w^{\mathrm{exp}}_{pq}. The expanded Schur clique is therefore the Schur complement of S\mathrm{S} onto PP.

Schur complementation preserves effective resistances among the retained vertices, so the effective resistance between pp and qq in the expanded clique equals their effective resistance in S\mathrm{S}. Since S\mathrm{S} is a tree, the unique ppqq path ppzzqq determines this resistance, giving

Rpqexp=1cp+1cq.R_{pq}^{\mathrm{exp}}=\frac{1}{c_{p}}+\frac{1}{c_{q}}.

By the transfer-current theorem [22], the inclusion probability of an edge in a weighted random spanning tree is its conductance times its effective resistance, whence

((p,q)T)=wpqexpRpqexp=cpcqa(1cp+1cq)=cp+cqa.\mathbb{P}\left((p,q)\in T\right)=w_{pq}^{\mathrm{exp}}R_{pq}^{\mathrm{exp}}=\frac{c_{p}c_{q}}{a}\left(\frac{1}{c_{p}}+\frac{1}{c_{q}}\right)=\frac{c_{p}+c_{q}}{a}.\qed

B.3 Proof of Theorem 4.2

Proof.

Write K^v=eEexpXeHe\widehat{K}_{v}=\sum_{e\in E^{\mathrm{exp}}}X_{e}H_{e} with Xe=𝟏{eT}X_{e}=\mathbf{1}_{\{e\in T\}}, so that by linearity 𝔼[K^v]=e(eT)He\mathbb{E}[\widehat{K}_{v}]=\sum_{e}\mathbb{P}\left(e\in T\right)\,H_{e}. Within-block edges contract to self-loops and contribute He=0H_{e}=0, so only pairs with endpoints in distinct blocks remain.

Fix distinct terminals iji\neq j. Collecting the terms carrying (𝐞i𝐞j)(𝐞i𝐞j)(\mathbf{e}_{i}-\mathbf{e}_{j})(\mathbf{e}_{i}-\mathbf{e}_{j})^{\top} and applying Lemma 4.1,

pPiqPj((p,q)T)cpcqcp+cq\displaystyle\sum_{p\in P_{i}}\sum_{q\in P_{j}}\mathbb{P}\left((p,q)\in T\right)\,\frac{c_{p}c_{q}}{c_{p}+c_{q}} =pPiqPjcp+cqacpcqcp+cq\displaystyle=\sum_{p\in P_{i}}\sum_{q\in P_{j}}\frac{c_{p}+c_{q}}{a}\cdot\frac{c_{p}c_{q}}{c_{p}+c_{q}}
=1a(pPicp)(qPjcq)=aiaja,\displaystyle=\frac{1}{a}\Bigl(\sum_{p\in P_{i}}c_{p}\Bigr)\Bigl(\sum_{q\in P_{j}}c_{q}\Bigr)=\frac{a_{i}a_{j}}{a},

using pPicp=ai\sum_{p\in P_{i}}c_{p}=a_{i}. This is exactly the coefficient of the terminal edge (i,j)(i,j) in KvK_{v}. Both 𝔼[K^v]\mathbb{E}[\widehat{K}_{v}] and KvK_{v} are graph Laplacians on {u1,,ud}\{u_{1},\ldots,u_{d}\}, and a graph Laplacian is determined by its edge coefficients, so

𝔼[K^v]=Kv.\mathbb{E}[\widehat{K}_{v}]=K_{v}.

B.4 Proof of Theorem 4.3

Proof.

The sampled tree TT is connected on the auxiliary-copy set PP. Contract each block PiP_{i} to its terminal uiu_{i}. Contraction preserves connectedness: given terminals uiu_{i} and uju_{j}, pick pPip\in P_{i} and qPjq\in P_{j}; the ppqq path in TT maps to a walk from uiu_{i} to uju_{j} in the quotient graph.

It remains to check that the quotient edges are exactly the edges of the support graph of K^v\widehat{K}_{v}. An auxiliary edge with both endpoints in one block becomes a self-loop and is discarded, which does not affect connectivity. A cross-block edge (p,q)(p,q) with ϕ(p)=ij=ϕ(q)\phi(p)=i\neq j=\phi(q) contributes conductance cpcq/(cp+cq)>0c_{p}c_{q}/(c_{p}+c_{q})>0 to the terminal edge (ui,uj)(u_{i},u_{j}), and parallel contributions are summed. Since all cp>0c_{p}>0, every such contribution is strictly positive and no cancellation occurs, so each quotient edge carries positive weight in K^v\widehat{K}_{v}. The support graph of K^v\widehat{K}_{v} is therefore the quotient graph with self-loops removed, and is connected.

When ρ=1\rho=1 each block is a single copy, so the contraction is the identity and K^v\widehat{K}_{v} is itself a spanning tree of the terminal neighborhood; for ρ>1\rho>1 it need not be a tree. ∎

B.5 Proof of Corollary 4.4

Proof.

The nullspace of a weighted graph Laplacian has dimension equal to the number of connected components of its support graph, and is spanned by the indicator vectors of those components. By Theorem 4.3 the support graph of K^v\widehat{K}_{v} is connected on {u1,,ud}\{u_{1},\ldots,u_{d}\}, so ker(K^v)=span{𝟏d}\ker(\widehat{K}_{v})=\operatorname{span}\{\mathbf{1}_{d}\} and, by rank–nullity, rank(K^v)=d1\operatorname{rank}(\widehat{K}_{v})=d-1. ∎

B.6 Proof of Theorem 4.5

Proof.

Every spanning tree of the support graph of KK has exactly d1d-1 edges, so eEK𝟏{eT}=d1\sum_{e\in E_{K}}\mathbf{1}_{\{e\in T\}}=d-1 for every realization; taking expectations gives eEKpe=d1\sum_{e\in E_{K}}p_{e}=d-1. The leverage scores satisfy eEKτe=rank(K)=d1\sum_{e\in E_{K}}\tau_{e}=\operatorname{rank}(K)=d-1 as well, so

1=eEKτeeEKpe=eEKpe(τe/pe)eEKpemaxeEKτepe=RK(𝒟),1=\frac{\sum_{e\in E_{K}}\tau_{e}}{\sum_{e\in E_{K}}p_{e}}=\frac{\sum_{e\in E_{K}}p_{e}\,(\tau_{e}/p_{e})}{\sum_{e\in E_{K}}p_{e}}\leq\max_{e\in E_{K}}\frac{\tau_{e}}{p_{e}}=R_{K}(\mathcal{D}),

since the middle expression is a weighted average of the ratios τe/pe\tau_{e}/p_{e} with positive weights pep_{e}. Hence RK(𝒟)1R_{K}(\mathcal{D})\geq 1.

A weighted average with positive weights attains its maximum only when every term equals that maximum. Equality therefore forces τe/pe=1\tau_{e}/p_{e}=1, i.e. pe=τep_{e}=\tau_{e}, for every eEKe\in E_{K}; conversely, if pe=τep_{e}=\tau_{e} throughout then RK(𝒟)=1R_{K}(\mathcal{D})=1. Finally, for the weighted random spanning-tree distribution of KK the transfer-current theorem [22] gives pe=(eT)=we𝐛eK+𝐛e=τep_{e}=\mathbb{P}\left(e\in T\right)=w_{e}\,\mathbf{b}_{e}^{\top}K^{+}\mathbf{b}_{e}=\tau_{e}, so this distribution attains the bound. ∎

B.7 Proof of Lemma 4.6

Proof.

If ee is a within-block edge then He=0H_{e}=0, hence Ae=0A_{e}=0 and both claims hold trivially. Otherwise let e=(p,q)e=(p,q) with ϕ(p)=ij=ϕ(q)\phi(p)=i\neq j=\phi(q), and write 𝐛=𝐞i𝐞j\mathbf{b}=\mathbf{e}_{i}-\mathbf{e}_{j}, so that He=cpcqcp+cq𝐛𝐛H_{e}=\frac{c_{p}c_{q}}{c_{p}+c_{q}}\,\mathbf{b}\mathbf{b}^{\top} and Ae=cpcqcp+cq(Kv+/2𝐛)(Kv+/2𝐛)A_{e}=\frac{c_{p}c_{q}}{c_{p}+c_{q}}\,(K_{v}^{+/2}\mathbf{b})(K_{v}^{+/2}\mathbf{b})^{\top}. Thus AeA_{e} is positive semidefinite and rank one, and its only nonzero eigenvalue is

Ae=cpcqcp+cqKv+/2𝐛2=cpcqcp+cq𝐛Kv+𝐛.\|A_{e}\|=\frac{c_{p}c_{q}}{c_{p}+c_{q}}\,\bigl\|K_{v}^{+/2}\mathbf{b}\bigr\|^{2}=\frac{c_{p}c_{q}}{c_{p}+c_{q}}\,\mathbf{b}^{\top}K_{v}^{+}\mathbf{b}.

By the argument of Lemma 4.1 applied to the pivot star, the effective resistance between uiu_{i} and uju_{j} in KvK_{v} is 𝐛Kv+𝐛=1/ai+1/aj\mathbf{b}^{\top}K_{v}^{+}\mathbf{b}=1/a_{i}+1/a_{j}. Substituting cp=ai/ρc_{p}=a_{i}/\rho and cq=aj/ρc_{q}=a_{j}/\rho,

Ae=aiajρ(ai+aj)(1ai+1aj)=1ρ,\|A_{e}\|=\frac{a_{i}a_{j}}{\rho\,(a_{i}+a_{j})}\left(\frac{1}{a_{i}}+\frac{1}{a_{j}}\right)=\frac{1}{\rho},

independently of dd and of the incident weights.

Write Ae=1ρ𝐯𝐯A_{e}=\frac{1}{\rho}\mathbf{v}\mathbf{v}^{\top} with 𝐯=Kv+/2𝐛/Kv+/2𝐛\mathbf{v}=K_{v}^{+/2}\mathbf{b}/\|K_{v}^{+/2}\mathbf{b}\|. Since 𝐯range(Kv+/2)=range(Kv)\mathbf{v}\in\operatorname{range}(K_{v}^{+/2})=\operatorname{range}(K_{v}) and ΠKv\Pi_{K_{v}} is the orthogonal projection onto that subspace, 𝐯𝐯ΠKv\mathbf{v}\mathbf{v}^{\top}\preceq\Pi_{K_{v}}, giving 0Ae1ρΠKv0\preceq A_{e}\preceq\frac{1}{\rho}\Pi_{K_{v}}. Finally, a rank-one matrix λ𝐯𝐯\lambda\mathbf{v}\mathbf{v}^{\top} with 𝐯=1\|\mathbf{v}\|=1 satisfies (λ𝐯𝐯)2=λ2𝐯𝐯=λλ𝐯𝐯(\lambda\mathbf{v}\mathbf{v}^{\top})^{2}=\lambda^{2}\mathbf{v}\mathbf{v}^{\top}=\lambda\cdot\lambda\mathbf{v}\mathbf{v}^{\top}, so Ae2=1ρAeA_{e}^{2}=\frac{1}{\rho}A_{e}. ∎

B.8 Proof of Lemma 4.7

Proof.

Fix an arbitrary orientation of the edges. The edge indicators of a weighted random spanning tree then form a determinantal point process whose kernel is the transfer-current matrix MM, which is symmetric and positive semidefinite, with Mee=peM_{ee}=p_{e} [22]. Determinantal pair correlations give, for efe\neq f,

(eT,fT)=det(MeeMefMfeMff)=pepfMef2,\mathbb{P}\left(e\in T,\,f\in T\right)=\det\begin{pmatrix}M_{ee}&M_{ef}\\ M_{fe}&M_{ff}\end{pmatrix}=p_{e}p_{f}-M_{ef}^{2},

so Cef=(eT,fT)pepf=Mef2C_{ef}=\mathbb{P}\left(e\in T,f\in T\right)-p_{e}p_{f}=-M_{ef}^{2}. On the diagonal, XeX_{e} is a Bernoulli indicator, so Cee=𝔼[Xe2]pe2=pepe2=peMee2C_{ee}=\mathbb{E}[X_{e}^{2}]-p_{e}^{2}=p_{e}-p_{e}^{2}=p_{e}-M_{ee}^{2}. Hence

C=diag(p)MM,C=\operatorname{diag}(p)-M\circ M,

where \circ is the entrywise product; note that CC does not depend on the chosen orientation, since only the squares Mef2M_{ef}^{2} appear. Since M0M\succeq 0, the Schur product theorem gives MM0M\circ M\succeq 0, and therefore Cdiag(p)C\preceq\operatorname{diag}(p). ∎

B.9 Proof of Theorem 4.8

Proof.

The mean-zero statement follows from Theorem 4.2:

𝔼[Yv]=Kv+/2(𝔼[K^v]Kv)Kv+/2=0.\mathbb{E}[Y_{v}]=K_{v}^{+/2}\bigl(\mathbb{E}[\widehat{K}_{v}]-K_{v}\bigr)K_{v}^{+/2}=0.

For eEexpe\in E^{\mathrm{exp}} let Xe=𝟏{eT}X_{e}=\mathbf{1}_{\{e\in T\}} and pe=𝔼[Xe]p_{e}=\mathbb{E}[X_{e}]. Since K^v=eXeHe\widehat{K}_{v}=\sum_{e}X_{e}H_{e} and, by unbiasedness, Kv=epeHeK_{v}=\sum_{e}p_{e}H_{e}, conjugating by Kv+/2K_{v}^{+/2} gives

Yv=eEexp(Xepe)Ae.Y_{v}=\sum_{e\in E^{\mathrm{exp}}}(X_{e}-p_{e})A_{e}.

Fix 𝐳d\mathbf{z}\in\mathbb{R}^{d}. As YvY_{v} is symmetric, 𝐳𝔼[Yv2]𝐳=𝔼[Yv𝐳22]\mathbf{z}^{\top}\mathbb{E}[Y_{v}^{2}]\mathbf{z}=\mathbb{E}\bigl[\lVert Y_{v}\mathbf{z}\rVert_{2}^{2}\bigr], and expanding the square,

𝔼[Yv𝐳22]=e,f𝔼[(Xepe)(Xfpf)]Ae𝐳,Af𝐳=e,fCefGef,\mathbb{E}\bigl[\lVert Y_{v}\mathbf{z}\rVert_{2}^{2}\bigr]=\sum_{e,f}\mathbb{E}\bigl[(X_{e}-p_{e})(X_{f}-p_{f})\bigr]\langle A_{e}\mathbf{z},A_{f}\mathbf{z}\rangle=\sum_{e,f}C_{ef}\,G_{ef},

where Gef=Ae𝐳,Af𝐳G_{ef}=\langle A_{e}\mathbf{z},A_{f}\mathbf{z}\rangle is the Gram matrix of the vectors {Ae𝐳}\{A_{e}\mathbf{z}\} and is therefore positive semidefinite. The right-hand side is the Frobenius inner product C,GF\langle C,G\rangle_{F}.

By Lemma 4.7, diag(p)C0\operatorname{diag}(p)-C\succeq 0. For positive-semidefinite AA and BB one has A,BF=tr(AB)=tr(A1/2BA1/2)0\langle A,B\rangle_{F}=\operatorname{tr}(AB)=\operatorname{tr}(A^{1/2}BA^{1/2})\geq 0, so diag(p)C,GF0\langle\operatorname{diag}(p)-C,\,G\rangle_{F}\geq 0 and hence

𝐳𝔼[Yv2]𝐳diag(p),GF=epeAe𝐳22=𝐳(epeAe2)𝐳,\mathbf{z}^{\top}\mathbb{E}[Y_{v}^{2}]\mathbf{z}\;\leq\;\langle\operatorname{diag}(p),G\rangle_{F}=\sum_{e}p_{e}\lVert A_{e}\mathbf{z}\rVert_{2}^{2}=\mathbf{z}^{\top}\Bigl(\sum_{e}p_{e}A_{e}^{2}\Bigr)\mathbf{z},

the last equality because each AeA_{e} is symmetric. As 𝐳\mathbf{z} was arbitrary, 𝔼[Yv2]epeAe2\mathbb{E}[Y_{v}^{2}]\preceq\sum_{e}p_{e}A_{e}^{2}.

Lemma 4.6 gives Ae2=1ρAeA_{e}^{2}=\frac{1}{\rho}A_{e}, so epeAe2=1ρepeAe\sum_{e}p_{e}A_{e}^{2}=\frac{1}{\rho}\sum_{e}p_{e}A_{e}, and unbiasedness gives

eEexppeAe=Kv+/2(epeHe)Kv+/2=Kv+/2KvKv+/2=ΠKv.\sum_{e\in E^{\mathrm{exp}}}p_{e}A_{e}=K_{v}^{+/2}\Bigl(\sum_{e}p_{e}H_{e}\Bigr)K_{v}^{+/2}=K_{v}^{+/2}K_{v}K_{v}^{+/2}=\Pi_{K_{v}}.

Therefore 𝔼[Yv2]1ρΠKv\mathbb{E}[Y_{v}^{2}]\preceq\frac{1}{\rho}\Pi_{K_{v}}. ∎

Appendix C Empirical Evaluation

C.1 SuiteSparse benchmark

Benchmark.

We evaluate on 28 symmetric diagonally dominant M-matrices from the SuiteSparse Matrix Collection, following the benchmark selection of Gao, Kyng, and Spielman [10]. The collection includes grid and mesh Laplacians, finite-element and finite-volume discretizations, shallow-water models, ill-conditioned structural systems, and irregular graph problems, with the largest matrices containing up to 4.84.8 million nonzeros.

Ten matrices are diagonal or effectively diagonal, and every method converges in one PCG iteration for every right-hand side. These instances do not exercise the randomized clique estimator; their timings primarily reflect fixed construction and application overhead. We therefore retain them as correctness checks but exclude them from aggregate performance comparisons.

Of the remaining 18 matrices, bcsstm25 is reported as did not finish (DNF) and excluded from the aggregates. Its conditioning places the requested tolerance of 10810^{-8} below the attainable double-precision accuracy for some right-hand sides, causing every method to reach the iteration limit on those right-hand sides. At tolerance 10510^{-5}, all methods converge in one iteration, indicating that the failure is attributable to the matrix–tolerance pair rather than to a particular solver. The aggregate comparison therefore contains 1717 matrices.

The SDDM inputs are reduced to Laplacian form using the standard Gremban expansion [12]. This preprocessing is applied once per matrix and shared identically by all methods.

Results.

Tables 2 and 3 report the complete per-matrix results for the base- and doubled-granularity comparisons, AC versus CAST-1 and AC2 versus CAST-2, respectively. Matrices are ordered by total workload time. Table 4 reports the ten trivial instances excluded from the comparative aggregates.

Base-granularity comparison.

CAST-1 is faster than AC on 14 of the 17 matrices, with an average speedup of 1.17×1.17\times. The largest gains occur on nos7 (1.55×1.55\times), shallow_water2 (1.54×1.54\times), and nos6 (1.48×1.48\times). On the two largest matrices, ecology1 and ecology2, CAST-1 is 1.25×1.25\times and 1.26×1.26\times faster, respectively.

Build costs are similar for the two methods on most matrices, whereas solve costs generally favor CAST-1. The aggregate improvement therefore arises primarily from the solve phase rather than from cheaper factor construction. The exceptions are apache1 (0.73×0.73\times), jnlbrng1 (0.77×0.77\times), and bcsstm24 (0.85×0.85\times). On apache1 and jnlbrng1, CAST-1 requires more PCG iterations; CAST-1 requires 54 iterations per solve on apache1, compared with 28 for AC.

Doubled-granularity comparison.

CAST-2 is faster than AC2 on 11 of the 17 matrices, with an average speedup of 1.069×1.069\times. It performs particularly well on shallow_water2 (1.42×1.42\times), the two ecology matrices (1.271.271.31×1.31\times), and apache1 (1.22×1.22\times). Thus, the ρ=2\rho=2 construction recovers the loss observed for CAST-1 on apache1, consistent with improved robustness under finer splitting.

On jnlbrng1, AC2 requires 14 iterations per solve, compared with 27 for CAST-2, yielding a speedup ratio of 0.64×0.64\times. The largest loss occurs on Andrews (0.50×0.50\times), whose highly skewed degree distribution leads to a CAST-2 build cost of 2.09μs/nnz2.09\,\mu\mathrm{s}/\mathrm{nnz}, compared with 0.63μs/nnz0.63\,\mu\mathrm{s}/\mathrm{nnz} for AC2. This construction overhead makes CAST-1, rather than CAST-2, the preferable CAST configuration on this matrix.

Cost decomposition and factor reuse.

The performance differences reflect both iteration count and preconditioner-application cost. On ecology1, for example, CAST-2 requires 26.3 iterations per solve, compared with 29.5 for AC2, while also having a lower per-iteration application cost. Together, these effects produce the observed 1.31×1.31\times total-time speedup.

Factor reuse is particularly important for the doubled-granularity variants. In a separate solve-count sweep, at q=1q=1, AC2 is 51%51\% more expensive than AC and is slower on all 17 matrices, while each CAST variant remains within a few percent of its corresponding baseline. The additional construction cost is amortized as the number of right-hand sides increases; at q=250q=250, the aggregate comparison modestly favors CAST-2.

Table 2: Base-granularity comparison (AC versus CAST-1) on the 17 nontrivial SuiteSparse matrices. T250T_{250} is the total time for factor construction and 250 PCG solves to relative residual 10810^{-8}. Each entry is reported in seconds as the median over five independently seeded factor draws, and the speedup is the ratio of these medians, T250(AC)/T250(CAST-1)T_{250}(\textit{AC})/T_{250}(\textit{CAST-1}). Build and per-right-hand-side solve costs are normalized by the number of input nonzeros.
T250T_{250} (s) solve μ\mus/nnz build μ\mus/nnz
Matrix nnz AC CAST-1 speedup AC CAST-1 AC CAST-1
ecology2 4,995,991 227.96 181.51 1.26×\times 0.174 0.139 0.12 0.12
ecology1 4,996,000 226.49 181.90 1.25×\times 0.171 0.138 0.12 0.12
apache1 542,184 14.26 19.59 0.73×\times 0.097 0.137 0.09 0.09
Andrews 760,154 13.84 11.29 1.23×\times 0.070 0.059 0.19 0.23
shallow_water2 327,680 5.46 3.55 1.54×\times 0.059 0.044 0.07 0.10
torsion1 197,608 3.80 3.29 1.16×\times 0.074 0.066 0.07 0.08
obstclae 197,608 3.79 3.24 1.17×\times 0.073 0.065 0.07 0.08
shallow_water1 327,680 3.46 2.43 1.42×\times 0.039 0.029 0.06 0.10
jnlbrng1 199,200 3.35 4.36 0.77×\times 0.067 0.087 0.07 0.07
nopoly 70,842 1.48 1.29 1.14×\times 0.081 0.073 0.05 0.06
fv3 87,025 1.26 1.23 1.03×\times 0.057 0.056 0.05 0.06
fv2 87,025 0.72 0.64 1.12×\times 0.033 0.029 0.05 0.05
fv1 85,264 0.71 0.62 1.14×\times 0.033 0.029 0.05 0.05
nos7 4,617 0.102 0.066 1.55×\times 0.086 0.055 0.07 0.08
gr_30_30 7,744 0.085 0.078 1.09×\times 0.043 0.039 0.05 0.06
bcsstm24 3,562 0.084 0.100 0.85×\times 0.087 0.103 0.04 0.07
nos6 3,255 0.076 0.051 1.48×\times 0.092 0.062 0.06 0.07
Arithmetic mean of speedups 1.172×\times wins 14/17
Excluded (DNF): bcsstm25 — its conditioning places the 10810^{-8} target below attainable double-precision accuracy,
so a subset of right-hand sides never converges for any method.
Table 3: Doubled-granularity comparison (AC2 versus CAST-2) on the same 17 SuiteSparse matrices and under the same protocol as Table 2. Speedup is the ratio of these medians defined as T250(AC2)/T250(CAST-2)T_{250}(\textit{AC2})/T_{250}(\textit{CAST-2}).
T250T_{250} (s) solve μ\mus/nnz build μ\mus/nnz
Matrix nnz AC2 CAST-2 speedup AC2 CAST-2 AC2 CAST-2
ecology1 4,996,000 164.76 125.98 1.31×\times 0.124 0.095 0.25 0.28
ecology2 4,995,991 163.20 128.32 1.27×\times 0.124 0.097 0.27 0.28
Andrews 760,154 14.77 29.58 0.50×\times 0.075 0.144 0.63 2.09
apache1 542,184 12.01 9.85 1.22×\times 0.082 0.069 0.24 0.23
shallow_water2 327,680 4.71 3.31 1.42×\times 0.051 0.040 0.14 0.12
obstclae 197,608 3.24 2.92 1.11×\times 0.065 0.058 0.18 0.15
torsion1 197,608 3.23 2.92 1.11×\times 0.065 0.058 0.18 0.15
shallow_water1 327,680 2.95 2.45 1.21×\times 0.035 0.030 0.10 0.12
jnlbrng1 199,200 2.70 4.21 0.64×\times 0.053 0.083 0.19 0.14
nopoly 70,842 1.06 1.03 1.02×\times 0.059 0.058 0.10 0.11
fv3 87,025 0.94 0.98 0.96×\times 0.043 0.044 0.12 0.15
fv2 87,025 0.61 0.63 0.97×\times 0.027 0.029 0.11 0.11
fv1 85,264 0.60 0.61 0.99×\times 0.027 0.028 0.12 0.11
bcsstm24 3,562 0.085 0.099 0.85×\times 0.086 0.103 0.07 0.07
nos7 4,617 0.077 0.061 1.26×\times 0.065 0.051 0.14 0.16
gr_30_30 7,744 0.068 0.063 1.09×\times 0.034 0.032 0.12 0.13
nos6 3,255 0.061 0.049 1.25×\times 0.074 0.059 0.08 0.10
Arithmetic mean of speedups 1.069×\times wins 11/17
Excluded (DNF): bcsstm25 — its conditioning places the 10810^{-8} target below attainable double-precision accuracy,
so a subset of right-hand sides never converges for any method.
Table 4: The ten trivial SuiteSparse matrices, retained as correctness checks and excluded from aggregate comparisons. Every method converges in exactly one PCG iteration on every right-hand side. The reported totals, in seconds, include factor construction and 250 solves to relative residual 10810^{-8} and therefore primarily measure fixed construction and application overhead rather than preconditioner quality.
Matrix nnz AC AC2 CAST-1 CAST-2
bcsstm39 46,772 0.141 0.142 0.153 0.153
t3dl_e 20,360 0.058 0.059 0.063 0.063
t2dal_e 4,257 0.012 0.012 0.013 0.013
bcsstm21 3,600 0.012 0.012 0.012 0.012
bibd_81_2 3,240 0.010 0.010 0.011 0.011
bcsstm23 3,134 0.009 0.008 0.009 0.010
bcsstm26 1,922 0.006 0.006 0.006 0.006
bcsstm11 1,473 0.005 0.004 0.005 0.005
bcsstm08 1,074 0.003 0.003 0.003 0.003
bcsstm09 1,083 0.003 0.003 0.004 0.004

C.2 IPM Sequences on Chimera Graphs

Collection.

We evaluate on the maximum-flow interior-point-method sequences from the SDDM2023 benchmark suite of Gao, Kyng, and Spielman [10]. Each system is a weighted graph Laplacian with n=100,000n=100{,}000 vertices and arises from a Newton step of an interior-point method for undirected maximum flow. The underlying graphs are five independent draws, denoted i1,,i5i_{1},\ldots,i_{5}, from the Chimera generator in Laplacians.jl 33 3 https://github.com/danspielman/Laplacians.jl. Chimera graphs combine heterogeneous structures, including grid-like components, star joins, and graph products, and are designed to stress Laplacian solvers.

The five graph instances differ in their elimination geometry. Under CAST-1 elimination, instance i1i_{1} has mean pivot degree d¯=26.7\bar{d}=26.7 and maximum pivot degree dmax=363d_{\max}=363, whereas i3i_{3} has d¯=6.4\bar{d}=6.4 and dmax=48d_{\max}=48 (Table 5). For each instance, the benchmark provides IPM runs at five duality-gap targets,

ε{101,,105},\varepsilon\in\{10^{-1},\ldots,10^{-5}\},

with each run contributing between three and six Newton-step systems. The resulting collection contains 23232828 matrix systems per instance and 128128 systems in total. Relative performance is stable across the duality-gap targets. We therefore aggregate over Newton steps and targets within each underlying graph instance.

Configuration.

We use the same protocol, metrics, and hardware described in Section 5. Every timed solve satisfies the explicitly verified residual criterion

A𝐱𝐛2𝐛2108,\frac{\lVert A\mathbf{x}-\mathbf{b}\rVert_{2}}{\lVert\mathbf{b}\rVert_{2}}\leq 10^{-8},

and no method reaches the iteration cap. Within each instance we report the mean total workload over its systems and take speedups as ratios of these means, which measures the aggregate cost of processing an entire IPM sequence. Win counts give the complementary per-system view (Table 5).

Results.

CAST-1 is faster than AC on all 128128 systems (Tables  5 and  6.). The per-instance speedups range from 1.13×1.13\times to 1.24×1.24\times, and the per-system ratios range from 1.08×1.08\times to 1.31×1.31\times. The normalized solve cost is lower for CAST-1 on all five instances. Build costs are equal or nearly equal on i1i_{1} and i2i_{2} and higher for CAST-1 on i3i_{3}i5i_{5}; at q=250q=250, however, the reduction in solve cost dominates these construction differences.

The behavior of CAST-2 depends more strongly on the elimination-degree profile. On i3i_{3}, which has the smallest mean and maximum pivot degrees, CAST-2 is the fastest method: it is 1.16×1.16\times faster than AC2 and wins on all 2727 systems. On the other four instances, the AC2/CAST-2 ratios are 0.35×0.35\times, 0.76×0.76\times, 0.45×0.45\times, and 0.52×0.52\times, respectively.

This difference is associated with construction fill. At a degree-dd pivot, CAST-2 samples one spanning tree on 2d2d auxiliary copies. The tree contains 2d12d-1 auxiliary edges before within-block edges are discarded and parallel terminal-edge contributions are aggregated, compared with d1d-1 edges for CAST-1. On instances with high-degree pivots, the additional terminal-edge contributions propagate through subsequent eliminations. Accordingly, the median CAST-2 build cost relative to CAST-1 increases from 3.0×3.0\times on i3i_{3} and 4.6×4.6\times on i2i_{2} to approximately 10×10\times on i4i_{4} and i5i_{5}, and 13.1×13.1\times on i1i_{1}. The doubled-granularity baseline is also structure dependent: AC2 has lower mean total cost than AC on i2i_{2} and i3i_{3}, but higher cost on i1i_{1}, i4i_{4}, and i5i_{5}.

Choosing the splitting factor.

At q=250q=250, CAST-2 outperforms CAST-1 only on i3i_{3}. Its factor is 3.0×3.0\times more expensive to construct on this instance, so CAST-1 remains 1.38×1.38\times faster at q=4q=4. The two variants cross between q=10q=10 and q=50q=50, and CAST-2 is 1.17×1.17\times faster by q=250q=250. On the four instances with dmax92d_{\max}\geq 92, CAST-2 is 1.31.34.6×4.6\times slower than CAST-1 at q=250q=250. Within this collection, the results support a degree-aware empirical choice of ρ\rho. A light upper tail in the pivot-degree distribution favors ρ=2\rho=2 when the factor is reused sufficiently to amortize its higher construction cost. In contrast, ρ=1\rho=1 is preferable when high-degree pivots make downstream fill and factor construction dominant. The pivot-degree profile observed during a CAST-1 construction may inform this choice, although we treat this as an empirical heuristic rather than as an evaluated adaptive selection algorithm.

Table 5: Chimera-IPM total workload at q=250q=250 right-hand sides per factor. T250T_{250} includes factor construction and 250 PCG solves to verified relative residual 10810^{-8}. For each system–method pair we report the median over five independently seeded factor draws; displayed times are arithmetic means of these medians over the 23232828 systems associated with each underlying graph instance. Parentheses give the number of systems on which the corresponding CAST variant is faster.
T250T_{250} (s) Speedup (mean)
Instance nnz d¯\bar{d} dmaxd_{\max} AC AC2 CAST-1 CAST-2 AC/CAST-1\textit{AC}/\textit{CAST-1} AC2/CAST-2\textit{AC2}/\textit{CAST-2}
i1i_{1} 1,100,592 26.7 363 30.6 40.1 24.6 113.8 1.24×1.24\times (28/28) 0.35×0.35\times (0/28)
i2i_{2} 797,974 9.5 92 19.8 17.6 17.5 23.1 1.13×1.13\times (24/24) 0.76×0.76\times (0/24)
i3i_{3} 499,696 6.4 48 17.9 15.5 15.7 13.4 1.14×1.14\times (27/27) 1.16×1.16\times (27/27)
i4i_{4} 814,436 15.2 229 23.1 25.8 19.5 57.4 1.19×1.19\times (26/26) 0.45×0.45\times (0/26)
i5i_{5} 499,982 10.7 246 13.9 15.6 11.9 30.1 1.17×1.17\times (23/23) 0.52×0.52\times (0/23)
Across instances: AC/CAST-1 arithmetic mean 1.18×\mathbf{1.18\times}; CAST-1 is faster on 128/128128/128 systems.
Table 6: Chimera-IPM costs normalized by the number of input nonzeros. The relative construction cost of CAST-2 broadly follows the upper tail of the elimination-degree distribution: its build cost is 3.0×3.0\times that of CAST-1 on i3i_{3}, approximately 10×10\times on i4i_{4} and i5i_{5}, and 13.1×13.1\times on i1i_{1}.
Solve (μs/nnz\mu\mathrm{s}/\mathrm{nnz}) Build (μs/nnz\mu\mathrm{s}/\mathrm{nnz})
Instance AC AC2 CAST-1 CAST-2 AC AC2 CAST-1 CAST-2
i1i_{1} 0.105 0.139 0.087 0.392 0.40 1.15 0.41 5.37
i2i_{2} 0.093 0.083 0.083 0.110 0.16 0.37 0.16 0.73
i3i_{3} 0.133 0.115 0.116 0.099 0.10 0.32 0.15 0.45
i4i_{4} 0.109 0.119 0.091 0.269 0.25 0.68 0.28 2.85
i5i_{5} 0.101 0.114 0.089 0.230 0.18 0.59 0.28 2.80
Table 7: Spielman-IPM total cost at q=250q=250 right-hand sides per factor. T250T_{250} includes factor construction and 250250 PCG solves to verified relative residual 10810^{-8}. Each scale has 1010 systems. For each system–method pair we report the median over five independently seeded factor draws; displayed times are arithmetic means of these medians over the systems in each instance, and speedups are ratios of the displayed means, so they measure the aggregate cost of solving an entire IPM sequence. Parentheses report the number of systems on which the CAST variant is faster. AC and AC2 use the buffered application kernel.
T250T_{250} (s) Speedup
Scale nnz AC AC2 CAST-1 CAST-2 AC/CAST-1\textit{AC}/\textit{CAST-1} AC2/CAST-2\textit{AC2}/\textit{CAST-2}
k=100k=100 1,025,404 7.35 6.84 8.23 1.45 0.89×0.89\times (9/10) 4.72×4.72\times (10/10)
k=200k=200 8,080,604 59.68 54.65 48.19 12.30 1.24×1.24\times (9/10) 4.44×4.44\times (10/10)
k=300k=300 27,226,204 204.60 182.78 132.75 40.42 1.54×1.54\times (10/10) 4.52×4.52\times (10/10)
k=400k=400 64,321,604 409.21 403.72 290.87 99.81 1.41×1.41\times (10/10) 4.04×4.04\times (10/10)
Across scales: AC/CAST-1\textit{AC}/\textit{CAST-1} mean 1.27×1.27\times; AC2/CAST-2\textit{AC2}/\textit{CAST-2} mean 4.43×\mathbf{4.43\times}, with CAST-2 faster on 40/4040/40 systems.
Table 8: Spielman IPM ladder normalized by the number of input nonzeros, under the same protocol as Table 7.
solve μ\mus/nnz build μ\mus/nnz
Scale AC AC2 CAST-1 CAST-2 AC AC2 CAST-1 CAST-2
k=100k=100 0.0248 0.0247 0.0204 0.0054 0.032 0.061 0.049 0.049
k=200k=200 0.0248 0.0247 0.0157 0.0055 0.043 0.072 0.070 0.069
k=300k=300 0.0247 0.0246 0.0161 0.0055 0.042 0.103 0.073 0.077
k=400k=400 0.0247 0.0248 0.0168 0.0055 0.044 0.121 0.076 0.081
Table 9: Sachdeva-star results at q=250q=250 right-hand sides per factor. Iteration counts are means over the 250250 solves, and T250T_{250} includes factor construction and 250250 PCG solves to relative residual 10810^{-8}. For every instance–method pair, each entry is the median over three independently seeded factor draws. Speedups are ratios of the displayed total times. The PCG iteration cap is 5×1035\times 10^{3} and is never reached.
Iterations per solve T250T_{250} (s) Speedup
Scale nnz AC AC2 CAST-1 CAST-2 AC AC2 CAST-1 CAST-2 ACCAST-1\frac{AC}{\textit{CAST-1}} ACtwoCAST-2\frac{ACtwo}{\textit{CAST-2}}
k=50k=50 62,551 50.8 27.6 37.9 25.2 0.88 0.46 0.55 0.37 1.58×1.58\times 1.23×1.23\times
k=100k=100 500,101 108.9 37.9 68.3 28.9 15.8 5.49 7.77 3.32 2.04×2.04\times 1.65×1.65\times
k=200k=200 4,000,201 279.1 51.9 139.0 36.3 349 66.6 127 33.2 2.75×2.75\times 2.00×2.00\times
k=400k=400 32,000,401 693.4 58.6 287.9 42.8 7,519 638 1,986 298 3.79×3.79\times 2.14×2.14\times
k=600k=600 108,000,601 1,120.8 65.0 352.9 44.7 42,804 2,539 8,072 1,033 5.30×5.30\times 2.46×2.46\times
CAST-2 is the fastest method on every instance and every solve count measured.

C.3 IPM Sequences on Spielman Graphs

Collection.

The second IPM family from the SDDM2023 benchmark suite [10] forms a scaling ladder with one Spielman graph for each size parameter k{100,200,300,400}k\in\{100,200,300,400\}. Each graph contributes the Laplacians from the ten Newton steps of a maximum-flow interior-point-method run, yielding 4040 systems in total. The systems range from n=3.4×105n=3.4\times 10^{5} to 2.1×1072.1\times 10^{7} vertices and contain up to 6.4×1076.4\times 10^{7} nonzeros.

These graphs are structurally close to trees but have highly heterogeneous edge weights. Most of their vertices have degree at most two, while the number of edges beyond a spanning tree ranges from 5,1005{,}100 to 80,40080{,}400. Each graph also contains kk hub vertices of input degree 2k2k. Across the IPM trajectory, edge weights span between 9.19.1 and 14.314.3 orders of magnitude, increasing primarily during the first approximately four Newton steps and then stabilizing.

Despite the high input degrees of the hubs, minimum-degree elimination produces no large pivots. Path vertices are eliminated first, and every hub has degree at most five when it is eventually eliminated. The mean pivot degree is 2.002.00 at every scale. Both CAST variants produce factors of the same measured size.

Configuration.

We use the protocol and metrics of Section 5. Unless otherwise stated, each factor is evaluated on q=250q=250 right-hand sides. For every system–method pair, the reported value is the median over five independently seeded factor draws. For each scale (1010 systems) we report the mean total workload over its systems and take speedups as ratios of these means, which measures the aggregate cost of processing an entire IPM sequence. Win counts give the complementary per-system view. The larger k{500,600}k\in\{500,600\} sequences, containing approximately 1.5×1081.5\times 10^{8} and 2.2×1082.2\times 10^{8} nonzeros, exceed the memory capacity of the benchmark machine for every method under the multi-solve protocol and are therefore excluded.

ρ=2\rho=2: fast iteration convergence.

CAST-2 converges in one to two PCG iterations on every recorded solve across all four problem scales. The worst verified relative residual is 5.5×1095.5\times 10^{-9}, which is below the requested tolerance of 10810^{-8}. At q=250q=250, the available comparisons give mean speedups of 4.044.044.72×4.72\times over AC2.

The normalized solve cost of CAST-2 remains between 0.00540.0054 and 0.0055μs/nnz0.0055\,\mu\mathrm{s}/\mathrm{nnz} on the reported scales. The improved convergence does not increase the measured factor size: CAST-1 and CAST-2 both produce factors containing approximately 0.660.66 times as many nonzeros as the input, and their construction costs are similar at the reported scales.

This behavior is associated with the uniformly small pivot degrees. At a degree-dd pivot, where d5d\leq 5 throughout this family, CAST-1 samples a spanning tree with d1d-1 edges. In contrast, CAST-2 samples one spanning tree on 2d2d auxiliary copies, containing 2d12d-1 auxiliary edges before within-block edges are discarded and parallel terminal-edge contributions are aggregated. Two-way splitting therefore increases local sampling granularity while remaining inexpensive when dd is small.

The low-iteration convergence is an empirical property of this graph family. It does not imply that CAST-2 reproduces every Schur clique exactly, nor is CAST-2 the union of two independent trees on the original terminal neighborhood. Rather, the resulting factor is sufficiently accurate for PCG to satisfy the requested tolerance after one to two iterations on every tested Spielman system.

ρ=1\rho=1: reliability on extreme-weight systems.

The base ρ=1\rho=1 estimator is less consistent on these extreme-weight, near-tree systems, where an unlucky draw can produce a noticeably worse factor. At k=100k=100 this is visible in the aggregate, which favors AC despite CAST-1 being faster on nine of ten systems: one system dominates the scale total (Table 7).

Comparison with Chimera-IPM.

The Spielman and Chimera families exhibit complementary behavior. On the Chimera instances with heavy elimination-degree tails (Section C.2), the additional local contributions introduced by ρ=2\rho=2 propagate through subsequent eliminations and substantially increase construction cost. On the Spielman family, every pivot has degree at most five, so the same increase in local sampling granularity remains inexpensive and yields convergence in one to two iterations.

Together, these results support a degree-aware empirical choice of the splitting factor. A uniformly light elimination-degree distribution favors ρ=2\rho=2 when the factor is reused, whereas ρ=1\rho=1 is preferable when high-degree pivots make downstream fill and construction cost dominant. We treat this as an empirical selection heuristic rather than as an evaluated adaptive algorithm.

C.4 Sachdeva-star stress tests

Collection.

The Sachdeva-star family is a synthetic construction on which the AC estimator is known to require rapidly increasing iteration counts [10]. For an even parameter kk, each instance consists of a hub connected by unit-weight gateway edges to k/2k/2 disjoint cliques of size kk. All edges have unit weight. The resulting Laplacian has

n=1+k22andnnz=k32+k+1.n=1+\frac{k^{2}}{2}\qquad\text{and}\qquad\mathrm{nnz}=\frac{k^{3}}{2}+k+1.

We evaluate

k{50,100,200,400,600},k\in\{50,100,200,400,600\},

corresponding to n=1,251n=1{,}251 through 180,001180{,}001 vertices and up to 108,000,601108{,}000{,}601 stored nonzeros.

Unlike the Spielman family, whose difficulty arises from extreme weights on near-tree graphs, the Sachdeva-star instances are unweighted and structurally challenging. Eliminations within the clique blocks create dense local neighborhoods, and the quality of the base-granularity estimators deteriorates as kk increases.

Configuration.

We use the protocol and metrics of Section 5. Each factor is evaluated on q=250q=250 right-hand sides, and for every instance–method pair the reported value is the median over three independently seeded factor draws. Because iteration growth is a primary quantity of interest on this family, we raise the PCG iteration cap from 10310^{3} to 5×1035\times 10^{3}. No method reaches this cap. Every solve satisfies the verified residual criterion

A𝐱𝐛2𝐛2108.\frac{\lVert A\,\mathbf{x}-\mathbf{b}\rVert_{2}}{\lVert\mathbf{b}\rVert_{2}}\leq 10^{-8}.

Results.

Table 9 shows a clear separation between the base- and doubled-granularity variants. The mean iteration count of AC increases from 50.850.8 at k=50k=50 to 1,120.81{,}120.8 at k=600k=600. CAST-1 also becomes less effective as the instances grow, but its iteration count increases more slowly, from 37.937.9 to 352.9352.9. The doubled-granularity variants are substantially more stable. Across the same range, AC2 increases from 27.627.6 to 65.065.0 iterations per solve, while CAST-2 increases from 25.225.2 to 44.744.7. At q=250q=250, CAST-2 is faster than AC2 on every instance, with speedup increasing monotonically from 1.23×1.23\times at k=50k=50 to 2.46×2.46\times at k=600k=600. Relative to AC, its total-time advantage at the largest instance is

42,8041,03341.4×.\frac{42{,}804}{1{,}033}\approx 41.4\times.

A separate solve-count sweep shows that CAST-2 is already the fastest method at q=1q=1, so its advantage on this family does not depend on amortizing construction cost.

Interpretation.

Unlike on the Spielman family, CAST-2 does not reduce these systems to one or two PCG iterations. The clique-dominated elimination structure remains nontrivial after contraction, and its mean iteration count grows from 25.225.2 to 44.744.7 along the ladder. Nevertheless, the growth is mild compared with the base-granularity methods. Although clique blocks produce high-degree pivots, the additional contributions of ρ=2\rho=2 fall within blocks that are already dense, so they do not propagate as new fill — the opposite of the Chimera instances with heavy degree tails, where the extra contributions land on sparse neighborhoods and compound through later eliminations. This behavior is consistent with the local second-moment improvement of the ρ=2\rho=2 construction: finer splitting reduces local sampling variability, although the theory does not by itself imply a global iteration bound. The Spielman and Sachdeva families therefore illustrate two distinct benefits of ρ=2\rho=2. On the low-degree Spielman eliminations, CAST-2 empirically produces an almost exact preconditioner and converges in one to two iterations. On the clique-dominated Sachdeva instances, it does not eliminate iteration growth, but it limits that growth sufficiently to provide the best total time throughout the tested ladder. These results agree qualitatively with those reported in [10]: the method ordering and the growth of the base-granularity iteration counts are unchanged, although absolute iteration counts here are approximately 15%15\%30%30\% higher, since our right-hand sides are Gaussians projected onto 𝟏\mathbf{1}^{\perp} rather than the range-restricted vectors used there.