arXiv reader

Model-Driven Deep Learning for Distributed Detection with Low-Bit Quantization

Wei Guo, Meng He, Chuan Huang, Hengtao He, Shenghui Song, Jun Zhang and Khaled B. Letaief

arXiv
2610.21759v1 · PDF · 15 October 2026
Categories
cs.IT, math.IT
Licence
CC BY 4.0 The site shows the text.

Abstract

Distributed detection plays a fundamental role in communication-efficient collaborative inference over large-scale networks, where spatially distributed nodes must cooperate using severely quantized messages due to bandwidth constraints. While low-bit quantization is essential for reducing communication overhead, it can significantly degrade detection performance, particularly when prior knowledge of observation noise is unavailable. To address this challenge, we propose a model-driven deep learning framework for distributed detection with low-bit quantization. For fixed local quantizers, we first derive the exact finite-sensor maximum a posteriori (MAP) detection error and prove that, under conditionally independent and identically distributed (i.i.d.) observations, independent local randomizations, and a common quantization-level constraint, identical quantizers preserve the supremum of the average network Chernoff information. Guided by these results, we develop a binary probabilistic quantizer with a trainable neural probability controller and design a tree-structured probabilistic quantizer for scalable multi-bit quantization. The exact finite-sensor MAP error provides the training objective for the binary quantizer, while we derive a computationally tractable Bhattacharyya surrogate objective for training the multi-bit quantizer. For both cases, we derive analytical MAP fusion rules based on the class-conditional probability mass functions (PMFs) of the quantized messages. When the observation statistics are unknown, these PMFs are estimated from held-out labeled data, yielding plug-in MAP detectors. Simulation results show that the proposed method approaches centralized-oracle performance at higher quantization resolutions and remains effective under changes in network size and test-time signal amplitude.

Items 12

Remark

Remark 1

4BII

Equation (?) shows that, after adopting the optimal MAP detector, the minimum detection error probability depends on the local quantizers only through the induced conditional distributions p(\mathbf{u}|H_0) and p(\mathbf{u}|H_1). Therefore, the detector need not be optimized separately, and P_E(H,\mathbf{u}) provides an exact finite-sensor objective for quantizer design.

Lemma

Lemma 1

4UWL

Suppose that the local observations are conditionally i.i.d. given H, and that all sensors are subject to the same L-level quantization constraint. blackAssume that the local quantization randomizations are mutually independent across sensors and independent of (H,X_1,\ldots,X_K). Then restricting all sensors to an identical quantizer does not change the supremum of the average network Chernoff information over all possibly heterogeneous local quantizers. Specifically,

\begin{aligned} &\textcolor{black}{\sup_{\{p(u_k|X_k)\}_{k=1}^{K}}}C(H,\mathbf{u})=\\ &\textcolor{black}{\sup_{p(u|X)}}\left\{-\min_{0\leq\lambda\leq 1}\log\left[\sum_{u=0}^{L-1}p(u|H_{0})^{\lambda}p(u|H_{1})^{1-\lambda}\right]\right\}, \end{aligned}

where p(u|H_i)=\mathbb{E}_{X|H_i}[p(u|X)],\ i=0,1. In particular, if p(u|X)^* attains the single-sensor blacksupremum on the right-hand side of (1), deploying p(u|X)^* at every sensor is globally optimal for maximizing the average network Chernoff information.

Proof of Lemma 1

The proof is provided in Appendix ?.

Proposition

Proposition 1

KSCD

If the binary quantized data u_1,\ldots,u_K from all sensors are conditionally i.i.d. given H, then the MAPDEP under binary quantization is given by

\begin{aligned} P_E^{\text{Binary}}\triangleq\sum_{k=0}^{K}C_{K}^{k}\min&\left\{\pi_0(\gamma(H_0))^k(1-\gamma(H_0))^{K-k},\right.\\ &\left.\pi_1(\gamma(H_1))^k(1-\gamma(H_1))^{K-k}\right\}, \end{aligned}

where

\gamma(H)=P(u=1|H)=\mathbb{E}_{X|H}[p(u=1|X)],\ H\in\{H_0,H_1\},

denotes the conditional probability that a quantized message equals ‘1’ given H, and C_K^k is the binomial coefficient.

Proof of Proposition 1

Please see Appendix ?.

Theorem

Theorem 1

DLQ1

If the binary quantized data u_k, k=1,\ldots,K, from all sensors are conditionally i.i.d. given H, then detection using the quantized data \mathbf{u}=[u_1,\dots,u_K]^T or their average \bar{u} = \frac{1}{K}\sum_{k=1}^{K} u_k achieves the same minimum detection error probability, i.e.,

\begin{aligned} P_{E}(H,\mathbf{u})=&P_E^{\text{Binary}}\\ =&P_{E}(H,\bar{u})\triangleq\sum_{\bar{u}}\min\left\{\pi_0p(\bar{u}|H_0),\pi_1p(\bar{u}|H_1)\right\}, \end{aligned}

where P_{E}(H,\bar{u}) is the minimum detection error probability achieved by using \bar{u} to detect H.

Proof of Theorem 1

Please see Appendix ?.

Proposition

Proposition 2

C79I

Given an observation X, suppose the binary codeword \mathbf b=[b_1,\dots,b_M]^T is generated according to the sequential dithering procedure. Denote the induced distribution of this random output by P_{\mathrm{SD}}(\cdot\mid X). Then, for any level u_l\in\mathcal U with associated codeword \mathbf b^{(l)}=[b_1^{(l)},\dots,b_M^{(l)}]^T and induced internal-node sequence \{v_0^{(l)},v_1^{(l)},\dots,v_{M-1}^{(l)}\} defined by (?), we have

P_{\mathrm{SD}}(u=u_l\mid X) = [\mathbf q(X)]_l,

where [\mathbf q(X)]_l is the model-induced probability defined in (?).

Proof of Proposition 2

The proof is provided in Appendix ?.

Remark

Remark 2

CNZH

Equation (?) provides a computationally tractable Bhattacharyya design objective whose evaluation is linear in the number of quantization levels. Its optimized Chernoff counterpart characterizes the asymptotic Bayesian error exponent, and (?) attains the same exponent when \lambda^*=1/2. At finite K, it serves as an upper-bound surrogate rather than the exact MAP error.

Theorem

Theorem 2

8WKE

If the M-bit quantized data from all sensors are conditionally i.i.d. given H, then detection using the full quantized data, i.e., the collection of binary codewords \mathbf{B}=[\mathbf{b}_1,\mathbf{b}_2,\ldots,\mathbf{b}_K]^T, or their mean one-hot vector \bar{\mathbf{v}}=\frac{1}{K}\sum_{k=1}^{K}\mathbf{v}_k achieves the same minimum detection error probability, i.e.,

\begin{aligned} P_E\left(H, \mathbf{B}\right) & = P_E\left(H, \bar{\mathbf{v}}\right)\\ & = \sum_{\bar{\mathbf{v}}}\min\left\{\pi_0p(\bar{\mathbf{v}} | H_0), \pi_1p(\bar{\mathbf{v}} | H_1)\right\}. \end{aligned}
Proof of Theorem 2

The proof is provided in Appendix ?.

Source and licence

The text on this page is from arXiv:2610.21759v1 by Wei Guo, Meng He, Chuan Huang, Hengtao He, Shenghui Song, Jun Zhang and Khaled B. Letaief, under the licence CC BY 4.0. The corpus made these changes: it read the items out of the LaTeX source, it expanded the macros of the paper, it put each proof after its statement, and it converted the text to HTML. The formulas are the TeX of the paper, and KaTeX renders them. A formula or a reference can look different from the PDF. The page is published under CC BY 4.0.

The record of each item is in analysis/objects/2610/2610.21759.jsonl.