arXiv reader

Multiple Packing: Lower Bounds via Infinite Constellations

Yihan Zhang and Shashank Vatedka

arXiv
2211.04407v2 · PDF · 9 November 2022
Categories
math.MG, cs.IT, math.IT
Licence
CC BY 4.0 The site shows the text.

Abstract

We study the problem of high-dimensional multiple packing in Euclidean space. Multiple packing is a natural generalization of sphere packing and is defined as follows. Let N>0 and L\in\mathbb{Z}_{\ge2}. A multiple packing is a set \mathcal{C} of points in \mathbb{R}^n such that any point in \mathbb{R}^n lies in the intersection of at most L-1 balls of radius \sqrt{nN} around points in \mathcal{C}. Given a well-known connection with coding theory, multiple packings can be viewed as the Euclidean analog of list-decodable codes, which are well-studied for finite fields. In this paper, we derive the best known lower bounds on the optimal density of list-decodable infinite constellations for constant L under a stronger notion called average-radius multiple packing. To this end, we apply tools from high-dimensional geometry and large deviation theory.

Items 19

Theorem

Theorem 1

598S

Let N>0. Then for any \varepsilon>0,

  1. There exist (N,L-1)-multiple packings of rate \frac{1}{2}\ln\frac{1}{2\pi eN} - \varepsilon for some L = {\mathcal O}\mleft(\frac{1}{\varepsilon}\ln\frac{1}{\varepsilon}\mright);

  2. Any (N,L-1)-multiple packing of rate \frac{1}{2}\ln\frac{1}{2\pi eN} + \varepsilon must satisfy L = e^{\Omega(n\varepsilon)}.

Therefore, C_{\mathrm{LD}}(N) = \frac{1}{2}\ln\frac{1}{2\pi eN}.

Theorem

Theorem 2

OL46

For any N>0, \overline C_{\mathrm{LD}}(N) = \frac{1}{2}\ln\frac{1}{2\pi eN}.

Lemma

Lemma 3 (Change of variable)

Z5OJ

Let {\mathcal U}\subset{\mathbb R}^n be an open set and \varphi\colon{\mathcal U}\to{\mathbb R}^n be an injective differentiable function with continuous partial derivatives, the Jacobian of which is nonzero for every {\underline x}\in{\mathcal U}. Then for any compactly supported, continuous function f \colon \varphi({\mathcal U})\to{\mathbb R}, the substitution {\underline v} = \varphi({\underline u}) yields the following formula

\begin{aligned} \int_{\varphi({\mathcal U})} f({\underline v}) \mathrm{d}{\underline v} &= \int_{\mathcal U} f(\varphi({\underline u})) \mleft|\det(\nabla\varphi)({\underline u})\mright| \mathrm{d} {\underline u}, \end{aligned}

where \nabla\varphi\in{\mathbb R}^{n\times n} denotes the Jacobian matrix of \varphi.

Theorem

Theorem 4 (Laplace’s method)

WLO9

Suppose f\colon{\mathbb R}^d\to{\mathbb R} is a twice continuously differentiable function on {\mathcal A}\subset{\mathbb R}^d, and there exists a unique point \vec t^*\in\operatorname{int}({\mathcal A}) (where \operatorname{int}(\cdot) denotes the interior of a set) such that

\begin{aligned} f(\vec t^*) = \min_{\vec t\in{\mathcal A}} f(\vec t),\quad (\operatorname{Hess} f)(\vec t^*) \succ 0, \end{aligned}

where \operatorname{Hess} f\in{\mathbb R}^{d\times d} denotes the Hessian matrix of f. Suppose g(\vec t) is positive. Then

\begin{aligned} \int_{{\mathcal A}} g(\vec t)e^{-Mf(\vec t)} \mathrm{d}\vec t & \stackrel{M\to\infty}{\asymp} e^{-Mf(\vec t^*)}\mleft(\frac{2\pi}{M}\mright)^{d/2} \frac{g(\vec t^*)}{\sqrt{\det((\operatorname{Hess} f)(\vec t^*))}} . \end{aligned}
Theorem

Theorem 5

AHS1

Let \mleft\{{\mathbf x}_i\mright\}_{i = 1}^n be a sequence of i.i.d. real-valued random variables. Let {\mathbf s}_n \coloneq\frac{1}{n}\sum_{i = 1}^n{\mathbf x}_i. Then for any closed {\mathcal F}\subset{\mathbb R},

\begin{aligned} \limsup_{n\to\infty} \frac{1}{n}\ln\Pr\mleft[{\mathbf s}_n\in {\mathcal F}\mright] &\le -\inf_{x\in {\mathcal F}} \sup_{\lambda\in{\mathbb R}}\mleft\{ \lambda x - \ln\mathbb{E}\mleft[e^{\lambda {\mathbf x}_1}\mright] \mright\}; \end{aligned}

and for any open {\mathcal G}\subset{\mathbb R},

\begin{aligned} \liminf_{n\to\infty} \frac{1}{n}\ln\Pr\mleft[{\mathbf s}_n\in {\mathcal G}\mright] &\ge -\inf_{x\in {\mathcal G}} \sup_{\lambda\in{\mathbb R}}\mleft\{\lambda x - \ln\mathbb{E}\mleft[e^{\lambda {\mathbf x}_1}\mright]\mright\}. \end{aligned}

Furthermore, when {\mathcal F} or {\mathcal G} corresponds to the upper (resp. lower) tail of {\mathbf s}_n, the maximizer \lambda\ge0 (resp. \lambda\le0).

Definition

Definition 1 (Multiple packing)

2DE8

Let N>0 and L\in{\mathbb Z}_{\ge2}. A subset {\mathcal C} \subseteq {\mathbb R}^n is called a (N,L-1)-list-decodable code (a.k.a. an (N,L-1)-multiple packing) if for every {\underline y}\in{\mathbb R}^n,

\begin{aligned} \mleft|{\mathcal C}\cap{\mathcal B}^n({\underline y}, \sqrt{nN})\mright| \le L-1 . \end{aligned}

The rate (a.k.a. density) of {\mathcal C} is defined as

\begin{aligned} R({\mathcal C}) \coloneqq& \limsup_{K\to\infty} \frac{1}{n}\ln\frac{\mleft|{\mathcal C}\cap (K{\mathcal B})\mright|}{\mleft|K{\mathcal B}\mright|}, \end{aligned}

where {\mathcal B} is an arbitrary centrally symmetric connected compact set in {\mathbb R}^n with nonempty interior.

Remark

Remark 1

VRS9

Common choices of {\mathcal B} include the unit ball {\mathcal B}^n, the unit cube [-1,1]^n, the fundamental Voronoi region {\mathcal V}_\Lambda of a (full-rank) lattice \Lambda\subset{\mathbb R}^n, etc. Some choices of {\mathcal B} may be more convenient than the others for analyzing certain ensembles of packings. Therefore, we do not fix the choice of {\mathcal B} in Definition 1.

Remark

Remark 2

VF59

The rate of a packing (as per Definition 1) is also called the normalized logarithmic density in the literature. It measures the the normalized number of points per unit volume.

Definition

Definition 2 (Chebyshev radius and average squared radius of a list)

KLUW

Let {\underline x}_1,\cdots,{\underline x}_L be L points in {\mathbb R}^n. Then the squared Chebyshev radius \operatorname{rad}^2({\underline x}_1,\cdots,{\underline x}_L) of {\underline x}_1,\cdots,{\underline x}_L is defined as the (squared) radius of the smallest ball containing {\underline x}_1,\cdots,{\underline x}_L, i.e.,

\begin{aligned} \operatorname{rad}^2({\underline x}_1,\cdots,{\underline x}_L) \coloneqq& \min_{{\underline y}\in{\mathbb R}^n} \max_{i\in[L]} \mleft\|{\underline x}_i - {\underline y}\mright\|_{2}^2. \end{aligned}

The average squared radius \overline\operatorname{rad}^2({\underline x}_1,\cdots,{\underline x}_L) of {\underline x}_1,\cdots,{\underline x}_L is defined as the average squared distance to the centroid, i.e.,

\begin{aligned} \overline\operatorname{rad}^2({\underline x}_1,\cdots,{\underline x}_L) \coloneqq& \frac{1}{L}\sum_{i = 1}^L{\mleft\|{\underline x}_{i} - {\underline x}\mright\|_{2}^2}, \end{aligned}

where {\underline x} \coloneqq \frac{1}{L}\sum_{i = 1}^L{\underline x}_i is the centroid of {\underline x}_1,\cdots,{\underline x}_L. We refer to the square root of the average squared radius as the average radius of the list.

Remark

Remark 3

NFMM

One should note that for an L-list {\mathcal L} of points, the smallest ball containing {\mathcal L} is not necessarily the same as the circumscribed ball, i.e., the ball such that all points in {\mathcal L} live on the boundary of the ball. The circumscribed ball of the polytope \operatorname{conv}\mleft\{{\mathcal L}\mright\} spanned by the points in {\mathcal L} may not exist. If it does exist, it is not necessarily the smallest one containing {\mathcal L}. However, whenever it exists, the smallest ball containing {\mathcal L} must be the circumscribed ball of a certain subset of {\mathcal L}.

Remark

Remark 4

WFGA

We remark that the motivation behind the definition of average squared radius (Definition 2) is to replace the maximization in Definition 2 with average.

\begin{aligned} \min_{{\underline y}\in{\mathbb R}^n} \mathop{\mathbb{E}}_{{\mathbf i}\sim[L]}\mleft[\mleft\|{\underline x}_{\mathbf i} - {\underline y}\mright\|_{2}^2\mright] &= \min_{{\underline y}\in{\mathbb R}^n} \frac{1}{L}\sum_{i = 1}^L \sum_{j = 1}^n \mleft({\underline x}_i(j) - {\underline y}(j)\mright)^2 \\ &= \min_{(y_1,\cdots,y_n)\in{\mathbb R}^n} \sum_{j = 1}^n \frac{1}{L}\sum_{i = 1}^L\mleft({\underline x}_i(j) - y_j\mright)^2 \\ &= \sum_{j = 1}^n \min_{y_j\in{\mathbb R}} \frac{1}{L}\sum_{i = 1}^L\mleft({\underline x}_i(j) - y_j\mright)^2 \\ &= \frac{1}{L}\sum_{i = 1}^L\sum_{j = 1}^n\mleft({\underline x}_i(j) - y_j^*\mright)^2 \\ &= \frac{1}{L} \sum_{i = 1}^L \mleft\|{\underline x}_i - {\underline x}\mright\|_{2}^2. \end{aligned}

Remark 4 holds since the inner summation \frac{1}{L}\sum_{i = 1}^L \mleft({\underline x}_i(j) - {\underline y}(j)\mright)^2 in Remark 4 only depends on y_j among all y_1,\cdots,y_n. Remark 4 follows since for each j, the minimizer of the minimization in Remark 4 is y_j^* \coloneqq \frac{1}{L}\sum_{i = 1}^L{\underline x}_i(j). In Remark 4, the minimizer {\underline y}^* equals {\underline x} \coloneqq \frac{1}{L}\sum_{i = 1}^L{\underline x}_i.

Definition

Definition 3 (Chebyshev radius and average squared radius of a code)

GKEU

Given a code {\mathcal C}\subset{\mathbb R}^n of rate R, the squared (L-1)-list-decoding radius of {\mathcal C} is defined as

\begin{aligned} \operatorname{rad}^2_L({\mathcal C}) \coloneqq& \min_{{\mathcal L}\in\binom{{\mathcal C}}{L}} \operatorname{rad}^2({\mathcal L}). \end{aligned}

The (L-1)-average squared radius of {\mathcal C} is defined as

\begin{aligned} \overline\operatorname{rad}^2_L({\mathcal C}) \coloneqq& \min_{{\mathcal L}\in\binom{{\mathcal C}}{L}} \overline\operatorname{rad}^2({\mathcal L}). \end{aligned}
Definition

Definition 4 (Average-radius multiple packing)

34F7

A subset {\mathcal C}\subset{\mathbb R}^n is called an (N,L-1)-average-radius list-decodable code (a.k.a. an (N,L-1)-average-radius multiple packing) if \overline\operatorname{rad}^2_L({\mathcal C})>nN. The rate (a.k.a. density) R({\mathcal C}) of {\mathcal C} is given by Definition 1. The (N,L-1)-average-radius list-decoding capacity (a.k.a. (N,L-1) average-radius multiple packing density) is defined as

\overline C_{L-1}(N) \coloneqq \limsup_{n\to\infty} \limsup_{{\mathcal C} \subseteq {\mathbb R}^n\colon \overline\operatorname{rad}^2_L({\mathcal C})>nN} R({\mathcal C}) .

The squared (L-1)-average-radius list-decoding radius at rate R (without input constraint) is defined as

\begin{aligned} \overline\operatorname{rad}^2_L(R) \coloneqq& \limsup_{n\to\infty} \limsup_{{\mathcal C} \subseteq {\mathbb R}^n \colon R({\mathcal C})\ge R} \overline\operatorname{rad}^2_L({\mathcal C}). \end{aligned}
Uses Definition 1 · Used by Theorem 6, Lemma 9
Theorem

Theorem 6

5862

Let N>0 and L\in{\mathbb Z}_{\ge2}. Let {\mathcal C}\subset{\mathbb R}^n be an (N,L-1)-multiple packing. Then \Delta({\mathcal C}) \stackrel{n\to\infty}{\asymp} R({\mathcal C}) + \frac{1}{2}\ln(2\pi eN).

Theorem

Theorem 7

3T86

Let L\in{\mathbb Z}_{\ge2} and {\underline x}_1,\cdots,{\underline x}_L\in{\mathbb R}^n. Then the squared Chebyshev radius of {\underline x}_1,\cdots,{\underline x}_L admits the following alternative representations:

  1. \begin{aligned} \operatorname{rad}^2({\underline x}_1,\cdots,{\underline x}_L) &= \max_{{\vec z}\in\Delta_L} \sum_{i = 1}^L{\vec z}(i)\mleft\|{\underline x}_i - {\underline y}_{\vec z}\mright\|_{2}^2, \end{aligned} where {\underline y}_{\vec z} \coloneqq \sum_{i = 1}^L{\vec z}(i){\underline x}_i and \Delta_L denotes the probability simplex on [L];

  2. \begin{aligned} \operatorname{rad}^2({\underline x}_1,\cdots,{\underline x}_L) &= \lim_{p\to\infty} \operatorname{rad}^{(p)}({\underline x}_1,\cdots,{\underline x}_L), \end{aligned} where

    \begin{aligned} \operatorname{rad}^{(p)}({\underline x}_1,\cdots,{\underline x}_L) &\coloneqq \mleft(\min_{{\underline y}\in{\mathbb R}^n}\frac{1}{L}\sum_{i = 1}^L\mleft\|{\underline x}_i - {\underline y}\mright\|_{2}^{2p}\mright)^{1/p}; \end{aligned}
  3. there exists a unique 1\le q\le\infty depending on {\underline x}_1,\cdots,{\underline x}_L such that

    \begin{aligned} \operatorname{rad}^2({\underline x}_1,\cdots,{\underline x}_L) &= \mleft(\frac{1}{L}\sum_{i = 1}^L\mleft\|{\underline x}_i - {\underline x}\mright\|_{2}^{2q}\mright)^{1/q}, \end{aligned}

    and {\underline x}\coloneqq\frac{1}{L}\sum_{i = 1}^L{\underline x}_i.

The average squared radius of {\underline x}_1,\cdots,{\underline x}_L admits the following alternative representations:

  1. \begin{aligned} \overline\operatorname{rad}^2({\underline x}_1,\cdots,{\underline x}_L) &= \frac{1}{L}\sum_{i = 1}^L\mleft\|{\underline x}_i\mright\|_{2}^2 - \mleft\|{\underline x}\mright\|_{2}^2; \end{aligned}

  2. \begin{aligned} \overline\operatorname{rad}^2({\underline x}_1,\cdots,{\underline x}_L) &= \frac{L-1}{L^2}\sum_{i = 1}^L\mleft\|{\underline x}_i\mright\|_{2}^2 - \frac{1}{L^2}\sum_{(i,j)\in[L]^2:i\ne j} \mleft\langle{\underline x}_i,{\underline x}_j\mright\rangle; \end{aligned}

  3. \begin{aligned} \overline\operatorname{rad}^2({\underline x}_1,\cdots,{\underline x}_L) &= \frac{1}{2L^2}\sum_{(i,j)\in[L]^2:i\ne j} \mleft\|{\underline x}_i - {\underline x}_j\mright\|_{2}^2. \end{aligned}

Theorem

Theorem 8

Q3YI

For any N>0 and L\in{\mathbb Z}_{\ge2}, the (N,L-1)-average-radius list-decoding capacity is at least

\begin{aligned} \overline C_{L-1}(N) &\ge \frac{1}{2}\ln\frac{L-1}{2\pi eNL} - \frac{1}{2(L-1)}\ln L. \end{aligned}
Remark

Remark 5

C1NJ

Note that the above bound (Theorem 8) approaches \frac{1}{2}\ln\frac{1}{2\pi eN} as L\to\infty. The latter quantity is known to be the list-decoding capacity for asymptotically large L (see ?). On the extreme, when L=2, the above bound becomes \frac{1}{2}\ln\frac{1}{8\pi eN} which recovers the best known bound due to Minkowski [minkowski-sphere-pack].

Lemma

Lemma 9

XBJN

There exists a finite codebook {\mathcal C}_K supported over {\mathcal A}, having minimum average squared radius at least \sqrt{nN} and density

\frac{1}{n}\ln \frac{|{\mathcal C}_K|}{|{\mathcal A}|} \geq \frac{1}{2}\ln\frac{L-1}{2\pi eNL} - \frac{1}{2(L-1)}\ln L +o(1).
Lemma

Lemma 10

0QCK

For any {\underline{\mathbf{x}}}_1,\cdots,{\underline{\mathbf{x}}}_L drawn independently and uniformly at random from {\mathcal A}, we have

\Pr\mleft[\overline\operatorname{rad}^2({\underline{\mathbf{x}}}_1,\cdots,{\underline{\mathbf{x}}}_L) \le nN\mright] = e^{nE(K)+o(n)} ,

where the o(n) term is independent of K, and

E(K)\coloneqq \frac{L-1}{2}\ln\frac{L-1}{2\pi eNL} - \frac{1}{2}\ln L + (L-1)\ln (2K).

Source and licence

The text on this page is from arXiv:2211.04407v2 by Yihan Zhang and Shashank Vatedka, under the licence CC BY 4.0. The corpus made these changes: it read the items out of the LaTeX source, it expanded the macros of the paper, it put each proof after its statement, and it converted the text to HTML. The formulas are the TeX of the paper, and KaTeX renders them. A formula or a reference can look different from the PDF. The page is published under CC BY 4.0.

The record of each item is in analysis/objects/2211/2211.04407.jsonl.