<p>Let <InlineEquation ID="IEq1"> <EquationSource Format="TEX">\(X=(X_1,\ldots , X_p)\)</EquationSource> </InlineEquation> be the vector of covariates in a regression problem and let <InlineEquation ID="IEq2"> <EquationSource Format="TEX">\({\widetilde{X}}\)</EquationSource> </InlineEquation> be a knockoff copy of <i>X</i> (in the sense of Candes et al. <CitationRef CitationID="CR8">2018</CitationRef>). In a number of applications, mainly in genetics, there is a finite set <i>F</i> such that <InlineEquation ID="IEq3"> <EquationSource Format="TEX">\(X_i\in F\)</EquationSource> </InlineEquation> for each <InlineEquation ID="IEq4"> <EquationSource Format="TEX">\(i=1,\ldots ,p\)</EquationSource> </InlineEquation>. Despite the latter fact, to make variable selection with the knockoff procedure, <i>X</i> is usually modeled as an absolutely continuous random vector. While comprehensible from the point of view of applications, this approximate procedure does not make sense theoretically, since <i>X</i> is supported by the finite set <InlineEquation ID="IEq5"> <EquationSource Format="TEX">\(F^p\)</EquationSource> </InlineEquation>. In this paper, explicit formulae for the joint distribution of <InlineEquation ID="IEq6"> <EquationSource Format="TEX">\((X,{\widetilde{X}})\)</EquationSource> </InlineEquation> are provided when <InlineEquation ID="IEq7"> <EquationSource Format="TEX">\(P(X\in F^p)=1\)</EquationSource> </InlineEquation> and <i>X</i> is partially exchangeable. In fact, when <InlineEquation ID="IEq8"> <EquationSource Format="TEX">\(X_i\in F\)</EquationSource> </InlineEquation> for all <i>i</i>, assuming <i>X</i> partially exchangeable is often a good strategy. In a few situations, even if extreme, it may be also reasonable to assume <i>X</i> exchangeable. Hence, some attention is paid to the exchangeable special case. The robustness of <InlineEquation ID="IEq9"> <EquationSource Format="TEX">\({\widetilde{X}}\)</EquationSource> </InlineEquation>, with respect to the de Finetti’s measure <InlineEquation ID="IEq10"> <EquationSource Format="TEX">\(\pi \)</EquationSource> </InlineEquation> of <i>X</i>, is investigated as well. Let <InlineEquation ID="IEq11"> <EquationSource Format="TEX">\({\mathcal {L}}_\pi ({\widetilde{X}}\mid X=x)\)</EquationSource> </InlineEquation> be the conditional distribution of <InlineEquation ID="IEq12"> <EquationSource Format="TEX">\({\widetilde{X}}\)</EquationSource> </InlineEquation>, given <InlineEquation ID="IEq13"> <EquationSource Format="TEX">\(X=x\)</EquationSource> </InlineEquation>, when <i>X</i> is exchangeable and the de Finetti’s measure of <i>X</i> is <InlineEquation ID="IEq14"> <EquationSource Format="TEX">\(\pi \)</EquationSource> </InlineEquation>. It is shown that <InlineEquation ID="IEq15"> <EquationSource Format="TEX">\(\Vert {\mathcal {L}}_{\pi _1}({\widetilde{X}}\mid X=x)-{\mathcal {L}}_{\pi _2}({\widetilde{X}}\mid X=x)\Vert \le c(x)\,\Vert \pi _1-\pi _2\Vert \)</EquationSource> </InlineEquation> where <InlineEquation ID="IEq16"> <EquationSource Format="TEX">\(\Vert \cdot \Vert \)</EquationSource> </InlineEquation> is total variation distance and <i>c</i>(<i>x</i>) a suitable constant. Finally, a numerical experiment is performed. Overall, the knockoffs of this paper outperform the alternatives (i.e., the knockoffs obtained by giving <i>X</i> an absolutely continuous distribution) as regards the false discovery rate but are slightly weaker in terms of power.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Knockoffs for partially exchangeable categorical covariates

  • Emanuela Dreassi,
  • Luca Pratelli,
  • Pietro Rigo

摘要

Let \(X=(X_1,\ldots , X_p)\) be the vector of covariates in a regression problem and let \({\widetilde{X}}\) be a knockoff copy of X (in the sense of Candes et al. 2018). In a number of applications, mainly in genetics, there is a finite set F such that \(X_i\in F\) for each \(i=1,\ldots ,p\) . Despite the latter fact, to make variable selection with the knockoff procedure, X is usually modeled as an absolutely continuous random vector. While comprehensible from the point of view of applications, this approximate procedure does not make sense theoretically, since X is supported by the finite set \(F^p\) . In this paper, explicit formulae for the joint distribution of \((X,{\widetilde{X}})\) are provided when \(P(X\in F^p)=1\) and X is partially exchangeable. In fact, when \(X_i\in F\) for all i, assuming X partially exchangeable is often a good strategy. In a few situations, even if extreme, it may be also reasonable to assume X exchangeable. Hence, some attention is paid to the exchangeable special case. The robustness of \({\widetilde{X}}\) , with respect to the de Finetti’s measure \(\pi \) of X, is investigated as well. Let \({\mathcal {L}}_\pi ({\widetilde{X}}\mid X=x)\) be the conditional distribution of \({\widetilde{X}}\) , given \(X=x\) , when X is exchangeable and the de Finetti’s measure of X is \(\pi \) . It is shown that \(\Vert {\mathcal {L}}_{\pi _1}({\widetilde{X}}\mid X=x)-{\mathcal {L}}_{\pi _2}({\widetilde{X}}\mid X=x)\Vert \le c(x)\,\Vert \pi _1-\pi _2\Vert \) where \(\Vert \cdot \Vert \) is total variation distance and c(x) a suitable constant. Finally, a numerical experiment is performed. Overall, the knockoffs of this paper outperform the alternatives (i.e., the knockoffs obtained by giving X an absolutely continuous distribution) as regards the false discovery rate but are slightly weaker in terms of power.