<p>Meta-learning, also known as learning to learn, has garnered significant attention in the fields of artificial intelligence and machine learning over the past few years. The core idea of meta-learning is to leverage prior experience and data to enhance quality and efficiency on new tasks. To date, numerous meta-learning algorithms have been studied within continuous domains. Recently, Adibi et al. integrated the concept of meta-learning into submodular optimization for the first time, proposing a discrete meta-learning framework termed submodular meta-learning. This framework can solve a series of tasks <InlineEquation ID="IEq1"> <EquationSource Format="TEX">\(\varGamma =\{\varGamma _{i}\}\)</EquationSource> <EquationSource Format="MATHML"><math> <mrow> <mi>Γ</mi> <mo>=</mo> <mo stretchy="false">{</mo> <msub> <mi>Γ</mi> <mi>i</mi> </msub> <mo stretchy="false">}</mo> </mrow> </math></EquationSource> </InlineEquation>, where each task <InlineEquation ID="IEq2"> <EquationSource Format="TEX">\(\varGamma _{i}\)</EquationSource> <EquationSource Format="MATHML"><math> <msub> <mi>Γ</mi> <mi>i</mi> </msub> </math></EquationSource> </InlineEquation> is considered as the problem of maximizing a monotone submodular function <InlineEquation ID="IEq3"> <EquationSource Format="TEX">\(f_{i}\)</EquationSource> <EquationSource Format="MATHML"><math> <msub> <mi>f</mi> <mi>i</mi> </msub> </math></EquationSource> </InlineEquation> under the cardinality constraint (upper bound by <i>k</i>). The goal is to train a common initial set with size <i>l</i> <InlineEquation ID="IEq4"> <EquationSource Format="TEX">\((0&lt;l&lt;k)\)</EquationSource> <EquationSource Format="MATHML"><math> <mrow> <mo stretchy="false">(</mo> <mn>0</mn> <mo>&lt;</mo> <mi>l</mi> <mo>&lt;</mo> <mi>k</mi> <mo stretchy="false">)</mo> </mrow> </math></EquationSource> </InlineEquation> using prior tasks, which can quickly adapt to new tasks. Through this framework, for each new task, we only need to continue searching for task-specific remaining <InlineEquation ID="IEq5"> <EquationSource Format="TEX">\((k-l)\)</EquationSource> <EquationSource Format="MATHML"><math> <mrow> <mo stretchy="false">(</mo> <mi>k</mi> <mo>-</mo> <mi>l</mi> <mo stretchy="false">)</mo> </mrow> </math></EquationSource> </InlineEquation> elements based on this common initial set, thereby reducing the computational cost for each new task. Inspired by their work, we investigate a faster algorithm to find this common initial set. We design a fast two-phase algorithm using threshold-decreasing technique, which achieves <InlineEquation ID="IEq6"> <EquationSource Format="TEX">\((\frac{3}{5}-\frac{1}{5e}-O(\epsilon ))\approx (0.526-O(\epsilon ))\)</EquationSource> <EquationSource Format="MATHML"><math> <mrow> <mrow> <mo stretchy="false">(</mo> <mfrac> <mn>3</mn> <mn>5</mn> </mfrac> <mo>-</mo> <mfrac> <mn>1</mn> <mrow> <mn>5</mn> <mi>e</mi> </mrow> </mfrac> <mo>-</mo> <mi>O</mi> <mrow> <mo stretchy="false">(</mo> <mi>ϵ</mi> <mo stretchy="false">)</mo> </mrow> <mo stretchy="false">)</mo> </mrow> <mo>≈</mo> <mrow> <mo stretchy="false">(</mo> <mn>0.526</mn> <mo>-</mo> <mi>O</mi> <mrow> <mo stretchy="false">(</mo> <mi>ϵ</mi> <mo stretchy="false">)</mo> </mrow> <mo stretchy="false">)</mo> </mrow> </mrow> </math></EquationSource> </InlineEquation> approximation ratio and optimizes the current query complexity from <InlineEquation ID="IEq7"> <EquationSource Format="TEX">\(O(mn^{2})\)</EquationSource> <EquationSource Format="MATHML"><math> <mrow> <mi>O</mi> <mo stretchy="false">(</mo> <mi>m</mi> <msup> <mi>n</mi> <mn>2</mn> </msup> <mo stretchy="false">)</mo> </mrow> </math></EquationSource> </InlineEquation> to <InlineEquation ID="IEq8"> <EquationSource Format="TEX">\(O(\frac{mn}{\epsilon }\log \frac{n}{\epsilon })\)</EquationSource> <EquationSource Format="MATHML"><math> <mrow> <mi>O</mi> <mo stretchy="false">(</mo> <mfrac> <mrow> <mi mathvariant="italic">mn</mi> </mrow> <mi>ϵ</mi> </mfrac> <mo>log</mo> <mfrac> <mi>n</mi> <mi>ϵ</mi> </mfrac> <mo stretchy="false">)</mo> </mrow> </math></EquationSource> </InlineEquation> in the worst case <InlineEquation ID="IEq9"> <EquationSource Format="TEX">\((k=O(n))\)</EquationSource> <EquationSource Format="MATHML"><math> <mrow> <mo stretchy="false">(</mo> <mi>k</mi> <mo>=</mo> <mi>O</mi> <mo stretchy="false">(</mo> <mi>n</mi> <mo stretchy="false">)</mo> <mo stretchy="false">)</mo> </mrow> </math></EquationSource> </InlineEquation> where <i>n</i> is the size of ground set, <i>m</i> is the number of samples and <InlineEquation ID="IEq10"> <EquationSource Format="TEX">\(\epsilon \in (0,1)\)</EquationSource> <EquationSource Format="MATHML"><math> <mrow> <mi>ϵ</mi> <mo>∈</mo> <mo stretchy="false">(</mo> <mn>0</mn> <mo>,</mo> <mn>1</mn> <mo stretchy="false">)</mo> </mrow> </math></EquationSource> </InlineEquation> is a small constant.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Fast Algorithms for Monotone Submodular Meta-Learning under the Cardinality Constraint

  • Shufang Gong,
  • Bin Liu,
  • Qizhi Fang,
  • Weili Wu

摘要

Meta-learning, also known as learning to learn, has garnered significant attention in the fields of artificial intelligence and machine learning over the past few years. The core idea of meta-learning is to leverage prior experience and data to enhance quality and efficiency on new tasks. To date, numerous meta-learning algorithms have been studied within continuous domains. Recently, Adibi et al. integrated the concept of meta-learning into submodular optimization for the first time, proposing a discrete meta-learning framework termed submodular meta-learning. This framework can solve a series of tasks \(\varGamma =\{\varGamma _{i}\}\) Γ = { Γ i } , where each task \(\varGamma _{i}\) Γ i is considered as the problem of maximizing a monotone submodular function \(f_{i}\) f i under the cardinality constraint (upper bound by k). The goal is to train a common initial set with size l \((0<l<k)\) ( 0 < l < k ) using prior tasks, which can quickly adapt to new tasks. Through this framework, for each new task, we only need to continue searching for task-specific remaining \((k-l)\) ( k - l ) elements based on this common initial set, thereby reducing the computational cost for each new task. Inspired by their work, we investigate a faster algorithm to find this common initial set. We design a fast two-phase algorithm using threshold-decreasing technique, which achieves \((\frac{3}{5}-\frac{1}{5e}-O(\epsilon ))\approx (0.526-O(\epsilon ))\) ( 3 5 - 1 5 e - O ( ϵ ) ) ( 0.526 - O ( ϵ ) ) approximation ratio and optimizes the current query complexity from \(O(mn^{2})\) O ( m n 2 ) to \(O(\frac{mn}{\epsilon }\log \frac{n}{\epsilon })\) O ( mn ϵ log n ϵ ) in the worst case \((k=O(n))\) ( k = O ( n ) ) where n is the size of ground set, m is the number of samples and \(\epsilon \in (0,1)\) ϵ ( 0 , 1 ) is a small constant.