<p>Fuzzy c-means (FCM) is one of the most frequently used methods for clustering. It typically generates a solution by alternately updating the membership matrix <i>U</i> and the center matrix <i>V</i>, with the majority of the computational cost concentrated on updating <i>U</i>. Each row of <i>U</i> is updated using Jacobi iteration, which results in a relatively slow convergence rate and increases the likelihood of being trapped in local optima. To address this, we propose an FCM clustering method using Gauss-Seidel iteration (GS-FCM), along with its batched version (GS-<InlineEquation ID="IEq1"> <InlineMediaObject> <ImageObject Color="BlackWhite" FileRef="40815_2025_2129_Article_IEq1.gif" Format="GIF" Height="20" Rendition="HTML" Resolution="72" Type="Linedraw" Width="53" /> </InlineMediaObject> <EquationSource Format="TEX">\(\hbox {FCM}_{\left( s \right) }\)</EquationSource> <EquationSource Format="MATHML"><math> <msub> <mtext>FCM</mtext> <mfenced close=")" open="("> <mi>s</mi> </mfenced> </msub> </math></EquationSource> </InlineEquation>). By eliminating <i>V</i>, the original optimization problem is transformed into an equivalent form involving only <i>U</i>. Then, <i>U</i> is updated using Gauss-Seidel iteration. In the batched version, <i>U</i> is randomly partitioned into <i>s</i> (<InlineEquation ID="IEq2"> <InlineMediaObject> <ImageObject Color="BlackWhite" FileRef="40815_2025_2129_Article_IEq2.gif" Format="GIF" Height="15" Rendition="HTML" Resolution="72" Type="Linedraw" Width="75" /> </InlineMediaObject> <EquationSource Format="TEX">\(1 \le s \le n\)</EquationSource> <EquationSource Format="MATHML"><math> <mrow> <mn>1</mn> <mo>≤</mo> <mi>s</mi> <mo>≤</mo> <mi>n</mi> </mrow> </math></EquationSource> </InlineEquation>) sub-blocks, where each sub-block is updated sequentially following the GS-FCM approach, while the variables within each block are updated in parallel as in FCM. Specifically, GS-<InlineEquation ID="IEq3"> <InlineMediaObject> <ImageObject Color="BlackWhite" FileRef="40815_2025_2129_Article_IEq1.gif" Format="GIF" Height="20" Rendition="HTML" Resolution="72" Type="Linedraw" Width="53" /> </InlineMediaObject> <EquationSource Format="TEX">\(\hbox {FCM}_{\left( s \right) }\)</EquationSource> <EquationSource Format="MATHML"><math> <msub> <mtext>FCM</mtext> <mfenced close=")" open="("> <mi>s</mi> </mfenced> </msub> </math></EquationSource> </InlineEquation> reduces to FCM when <InlineEquation ID="IEq4"> <InlineMediaObject> <ImageObject Color="BlackWhite" FileRef="40815_2025_2129_Article_IEq4.gif" Format="GIF" Height="14" Rendition="HTML" Resolution="72" Type="Linedraw" Width="40" /> </InlineMediaObject> <EquationSource Format="TEX">\( s=1 \)</EquationSource> <EquationSource Format="MATHML"><math> <mrow> <mi>s</mi> <mo>=</mo> <mn>1</mn> </mrow> </math></EquationSource> </InlineEquation> and becomes the proposed GS-FCM when <InlineEquation ID="IEq5"> <InlineMediaObject> <ImageObject Color="BlackWhite" FileRef="40815_2025_2129_Article_IEq5.gif" Format="GIF" Height="10" Rendition="HTML" Resolution="72" Type="Linedraw" Width="44" /> </InlineMediaObject> <EquationSource Format="TEX">\( s=n \)</EquationSource> <EquationSource Format="MATHML"><math> <mrow> <mi>s</mi> <mo>=</mo> <mi>n</mi> </mrow> </math></EquationSource> </InlineEquation>. When <i>s</i> is set to a small value, GS-<InlineEquation ID="IEq6"> <InlineMediaObject> <ImageObject Color="BlackWhite" FileRef="40815_2025_2129_Article_IEq1.gif" Format="GIF" Height="20" Rendition="HTML" Resolution="72" Type="Linedraw" Width="53" /> </InlineMediaObject> <EquationSource Format="TEX">\(\hbox {FCM}_{\left( s \right) }\)</EquationSource> <EquationSource Format="MATHML"><math> <msub> <mtext>FCM</mtext> <mfenced close=")" open="("> <mi>s</mi> </mfenced> </msub> </math></EquationSource> </InlineEquation> also exhibits linear computational complexity with respect to the number of samples. Experimental results show that GS-<InlineEquation ID="IEq7"> <InlineMediaObject> <ImageObject Color="BlackWhite" FileRef="40815_2025_2129_Article_IEq1.gif" Format="GIF" Height="20" Rendition="HTML" Resolution="72" Type="Linedraw" Width="53" /> </InlineMediaObject> <EquationSource Format="TEX">\(\hbox {FCM}_{\left( s \right) }\)</EquationSource> <EquationSource Format="MATHML"><math> <msub> <mtext>FCM</mtext> <mfenced close=")" open="("> <mi>s</mi> </mfenced> </msub> </math></EquationSource> </InlineEquation> converges faster than FCM and reaches better local minima in fewer iterations.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Fuzzy C-Means Clustering Using Gauss-Seidel Iteration

  • Yuxue Chen,
  • Shuisheng Zhou,
  • Cui Fu

摘要

Fuzzy c-means (FCM) is one of the most frequently used methods for clustering. It typically generates a solution by alternately updating the membership matrix U and the center matrix V, with the majority of the computational cost concentrated on updating U. Each row of U is updated using Jacobi iteration, which results in a relatively slow convergence rate and increases the likelihood of being trapped in local optima. To address this, we propose an FCM clustering method using Gauss-Seidel iteration (GS-FCM), along with its batched version (GS- \(\hbox {FCM}_{\left( s \right) }\) FCM s ). By eliminating V, the original optimization problem is transformed into an equivalent form involving only U. Then, U is updated using Gauss-Seidel iteration. In the batched version, U is randomly partitioned into s ( \(1 \le s \le n\) 1 s n ) sub-blocks, where each sub-block is updated sequentially following the GS-FCM approach, while the variables within each block are updated in parallel as in FCM. Specifically, GS- \(\hbox {FCM}_{\left( s \right) }\) FCM s reduces to FCM when \( s=1 \) s = 1 and becomes the proposed GS-FCM when \( s=n \) s = n . When s is set to a small value, GS- \(\hbox {FCM}_{\left( s \right) }\) FCM s also exhibits linear computational complexity with respect to the number of samples. Experimental results show that GS- \(\hbox {FCM}_{\left( s \right) }\) FCM s converges faster than FCM and reaches better local minima in fewer iterations.