<p>Active colloidal fluids exhibit spontaneous emergence of correlated states, characterized by complex collective dynamics and self-organization. In geometrically confined systems, activity modulations trigger robust polar state reversals of a macroscopic vortex formed by colloidal rollers. Here, we reveal that the shape anisotropy of dielectric rollers transforms the system into a chiral active fluid comprised of rollers of arbitrary handedness. The chiral rollers self-assemble into multiple freestanding vortices with a spontaneously selected sense of rotation. We demonstrate that upon reactivation of the system after a complete cessation of activity beyond all relevant timescales, the vortices simultaneously restore their previous chiral states in striking contrast to the chiral state reversals demonstrated by spherical rollers. The analysis reveals that shape-anisotropy modifies the collective state memory of the ensemble. The findings provide insights into the emergence of complex collective behavior in chiral colloidal fluids governed by an interplay between shape anisotropy, chiral motion, and activity modulations.</p>