<p>Currently, lithium batteries are widely used in electronic devices, electric vehicles, and new energy fields due to their high energy density and extremely low electrochemical potential. However, problems such as electrolyte leakage and poor low-temperature performance plague the existing liquid lithium-ion batteries, severely impeding their development towards high safety and high performance. Polymer electrolyte, when compared to organic liquid electrolyte, enhances the deficiencies in liquid electrolyte assembly batteries and bolsters the safety of lithium batteries significantly. However, at present, polymer electrolyte has low ionic conductivity at room temperature, large interface resistance, and poor mechanical properties. Cellulose, the most abundant natural polymer compound on earth, possesses excellent electrolyte wettability and thermal stability. Its polar functional group allows it to complex with lithium ions, resulting in lithium-ion migration. It is one of the preferred materials for the next generation of polymer electrolytes. This paper reviews the research progress of ether cellulose, ester cellulose, and nanocellulose in the polymer electrolyte field, discusses the preparation methods of cellulose polymer electrolyte, analyzes the influence of different fillers on the performance of cellulose polymer electrolyte, and finally presents the challenges faced by cellulose polymer electrolyte for high-performance lithium batteries and its future research prospects.</p>