CYPBL: Crop Yield Prediction using Bi-Directional LSTM under PySpark interface

In the context of India's evolving economy, where agriculture remains a vital yet limited sector, the challenge is to enhance productivity on finite cultivable land. This research addresses this imperative by introducing the Crop Yield Prediction Using Deep Learning (CYPBL) model, leveraging the Bi-Directional Long Short-Term Memory (Bi-LSTM) algorithm. Employing soil health and crop yield data from the Government of India, the CYPBL model is implemented through PySpark for scalability. Featuring 20 LSTM layers with a 12 × 1 input shape, including a bidirectional LSTM layer, the model achieves exceptional accuracy at 99.5 percent on test data. With a focus on real-time data, a batch size of 1 ensures optimal responsiveness. Beyond technological advancements, CYPBL emerges as a groundbreaking soil health monitoring system, bridging the gap between experts and farmers. By empowering farmers with insights into soil conditions, crop suitability, and improvement strategies, this research paves the way for data-driven, responsive agriculture in India and globally, contributing to the pressing issue of global food security.