The agriculture sector grapples with several challenges, such as the diminishing workforce on farms and the escalating expenses associated with manual fruit harvesting. Despite ongoing progress in automating agriculture for efficiency and large-scale production, manual labor remains prevalent in fruit harvesting. Addressing these issues necessitates a focus on labor-saving measures and the expansion of agricultural operations. To tackle these challenges, the development of an automated fruit harvesting and segregation robot emerges as a practical solution. This involves creating a robotic system that combines a low-cost vision camera and a robotic arm. The stereo-vision camera serves to identify the color, distance, and position of the fruit, while the robotic arm is employed for mechanically plucking and segregating the fruits based on ripeness.