In this study, resource allocation techniques based on reinforcement learning (RL) for 5G millimeter wave (mmWave) networks are compared and analyzed. The high bandwidth and large available spectrum in mmWave networks offer a great opportunity for high data rate communication but also pose significant challenges in terms of resource allocation. RL, being a powerful tool for decision making in dynamic and uncertain environments, has been widely studied for resource allocation in mmWave networks. In this paper, we survey the state-of-the-art RL-based resource allocation methods for mmWave networks and we also discuss the challenges and open research directions in this field. This study presents an effective method for balancing stable, low-capacity mmWave links with reliable, high-capacity backhaul links designed using stochastic geometry and analytical channel modeling. We also propose a backhaul resource allocation strategy. To increase system utility with a mmWave network’s limited backhaul capacity, a neural network-based backhaul resource allocation has been proposed.