There are many Visual Question Answering (VQA) datasets like VQA [1], OK-VQA [4] and TextVQA [13] but very few of them focus on public transport domain, especially buses. If you are a bus commuter and standing at a bus stop which is new to you, then you may have many questions such as “When next bus will arrive for the destination” or “What are different buses which you can take to reach the destination”. So a commuter generally have questions about the bus routes, timings, frequency and finding alternatives. Current datasets do not include these practical questions. Also the existing datasets does not include the location of the user asking the question and the time when the question was asked. Lack of this information limits the design and development of the applications which can help commuters in their daily travel. To address these issues we created a dataset called “CommuteQA” which focuses on public transport user questions. We also propose method for the Visual Question Answering over this dataset, which considers the image, location, time and bus schedule information to answer the user questions. This dataset also aims to help creation of tools and applications for the visually impaired people who use public transport.