Design with renewable energy is dedicated to those challenges encountered by the authors in generating solar energy (PVe) based on new and existing buildings in different cities (the Middle East, Singapore, and China). This Chapter presents selected case studies of Building Integrated, Building Applied, or Hybrid implementations, focusing on challenges due to site configuration, orientation, shading, materials, construction, initial versus operation cost, market readiness, building typology, ownership, policy, and regulatory compliances, etc. Example cases are drawn from different latitudes, economies, and markets in order to provide a better understanding of those complex forces at work. Particular attention is also paid to recent occurrences of weather extremities, causing challenges for predictive calculation. Another discussion in this Chapter deals with the aesthetics associated with building integration with photo-voltaic panels on building facades as the market has seen the introduction of coloured PV modules. Aesthetics and visual impact thus emerge as another new topic for the designer and urban designer. Of interest to this Chapter is the introduction by the authors on the development of a self-evaluative template, which was developed by the authors to address various challenges as they arose. It provides a preliminary checklist to enable designers and building operators to guide design decisions by addressing and resolving various technical challenges step by step.