Caesar Cipher is an ancient encryption technique that converts plaintext into cipher text using simple substitution. It was used to protect messages of national significance. It uses the least time complexity for encryption, i.e., O(n). However, with the improvements in processing power, modern-day computers can decode the cipher texts produced by Caesar cipher in milliseconds. Hence, there is a need to improve the intricacy of the Caesar Cipher technique while preserving its time complexity. This paper aims to improve the security of the Caesar Cipher by modifying it using a new algorithm. The proposed algorithm uses various mathematical operations, a substitution technique, and a randomly generated key for encrypting characters. All readable/printable characters defined by the ASCII standard can be encrypted and decrypted by the proposed algorithm. With this algorithm, all the drawbacks of the traditional Caesar Cipher technique are overcome.