The Substitution principle in linguistics suggests that synonyms can better represent compositionality when partially substituted. Our research explores a novel method for assessing word-pair compositionality using hierarchical synonym substitution rules. This involves recursively extracting synonyms for each word from WordNet to a set depth. The structure includes direct synonyms, hypernyms, and hyponyms, allowing complex semantic representation. The closest synonym from the hierarchy is used in the two proposed substitution-based compositions (H-t and h-T), serving as a substitute in word pairs for deeper compositionality analysis.