Due to difference of physical characteristics among various weathers, weather features and high-frequency signals remain in reconstructed image obtained by single restoration methods. The traditional single recovery methods are not suitable for multiple weather degenerate images. To address this limitation, this paper proposes an unsupervised image restoration network combined with feature disentangle technology. The multiple encoder-decoder network is firstly introduced to extract background information or weather features from degenerate images. Then, the domain discriminator and latent feature space consistency loss are used to constrain extracted background information and weather features, thus to assist feature disentangle and reduce residual weather features and high-frequency signals. Subjective and objective results show that the designed restoration network is suitable for various weather degenerate images while maintaining a competitive background image restoration effect.