No, this looks wonderful 
#do the colors look bad or off somethings just not sitting right with me on them
weary tapir
Great use of color, nice and desaturated as you were going for
It doesn't feel like it's been "left to wilt"
It just feels like a house
If you were to desaturate and age the house with your texturing more than it could feel more aged
ancient wasp
swift turtle
And if you wanna go even further with making it look abandoned use some plants to make it look overgrown. You could also make broken windows. But maybe thats not the left to wilt that you meant