Even though you can't double major in college of engineering at Cornell (this is true at Duke too), usually there will be a lot of overlap between the classes and like cs students can still take some ece classes at Duke at least.
I also wasn't a big sports person and I only ever went to one game, but there's still a lot of school spirit and positive energy that you can just feel around the campus. and the people are all super collaborative and creative.
I don't think you need to pick a school that you think isn't a good emotional/social fit just because you feel it'll push you. College will already do that, so having a space where you have community, resources, support to fall back on is really important