You're not an asshole for not wanting to be in a relationship with that girl. I actually think it's quite noble. A lot of people would probably just agree and then cheat/fuck shit up even worse down the line when even more feelings are involved. Being honest isn't bad. It's brave knowing you have to hurt someone because you're not willing to be a liar.