My neighbor complained about my noise level, but I'm still playing the music moderately loud.
Are you trying to be loud on purpose?
Perhaps.
Different people have different work, school and sleep schedules. You continuing to disrespect your neighbor just to spite them could be enough cause to have you in breach of your lease and kicked out. Be courteous of your neighbors.
Oh damn, am I going to get kicked out?
It's unlikely that you'll be kicked out so long as  you stop purposely doing  things that annoy your neighbor. You live in a community with shared walls and you need to be respectful of your neighbors. If necessary, you might consider apologizing to your neighbor as well.