You shouldn't make differences among one insect and the other. Killing something should always be perceived as "negative" even if you say "But the bee could hurt me!". Yes, the bee could hurt you, but this doesn't mean it will necessarily hurt you. If you feel the sense of guilt, you shouldn't feel it only towards insects you consider to be annoying for you. At least I think so
