Thanks for answering, Jeremy!
Please notice that the problem doesn't concern spam entries coming from the comments section but those coming from the contact form, which don't show up in the Feedback menu in my dashboard, since they are normally directle send to me via e-mail. So I find no other possibility than to delete them in my database.