Nevermind, it's in General settings, I went hunting



Save a copy of sent messages in my Sent Items folder by default
Don't save a copy of sent messages
When sending private messages the forum can make a copy of the message in your Sent Items folder.