i have anxiety and depression too, so i understand your dilemma, i really do. what i do is try to see it from an objective point of view and overall i'm very aware of everything i do.
i can tell you the friend was partly the cause of your breakup. i've met people like him, and they can influence even the best people. however, your ex clearly has no common sense, so you're better off.
i personally don't think you sound like a toxic person, you just can't differentiate between paranoia and reality, and that's a struggle i share with you. what i've done is try to focus more on other people instead of myself, and try to be more positive. if people see that you are kind and you care about them, they can't think you're toxic.
also, i've repeatedly apologized to friends for things that my anxiety told me were bad, such as messaging them multiple times in a row or other stuff like that, and they said that they either didn't mind it at all or they didn't notice. trust me, a lot of things are better than they seem.