I need help

Dear Madam / Sir,
I am 29 years old girl and im in relationship with a married man i know how much it is bad!!! we know each-other more than 6 years (he was single) but I never saw him, in fact he was not attractive for on that time!! he found me again through facebook and after 2 years avoid of meeting him and always telling him you are married and I am not interesting to meet you at last we met 2 month ago and now we are deeply in Love ...... he is not happy with his marriage at all but because they have new born baby, he cannot make decision,I am very nervous this days and feel very bad because im with a married man I ask him many times to break up but he gets mad and just begging me please don't do it and give me more time to make right decision....
her wife is always in her mother home .... and they really have problem before me .... I am feeling guilty ... i promise i never dont act to distrub his life.....
everything really hurt me ... i cannot broke up with him because i love him more than i can talk about and he loves me more .... also i cannot accept this situation .... i think i really deserve to have my love in normal situation ...
please helop me what i have to do!!! stay with him or leave this relationship

It would be very appreciated if reply me as soon as possible.