I know exactly how you feel. Trust me, you're not alone. It's so difficult because you have so many hormones and so many things are coming to you at once. And then the baby feels your emotions almost as much as you do, so it can create issues with the baby- just not as bad as you think. Only some like wanting more attention, being impatient, etc. once he/she is born. I worried constantly about him not being healthy or anything until I got to my 20 week ultrasound and I found that he was perfectly healthy, growing fine, and he was a boy! Since then, I've been trying to enjoy my pregnancy... but at the same time self-esteem problems are creeping up, now.
So what helped me was a glass of warm milk with honey every night. My boyfriend also did a lot of easing. BUT talking to your doctor is a good idea if he/she can give some more suggestions.
But trust me... you aren't alone and your normal!