Pacifiers! Can babies become too dependent?

I've read about the pros and cons of pacifiers but I'm still not sure! My baby at 3 months started sucking her hands constantly so we started to use a pacifier. She seems to want it in very often during the day and it stops her from whining (for apparently no reason - when she's fed, burped, changed, good to go...) so it's hard to deny her. She's about 4 months now and I got up 5 times last night to settle her and give her her pacifier. She used to sleep through the night much better than this. I'm not sure what to do! Granted she hadn't pooped in 24 hrs. but still! How is she going to learn to settle herself at night if I'm constantly having to give her her pacifier in the night?