The difference between dreaming and waking is not a line, but a fuzzy width of indeterminate shape. It is a feeling of familiar, repetitive and certain. I have dreamed of stranger. This... this is not a dream.
Madness string 82375
Even just emotionally, if a baby doesn't get their emotional or social needs met, they can have lifetime emotional damage. I have to imagine a physical trauma would do the same.