From what I know, the speed of light is the limitation we're facing. The light from extremely far away places is expanding faster than the speed of light can reach us, so in an infinite amount of time, we'll never get to see or even know about what was there.