What If the Universe Remembers Everything?