Stitching memories from the past to the future