Every time a bit of information is erased, we know it doesn't disappear. It goes out into the environment. It may be horribly scrambled and confused, but it never really gets lost. It's just converted into a different form.