That's exactly how it is for me. I can think I've forgotten a decent chunk of the details, but once I actually start playing through again everything generally starts rushing back to the point where I just about know the next line -- let alone scenario. Pretty much holds for me in all media, though--books, television, games, etc. Even when I want to re-watch something, I rarely get comparable levels of enjoyment from it.