Humans have the 'lost in the middle' problem too
Quote
it's sort of like the lost in the middle problem. With context, the very first prompt you ask tends to be retained, and then the most recent question you ask tends to be retained. But a bunch of stuff in that middle tends to get lost. I think that applies with human effort.
Episode 270: YOLO Guy (episode page, opens in a new tab) 00:32:40 (play audio from this timestamp, opens in a new tab)
Voice-matched
Summary
Like LLM context windows, which retain the first prompt and the most recent one but lose the middle, people on a long project keep the big picture and the last thing they did, but the many layers in between fade in and out of clarity. You can recover that clarity, but it costs a lot of time and attention.