Our eyes are continuously bombarded by an enormous amount of visual information—millions of shapes, colors, and ever-changing motion all around us. For the brain, this is no easy feat. On the one hand, the visual world alters continuously because of changes in light, viewpoint, and other factors. On the other, our visual input constantly changes due to blinking and the fact that our eyes, head, and body are frequently in motion.
To get an idea of the “noisiness” of this visual input, place a phone in front of your eyes and record a live video while you are walking around and looking at different things. The jittery, messy result is exactly what your brain deals with in every moment of your visual experience.
Yet, seeing never feels like work for us. Rather than perceiving the fluctuations and visual noise that a video might record, we perceive a consistently stable environment. So how does our brain create this illusion of stability? This process has fascinated scientists for centuries and it is one of the fundamental questions in vision science.
The Time Machine Brain
In our latest research, we discovered a new mechanism that, among others, can explain this illusory stability. The brain automatically smoothes our visual input over time. Instead of analyzing every single visual snapshot, we perceive in a given moment an average of what we saw in the past 15 seconds. So, by pulling together objects to appear more similar to each other, our brain tricks us into perceiving a stable environment. Living “in the past” can explain why we do not notice subtle changes that occur over time.
In other words, the brain is like a time machine which keeps sending us back in time. It’s like an app that consolidates our visual input every 15 seconds into one impression so that we can handle everyday life. If our brains were always updating in real time, the world would feel like a chaotic place with constant fluctuations in light, shadow, and movement. We would feel like we were hallucinating all the time.
There are positive and negative implications to our brains operating with this slight lag when processing our visual world. The delay is great for preventing us from feeling bombarded by visual input every day, but it can also risk life-or-death consequences when absolute precision is needed.
For example, radiologists examine hundreds of images in batches, seeing several related images one after the other. When looking at an X-ray, clinicians are typically asked to identify any abnormalities and then classify them. During this visual search and recognition task, researchers have found that radiologists’ decisions were based not only on the present image, but also on images they had previously seen, which could have grave consequences for patients.
Our visual system’s sluggishness to update can make us blind to immediate changes because it grabs on to our first impression and pulls us toward the past. Ultimately, though, continuity fields promote our experience of a stable world. At the same time, it’s important to remember that the judgements we make every day are not totally based on the present, but strongly depend on what we have seen in the past.