Abstract A key to interacting with the physical world is the ability to visually infer object properties, like elasticity, allowing us to anticipate object behaviour. Such perceptual inferences continue to challenge artificial intelligence systems, highlighting the complexity of the underlying computations. How does the human brain solve this task? Here, we propose a resource-rational model based on learned statistics of object motion to explain how humans judge elasticity. We created 100 000 ph