That’s a trick question! Here are a few factors that affect the difficulty of scrubbing:
Duration: this one is self-explanatory – more frames to scrub mean more time.
Surface: A firm / stable / flat surface is quicker to change than flexing fabric.
Lighting: Shifting shadows falling across the scrubbed surface or moving from shade to light increases complexity.
Object motion: Is the scrubbed object moving, i.e. a license plate on a moving vehicle.
Camera moves: A still frame with no movement is simplest, a moving camera is trickier and a camera moving dramatically in 3d space is much more complicated, especially with motion blur & depth of field. So a flat sign in a locked off shot with steady light is much quicker to change than a waving fabric surface in shifting shadow with objects moving in and out of the foreground.