A rudder is at it's best in windy areas, particularly when crossing an expanse of open water. They are also practically indispensible when using a kite or sail.
As a general rule, longer kayaks need them more. But you guessed the answer, you have to try the model(s) that you are considering, and the answer will become apparent.
Flounder