If you want to incorporate a bit more texture, you could also wear flannels with different kinds of boots such as the chukka boot, chelsea boot or the leather boots I'm wearing here today.
In combination with those mid brown suede chukka boots, I have this nice blend of earthy tones that is casual and relaxed yet more formal than, let's say, a regular dress shirt with Chino slacks.