Buff can mean attractive (usually towards men eg he's a bit buff), or a yellowish colour or ' in the buff' means naked.
In the UK, if you have joined the 'buffs' it means you have obtained membership of the R.A.O.B.. or 'poor man's masons'.
They drink cheap but gassy beer in a run down little hall or function room, and have a treasurer and a membership secretary and a dartboard.
Buff means fit/attractive, normally quite muscular.
"Hey Lisa, that guy over there is SO buff!"
I agree with spudbocket