Definately go up one size. A few years ago they were bang on but since they changed their material to a stretchier one, they are sized wierd. By the fitment charts i'm a large but the large was snug on me, the X-large is a perfect fit.
BTW, I'm 5'9" and 195lbs if that helps.