You will see this screen by clicking the Extra tab when you are creating or maintaining an item group. Under this tab, you can define the price list rounding option for the item group.
Select No rounding if you do not want to round the prices, Round up if you want to round up the prices or Round down if you want to round down the prices.