Strictly speaking the answer to your question is to use the UltraControlContainerEditor to host a NumericUpDown control, and assign the UltraControlContainerEditor to the column's EditorComponent property.

Another approach is to use the column's masking and spin button capabilities to do it, like so:

UltraGridColumn column = e.Layout.Bands[x].Columns[y];
column.MaskInput = "nnn";
column.MinValue = 0;
column.MaxValue = 999;
column.Style = Infragistics.Win.UltraWinGrid.ColumnStyle.IntegerWithSpin;
column.ButtonDisplayStyle = Infragistics.Win.UltraWinGrid.ButtonDisplayStyle.Always;