Was their icy mountains during the last Ice Age

Yes there were icy mountains, exactly like we have in cold places today, like the alps or himalayas. There were also bigger ice sheets, like the north and south poles have, although these can be thick, they are not really mountains as they are fairly flat, as ice is able to flow (slowly) like honey does, so it cannot make steep mountains.