To craft one, you must have 1 redstone lamp, and 4 dyes of the color lamp you want. place one lamp in the middle, and for dyes directly around the lamp.
You can also revert the lamps to default with 1 colored lamp and one watterbottle anywhere in the table.