Right-click the folder, select Folder color and then select from the preselected list or set your own custom color.
For Gmail folders, the color of your label is used instead, which can be set in menu > Tags.