The color-furnishing portion of hemoglobin. It is found free in tissues and as the prosthetic group in many hemeproteins.