Pilot lights should be blue in color. So, if yours is yellow, it usually means a problem with combustion, which could indicate a carbon monoxide leak. If that’s the case, turn the furnace off right away and call our team for repair.