A gene that alters the expression of another gene which is non-allelic. The effect of the modifying gene (modifier) is relatively small compared to that of the non-allelic gene being affected.