At an American research university, supervising graduate student research is a significant part of a professor's job (especially in the sciences). Not working with graduate students will hurt a faculty member's job evaluations, just as would not publishing enough research or getting teaching evaluations. How many graduate students is an appropriate number can still depend a lot of the institution and the specific field.
Usually, graduate student supervision will be part of a holistic evaluation of how well a faculty member is doing. However, there may sometimes be specific requirements—such as, in my department a faculty member cannot be promoted to the rank of full professor without being the primary supervisor for at least one Ph. D. graduate. More generally, when faculty members are up for tenure or promotion, quite a bit of attention is paid to whether they have worked with or are working with graduate students. Masters students are certainly worth something in this regard, but not nearly as much as doctoral students. Similarly, when it comes time to be evaluated for merit raises, among the evaluation criteria are whether a professor is successful in advising Ph. D. students.
For faculty who do not show a record of involvement in graduate student training, this will count against them. Since supervising graduate students is a part of a professor's teaching responsibility, if someone rarely or never works with graduate students, they may be assigned a heavier load of classroom teaching to make up for that absence.