Can I display number of rows going into computation of average in Graph Builder?

I have a fairly simple line plot in Graph Builder plotting an average response vs. a key categorical X variable.

Is there an easy way to label each point in the Graph Builder with the number of non-missing respondents for that response-category combination?

I can do this with Summary (get Mean and N for each response), label all rows in the Summary, and label the N(column) column. However, if I want to do it for a different response I can't simply use something like Column Switcher to change my response and my label column at the same time, so it's tedious to compare across multiple responses.