According to the API documentation on inbox_item, inbox items corresponding to a comment on an answer to a question should have an answer_id field identifying the answer that the comment was on, but that seems to be missing, and answer_id only seems to exist for inbox items about answer to questions.