While I recognize a lot of these points, I do think that we should not let the tail wag the dog
If the non-financial factors add predictive power, I don’t think there is any reason on a first principles basis to categorically exclude them. But of course, I do appreciate that these kind of factors can be subjective and therefore of lower quality, so we should keep an eye on that and encourage the clients to improve data quality
Also, many banks lump treatment of these kind of factors with overrides, which is almost always where the supervisory feedback is coming from. It is commonly used as a fudge factor, and that is poor practice. One can develop a disciplined, (high-quality) data based use of this type of information to avoid that pitfall