Abstract
We develop an intelligent credit rating system that can provide debtors' rating information without involving credit rating agencies. Several models are used for credit scoring in our work, including the Duffie's model, logistic regression, and random forest. We compare the performance of these models and build an in-depth understanding of the evaluation of credit rating. Furthermore, we propose a new framework to evaluate the performance of credit ratings from multiple perspectives. The framework contains two components, defaulter recognition and rating quality. We use generic indices, area under curve (AUC) of receiver operating characteristics (ROC) and log loss, to evaluate the defaulter recognition ability of credit rating models. However, rating quality is more complicated than defaulter recognition. Inspired by rating agencies, we propose indices that reflect stability and migration of rating. We also adopt minimum default distance and rating path for evaluation of rating quality. Experimental results indicate that random forest (RF) has the best performance among the generic indices, but its stability is demonstrated to be 63% lower than the other two models. Similar results were found in the ratings path to default and minimum default distance. In this study, we specify a general evaluation framework of credit rating system and reveal the possibility of agency-free credit rating.
Original language | English |
---|---|
Title of host publication | Proceedings - 2017 IEEE 10th International Conference on Service-Oriented Computing and Applications, SOCA 2017 |
Publisher | Institute of Electrical and Electronics Engineers Inc. |
Pages | 181-189 |
Number of pages | 9 |
ISBN (Electronic) | 9781538613269 |
DOIs | |
State | Published - 28 12 2017 |
Externally published | Yes |
Event | 10th IEEE International Conference on Service-Oriented Computing and Applications, SOCA 2017 - Kanazawa, Japan Duration: 22 11 2017 → 25 11 2017 |
Publication series
Name | Proceedings - 2017 IEEE 10th International Conference on Service-Oriented Computing and Applications, SOCA 2017 |
---|---|
Volume | 2017-January |
Conference
Conference | 10th IEEE International Conference on Service-Oriented Computing and Applications, SOCA 2017 |
---|---|
Country/Territory | Japan |
City | Kanazawa |
Period | 22/11/17 → 25/11/17 |
Bibliographical note
Publisher Copyright:© 2017 IEEE.
Keywords
- Duffie's model
- credit rating
- logistics regression
- machine learning
- performance evaluation
- random forest