Publication Details

Will Farlessyost, Kelsey-Ryan Grant, Sara Davis, Emily Hand, and David Feil-Seifer. "The Effectiveness of Multi-Label Classification and Multi-Output Regression in Social Trait Recognition." In Sensors, 21(12), Jun 2021. doi: 10.3390/s21124127 ( pdf )


  • Keywords:
  • REU

Abstract

First impressions make up an integral part of our interactions with other humans by providing an instantaneous judgement of the trustworthiness, dominance and attractiveness of an individual prior to engaging in any other form of interaction. Unfortunately, this can lead to unintentional bias in situations that have serious consequences, whether it be in judicial proceedings, career advancement, or politics. The ability to automatically recognize social traits presents a number of highly useful applications: from minimizing bias in social interactions to providing insight into how our own facial attributes are interpreted by others. However, while first impressions are well-studied in the field of psychology, automated methods for predicting social traits are largely non-existent. In this work, we demonstrate the feasibility of two automated approaches -- multi-label classification (MLC) and multi-output regression (MOR) -- for first impression recognition from faces. We demonstrate that both approaches are able to predict social traits with better than chance accuracy, but there is still significant room for improvement. We evaluate ethical concerns and detail application areas for future work in this direction.

Author Details

Name: Will Farlessyost
Status: Inactive

Name: Kelsey-Ryan Grant
Status: Inactive

Name: Sara Davis
Status: Inactive

Name: Emily Hand
Status: Inactive

Name: David Feil-Seifer
email: dave@cse.unr.edu
Website: http://cse.unr.edu/~dave
Phone: (775) 784-6469
Status: Active

BibTex Reference

@article{farlessyost2021the,
  title={The Effectiveness of Multi-Label Classification and Multi-Output Regression in Social Trait Recognition},
  author={Will Farlessyost and Kelsey-Ryan Grant and Sara Davis and Emily Hand and David Feil-Seifer},
  year={2021},
  month={June},
  journal={Sensors},
  volume={21},
  number={12},
  publisher={MDPI},
  doi={10.3390/s21124127},
}

HTML Reference

<span class="authors">Will Farlessyost, Kelsey-Ryan Grant, Sara Davis, Emily Hand, and David Feil-Seifer</span>. <span class="title">"The Effectiveness of Multi-Label Classification and Multi-Output Regression in Social Trait Recognition." </span> <span class="status">In</span> <span class="booktitle">Sensors, </span><span class="volume">21</span><span class="number">(12)</span><span class="pg"></span>, <span class="month">Jun</span> <span class="year">2021</span>. <span class="ending"></span> <span class="doi">doi: 10.3390/s21124127</span>

Support

REU Site: Collaborative Human-Robot Interaction, National Science Foundation PI: David Feil-Seifer, co-PI: Shamik Sengupta, Amount: $360,000, Feb. 1, 2018 - Jan. 31, 2022