Data and description

THESE DATA AND SOFTWARE ARE PROVIDED BY THE COPYRIGHT HOLDERS AND CONTRIBUTORS "AS IS" AND ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE ARE DISCLAIMED. IN NO EVENT SHALL THE COPYRIGHT HOLDER OR CONTRIBUTORS BE LIABLE FOR ANY DIRECT, INDIRECT, INCIDENTAL, SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES (INCLUDING, BUT NOT LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF USE, DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND ON ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE OF THIS

SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE.

WARNING: Even though this dataset includes people from different ethnical backgrounds, gender, and ethnicity, it was not designed to be balanced and/or representative of any given population.

DOWNLOAD THE DATA

ChaLearn Looking at People Workshop on Automatic Personality Analysis and

First Impressions Challenge @ ECCV2016

First impressions challenge

Description & data

As part of the speeds interviews project, we are organizing a challenge on “first impressions”, in which participants will develop solutions for recognizing personality traits of users in short video sequences. We are making available a large newly collected data set sponsored by Microsoft of at least 10,000 15-second videos collected from YouTube, annotated with personality traits by AMT workers.

Table 1. Sample videos that will be used for the first impression challenge.

The traits to be recognized will correspond to the “big five” personality traits used in psychology and well known of hiring managers using standardized personality profiling: Extroversion, Agreeableness, Conscientiousness, Neuroticism, and Openness to experience.

As is known, the first impression made is highly important in many contexts, such as human resourcing or job interviews. This work could become very relevant to training young people to present themselves better by changing their behavior in simple ways. The participants who obtain the best results in the challenge will be invited to submit a paper to the workshop.

The challenge is part of the Speed Interviews project, you can know more about this project by entering the corresponding section, additionally, the following video provides a comprehensive overview of the project:

Participating

As previous challenges organized by Chalearn, the first impressions challenge will be based on the CodaLab platform, information about registration and participation can be found in the competition site:

https://competitions.codalab.org/competitions/9181

In broad terms the challenge will proceed as follows:

1. Participants register to the challenge.
2. Development (labeled) and validation (unlabeled) data sets are made available to registered participants.
3. Participants develop their trait recognition methods using development and validation data.
4. Validation labels are released, participants can tune their methods and use development+validation data to train their final models.
5. Final evaluation (test) data are released, participants make predictions for test samples and submit them via CodaLab.
6. Participants submit fact sheets describing their methods.
7. Organizers start the verification process and notify the final results.
8. Top ranked participants with verified codes are eligible for prizes.
9. Top ranked participants are encouraged to submit a paper to the associated workshop.
10. Prizes are awarded during the ECCV workshop at Amsterdam.

Evaluation

Participants will be evaluated by a measure associated to the number of correct traits being recognized in the test set. More information to be added soon.

Prizes

Top three ranked participants of the challenge will receive a prize as follows (estimated, it depends on the available budget):

• First place: 1500USD + 400USD travel grant + award certificate
• Second place: 1000USD + 400USD travel grant + award certificate
• Thrid- place: 500USD + 400USD travel grant + award certificate

in addition top ranked participants will be invited to follow the workshop submission guide for inclusion of a description of their system at the ECCV 2016 workshop proceedings, participants of the workshop or challenge will be invited to submit revised and extended versions of their papers to be considered for publication in a special issue on personality analysis in the IEEE Transactions on Affecfive Computing.

Important dates

• May, 15th, 2016: Beginning of the quantitative competition, release of development (with labels) and validation data (without labels).
• June 30th, 2016: Release of encrypted final evaluation data (without labels) and validation labels. Participants can start training their methods with the whole data set.
• July 3rd, 2016: Release of final evaluation data decryption key. Participants start predicting the results on the final evaluation data.
• July 13th, 2016: End of the quantitative competition. Deadline for submitting the predictions over the final evaluation data. Deadline for code submission. The organizers start the code verification by running it on the final evaluation data.
• July 15th, 2016: Deadline for submitting the fact sheets.
• July 15th, 2016: Release of the verification results to the participants for review. Top ranked participants are invited to follow the workshop submission guide for inclusion at ECCV 2016 ChaLearn Looking at People workshop proceedings.