“Video Captioning” Project

Project Details / Instructions / Workflow

• A project for AirBnB
• Video instruction by Kevin L: Slack

Tasks

• Scouting Alignerrs for respective language groups
• Source Alignerrs of various linguistic backgrounds into projects of various languages

Takeaways

• Revealed problem with “Domain Rating”
  • Labelers get to rate fellow labelers during the review process. This leaves opening for abuse and unfair assessments.
  • How do we rate labelers who skipped data rows, for instance, based on previous instructions, when they’re not allowed to because of updated instructions?

Achievements

Learnings