leondz/wnut_17

Dataset Overview

Dataset Name

• Name: WNUT 17
• Alias: wnut_17

Dataset Description

• Task: Emerging and rare entity recognition
• Language: English (en)
• License: CC‑BY‑4.0
• Source: Original data
• Data Type: Monolingual
• Scale: 1K < n < 10K
• Task Category: Token Classification
• Task ID: Named Entity Recognition

Dataset Structure

• Features:
  • id: string, example identifier
  • tokens: list of strings, example text tokens
  • ner_tags: list of labels, IOB2‑formatted NER tags
• Splits:
  • train: 3,394 examples
  • validation: 1,009 examples
  • test: 1,287 examples

Annotation

• Annotators: Crowd‑sourced
• Language Creators: Discovery

Usage Notes

• Citation:

  @inproceedings{derczynski-etal-2017-results, title = "Results of the {WNUT}2017 Shared Task on Novel and Emerging Entity Recognition", author = "Derczynski, Leon and Nichols, Eric and van Erp, Marieke and Limsopatham, Nut", booktitle = "Proceedings of the 3rd Workshop on Noisy User‑generated Text", month = sep, year = "2017", address = "Copenhagen, Denmark", publisher = "Association for Computational Linguistics", url = "https://www.aclweb.org/anthology/W17-4418", doi = "10.18653/v1/W17-4418", pages = "140--147", abstract = "This shared task focuses on identifying unusual, previously‑unseen entities in the context of emerging discussions. ..." }