Here are some resources I always go to for data annotation and how to have the best-quality possible for your annotated datasets:
📚 Books
- Ide, N., & Pustejovsky, J. (2017). Handbook of Linguistic Annotation. Springer
- Pustejovsky, J., & Stubbs, A. (2012). Natural Language Annotation for Machine Learning: A guide to corpus-building for applications. O’Reilly Media, Inc.
📄 Papers & white-papers
- Aldama, N. et al. Anotación de corpus lingüísticos: metodología utilizada en el Instituto de Ingeniería del Conocimiento (IIC)
- Klie, J.-C., Eckart de Castilho, R., & Gurevych, I. (2024). Analyzing Dataset Annotation Quality Management in the Wild. Computational Linguistics, 50(3), 817-866. https://doi.org/10.1162/coli_a_00516
- Tseng, T. et al. (2020) Best Practices for Managing Annotation Projects. Bloomberg