CEGS N-GRID Natural Language Processing (NLP) Challenge and Workshop


Friday, November 11, 2016 (All day)


Hilton Chicago, 720 South Michigan Avenue, Chicago, IL 60605

Workshop to be held as allied meeting of the 2016 Fall Symposium of the American Medical Informatics Medical Association (AMIA).

The 2016 Centers of Excellence in Genomic Science (CEGS) Neuropsychiatric Genome-Scale and RDoC Individualized Domains (N-GRID) Challenge, a.k.a., RDoC for Psychiatry Challenge, aims to extract symptom severity from neuropsychiatric clinical records. RDoC is a framework developed under the aegis of the National Institute of Mental Health (NIMH) that facilitates the study of human behaviour from normal to abnormal in various domains. The "Challenge" goal is to classify symptom severity in a domain for a patient based on information included in initital psychiatric evaluations and as recorded as part of each individual's electronic health record.

This Challenge will be conducted on initial psychiatric evaluations (1 per patient) which have been fully de-identified and scored by clinical experts in a symptom domain. The data for this task are derived from actual clinical records used as part of this project and will be released under a Rules of Conduct and Data Use Agreement.

The evaluation for the various NLP tracks will be conducted using withheld test data. Participating teams are asked to stop development as soon as the test data is downloaded. Each team is allowed to upload up to to three system runs for each task, output from which will be submitted in the exact format of the ground truth annotations provided by organizers for scoring.

Participants are asked to submit a 500-word long abstract describing their methodologies. Abstracts may also have a graphical summary of the proposed architecture. This document should not exceed 2 pages, 1.5 line spacing, 12 font size. The authors of either the top performing systems or particularly novel approaches will be invited to present or demonstrate their systems at the Workshop. A special issue of an appropriate journal will be organized following the workshop so that the NLP community at large may benefit from this work.

Organizing Committee

  • Ozlem Uzuner, co-chair, SUNY at Albany
  • Amber Stubbs, co-chair, Simmons College
  • Michele Filannino, co-chair, SUNY at Albany
  • Tianxi Cai, Harvard T.H. Chan School of Public Health
  • Susanne Churchill, Harvard Medical School
  • Isaac Kohane, Harvard Medical School
  • Thomas McCoy, MGH, Harvard Medical School
  • Roy Perlis, MGH, Harvard Medical School
  • Peter Szolovits, MIT
  • Uma Vaidyanathan, NIMH
  • Philip Wang, American Psychiatric Association

Additional information, Challenge milestones and DUAs.