Svetlana Kiritchenko, Ph.D.

National Research Council Canada

• Home
• CV
• Research
• Publications
• Resources

Google Scholar Profile

Publications:

• Guo, R., Nejadgholi, I., Dawkins, H., Fraser, K.C., Kiritchenko, S. (2024) Adaptable Moral Stances of Large Language Models on Sexist Content: Implications for Society and Gender Discourse. In Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP 2024), Miami, Florida, USA, November 2024. [pdf]
• Fraser, K.C., Kiritchenko, S., Nejadgholi, I. (2024) How Does Stereotype Content Differ across Data Sources? In Proceedings of the 13th Joint Conference on Lexical and Computational Semantics (*SEM 2024), Mexico City, Mexico, June 2024. [pdf]
• Curto, G., Kiritchenko, S., Fraser, K.C., Nejadgholi, I. (2024) The Crime of Being Poor: Associations between Crime and Poverty on Social Media in Eight Countries. In Proceedings of the Sixth Workshop on NLP and Computational Social Science (NLP+CSS), Mexico City, Mexico, June 2024. [pdf]
• Nejadgholi, I., Fraser, K.C., Kerkhof, A., Kiritchenko, S. (2024) Challenging Negative Gender Stereotypes: A Study on the Effectiveness of Automated Counter-Stereotypes. In Proceedings of the Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024), Torino, Italy, May 2024. [pdf] [data]
• Fraser, K.C., Kiritchenko, S. (2024) Examining Gender and Racial Bias in Large Vision--Language Models Using a Novel Dataset of Parallel Images. In Proceedings of the 18th Conference of the European Chapter of the Association for Computational Linguistics (EACL), Malta, March 2024. [paper]
• Kiritchenko, S., Curto, G., Nejadgholi, I., Fraser, K.C. (2023) Aporophobia: An Overlooked Type of Toxic Language Targeting the Poor. In Proceedings of the 7th Workshop on Online Abuse and Harms (WOAH), Toronto, ON, Canada, July 2023. Outstanding Paper Award [pdf]
• Nejadgholi, I., Kiritchenko, S., Fraser, K.C., Balkir, E. (2023) Concept-Based Explanations to Test for False Causal Relationships Learned by Abusive Language Classifiers. In Proceedings of the 7th Workshop on Online Abuse and Harms (WOAH), Toronto, ON, Canada, July 2023. [pdf]
• Fraser, K.C., Kiritchenko, S., Nejadgholi, I., Kerkhof, A. (2023) What Makes a Good Counter-Stereotype? Evaluating Strategies for Automated Responses to Stereotypical Text. In Proceedings of the First Workshop on Social Influence in Conversations (SICon), Toronto, ON, Canada, July 2023. [pdf]
• Fraser, K.C., Kiritchenko, S., Nejadgholi, I. (2023) Diversity is Not a One-Way Street: Pilot Study on Ethical Interventions for Racial Bias in Text-to-Image Systems. In Proceedings of the 14th International Conference on Computational Creativity (ICCC), Waterloo, ON, Canada, June 2023. Best Short Paper Award [pdf]
• Fraser, K.C., Nejadgholi, I., Kiritchenko, S. (2023) A Friendly Face: Do Text-to-Image Systems Rely on Stereotypes when the Input is Under-Specified? In Proceedings of the Creative AI Across Modalities Workshop (CreativeAI @ AAAI), Washington, DC, USA, Feb. 2023. [pdf]
• Nejadgholi, I., Balkir, E., Fraser, K.C., Kiritchenko, S. (2022) Towards Procedural Fairness: Uncovering Biases in How a Toxic Language Classifier Uses Sentiment Information. In Proceedings of the Workshop on Analyzing and Interpreting Neural Networks for NLP (BlackboxNLP), Abu Dhabi, United Arab Emirates, Dec. 2022. [pdf][code]
• Balkir, E., Kiritchenko, S., Nejadgholi, I., Fraser, K.C. (2022) Challenges in Applying Explainability Methods to Improve the Fairness of NLP Models. In Proceedings of the Second Workshop on Trustworthy Natural Language Processing (TrustNLP @ NAACL), Seattle, WA, USA, July 2022. [pdf]
• Fraser, K.C., Kiritchenko, S., Balkir, E. (2022) Does Moral Code Have a Moral Code? Probing Delphi's Moral Philosophy. In Proceedings of the Second Workshop on Trustworthy Natural Language Processing (TrustNLP @ NAACL), Seattle, WA, USA, July 2022. [pdf][project webpage]
• Balkir, E., Nejadgholi, I., Fraser, K.C., Kiritchenko, S. (2022). Necessity and Sufficiency for Explaining Text Classifiers: A Case Study in Hate Speech Detection. In Proceedings of the Annual Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL), Seattle, WA, USA, July 2022. [pdf][code]
• Fraser, K.C., Kiritchenko, S., Nejadgholi, I. (2022). Extracting Age-Related Stereotypes from Social Media Texts. In Proceedings of the Language Resources and Evaluation Conference (LREC-2022), Marseille, France, June 2022. [pdf][project webpage]
• Fraser, K.C., Kiritchenko, S., Nejadgholi, I. (2022). Computational Modelling of Stereotype Content in Text. Frontiers in Artificial Intelligence, April, 2022. [paper]
• Nejadgholi, I., Fraser K. C., and Kiritchenko, S. (2022). Improving Generalizability in Implicitly Abusive Language Detection with Concept Activation Vectors. In Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics, Dublin, Ireland, May 2022. [pdf][code]
• Fraser K. C., Nejadgholi, I. and Kiritchenko, S. (2021). Understanding and Countering Stereotypes: A Computational Approach to the Stereotype Content Model. In Proceedings of the Joint Conference of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (ACL-IJCNLP 2021), August 2021. [pdf]
• Hipson, W., Kiritchenko, S., Mohammad, S., Coplan R. (2021). Examining the Language of Solitude vs. Loneliness in Tweets. Journal of Social and Personal Relationships, March 2021. [paper]
• Kiritchenko, S., Nejadgholi, I., and Fraser, K. C. (2021). Confronting Abusive Language Online: A Survey from the Ethical and Human Rights Perspective. Journal of Artificial Intelligence Research, 71: 431-478, July 2021. [pdf][extended abstract]
• Nejadgholi, I. and Kiritchenko, S. (2020). On Cross-Dataset Generalization in Automatic Detection of Online Abuse. In Proceedings of the 4th Workshop on Online Abuse and Harms at EMNLP-2020, November 2020. [pdf]
• Kiritchenko, S. and Nejadgholi, I. (2020). Towards Ethics by Design in Online Abusive Content Detection. NRC Technical Report, October 2020. [pdf]
• Kiritchenko, S., Hipson, W. E., Coplan, R. J., and Mohammad, S. (2020). SOLO: A Corpus of Tweets for Examining the State of Being Alone. In Proceedings of the 12th edition of the Language Resources and Evaluation Conference, May 2020. [pdf][project webpage]
• de Bruijn, B., Désillets, A., Fraser, K., Kiritchenko, S., Mohammad, S., Vinson, N., Bloomfield, P., Brace, H., Brzoska, K., Elhalal, A., Ho, K., Kinsey, L., McWhirter, R., Nazare, M., and Ofuri-Kuragu, E. (2019). Applied AI Ethics. Report on Canada-United Kingdom Symposia on Ethics in AI in Ottawa, Canada and London, UK. Digital Catapult, London, UK / NRC, Ottawa, Canada, 2019 [pdf] [website]
• Asaadi, S., Mohammad, S., and Kiritchenko, S. (2019). Big BiRD: A Large, Fine-Grained, Bigram Relatedness Dataset for Examining Semantic Composition. In Proceedings of the Annual Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL), Minneapolis, USA, 2019 [pdf] [project webpage]
• Sarker, A., Belousov, M., Friedrichs, J., Hakala, K., Kiritchenko, S., Mehryary, F., Han, S., Tran, T., Rios, A., Kavuluru, R., de Bruijn, B., Ginter, F., Mahata, D., Mohammad, S., Nenadic, G., Gonzalez-Hernandez, G. (2018). Data and Systems for Medication-Related Text Classification and Concept Normalization from Twitter: Insights from the Social Media Mining for Health (SMM4H) 2017 Shared Task. Journal of the American Medical Informatics Association (JAMIA), 25(10): 1274-1283, 2018 [paper]
• Wojatzki, M., Zesch, T., Mohammad, S., and Kiritchenko, S. (2018). Agree or Disagree: Predicting Judgments on Nuanced Assertions. In Proceedings of the 7th Joint Conference on Lexical and Computational Semantics (*SEM), New Orleans, USA, 2018 [pdf] [project webpage]
• Kiritchenko, S. and Mohammad, S. (2018). Examining Gender and Race Bias in Two Hundred Sentiment Analysis Systems. In Proceedings of the 7th Joint Conference on Lexical and Computational Semantics (*SEM), New Orleans, USA, 2018 [pdf] [data]
• Naderi, H., Soleimani, B. H., Mohammad, S., Kiritchenko, S., and Matwin S. (2018). DeepMiner at SemEval-2018 Task 1: Emotion Intensity Recognition Using Deep Representation Learning. In Proceedings of the International Workshop on Semantic Evaluation (SemEval-2018), New Orleans, LA, USA, June 2018 [pdf]
• Mohammad, S., Bravo-Marquez, F., Salameh, M., and Kiritchenko, S. (2018). Semeval-2018 Task 1: Affect in tweets. In Proceedings of the International Workshop on Semantic Evaluation (SemEval-2018), New Orleans, LA, USA, June 2018 [pdf] [task webpage]
• Wojatzki, M., Mohammad, S., Zesch, T., and Kiritchenko, S. (2018). Quantifying Qualitative Data for Understanding Controversial Issues. In Proceedings of the 11th edition of the Language Resources and Evaluation Conference, Miyazaki, Japan, May 2018 [pdf] [project webpage]
• Mohammad, S. and Kiritchenko, S. (2018). Understanding Emotions: A Dataset of Tweets to Study Interactions between Affect Categories. In Proceedings of the 11th edition of the Language Resources and Evaluation Conference, Miyazaki, Japan, May 2018 [pdf] [data]
• Mohammad, S. and Kiritchenko, S. (2018). WikiArt Emotions: An Annotated Dataset of Emotions Evoked by Art. In Proceedings of the 11th edition of the Language Resources and Evaluation Conference, Miyazaki, Japan, May 2018 [pdf] [data]
• Kiritchenko, S., Mohammad, S., Morin, J., and de Bruijn, B. (2017). NRC-Canada at SMM4H Shared Task: Classifying Tweets Mentioning Adverse Drug Reactions and Medication Intake. In Proceedings of the Social Media Mining for Health Applications Workshop at AMIA-2017, Washington, DC, USA, 2017. SMM4H-2017 best performing system to classify tweets mentioning adverse drug reactions (subtask 1) [pdf]
• Kiritchenko, S. and Mohammad, S. (2017) Best-Worst Scaling More Reliable than Rating Scales: A Case Study on Sentiment Intensity Annotation. In Proceedings of the Annual Meeting of the Association for Computational Linguistics, Vancouver, Canada, 2017 [pdf] [BWS scripts]
• Mohammad, S., Sobhani, P., Kiritchenko, S. (2017). Stance and Sentiment in Tweets. ACM Transactions on Internet Technology, 17(3), 2017 [pdf] [data] [interactive visualization]
• Sobhani, P., Mohammad, S., and Kiritchenko, S. (2016) Detecting Stance in Tweets and Analyzing its Interaction with Sentiment. In Proceedings of the 5th Joint Conference on Lexical and Computational Semantics (*SEM), pp. 159-169, Berlin, Germany, 2016 [pdf] [data] [interactive visualization]
• Kiritchenko, S., and Mohammad, S. (2016) The Effect of Negators, Modals, and Degree Adverbs on Sentiment Composition. In Proceedings of the 7th Workshop on Computational Approaches to Subjectivity, Sentiment and Social Media Analysis (WASSA), San Diego, California, 2016 [pdf] [lexicon] [interactive visualization]
• Kiritchenko, S., Mohammad, S., and Salameh, M. (2016) SemEval-2016 Task 7: Determining Sentiment Intensity of English and Arabic Phrases. In Proceedings of the International Workshop on Semantic Evaluation (SemEval-2016), San Diego, California, 2016 [pdf] [task webpage]
• Mohammad, S., Kiritchenko, S., Sobhani, P., Zhu, X., and Cherry, C. (2016) SemEval-2016 Task 6: Detecting Stance in Tweets. In Proceedings of the International Workshop on Semantic Evaluation (SemEval-2016), San Diego, California, 2016 [pdf] [task webpage] [interactive visualization]
• Kiritchenko, S., and Mohammad, S. (2016) Capturing Reliable Fine-Grained Sentiment Associations by Crowdsourcing and Best-Worst Scaling. In Proceedings of the 15th Annual Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL), San Diego, California, 2016 [pdf] [BWS scripts] [lexicons]
• Kiritchenko, S., and Mohammad, S. (2016) Sentiment Composition of Words with Opposing Polarities. In Proceedings of the 15th Annual Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL), San Diego, California, 2016 [pdf] [lexicon] [interactive visualization]
• Mohammad, S., Kiritchenko, S., Sobhani, P., Zhu, X., and Cherry, C. (2016) A Dataset for Detecting Stance in Tweets. In Proceedings of the 10th edition of the Language Resources and Evaluation Conference (LREC), Portoroz, Slovenia, 2016 [pdf] [data] [interactive visualization]
• Mohammad, S., Salameh, M., and Kiritchenko, S. (2016) Sentiment Lexicons for Arabic Social Media. In Proceedings of the 10th edition of the Language Resources and Evaluation Conference (LREC), Portoroz, Slovenia, 2016 [pdf] [lexicons]
• Kiritchenko, S., and Mohammad, S. (2016) Happy Accident: A Sentiment Composition Lexicon for Opposing Polarities Phrases. In Proceedings of the 10th edition of the Language Resources and Evaluation Conference (LREC), Portoroz, Slovenia, 2016 [pdf] [lexicon] [interactive visualization]
• Mohammad, S., Salameh, M., Kiritchenko, S. (2016). How Translation Alters Sentiment. Journal of Artificial Intelligence Research, 55:95-130, 2016 [pdf] [data and lexicons]
• Nakov, P., Rosenthal, S., Kiritchenko, S., Mohammad, S., Kozareva, Z., Ritter, A., Stoyanov, V., Zhu, X. (2016). Developing a Successful SemEval Task in Sentiment Analysis of Twitter and Other Social Media Texts. Language Resources and Evaluation, 50(1):35-65, 2016 [pdf]
• Rosenthal, S., Nakov, P., Kiritchenko, S., Mohammad, S., Ritter, A., and Stoyanov, V. (2015) SemEval-2015 Task 10: Sentiment Analysis in Twitter. In Proceedings of the 9th International Workshop on Semantic Evaluation (SemEval-2015), Denver, Colorado, USA, 2015 [pdf] [task webpage]
• Salameh, M., Mohammad, S., Kiritchenko, S. (2015). Sentiment after Translation: A Case-Study on Arabic Social Media Posts. In Proceedings of the Conference of the North American Chapter of the Association for Computational Linguistics - Human Language Technologies (NAACL-HLT-2015), Denver, Colorado, USA, 2015 [pdf] [data and lexicons]
• Mohammad, S., Zhu, X., Kiritchenko, S., and Martin, J. (2015) Sentiment, Emotion, Purpose, and Style in Electoral Tweets. Information Processing & Management, 51:480-499, 2015 [pdf]
• Mohammad, S., Kiritchenko S. (2015) Using Hashtags to Capture Fine Emotion Categories from Tweets. Computational Intelligence, 31(2): 301-326, 2015 [pdf]
• Kiritchenko, S., Zhu, X., Mohammad, S. (2014). Sentiment Analysis of Short Informal Texts. Journal of Artificial Intelligence Research, 50:723-762, 2014 [pdf] [lexicons]
• Kiritchenko, S., Zhu, X., Cherry, C., and Mohammad, S. (2014) NRC-Canada-2014: Detecting Aspects and Sentiment in Customer Reviews. In Proceedings of the 8th International Workshop on Semantic Evaluation Exercises (SemEval-2014), Dublin, Ireland, 2014. SemEval-2014 Task 4 best performing system to detect sentiment towards aspect terms (subtask 2), to detect aspect categories (subtask 3), and to detect sentiment towards aspect categories (subtask 4) [pdf] [lexicons]
• Zhu, X., Kiritchenko, S., and Mohammad, S. (2014) NRC-Canada-2014: Recent Improvements in the Sentiment Analysis of Tweets. In Proceedings of the 8th International Workshop on Semantic Evaluation Exercises (SemEval-2014), Dublin, Ireland, 2014. SemEval-2014 Task 9 best performing system to determine term-level sentiment (subtask A) and message-level sentiment (subtask B) [pdf] [lexicons]
• Zhu, X., Guo, H., Mohammad, S., Kiritchenko, S. (2014). An Empirical Study on the Effect of Negation Words on Sentiment. In Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics (ACL), 2014 [pdf]
• Mohammad, S., Kiritchenko, S., and Martin, J. (2013) Identifying Purpose behind Electoral Tweets. In Proceedings of the Second International Workshop on Issues of Sentiment Discovery and Opinion Mining (WISDOM), 2013 [pdf]
• Mohammad, S., Kiritchenko, S., and Zhu, X. (2013) NRC-Canada: Building the State-of-the-Art in Sentiment Analysis of Tweets. In Proceedings of the 7th International Workshop on Semantic Evaluation Exercises (SemEval-2013), 2013. SemEval-2013 Task 2 best performing system to determine term-level sentiment (subtask A) and message-level sentiment (subtask B) [pdf] [lexicons]
• Mohammad, S. and Kiritchenko, S. (2013) Using Nuances of Emotion to Identify Personality. In Proceedings of the ICWSM workshop on Computational Personality Recognition, 2013 [pdf]
• Zhu, X., Cherry, C., Kiritchenko, S., Martin, J., de Bruijn, B. (2013) Detecting Concept Relations in Clinical Text: Insights from a State-of-The-Art Model. Journal of Biomedical Informatics, 46(2):275-85, 2013 [pdf]
• Kiritchenko, S., and Cherry, C. (2011) Lexically-Triggered Hidden Markov Models for Clinical Document Coding. In Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics (ACL), 2011 [pdf]
• de Bruijn, B., Cherry, C., Kiritchenko, S., Martin, J., Zhu, X. (2011) Machine-Learned Solutions for Three Stages of Clinical Information Extraction: the State of the Art at i2b2 2010. Journal of the American Medical Informatics Association (JAMIA), 18:557-562, 2011. i2b2-2010 best performing system to extract medical problems, tests, and treatments (subtask 1) and to classify assertions made on medical problems (subtask 2) [pdf]
• de Bruijn, B., Cherry, C., Kiritchenko, S., Martin, J., Zhu, X. (2010) NRC at i2b2: One Challenge, Three Practical Tasks, Nine Statistical Systems, Hundreds of Clinical Records, Millions of Useful Features. In Proceedings of the I2B2 workshop at AMIA, 2010. i2b2-2010 best performing system to extract medical problems, tests, and treatments (subtask 1) and to classify assertions made on medical problems (subtask 2) [pdf]
• Kiritchenko, S., de Bruijn, B., Carini, S., Martin, J., and Sim, I. (2010) ExaCT: Automatic Extraction of Clinical Trial Characteristics from Journal Publications. BMC Medical Informatics and Decision Making 2010, 10:56 [pdf] [demo][video]
• Kiritchenko, S. (2009) Hierarchical Text Categorization: Algorithms, Evaluation, and Applications. VDM Verlag, 2009 [buy]
• de Bruijn, B., Carini, S., Kiritchenko, S., Sim, I., and Martin, J. (2008) Automated Information Extraction of Key Trial Design Elements from Clinical Trial Publications. In Proceedings of the AMIA Annual Symposium, pp. 141-145, 2008 [pdf] [demo]
• Kiritchenko, S., and Jiline, M. (2008) Keyword Optimization in Sponsored Search via Feature Selection. Journal of Machine Learning Research, Workshop and Conference Proceedings, 4:122-134, 2008 [pdf]
• Kiritchenko, S. (2006) Hierarchical Text Categorization: Algorithms, Evaluation, and Applications. Ph.D. Thesis, University of Ottawa, 2006 [pdf]
• Kiritchenko, S., Matwin, S., Nock, R., and Famili, F. (2006) Learning and Evaluation in the Presence of Class Hierarchies: Application to Text Categorization. In Proceedings of the 19th Canadian Conference on Artificial Intelligence, LNCS, v. 4013, pp. 395-406, Springer, 2006 [pdf]
• Kiritchenko, S., Matwin, S. and Famili, F. (2005) Functional Annotation of Genes Using Hierarchical Text Categorization. In Proceedings of the BioLINK SIG: Linking Literature, Information and Knowledge for Biology, a joint meeting of the ISMB BioLINK Special Interest Group on Text Data Mining and the ACL Workshop on Linking Biological Literature, Ontologies and Databases: Mining Biological Semantics (held at ISMB-05), 2005 [pdf]
• Kiritchenko, S., Matwin, S., and Famili, F. (2004) Hierarchical Text Categorization as a Tool of Associating Genes with Gene Ontology Codes. In Proceedings of the Second European Workshop on Data Mining and Text Mining for Bioinformatics (held at ECML-04), pp. 26-30, 2004 [pdf]
• Kiritchenko, S., Matwin, S., and Abu-Hakima, S. (2004) Email Classification with Temporal Features. In Proceedings of Intelligent Information Systems, New Trends in Intelligent Information Processing and Web Mining (IIPWM), Springer Verlag series on Advances in Soft Computing, pp. 523 - 534, Zakopane, Poland, 2004 [pdf]
• Kiritchenko, S., and Matwin, S. (2002) Generalized Features. Their Application to Classification. In Proceedings of the AAAI Conference on Artificial Intelligence, Doctoral Consortium, p. 985, Edmonton, Canada, 2002 [pdf]
• Kiritchenko, S., and Matwin, S. (2001) Email Classification with Co-Training. In Proceedings of CASCON 2001, pages 192-201, Toronto, Canada, 2001. CASCON-2011 Award: Most Influential Paper from a decade ago [pdf]