Prof. Dr.-Ing. Torsten Zesch

2022

1. German Medical Natural Language Processing–A Data-centric Survey

   Zesch, Torsten, and Bewersdorff, Jeanette

   Applications in Medicine and Manufacturing Nov 2022

   PDF
2. CNN-based Ruled Line Removal in Handwritten Documents

   Gold, Christian, and Zesch, Torsten

   In Proceedings of the 18th International Conference on Frontiers of Handwriting Recognition (ICFHR 2022) Dec 2022

   PDF
3. Similarity-Based Content Scoring - How to Make S-BERT Keep Up With BERT

   Bexte, Marie, Horbach, Andrea, and Zesch, Torsten

   In Proceedings of the 17th Workshop on Innovative Use of NLP for Building Educational Applications (BEA 2022) Jul 2022

   Abstract PDF

   The dominating paradigm for content scoring is to learn an instance-based model, i.e. to use lexical features derived from the learner answers themselves. An alternative approach that receives much less attention is however to learn a similarity-based model. We introduce an architecture that efficiently learns a similarity model and find that results on the standard ASAP dataset are on par with a BERT-based classification approach.

4. ‘Meet me at the ribary’ – Acceptability of spelling variants in free-text answers to listening comprehension prompts

   Laarmann-Quante, Ronja, Schwarz, Leska, Horbach, Andrea, and Zesch, Torsten

   In Proceedings of the 17th Workshop on Innovative Use of NLP for Building Educational Applications (BEA 2022) Jul 2022

   Abstract PDF

   When listening comprehension is tested as a free-text production task, a challenge for scoring the answers is the resulting wide range of spelling variants. When judging whether a variant is acceptable or not, human raters perform a complex holistic decision. In this paper, we present a corpus study in which we analyze human acceptability decisions in a high stakes test for German. We show that for human experts, spelling variants are harder to score consistently than other answer variants.Furthermore, we examine how the decision can be operationalized using features that could be applied by an automatic scoring system. We show that simple measures like edit distance and phonetic similarity between a given answer and the target answer can model the human acceptability decisions with the same inter-annotator agreement as humans, and discuss implications of the remaining inconsistencies.

5. LeSpell - A Multi-Lingual Benchmark Corpus of Spelling Errors to Develop Spellchecking Methods for Learner Language

   Bexte, Marie, Laarmann-Quante, Ronja, Horbach, Andrea, and Zesch, Torsten

   In Proceedings of the Language Resources and Evaluation Conference Jun 2022

   Abstract PDF

   Spellchecking text written by language learners is especially challenging because errors made by learners differ both quantitatively and qualitatively from errors made by already proficient learners. We introduce LeSpell, a multi-lingual (English, German, Italian, and Czech) evaluation data set of spelling mistakes in context that we compiled from seven underlying learner corpora. Our experiments show that existing spellcheckers do not work well with learner data. Thus, we introduce a highly customizable spellchecking component for the DKPro architecture, which improves performance in many settings.

1. INCEpTALYTICS - An easy-to-use API for analyzing INCEpTION annotation projects.

   Hamacher, Marius, and Zesch, Torsten

   In Proceedings of the 18th Workshop on the Semantics and Pragmatics of Dialogue Feb 2022

   PDF

2021

1. VL-BERT+: Detecting Protected Groups in Hateful Multimodal Memes

   Aggarwal, Piush, Liman, Michelle Espranita, Gold, Darina, and Zesch, Torsten

   In Proceedings of the 5th Workshop on Online Abuse and Harms (WOAH 2021) Aug 2021

   Abstract PDF

   This paper describes our submission (winning solution for Task A) to the Shared Task on Hateful Meme Detection at WOAH 2021. We build our system on top of a state-of-the-art system for binary hateful meme classification that already uses image tags such as race, gender, and web entities. We add further metadata such as emotions and experiment with data augmentation techniques, as hateful instances are underrepresented in the data set.

2. Implicit Phenomena in Short-answer Scoring Data

   Bexte, Marie, Horbach, Andrea, and Zesch, Torsten

   In Proceedings of the First Workshop on Understanding Implicit and Underspecified Language Aug 2021

   PDF
3. Künstliche Intelligenz in der Bildung

   Zesch, Torsten, Horbach, Andrea, and Laarmann-Quante, Ronja

   Unikate: Berichte aus Forschung und Lehre Aug 2021

   PDF
4. Personalizing Handwriting Recognition Systems with Limited User-Specific Samples

   Gold, Christian, Boom, Dario, and Zesch, Torsten

   In Proceedings of the 16th International Conference on Document Analysis and Recognition (ICDAR 2021) Aug 2021

   PDF
5. C-Test Collector: A Proficiency Testing Application to Collect Training Data for C-Tests

   Haring, Christian, Lehmann, Rene, Horbach, Andrea, and Zesch, Torsten

   In Proceedings of the 16th Workshop on Innovative Use of NLP for Building Educational Applications Aug 2021

   PDF
6. Fully vs. Weakly Supervised Caries Localization in Smartphone Images with CNNs

   Pham, Duc Duy, Müller, Jonas, Aggarwal, Piush, Khatri, Amit, Sharma, Mayank, Zesch, Torsten, and Pauli, Josef

   In Artificial Intelligence for Healthcare Applications International Workshop - ICPR 2020 Workshop Proceedings Jan 2021

2020

1. Don’t take "nswvtnvakgxpm" for an answer - The surprising vulnerability of automatic content scoring systems to adversarial input

   Ding, Yuning, Riordan, Brian, Horbach, Andrea, Cahill, Aoife, and Zesch, Torsten

   In Proceedings of the 28th International Conference on Computational Linguistics(COLING 2020) Jan 2020

   PDF
2. Chinese Content Scoring: Open-Access Datasets and Features on Different Segmentation Levels

   Ding, Yuning, Horbach, Andrea, Wang, Haoshi, Song, Xuefeng, and Zesch, Torsten

   In Proceedings of the 1st conference of the Asia-Pacific Chapter of the Association for Computational Linguistics and the 10th International Joint Conference on Natural Language Processing(AACL-IJCNLP 2020) Jan 2020

   PDF
3. Automated Scoring of Teachers’ Pedagogical Content Knowledge - A Comparison between Human and Machine Scoring

   Wahlen, Andreas, Kuhn, Christiane, Zlatkin-Troitschanskaia, Olga, Gold, Christian, Zesch, Torsten, and Horbach, Andrea

   Frontiers in Education Jan 2020

   PDF
4. Exploring the Impact of Handwriting Recognition on the Automated Scoring of Handwritten Student Answers

   Gold, Christian, and Zesch, Torsten

   In Proceedings of the 17th International Conference on Frontiers in Handwriting Recognition (ICFHR 2020) Jan 2020

   PDF
5. Decomposing and Comparing Meaning Relations: Paraphrasing, Textual Entailment, Contradiction, and Specificity

   Kovatchev, Venelin, Gold, Darina, Marti, M. Antonia, Salamo, Maria, and Zesch, Torsten

   In Proceedings of the 12th International Conference on Language Resources and Evaluation (LREC-2020) Jan 2020

   PDF

1. A Legal Approach to Hate Speech: Operationalizing the EU’s Legal Framework against the Expression of Hatred as an NLP Task

   Zufall, Frederike, Hamacher, Marius, Kloppenborg, Katharina, and Zesch, Torsten

   In Proceedings of the 18th Workshop on the Semantics and Pragmatics of Dialogue Feb 2020

   PDF

2019

1. A survey of semantic relatedness evaluation datasets and procedures

   Taieb, Mohamed Ali Hadj, Zesch, Torsten, and Aouicha, Mohamed Ben

   Artificial Intelligence Review Jan 2019

   PDF
2. Proceedings of the Fourteenth Workshop on Innovative Use of NLP for Building Educational Applications

   Yannakoudakis, Helen, Kochmar, Ekaterina, Leacock, Claudia, Madnani, Nitin, Pilán, Ildikó, and Zesch, Torsten

   In Proceedings of the Fourteenth Workshop on Innovative Use of NLP for Building Educational Applications Jan 2019

   PDF
3. German End-to-end Speech Recognition based on DeepSpeech

   Agarwal, Aashish, and Zesch, Torsten

   In Proceedings of the 15th Conference on Natural Language Processing (KONVENS 2019): Long Papers Jan 2019

   PDF
4. Annotating and analyzing the interactions between meaning relations

   Gold, Darina, Kovatchev, Venelin, and Zesch, Torsten

   In Proceedings of the 13th Linguistic Annotation Workshop Jan 2019

   PDF
5. Automatic Diacritization as Prerequisite Towards the Automatic Generation of Arabic Lexical Recognition Tests

   Hamed, Osama, and Zesch, Torsten

   In Proceedings of the 3rd International Conference on Natural Language and Speech Processing Jan 2019

   PDF
6. RELATIONS-Workshop on meaning relations between phrases and sentences

   Kovatchev, Venelin, Gold, Darina, and Zesch, Torsten

   In RELATIONS-Workshop on meaning relations between phrases and sentences Jan 2019

   PDF
7. The Influence of Variance in Learner Answers on Automatic Content Scoring

   Horbach, Andrea, and Zesch, Torsten

   Frontiers in Education Jan 2019

   PDF
8. From legal to technical concept: Towards an automated classification of German political Twitter postings as criminal offenses

   Zufall, Frederike, Horsmann, Tobias, and Zesch, Torsten

   In Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL) Jan 2019

   PDF
9. ltl.uni-due at SemEval 2019 Task 5: Simple but Effective Lexico-Semantic Features for Detecting Hate Speech in Twitter

   Zhang, Huangpan, Wojatzki, Michael, Horsmann, Tobias, and Zesch, Torsten

   In Proceedings of the International Workshop on Semantic Evaluation (SemEval) Jan 2019

   PDF
10. LTL-UDE at SemEval-2019 Task 6: BERT and Two-Vote Classification for Categorizing Offensiveness

    Aggarwal, Piush, Horsmann, Tobias, Wojatzki, Michael, and Zesch, Torsten

    In Proceedings of the International Workshop on Semantic Evaluation (SemEval) Jan 2019

    PDF

2018

1. Corpus of Aspect-based Sentiment in Political Debates

   Gold, Darina, Bexte, Marie, and Zesch, Torsten

   In KONVENS Jan 2018
2. Do Women Perceive Hate Differently: Examining the Relationship Between Hate Speech, Gender, and Agreement Judgments

   Wojatzki, Michael, Horsmann, Tobias, Gold, Darina, and Zesch, Torsten

   In Proceedings of the 14th Conference on Natural Language Processing (KONVENS 2018) Jan 2018

   PDF
3. The Role of Diacritics in Increasing the Difficulty of Arabic Lexical Recognition Tests

   Hamed, Osama, and Zesch, Torsten

   In Proceedings of the 7th Workshop on NLP for Computer Assisted Language Learning at SLTC 2018 (NLP4CALL 2018) Jan 2018

   PDF
4. A flexible online system for curating reduced redundancy language exercises and tests

   Zesch, Torsten, Horbach, Andrea, Goggin, Melanie, and Wrede-Jackes, Jennifer

   In Future-proof CALL: language learning as exploration and encounters – short papers from EUROCALL 2018 Jan 2018

   PDF
5. ESCRITO-An NLP-Enhanced Educational Scoring Toolkit

   Zesch, Torsten, and Horbach, Andrea

   In Proceedings of the Eleventh International Conference on Language Resources and Evaluation (LREC-2018) Jan 2018

   PDF
6. Quantifying qualitative data for understanding controversial issues

   Wojatzki, Michael, Mohammad, Saif, Zesch, Torsten, and Kiritchenko, Svetlana

   In Proceedings of the Eleventh International Conference on Language Resources and Evaluation (LREC-2018) Jan 2018

   PDF
7. DeepTC–An Extension of DKPro Text Classification for Fostering Reproducibility of Deep Learning Experiments

   Horsmann, Tobias, and Zesch, Torsten

   In Proceedings of the Eleventh International Conference on Language Resources and Evaluation (LREC-2018) Jan 2018

   PDF
8. Exploring the Effects of Diacritization on Arabic Frequency Counts

   Hamed, Osama, and Zesch, Torsten

   In International Conference on Natural Language and Speech Processing (ICNLSP 2018) Jan 2018

   PDF
9. Cross-lingual Content Scoring

   Horbach, Andrea, Stennmanns, Sebastian, and Zesch, Torsten

   In Proceedings of the Thirteenth Workshop on Innovative Use of NLP for Building Educational Applications Jan 2018

   PDF

2017

1. A Survey and Comparative Study of Arabic Diacritization Tools

   Hamed, Osama, and Zesch, Torsten

   JLCL: Special Issue-NLP for Perso-Arabic Alphabets Jan 2017

   PDF
2. The Influence of Spelling Error on Content Scoring Performance

   Horbach, Andrea, Ding, Yuning, and Zesch, Torsten

   In Proceedings of the 4th Workshop on Natural Language Processing Techniques for Educational Applications Jan 2017

   PDF
3. GermEval 2017: Shared Task on Aspect-based Sentiment in Social Media Customer Feedback

   Wojatzki, Michael, Ruppert, Eugen, Holschneider, Sarah, Zesch, Torsten, and Biemann, Chris

   In Proceedings of the GermEval 2017 Shared Task on Aspect-based Sentiment in Social Media Customer Feedback Jan 2017

   PDF
4. Same same, but different: Compositionality of paraphrase granularity levels

   Benikova, Darina, and Zesch, Torsten

   In Proceedings of the Recent Advances in Natural Language Processing (RANLP-2017) Jan 2017

   PDF
5. The Role of Diacritics in Designing Lexical Recognition Tests for Arabic

   Hamed, Osama, and Zesch, Torsten

   In 3rd International Conference on Arabic Computational Linguistics (ACLing 2017) Jan 2017

   PDF
6. Part-of-speech tagging for corpora of computer-mediated communication: A case study on finding rare phenomena

   Beißwenger, Michael, Horsmann, Tobias, and Zesch, Torsten

   In 3rd International Conference on Arabic Computational Linguistics (ACLing 2017) Jan 2017

   PDF
7. Investigating neural architectures for short answer scoring

   Riordan, Brian, Horbach, Andrea, Cahill, Aoife, Zesch, Torsten, and Lee, Chong Min

   In Proceedings of the Building Educational Applications Workshop at EMNLP Jan 2017

   PDF
8. Neural, Non-neural and Hybrid Stance Detection in Tweets on Catalan Independence

   Wojatzki, Michael, and Zesch, Torsten

   In Stance and Gender Detection in Tweets on Catalan Independence at Ibereval 2017 Jan 2017

   PDF
9. Fine-grained essay scoring of a complex writing task for native speakers

   Horbach, Andrea, Scholten-Akoun, Dirk, Ding, Yuning, and Zesch, Torsten

   In Proceedings of the Building Educational Applications Workshop at EMNLP Jan 2017

   PDF
10. Reliable Part-of-Speech Tagging of Low-frequency Phenomena in the Social Media Domain

    Horsmann, Tobias, Beißwenger, Michael, and Zesch, Torsten

    In Proceedings of the Conference on CMC and Social Media Corpora for the Humanities Jan 2017

    PDF
11. Do LSTMs really work so well for PoS tagging? – A replication study

    Horsmann, Tobias, and Zesch, Torsten

    In Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP) Jan 2017

    PDF
12. What does this imply? Examining the Impact of Implicitness on the Perception of Hate Speech

    Benikova, Darina, Wojatzki, Michael, and Zesch, Torsten

    In Proceedings of the International Conference of the German Society for Computational Linguistics and Language Technology (GSCL-2017) Jan 2017

    PDF

2016

1. Bridging the gap between computable and expressive event representations in Social Media

   Benikova, Darina, and Zesch, Torsten

   In Proceedings of the Workshop on Uphill Battles in Language Processing: Scaling Early Achievements to Robust Methods Jan 2016

   Abstract PDF

   An important goal in text understanding is making sense of events. However, there is a gap between computable representations on the one hand and expressive representations on the other hand. We aim to bridge this gap by inducing distributional semantic clusters as labels in a frame structural representation.

2. LTL-UDE at EmpiriST 2015: Tokenization and PoS Tagging of Social Media Text

   Horsmann, Tobias, and Zesch, Torsten

   In Proceedings of the 10th Web as Corpus Workshop (WAC-X) and the EmpiriST Shared Task Jan 2016

   PDF
3. Stance-based Argument Mining – Modeling Implicit Argumentation Using Stance

   Wojatzki, Michael, and Zesch, Torsten

   In Proceedings of the KONVENS Jan 2016

   PDF
4. ltl.uni-due at SemEval-2016 Task 6: Stance Detection in Social Media Using Stacked Classifiers

   Wojatzki, Michael, and Zesch, Torsten

   In Proceedings of the 10th International Workshop on Semantic Evaluation (SemEval 2016) Jan 2016

   PDF
5. Assigning Fine-grained PoS Tags based on High-precision Coarse-grained Tagging

   Horsmann, Tobias, and Zesch, Torsten

   In Proceedings of COLING 2016, the 26th International Conference on Computational Linguistics: Technical Papers Jan 2016

   PDF
6. Predicting proficiency levels in learner writings by transferring a linguistic complexity model from expert-written coursebooks

   Pilán, Ildikó, Volodina, Elena, and Zesch, Torsten

   In Proceedings of COLING 2016, the 26th International Conference on Computational Linguistics: Technical Papers Jan 2016

   PDF
7. Predicting the Spelling Difficulty of Words for Language Learners

   Beinborn, Lisa, Zesch, Torsten, and Gurevych, Iryna

   In Proceedings of the Building Educational Applications Workshop at NAACL Jan 2016

   PDF
8. Bundled Gap Filling: A New Paradigm for Unambiguous Cloze Exercises.

   Wojatzki, Michael, Melamud, Oren, and Zesch, Torsten

   In Proceedings of the Building Educational Applications Workshop at NAACL Jan 2016

   PDF
9. FlexTag: A Highly Flexible Pos Tagging Framework

   Zesch, Torsten, and Horsmann, Tobias

   In Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC 2016) Jan 2016

   PDF
10. Building a Social Media Adapted PoS Tagger Using FlexTag – A Case Study on Italian Tweets

    Horsmann, Tobias, and Zesch, Torsten

    In Fifth Evaluation Campaign of Natural Language Processing and Speech Tools for Italian - EVALITA 2016 Jan 2016

    PDF
11. Validating Bundled Gap Filling – Empirical Evidence for Ambiguity Reduction and Language Proficiency Testing Capabilities

    Meyer, Niklas, Wojatzki, Michael, and Zesch, Torsten

    In Proceedings of the NLP4CALL at SLTC 2016 Jan 2016

    PDF

2015

1. Candidate evaluation strategies for improved difficulty prediction of language tests

   Beinborn, Lisa, Zesch, Torsten, and Gurevych, Iryna

   In Proceedings of the Building Educational Applications Workshop at NAACL Jan 2015

   PDF
2. Fast or Accurate ? – A Comparative Evaluation of PoS Tagging Models

   Horsmann, Tobias, Erbs, Nicolai, and Zesch, Torsten

   In Proceedings of the International Conference of the German Society for Computational Linguistics and Language Technology (GSCL-2015) Jan 2015

   PDF
3. Reducing Annotation Efforts in Supervised Short Answer Scoring

   Zesch, Torsten, Heilman, Michael, and Cahill, Aoife

   In Proceedings of the Building Educational Applications Workshop at NAACL Jan 2015

   PDF
4. Task-Independent Features for Automated Essay Grading

   Zesch, Torsten, Wojatzki, Michael, and Scholten-Akoun, Dirk

   In Proceedings of the Building Educational Applications Workshop at NAACL Jan 2015

   PDF
5. Counting What Counts: Decompounding for Keyphrase Extraction

   Erbs, Nicolai, Santos, Pedro Bispo, Zesch, Torsten, and Gurevych, Iryna

   In Counting What Counts: Decompounding for Keyphrase Extraction Jan 2015

   PDF
6. Effectiveness of Domain Adaptation Approaches for Social Media PoS Tagging

   Horsmann, Tobias, and Zesch, Torsten

   In Proceeding of the Second Italian Conference on Computational Linguistics Jan 2015

   PDF
7. Proceedings of the 9th International Workshop on Semantic Evaluation (SemEval 2015)

   Nakov, Preslav, Zesch, Torsten, Cer, Daniel, and Jurgens, David

   In Proceeding of the Second Italian Conference on Computational Linguistics Jan 2015

   PDF
8. Composing Measures for Computing Text Similarity

   Bär, Daniel, Zesch, Torsten, and Gurevych, Iryna

   In Proceeding of the Second Italian Conference on Computational Linguistics Jan 2015

   PDF
9. Generating Nonwords for Vocabulary Proficiency Testing

   Hamed, Osama, and Zesch, Torsten

   In Proceeding of the 7th Language and Technology Conference: Human Language Technologies as a Challenge for Computer Science and Linguistics Jan 2015

   PDF

2014

1. DKPro Keyphrases: Flexible and Reusable Keyphrase Extraction Experiments

   Erbs, Nicolai, Santos, Pedro Bispo, Gurevych, Iryna, and Zesch, Torsten

   In Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics. System Demonstrations Jan 2014

   PDF
2. Readability for foreign language learning: The importance of cognates

   Beinborn, Lisa, Zesch, Torsten, and Gurevych, Iryna

   International Journal of Applied Linguistics Jan 2014

   PDF
3. Predicting the Difficulty of Language Proficiency Tests

   Beinborn, Lisa, Zesch, Torsten, and Gurevych, Iryna

   Transactions of the Association for Computational Linguistics Jan 2014

   Abstract PDF

   Language proficiency tests are used to evaluate and compare the progress of language learners. We present an approach for automatic difficulty prediction of C-tests that performs on par with human experts. On the basis of detailed analysis of newly collected data, we develop a model for C-test difficulty introducing four dimensions: solution difficulty, candidate ambiguity, inter-gap dependency, and paragraph difficulty. We show that cues from all four dimensions contribute to C-test difficulty.

4. Automatic Generation of Challenging Distractors Using Context-Sensitive Inference Rules

   Zesch, Torsten, and Melamud, Oren

   In Proceedings of the 9th Workshop on Innovative Use of NLP for Building Educational Applications at ACL Jan 2014

   PDF
5. DKPro TC: A Java-based Framework for Supervised Learning Experiments on Textual Data

   Daxenberger, Johannes, Ferschke, Oliver, Gurevych, Iryna, and Zesch, Torsten

   In Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics. System Demonstrations Jan 2014

   PDF
6. Sense and Similarity: A Study of Sense-level Similarity Measures

   Erbs, Nicolai, Gurevych, Iryna, and Zesch, Torsten

   In Proceedings of the 3rd Joint Conference on Lexical and Computational Semantics (*SEM 2014) Jan 2014

   PDF
7. Towards Automatic Scoring of Cloze Items by Selecting Low-Ambiguity Contexts

   Horsmann, Tobias, and Zesch, Torsten

   In 3rd workshop on NLP for computer-assisted language learning Jan 2014

   PDF

2013

1. Recognizing Partial Textual Entailment

   Levy, Omer, Zesch, Torsten, Dagan, Ido, and Gurevych, Iryna

   In Proceedings of the 51st Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers) Jan 2013

   PDF
2. UKP-BIU: Similarity and Entailment Metrics for Student Response Analysis

   Levy, Omer, Zesch, Torsten, Dagan, Ido, and Gurevych, Iryna

   In Second Joint Conference on Lexical and Computational Semantics (*SEM), Volume 2: Proceedings of the Seventh International Workshop on Semantic Evaluation (SemEval 2013) Jan 2013

   PDF
3. DKPro WSD: A Generalized UIMA-based Framework for Word Sense Disambiguation

   Miller, Tristan, Erbs, Nicolai, Zorn, Hans-Peter, Zesch, Torsten, and Gurevych, Iryna

   In Proceedings of the 51st Annual Meeting of the Association for Computational Linguistics (System Demonstrations) (ACL 2013) Jan 2013

   Abstract PDF

   Implementations of word sense disambiguation (WSD) algorithms tend to be tied to a particular test corpus format and sense inventory. This makes it difficult to test their performance on new data sets, or to compare them against past algorithms implemented for different data sets. In this paper we present DKPro WSD, a freely licensed, general-purpose framework for WSD which is both modular and extensible. DKPro WSD abstracts the WSD process in such a way that test corpora, sense inventories, and algorithms can be freely swapped. Its UIMA-based architecture makes it easy to add support for new resources and algorithms. Related tasks such as word sense induction and entity linking are also supported.

4. SemEval-2013 Task 5: Evaluating Phrasal Semantics

   Korkontzelos, Ioannis, Zesch, Torsten, Zanzotto, Fabio Massimo, and Biemann, Chris

   Proceedings of the 6th International Workshop on Semantic Evaluation (SemEval 2013) Jan 2013

   PDF
5. DKPro Similarity: An Open Source Framework for Text Similarity

   Bär, Daniel, Zesch, Torsten, and Gurevych, Iryna

   In Proceedings of the 51st Annual Meeting of the Association for Computational Linguistics (System Demonstrations) Jan 2013

   PDF
6. Detecting Malapropisms Using Measures of Contextual Fitness

   Zesch, Torsten

   Special Issue of the TAL Journal on "Managing Noise in the Signal: Error Handling in Natural Language Processing"‚ Jan 2013

   PDF
7. Scalable Construction of High-Quality Web Corpora

   Biemann, Chris, Bildhauer, Felix, Evert, Stefan, Goldhahn, Dirk, Quasthoff, Uwe, Schäfer, Roland, Simon, Johannes, Swiezinski, Leonard, and Zesch, Torsten

   JLCL Jan 2013

   PDF
8. Hierarchy Identification for Automatically Generating Table-of-Contents

   Erbs, Nicolai, Gurevych, Iryna, and Zesch, Torsten

   In Proceedings of 9th Conference on Recent Advances in Natural Language Processing (RANLP 2013) Jan 2013

   Abstract PDF

   A table-of-contents (TOC) provides a quick reference to a document’s content and structure. We present the first study on identifying the hierarchical structure for automatically generating a TOC using only textual features instead of structural hints e.g. from HTML-tags. We create two new datasets to evaluate our approaches for hierarchy identification. We find that our algorithm performs on a level that is sufficient for a fully automated system. For documents without given segment titles, we extend out work by auto matically generating segment titles. We make the datasets and our experimental framework publicly available in order to foster future research in TOC generation.

9. Language Resources and Evaluation Journal - Special Issue on Collaboratively Constructed Language Resources

   Gurevych, Iryna, and Zesch, Torsten

   In Proceedings of 9th Conference on Recent Advances in Natural Language Processing (RANLP 2013) Jan 2013
10. Cognate Production using Character-based Machine Translation

    Beinborn, Lisa, Zesch, Torsten, and Gurevych, Iryna

    In Proceedings of the 6th International Joint Conference on Natural Language Processing Jan 2013

    PDF

2012

1. Measuring Contextual Fitness Using Error Contexts Extracted from the Wikipedia Revision History

   Zesch, Torsten

   In Proceedings of the 13th Conference of the European Chapter of the Association for Computational Linguistics (EACL 2012) Jan 2012

   PDF
2. HOO 2012 Shared Task: UKP Lab System Description

   Zesch, Torsten, and Haase, Jens

   In Proceedings of the Seventh Workshop on Innovative Use of NLP for Building Educational Applications at NAACL-HLT Jan 2012

   PDF
3. UKP-UBC Entity Linking at TAC-KBP

   Erbs, Nicolai, Agirre, Eneko, Soroa, Aitor, Barrena, Ander, Etxebarria, Ugaitz, Gurevych, Iryna, and Zesch, Torsten

   In Proceedings of the 5th Text Analysis Conference Jan 2012

   PDF
4. UKP: Computing Semantic Textual Similarity by Combining Multiple Content Similarity Measures

   Bär, Daniel, Biemann, Chris, Gurevych, Iryna, and Zesch, Torsten

   In Proceedings of the 6th International Workshop on Semantic Evaluation, held in conjunction with the 1st Joint Conference on Lexical and Computational Semantics Jan 2012

   PDF
5. Towards fine-grained readability measures for self-directed language learning

   Beinborn, Lisa, Zesch, Torsten, and Gurevych, Iryna

   In Proceedings of the SLTC 2012 workshop on NLP for CALL Jan 2012

   PDF
6. Text Reuse Detection Using a Composition of Text Similarity Measures

   Bär, Daniel, Zesch, Torsten, and Gurevych, Iryna

   In Proceedings of the 24th International Conference on Computational Linguistics (COLING 2012) Jan 2012

   PDF
7. Collective Intelligence and Language Resources: Introduction to the Special Issue on Collaboratively Constructed Language Resources

   Gurevych, Iryna, and Zesch, Torsten

   In Proceedings of the 24th International Conference on Computational Linguistics (COLING 2012) Jan 2012

   PDF
8. Using Distributional Similarity for Lexical Expansion in Knowledge-based Word Sense Disambiguation

   Miller, Tristan, Biemann, Chris, Zesch, Torsten, and Gurevych, Iryna

   In Proceedings of the 24th International Conference on Computational Linguistics (COLING 2012) Jan 2012

   PDF

2011

1. Wikipedia Revision Toolkit: Efficiently Accessing Wikipedia’s Edit History

   Ferschke, Oliver, Zesch, Torsten, and Gurevych, Iryna

   In Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies. System Demonstrations Jan 2011

   PDF
2. Wikulu: An Extensible Architecture for Integrating Natural Language Processing Techniques with Wikis

   Bär, Daniel, Erbs, Nicolai, Zesch, Torsten, and Gurevych, Iryna

   In Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies. System Demonstrations Jan 2011

   PDF
3. A Reflective View on Text Similarity

   Bär, Daniel, Zesch, Torsten, and Gurevych, Iryna

   In Proceedings of the International Conference on Recent Advances in Natural Language Processing Jan 2011

   PDF
4. First Aid for Information Chaos in Wikis: Collaborative Information Management Enhanced Through Language Technology

   Erbs, Nicolai, Bär, Daniel, Gurevych, Iryna, and Zesch, Torsten

   In Proceedings of the International Conference on Recent Advances in Natural Language Processing Jan 2011

   PDF
5. Aufbereitung und Strukturierung von Information mittels automatischer Sprachverarbeitung

   Stille, Wolfgang, Erbs, Nicolai, Zesch, Torsten, Gurevych, Iryna, and Weihe, Karsten

   In Proceedings of KnowTech Jan 2011

   PDF
6. Link Discovery: A Comprehensive Analysis

   Erbs, Nicolai, Zesch, Torsten, and Gurevych, Iryna

   In Proceedings of the 5th IEEE International Conference on Semantic Computing (IEEE-ICSC) Jan 2011

   Abstract PDF

   We present a comprehensive analysis of link discovery approaches. We classify them with regard to the type of knowledge being used, and identify three commonly used sources of knowledge: The text of a document, the document title, and already existing links. We analyze the influence of the knowledge source as well as of the amount of training data used. Results show that the link-based approach performs best if the amount of training data is huge. In a more realistic setting with fewer training data, the text-based approach yields better results.

7. Combining heterogeneous knowledge resources for improved distributional semantic models

   Szarvas, György, Zesch, Torsten, and Gurevych, Iryna

   In Proceedings of the 5th IEEE International Conference on Semantic Computing (IEEE-ICSC) Jan 2011

   Abstract PDF

   The Explicit Semantic Analysis (ESA) model based on term cooccurrences in Wikipedia has been regarded as state-of-the-art semantic relatedness measure in the recent years. We provide an analysis of the important parameters of ESA using datasets in five different languages. Additionally, we propose the use of ESA with multiple lexical semantic resources thus exploiting multiple evidence of term cooccurrence to improve over the Wikipedia-based measure. Exploiting the improved robustness and coverage of the proposed combination, we report improved performance over single resources in word semantic relatedness, solving word choice problems, classification of semantic relations between nominals, and text similarity.

8. Helping Our Own 2011: UKP Lab System Description

   Zesch, Torsten

   In Proceedings of the Helping Our Own Working Group Session at the 13th European Workshop on Natural Language Generation Jan 2011

   PDF

2010

1. The More the Better? Assessing the Influence of Wikipedia’s Growth on Semantic Relatedness Measures

   Zesch, Torsten, and Gurevych, Iryna

   In Proceedings of the Seventh International Conference on Language Resources and Evaluation Jan 2010

   PDF
2. 2nd Workshop on The People’s Web Meets NLP: Collaboratively Constructed Semantic Resources

   Gurevych, Iryna, and Zesch, Torsten

   In Jan 2010

   PDF
3. Wisdom of Crowds versus Wisdom of Linguists - Measuring the Semantic Relatedness of Words

   Zesch, Torsten, and Gurevych, Iryna

   Journal of Natural Language Engineering Jan 2010

   PDF
4. Effektivere Informationssuche im World Wide Web

   Schwarz, Christopher Kim, Keith, Nina, Gurevych, Iryna, Erbs, Nicolai, and Zesch, Torsten

   Journal of Natural Language Engineering Jan 2010

   PDF

2009

1. Proceedings of the Workshop on The People’s Web Meets NLP: Collaboratively Constructed Semantic Resources

   Gurevych, Iryna, and Zesch, Torsten

   Journal of Natural Language Engineering Jan 2009
2. Discovering Links Using Semantic Relatedness

   Hoffart, Johannes, Bär, Daniel, Zesch, Torsten, and Gurevych, Iryna

   In INEX 2009 Workshop Preproceedings Jan 2009

   Abstract PDF

   We present our approaches for link discovery in document collections with or without existing links. In collections containing links, we discover links using measures of link anchor ranking based on existing links. In collections without links, we gather noun phrases as anchor candidates. To discover targets, we use a measure of semantic relatedness between texts. We nd that semantic relatedness is useful to identify targets for ambiguous link anchors. In collections that contain no existing links, using only document titles as anchor candidates can be enhanced by using arbitrary noun phrases extracted from documents.

3. Semantic relations in a bilingual corpus of different registers

   Čulo, Oliver, Kunz, Kerstin, and Zesch, Torsten

   In Deutsche Gesellschaft für Sprachwissenschaft (DGfS) Workshop on Corpus, Colligation, Register Variation Jan 2009

   PDF
4. An Architecture to Support Intelligent User Interfaces for Wikis by Means of Natural Language Processing

   Hoffart, Johannes, Zesch, Torsten, and Gurevych, Iryna

   In Proceedings of the International Symposium on Wikis and Open Collaboration (WikiSym ’09) Jan 2009

   PDF
5. Approximate Matching for Evaluating Keyphrase Extraction

   Zesch, Torsten, and Gurevych, Iryna

   In Proceedings of the 7th International Conference on Recent Advances in Natural Language Processing Jan 2009

   PDF
6. Study of Semantic Relatedness of Words Using Collaboratively Constructed Semantic Resources

   Zesch, Torsten

   In Proceedings of the 7th International Conference on Recent Advances in Natural Language Processing Jan 2009

   PDF

2008

1. Flexible UIMA Components for Information Retrieval Research

   Müller, Christof, Zesch, Torsten, Müller, Mark-Christoph, Bernhard, Delphine, Ignatova, Kateryna, Gurevych, Iryna, and Mühlhäuser, Max

   In Proceedings of the LREC 2008 Workshop ’Towards Enhanced Interoperability for Large HLT Systems: UIMA for NLP’ Jan 2008

   PDF
2. Extracting Lexical Semantic Knowledge from Wikipedia and Wiktionary

   Zesch, Torsten, Müller, Christof, and Gurevych, Iryna

   In Proceedings of the 6th International Conference on Language Resources and Evaluation Jan 2008

   PDF
3. Selbstorganisierende Wikis

   Gurevych, Iryna, and Zesch, Torsten

   In Proceedings of KnowTech Jan 2008

   PDF
4. Representational Interoperability of Linguistic and Collaborative Knowledge Bases

   Garoufi, Konstantina, Zesch, Torsten, and Gurevych, Iryna

   In Proceedings of the KONVENS Workshop on Lexical-Semantic and Ontological Resources – Maintenance, Representation, and Standards Jan 2008

   PDF
5. Graph-Theoretic Analysis of Collaborative Knowledge Bases in Natural Language Processing

   Garoufi, Konstantina, Zesch, Torsten, and Gurevych, Iryna

   In Proceedings of the Poster Session of the 7th International Semantic Web Conference Jan 2008

   PDF
6. Using Wiktionary for Computing Semantic Relatedness

   Zesch, Torsten, Müller, Christof, and Gurevych, Iryna

   In Proceedings of the Twenty-Third AAAI Conference on Artificial Intelligence Jan 2008

   PDF
7. Using Similarity Measures for Context-Aware User Interfaces

   Hartmann, Melanie, Zesch, Torsten, Mühlhäuser, Max, and Gurevych, Iryna

   In Proceedings of the 2nd IEEE International Conference on Semantic Computing Jan 2008

   PDF

2007

1. Analysis of the Wikipedia Category Graph for NLP Applications

   Zesch, Torsten, and Gurevych, Iryna

   In Proceedings of the TextGraphs-2 Workshop (NAACL-HLT 2007) Jan 2007

   PDF
2. Cross-lingual Distributional Profiles of Concepts for Measuring Semantic Distance

   Mohammad, Saif, Gurevych, Iryna, Hirst, Graeme, and Zesch, Torsten

   In Proceedings of EMNLP-CoNLL Jan 2007

   PDF
3. Darmstadt Knowledge Processing Repository Based on UIMA

   Gurevych, Iryna, Mühlhäuser, Max, Müller, Christof, Steimle, Jürgen, Weimer, Markus, and Zesch, Torsten

   In Proceedings of the First Workshop on Unstructured Information Management Architecture at Biannual Conference of the Society for Computational Linguistics and Language Technology Jan 2007

   PDF
4. Teaching “Unstructured Information Management: Theory and Applications” to Computational Linguistics Students

   Gurevych, Iryna, Müller, Christof, and Zesch, Torsten

   In Proceedings of the First Workshop on Unstructured Information Management Architecture at Biannual Conference of the Society for Computational Linguistics and Language Technology Jan 2007

   PDF
5. Analyzing and Accessing Wikipedia as a Lexical Semantic Resource

   Zesch, Torsten, Gurevych, Iryna, and Mühlhäuser, Max

   In Proceedings of the First Workshop on Unstructured Information Management Architecture at Biannual Conference of the Society for Computational Linguistics and Language Technology Jan 2007

   PDF
6. Comparing Wikipedia and German Wordnet by Evaluating Semantic Relatedness on Multiple Datasets

   Zesch, Torsten, Gurevych, Iryna, and Mühlhäuser, Max

   In Proceedings of Human Language Technologies: The Annual Conference of the North American Chapter of the Association for Computational Linguistics (NAACL-HLT 2007) Jan 2007

   PDF
7. What to be? - Electronic Career Guidance Based on Semantic Relatedness

   Gurevych, Iryna, Müller, Christof, and Zesch, Torsten

   In Proceedings of ACL Jan 2007

   PDF

2006

1. Automatically Creating Datasets for Measures of Semantic Relatedness

   Zesch, Torsten, and Gurevych, Iryna

   In Proceedings of the COLING/ACL Workshop on Linguistic Distances Jan 2006

   PDF