Author name cluster

Yannis Katsis

Possible papers associated with this exact author name in Arrow. This page groups case-insensitive exact name matches and is not a full identity disambiguation profile.

3 papers

1 author row

AAAI Conference 2022 System Paper

InteractEva: A Simulation-Based Evaluation Framework for Interactive AI Systems

Yannis Katsis
Maeda F. Hanafi
Martín Santillán Cooper
Yunyao Li

Evaluating interactive AI (IAI) systems is a challenging task, as their output highly depends on the performed user actions. As a result, developers often depend on limited and mostly qualitative data derived from user testing to improve their systems. In this paper, we present InteractEva; a systematic evaluation framework for IAI systems. InteractEva employs (a) a user simulation backend to test the system against different use cases and user interactions at scale with (b) an interactive frontend allowing developers to perform important quantitative evaluation tasks, including acquiring a performance overview, performing error analysis, and conducting what-if studies. The framework has supported the evaluation and improvement of an industrial IAI text extraction system, results of which will be presented during our demonstration.

PDF Details

AAAI Conference 2021 System Paper

AutoText: An End-to-End AutoAI Framework for Text

Arunima Chaudhary
Alayt Issak
Kiran Kate
Yannis Katsis
Abel Valente
Dakuo Wang
Alexandre Evfimievski
Sairam Gurajada

Building models for natural language processing (NLP) tasks remains a daunting task for many, requiring significant technical expertise, efforts, and resources. In this demonstration, we present AutoText, an end-to-end AutoAI framework for text, to lower the barrier of entry in building NLP models. AutoText combines state-of-the-art AutoAI optimization techniques and learning algorithms for NLP tasks into a single extensible framework. Through its simple, yet powerful UI, non-AI experts (e. g. , domain experts) can quickly generate performant NLP models with support to both control (e. g. , via specifying constraints) and understand learned models.

PDF Details

AAAI Conference 2021 System Paper

KAAPA: Knowledge Aware Answers from PDF Analysis

Nicolas Fauceglia
Mustafa Canim
Alfio Gliozzo
Jennifer J Liang
Nancy Xin Ru Wang
Douglas Burdick
Nandana Mihindukulasooriya
Vittorio Castelli

We present KaaPa (Knowledge Aware Answers from Pdf Analysis), an integrated solution for machine reading comprehension over both text and tables extracted from PDFs. KaaPa enables interactive question refinement using facets generated from an automatically induced Knowledge Graph. In addition it provides a concise summary of the supporting evidence for the provided answers by aggregating information across multiple sources. KaaPa can be applied consistently to any collection of documents in English with zero domain adaptation effort. We showcase the use of KaaPa for QA on scientific literature using the COVID-19 Open Research Dataset.

PDF Details