Institut für Wirtschaftsinformatik
Dauerhafte URI für die Sammlunghttps://irf.fhnw.ch/handle/11654/66
Listen
82 Ergebnisse
Ergebnisse nach Hochschule und Institut
Publikation Graph-based keyword spotting in historical documents using context-aware Hausdorff edit distance(IEEE, 2018) Stauffer, Michael; Fischer, Andreas; Riesen, KasparScanned handwritten historical documents are often not well accessible due to the limited feasibility of automatic full transcriptions. Thus, Keyword Spotting (KWS) has been proposed as an alternative to retrieve arbitrary query words from this kind of documents. In the present paper, word images are represented by means of graphs. That is, a graph is used to represent the inherent topological characteristics of handwriting. The actual keyword spotting is then based on matching a query graph with all document graphs. In particular, we make use of a fast graph matching algorithm that considers the contextual substructure of nodes. The motivation for this inclusion of node context is to increase the overall KWS accuracy. In an experimental evaluation on four historical documents, we show that the proposed procedure clearly outperforms diverse other template-based reference systems. Moreover, our novel framework keeps up or even outperforms many state-of-the-art learning-based KWS approaches.04B - Beitrag KonferenzschriftPublikation Graph embedding for offline handwritten signature verification(2019) Stauffer, Michael; Maergner, Paul; Fischer, Andreas; Riesen, KasparDue to the high availability and applicability, handwritten signatures are an eminent biometric authentication measure in our life. To mitigate the risk of a potential misuse, automatic signature verification tries to distinguish between genuine and forged signatures. Most of the available signature verification approaches make use of vectorial rather than graph-based representations of the handwriting. This is rather surprising as graphs offer some inherent advantages. Graphs are, for instance, able to directly adapt their size and structure to the size and complexity of the respective handwritten entities. Moreover, several fast graph matching algorithms have been proposed recently that allow to employ graphs also in domains with large amounts of data. The present paper proposes to use different graph embedding approaches in conjunction with a recent graph-based signature verification framework. That is, signature graphs are not directly matched with each other, but first compared with a set of predefined prototype graphs, in order to obtain a dissimilarity representation. In an experimental evaluation, we employ the proposed method on two widely used benchmark datasets. On both datasets, we empirically confirm that the learning-free graph embedding outperforms state-of-the-art methods with respect to both accuracy and runtime.04B - Beitrag KonferenzschriftPublikation Offline signature verification by combining graph edit distance and triplet networks(Springer, 2018) Maergner, Paul; Pondenkandath, Vinaychandran; Alberti, Michele; Liwicki, Marcus; Riesen, Kaspar; Ingold, Rolf; Fischer, Andreas; Bai, Xiao; Hancock, Edwin R.; Ho, Tin Kam; Wilson, Richard C.; Biggio, Battista; Robles-Kelly, AntonioBiometric authentication by means of handwritten signatures is a challenging pattern recognition task, which aims to infer a writer model from only a handful of genuine signatures. In order to make it more difficult for a forger to attack the verification system, a promising strategy is to combine different writer models. In this work, we propose to complement a recent structural approach to offline signature verification based on graph edit distance with a statistical approach based on metric learning with deep neural networks. On the MCYT and GPDS benchmark datasets, we demonstrate that combining the structural and statistical models leads to significant improvements in performance, profiting from their complementary properties.04B - Beitrag KonferenzschriftPublikation KvGR: A graph-based interface for explorative sequential question answering on heterogeneous information sources(Springer, 2020) Witschel, Hans Friedrich; Riesen, Kaspar; Grether, Loris; Jose, Joemon M.; Yilmaz, Emine; Magalhães, João; Castells, Pablo; Ferro, Nicola; Silva, Mário J.; Martins, FlávioExploring a knowledge base is often an iterative process: initially vague information needs are refined by interaction. We propose a novel approach for such interaction that supports sequential question answering (SQA) on knowledge graphs. As opposed to previous work, we focus on exploratory settings, which we support with a visual representation of graph structures, helping users to better understand relationships. In addition, our approach keeps track of context – an important challenge in SQA – by allowing users to make their focus explicit via subgraph selection. Our results show that the interaction principle is either understood immediately or picked up very quickly – and that the possibility of exploring the information space iteratively is appreciated.04B - Beitrag KonferenzschriftPublikation Offline signature verification via structural methods: graph edit distance and inkball models(IEEE, 2018) Maergner, Paul; Howe, Nicholas; Riesen, Kaspar; Ingold, Rolf; Fischer, AndreasFor handwritten signature verification, signature images are typically represented with fixed-sized feature vectors capturing local and global properties of the handwriting. Graphbased representations offer a promising alternative, as they are flexible in size and model the global structure of the handwriting. However, they are only rarely used for signature verification, which may be due to the high computational complexity involved when matching two graphs. In this paper, we take a closer look at two recently presented structural methods for handwriting analysis, for which efficient matching methods are available: keypoint graphs with approximate graph edit distance and inkball models. Inkball models, in particular, have never been used for signature verification before. We investigate both approaches individually and propose a combined verification system, which demonstrates an excellent performance on the MCYT and GPDS benchmark data sets when compared with the state of the art.04B - Beitrag KonferenzschriftPublikation Offline signature verification using structural dynamic time warping(IEEE, 2019) Stauffer, Michael; Maergner, Paul; Fischer, Andreas; Ingold, Rolf; Riesen, KasparIn recent years, different approaches for handwriting recognition that are based on graph representations have been proposed (e.g. graph-based keyword spotting or signature verification). This trend is mostly due to the availability of novel fast graph matching algorithms, as well as the inherent flexibility and expressivity of graph data structures when compared to vectorial representations. That is, graphs are able to directly adapt their size and structure to the size and complexity of the respective handwritten entities. However, the vast majority of the proposed approaches match the graphs from a global perspective only. In the present paper, we propose to match the underlying graphs from different local perspectives and combine the resulting assignments by means of Dynamic Time Warping. Moreover, we show that the proposed approach can be readily combined with global matchings. In an experimental evaluation, we employ the novel method in a signature verification scenario on two widely used benchmark datasets. On both datasets, we empirically confirm that the proposed approach outperforms state-of-the-art methods with respect to both accuracy and runtime.04B - Beitrag KonferenzschriftPublikation Natural language-based user guidance for knowledge graph exploration: a user study(SciTePress, 2021) Witschel, Hans Friedrich; Riesen, Kaspar; Grether, Loris; Cucchiara, Rita; Fred, Ana; Filipe, JoaquimLarge knowledge graphs hold the promise of helping knowledge workers in their tasks by answering simple and complex questions in specialised domains. However, searching and exploring knowledge graphs in current practice still requires knowledge of certain query languages such as SPARQL or Cypher, which many untrained end users do not possess. Approaches for more user-friendly exploration have been proposed and range from natural language querying over visual cues up to query-by-example mechanisms, often enhanced with recommendation mechanisms offering guidance. We observe, however, a lack of user studies indicating which of these approaches lead to a better user experience and optimal exploration outcomes. In this work, we make a step towards closing this gap by conducting a qualitative user study with a system that relies on formulating queries in natural language and providing answers in the form of subgraph visualisations. Our system is able to offer guidance via query recommendations based on a current context. The user study evaluates the impact of this guidance in terms of both efficiency and effectiveness (recall) of user sessions. We find that both aspects are improved, especially since query recommendations provide inspiration, leading to a larger number of insights discovered in roughly the same time.04B - Beitrag KonferenzschriftPublikation Matching of matching-graphs - a novel approach for graph classification(IEEE, 2020) Fuchs, Mathias; Riesen, KasparDue to fast developments in data acquisition, we observe rapidly increasing amounts of data available in diverse areas. Simultaneously, we observe that in many applications the underlying data is inherently complex, making graphs a very useful and adequate data structure for formal representation. A large amount of graph based methods for pattern recognition have been proposed. Many of these methods actually rely on graph matching. In the present paper a novel encoding of graph matching information is proposed. The idea of this encoding is to formalize the stable cores of specific classes by means of graphs. In an empirical evaluation we show that it can be highly beneficial to focus on these stable parts of graphs during graph classification.04B - Beitrag KonferenzschriftPublikation Cross-evaluation of graph-based keyword spotting in handwritten historical documents(Springer, 2019) Stauffer, Michael; Maergner, Paul; Fischer, Andreas; Riesen, Kaspar; Conte, Donatello; Ramel, Jean-Yves; Foggia, PasqualeIn contrast to statistical representations, graphs offer some inherent advantages when it comes to handwriting representation. That is, graphs are able to adapt their size and structure to the individual handwriting and represent binary relationships that might exist within the handwriting. We observe an increasing number of graph-based keyword spotting frameworks in the last years. In general, keyword spotting allows to retrieve instances of an arbitrary query in documents. It is common practice to optimise keyword spotting frameworks for each document individually, and thus, the overall generalisability remains somehow questionable. In this paper, we focus on this question by conducting a cross-evaluation experiment on four handwritten historical documents. We observe a direct relationship between parameter settings and the actual handwriting. We also propose different ensemble strategies that allow to keep up with individually optimised systems without a priori knowledge of a certain manuscript. Such a system can potentially be applied to new documents without prior optimisation.04B - Beitrag KonferenzschriftPublikation Keyword spotting in historical handwritten documents based on graph matching(Elsevier, 2018) Stauffer, Michael; Fischer, Andreas; Riesen, KasparIn the last decades historical handwritten documents have become increasingly available in digital form. Yet, the accessibility to these documents with respect to browsing and searching remained limited as full automatic transcription is often not possible or not sufficiently accurate. This paper proposes a novel reliable approach for template-based keyword spotting in historical handwritten documents. In particular, our framework makes use of different graph representations for segmented word images and a sophisticated matching procedure. Moreover, we extend our method to a spotting ensemble. In an exhaustive experimental evaluation on four widely used benchmark datasets we show that the proposed approach is able to keep up or even outperform several state-of-the-art methods for template- and learning-based keyword spotting.01A - Beitrag in wissenschaftlicher Zeitschrift