DMCA
Layout-sensitive Generalized Parsing
Cached
Download Links
| Citations: | 10 - 5 self |
BibTeX
@MISC{Erdweg_layout-sensitivegeneralized,
author = {Sebastian Erdweg and Tillmann Rendel and Christian Kästner and Klaus Ostermann},
title = {Layout-sensitive Generalized Parsing},
year = {}
}
Share
 |
 |
 |
 |
||
OpenURL
Abstract
Abstract. The theory of context-free languages is well-understood and context-free parsers can be used as off-the-shelf tools in practice. In particular, to use a context-free parser framework, a user does not need to understand its internals but can specify a language declaratively as a grammar. However, many languages in practice are not context-free. One particularly important class of such languages is layout-sensitive languages, in which the structure of code depends on indentation and whitespace. For example, Python, Haskell, F#, and Markdown use indentation instead of curly braces to determine the block structure of code. Their parsers (and lexers) are not declaratively specified but hand-tuned to account for layout-sensitivity. To support declarative specifications of layout-sensitive languages, we propose a parsing framework in which a user can annotate layout in a grammar. Annotations take the form of constraints on the relative positioning of tokens in the parsed subtrees. For example, a user can declare that a block consists of statements that all start on the same column. We have integrated layout constraints into SDF and implemented a layoutsensitive generalized parser as an extension of generalized LR parsing. We evaluate the correctness and performance of our parser by parsing 33 290 open-source Haskell files. Layout-sensitive generalized parsing is easy to use, and its performance overhead compared to layout-insensitive parsing is small enough for practical application. 1
Keyphrases
layout-sensitive generalized parsing layout-sensitive language important class performance overhead context-free language code depends practical application block structure off-the-shelf tool curly brace layout constraint parsing framework layout-insensitive parsing many language declarative specification parsed subtrees context-free parser framework relative positioning open-source haskell file generalized lr parsing context-free parser
