Creichen: Created page with "In many data processing tasks, declarative query programming offers substantial benefit over manual data analysis: the query processors found in declarative systems can use po..."

2017-07-01T16:19:15Z

Created page with "In many data processing tasks, declarative query programming offers substantial benefit over manual data analysis: the query processors found in declarative systems can use po..."

New page

In many data processing tasks, declarative query programming offers substantial benefit over manual data analysis: the query processors found in declarative systems can use powerful algorithms such as query planning to choose high-level execution strategies during compilation.
However, the principal downside of such languages is that their primitives must be carefully curated, to allow the query planner to correctly estimate their overhead. In this talk I explore this challenge in our PQL/Java system.
PQL/Java adds a powerful declarative query language to Java to enable and automatically parallelise queries over the Java heap. In the past, the language has not provided any sup- port for custom user-designed datatypes, as such support requires complex interactions with its query planner and backend.
We examine PQL/Java and its intermediate language in detail and describe a new system that simplifies PQL/Java extensions. This system provides a DSL that permits users to add new primitives with arbitrary Java computations, and new rewriting rules for optimisation.
Our system automatically stages compilation and exploits constant information for dead code elimination and type specialisation. We have re-written our PQL/Java backend in our extension language, enabling dynamic and staged compilation.
We demonstrate the effectiveness of our extension language in several case studies, including the efficient integration of SQL queries, and by analysing the run-time performance of the rewritten prototype backend.

WG211/M17Reichenbach - Revision history

Creichen: Created page with "In many data processing tasks, declarative query programming offers substantial benefit over manual data analysis: the query processors found in declarative systems can use po..."