Universität Bamberg
Suche öffnen
Sie befinden sich hier:

Fakultät Wirtschaftsinformatik und Angewandte Informatik

Data Engineering

  1.  Otto-Friedrich-Universität Bamberg
  2. Fakultäten
  3. Wirtschaftsinformatik und Angewandte Informatik
  4. Professuren und Lehrstühle
  5. Informatik
  6. Data Engineering
  7. Forschung
  8. Projekte

Geförderte Projekte

Buffers with Benefits: Elastic Memory Hierarchies for Memory-Intensive Applications

DFG-Projekt im Schwerpunktprogramm 2377 (seit 2025). Hauptspeicher-Datenbanksysteme sollen von einer elastischen Speicherhierarchie profitieren, die Technologien wie NVRAM, HBM, PIM und NMC einbezieht und je nach Anwendungsfall geeignete Komponenten wie Speicherkomprimierung, GPU-Beschleunigung oder Remote-Speicher auswählt.

Projektleitung: Prof. Dr. Maximilian E. Schüle

Projektmitarbeitende: Maha Alwahibi, Bachana Jangebashvili, Duong Tung Nguyen, Lakshmi Nair

Funktionen werden Daten: Höherwertige Lambda-Funktionen für Datenbanksysteme

DFG-Sachbeihilfe (seit 2025). SQL-Lambda-Funktionen höherer Ordnung für die datenbankinterne Ausführung von Modellen des maschinellen Lernens, anstatt Code und Daten aus dem Datenbanksystem zu extrahieren.

Projektleitung: Prof. Dr. Maximilian E. Schüle

Projektmitarbeitende: Clemens Ruck, Lakshmi Nair

Projektideen

This demonstration presents a machine learning language MLearn that allows declarative programming of machine learning tasks similarly to SQL. Our demonstrated machine learning language is independent of the underlying platform and can be translated into SQL and Python as target platforms. As modern hardware allows database systems to perform more computational intense tasks than just retrieving data, we introduce the  ML2SQL compiler to translate machine learning tasks into stored procedures intended to run inside database servers running PostgreSQL or HyPer. We therefore extend both database systems by a gradient descent optimiser and tensor algebra. In our evaluation section, we illustrate the claim of running machine learning tasks independently of the target platform by comparing the run-time of three in MLearn specified tasks on two different database systems as well as in Python.
We infer potentials for database systems on optimising tensor data types, whereas database systems show competitive performance when performing gradient descent.

As part of the code-generating database system HyPer, SQL lambda functions allow user-defined metrics to be injected into data mining operators during compile time. Since version 11, PostgreSQL has supported just-in-time compilation with LLVM for expression evaluation. This enables the concept of SQL lambda functions to be transferred to this open-source database system. In this study, we extend PostgreSQL by adding two subquery types for lambda expressions that either pre-materialise the result or return a cursor to request tuples. We demonstrate the usage of these subquery types in conjunction with dedicated table functions for data mining algorithms such as PageRank, k-Means clustering and labelling. Furthermore, we allow four levels of optimisation for query execution, ranging from interpreted function calls to just-in-time-compiled execution. The latter---with some adjustments to the PostgreSQL's execution engine---transforms our lambda functions into real user-injected code. In our evaluation with the LDBC social network benchmark for PageRank and the Chicago taxi data set for clustering, optimised lambda functions achieved comparable performance to hard-coded implementations and HyPer's data mining algorithms.
 

 

Online encyclopaedias such as Wikipedia implement their own version control above database systems to manage multiple revisions of the same page. In contrast to temporal databases that restrict each tuple's validity to a time range, a version affects multiple tuples. To overcome the need for a separate version layer, we have created TardisDB, the first database system with incorporated data versioning across multiple relations. This paper presents the interface for TardisDB with an extended SQL to manage and query data from different branches. We first give an overview of TardisDB's architecture that includes an extended table scan operator: a branch bitmap indicates a tuple's affiliation to a branch and a chain of tuples tracks the different versions. This is the first database system that combines chains for multiversion concurrency control with a bitmap for each branch to enable versioning. Afterwards, we describe our proposed SQL extension to create, query and modify tables across different, named branches.
In our demonstration setup, we allow users to interactively create and edit branches and display the lineage of each branch.

 

Both forward and reverse mode automatic differentiation derive a model function as used for gradient descent automatically. Reverse mode calculates all derivatives in one run, whereas forward mode requires rerunning the algorithm with respect to every variable for which the derivative is needed. To allow for in-database machine learning, we have integrated automatic differentiation as an SQL operator inside the Umbra database system. To benchmark code-generation to GPU, we implement forward as well as reverse mode automatic differentiation. The inspection of the optimised LLVM code shows that nearly the same machine code is executed after the generated LLVM code has been optimised. Thus, both modes yield similar runtimes but different compilation times.