© TUHH, Martin Kunze

Train Your Engineering Network

Vergangene Semester

Wintersemester 2020/21

Inhalte und Vortragende:

116.11.20Lennart BargstenDeep learning approaches for intravascular ultrasound image processing: dealing with data scarcity (Video)
223.11.20Morten SchierholzData Sources for Machine Learning Applications in Engineering
330.11.20Marvin KastnerHow to Talk About Machine Learning with Jupyter Notebooks (Video)
407.12.20Thomas KohlscheData-driven construction of fast predictors for complex systems using Gaussian process regression techniques (Video)
514.12.20Benjamin BollWeakbond Detection – Enhancing Vibro-Acoustic Modulation Analysis by Machine Learning
-21.12.20-Winter break
-28.12.20-Winter break
604.01.21Lars Köttner, Jan Mehnen, Denys RomanekoProzessüberwachung mit maschinellem Lernen für semi-automatisches Bohren von Nietlöchern in der Luftfahrtindustrie
711.01.21Christian FeilerExploring Chemical Space using Computational Techniques
818.01.21Rupert AngerbauerAnwendung von Methoden des Maschinellen Lernens zur Darstellung komplexer Strömungsfelder
925.01.21Pascal Gleske, Konrad Nölle, Hendrik Sieck ( HULKs)Distributed Genetic Neural Network Architecture Search at HULKs (Video)


  1. Lennart Bargsten: Deep learning approaches for intravascular ultrasound image processing: dealing with data scarcity.
    Intravascular ultrasound (IVUS) plays a major role in clinical practice when it comes to assessing vessel morphologies during percutaneous coronary interventions (PCIs) or for treatment planning. Usually, the physician estimates morphological features by marking important regions in multiple IVUS images. This is a rather time consuming task and the results depend heavily on the physician’s experience. Automated detection and segmentation of meaningful image content can thus help streamlining the clinical workflow. Data driven methods like deep learning have gained huge importance in the field of medical image analysis over the last years. The usual scarcity of annotated image data in the medical field makes it important to tailor deep learning methods with respect to specific tasks and imaging modalities. Possibilities are generating synthetic image data, considering specific image characteristics as well as performing multi-task learning. This talk presents such approaches for improving deep learning performance on IVUS image analysis.

  2. Morten Schierholz: Data Sources for Machine Learning Applications in Engineering.
    Investigating the possibility of machine learning tools and techniques in the domain of engineering is a widely found concept with an increased number of authors and increasing audience. This development in the machine learning community has been led by researchers from data science. However this development has been possible due to large amount of data that has been available to these researchers in combination with an increased number of computational resources. For example the object recognition on images or in speech would not have been progressed as quickly without the widely available images over the internet. Generating and sharing knowledge is a broadly established concept in engineering domain, in form of conferences or other publications. However it is observed that in the domain of data the sharing of those is not established. First data sources are available where data is shared, however larger projects are not observed. We therefore propose a new database to share data and knowledge of this data. Thereby enabling researches that do not have the possibility to create those data samples by themselves, to work with interesting and rich data and apply new tools and techniques of the machine learning domain or others. Besides the data that is available in the database and the investigated machine learning tools and techniques on this data, a general overview of the database is given.

  3. Marvin Kastner: How to Talk About Machine Learning with Jupyter Notebooks.
    In the field of Machine Learning, scientists often use programming for data preprocessing, running the learning algorithms, and obtaining key metrics. To increase transparency, nowadays more and more additional material (such as datasets, code, documentation etc.) is shared so that fellow researchers can replicate these experiments. Jupyter Notebooks are a very valuable medium in this context – they are capable of displaying documentation, code, its output (such as visualizations, tables or logging messages) etc. side by side. Recently, Jupyter Notebooks have also been used in university courses more often. Here, the students benefit from the integration of code, its documentation, and the related exercise questions into a single interactive document. There are plenty of options how to design very appealing exercises for a course. Both in the scenario of transparent science and when using Jupyter Notebooks for teaching, the author’s code is meant to be run at another machine and achieve the same results. During this talk, possible issues during replication and suitable fixes are highlighted. The open source application JupyterHub can be part of that strategy. While the backend of the Integrated Development Environment runs on TUHH resources, the frontend is just a simple browser application. This reliefs the students from having up-to-date equipment for replication. Especially in times of COVID-19 this allows students to program from home more easily.

  4. Thomas Kohlsche: Data-driven construction of fast predictors for complex systems using Gaussian process regression techniques.
    In many real life applications, engineers are often interested in accessible predictions of a complex systems behavior for which only sparse data is available. The data may arise either from measurements or numerical simulations. Especially for numerical design tasks like optimization and uncertainty quantification where a very large number of model evaluations is required, cheap predictors, often called meta- or surrogate models, are unavoidable. Since gathering data from such systems is typically very costly, this task requires machine learning techniques that are capable of operating on small data sets. For the problem described, Gaussian process regression has proved itself to be a powerful and flexible tool. New extensions of the technique to, e.g., data-fusion concepts can offer solutions to problems that are hard to tackle with other techniques.

  5. Benjamin Boll: Weakbond Detection – Enhancing Vibro-Acoustic Modulation Analysis by Machine Learning.

  6. Lars Köttner, Jan Mehnen, Denys Romaneko: Prozessüberwachung mit maschinellem Lernen für semi-automatisches Bohren von Nietlöchern in der Luftfahrtindustrie.
    Die meisten der mehreren hundert Millionen gebohrten Flugzeugnietbohrungen pro Jahr werden mit semi-automatischen und manuell gesteuerten, pneumatisch angetriebenen Maschinen hergestellt, da eine Vollautomatisierung aufgrund von Arbeitsraumbeschränkungen oft ungeeignet ist. Diese Maschinen sind im Hinblick auf die Anpassbarkeit der Bohrungsparameter unflexibel, was u.a. auf die hohen Qualitätsanforderungen der Luftfahrtbranche zurückzuführen ist. Um zuverlässige und sichere Nietverbindungen herzustellen, ist das Bohren in mehreren Prozessschritten, der Einsatz von Minimalmengenschmierung sowie anschließendes manuelles Entgraten und Reinigen der Bohrungen unabdingbar. Vor diesem Hintergrund ermöglichen neu entwickelte elektrisch angetriebene semi-automatische Advanced Drilling Units (ADUs) neue Potenziale, wie z.B. intelligente Prozesslayouts, eine Online-Zustandsüberwachung durch die Auswertung integrierter Sensordaten und eine automatische Anpassung der Prozessparameter. Für die Zustandsüberwachung des Bohrprozesses wurde der Einsatz von maschinellem Lernen (ML) überprüft, um Schnittkräfte und Prozessbedingungen auf der Grundlage der Ströme der verwendeten Elektromotoren der ADUs vorherzusagen. Die Anwendung von ML auf ADU- Daten ist vorteilhaft, da die hohe Anzahl zu fertigender Nietbohrungen große Datensätze liefert. ML-Methoden wie lineare Regression, künstliche neuronale Netze, Entscheidungsbäume und k-Nearest-Neighbor wurden hinsichtlich ihrer Anwendbarkeit bewertet. Bohrprozesseigenschaften wie Material- und Vorschubgeschwindigkeitsauswahl wurden mit den Modellvorhersagen verglichen. Die vorgestellten Ergebnissen zeigen, dass eine ML-basierte Prozessüberwachung das Potenzial besitzt Prozessabweichungen zuverlässig zu identifizieren und auf diese Weise manuelle Nacharbeit zu reduzieren, eine umfassende Qualitätssicherung zu gewährleisten und die Ausnutzung der Werkzeugstandzeiten zu erhöhen.

  7. Christian Feiler: Exploring Chemical Space using Computational Techniques.
    The degradation behaviour of magnesium (Mg) renders it one of the most versatile engineering materials available today as it can be employed in a large variety of applications ranging from automotive and aerospace components to battery applications where Mg is used as anode material. However, a prerequisite to unlock the full potential of Mg–based materials is gaining control over the corrosion rate. Consequently, bespoke additives must be identified for each application for an optimal performance. Corrosion prevention is essential in transport applications to avoid material failure whereas constant dissolution of the material is required to boost the efficiency of Mg-air primary batteries. Furthermore, the search for benign and efficient corrosion inhibitors has become critical due to the imminent ban of highly effective but toxic chromates. The vast number of small molecules with potentially useful dissolution modulating properties (inhibitors or accelerators) renders conventional experimental discovery methods too time- and resource-consuming. Consequently, computer-assisted selection prior to experimental investigations of the most promising candidates is of great benefit in the search for efficient corrosion modulating additives for Mg-based materials. One of the major challenges is the identification of sound molecular descriptors that correlate well with experimentally derived properties as input parameters with low or no relevance to the modelled property will degrade the model. Towards this end, we utilized colour-coded correlation maps to facilitate an intuitive screening for reliable input features. We recently illustrated the potential of complementary quantum chemical density functional theory (DFT) calculations and machine learning methods for the prediction of corrosion modulating properties of small organic molecules for commercially pure Mg (CP Mg). Furthermore, we developed a workflow that facilitates screening of a large commercial database for an unbiased selection of untested additives for the control of the degradation rate of Mg.

  8. Rupert Angerbauer: Anwendung von Methoden des Maschinellen Lernens zur Darstellung komplexer Strömungsfelder.

  9. Pascal Gleske, Konrad Nölle, Hendrik Sieck (HULKs): Distributed Genetic Neural Network Architecture Search at HULKs.
    The increasing application of artificial neural networks (ANN) in various domains of robotics demands highly optimized ANN architectures. The efficient architecture search requires horizontal and vertical scaling of ANN evaluation. In this talk the HULKs present their approach and application of a scalable genetic algorithm based on distributed task execution, to be used in the context of RoboCup soccer competitions.

Sommersemester 2020

Inhalte und Vortragende:

120.04.20Leo DostalTowards Reinforcement Learning-based Control of an Energy Harvesting Pendulum (Video)
227.04.20Leo DostalAdvances in the development of car simulation models for vibration load prediction using Machine Learning (Video)
304.05.20Helge GrossertA Hybrid Approach for Modeling of Multibody Systems with Nonlinear Force Elements
411.05.20Daniel SchoepflinBilddatengenerierung als Trainingsdatensatz für eine KI-Objektidentifikation in der Intralogistik (Video)
(Prof Date)
Tobias Knopp
Görschwin Fey
Robert Meißner
Deep Learning for the Classification of Diseases in Chest X-Ray
Artificial Neural Networks and Faults
An automatic, data-driven definition of atomic-scale structural motifs
625.05.20Kai Sellschopp, Tim WürgerExploration of structure - property relationships with unsupervised ML (Video)
-01.06.20-Pfingsten Holiday
708.06.20Leon Kellner, Merten StenderExplainable AI and its application to ice mechanics
815.06.20Fin Hendrik BahnsenEmulation von neuronalen Netzen unter Hardwarefehlern
(Prof Date)
Alexander Schlaefer
Christian Cyron
Carlos Jahn
Machine Learning for Spatio-Temporal Signal Processing
Maschinelles Lernen in der Materialmodellierung
ML in der maritimen Logistik - Anwendungen aus Schifffahrt und Hafen
1029.06.20Morten SchierholzApplication of Artificial Neural Networks for Power Integrity Evaluation
1106.07.20Sebastian LindnerPredictive medium access techniques for wireless networks
1213.07.20Maximilian StarkEnd-to-end learning in Wireless Communications
1320.07.20Rüdiger Schmitztbd
1427.07.20Niklas JahnML-unterstützte Problembeschreibungen in digitalen Assistenzsystemen


  1. Leo Dostal: Towards Reinforcement Learning-based Control of an Energy Harvesting Pendulum.
    Harvesting energy from the environment, e. g. ocean waves, is a key capability for the long-term operation of remote electronic systems where standard energy supply is not available. Rotating pendulums can be used as energy converters when excited close to their eigenfrequency. However, to ensure robust operation of the harvester, the energy of the dynamic system has to be controlled. In this study, we deploy a lightweight reinforcement learning algorithm to drive the energy of an Acrobot pendulum towards a desired value. We analyze the algorithm in an extensive series of simulations. Moreover, we explore the real world application of our energy-based reinforcement learning algorithm using a computationally constrained hardware setup based on low-cost components, such as the Raspberry Pi platform.

  2. Leo Dostal: Advances in the development of car simulation models for vibration load prediction using Machine Learning.
    Nowadays electric cars are a focus area in automotive research. In this context we consider data based approache as tools to improve and facilitate the car design process. Hereby, we address the challenge of vibration load prediction for electric cars using neural network based machine learning (ML), a data-based frequency response function approach, and a hybrid combined model. We extensively study the challenging case of vibration load prediction of car components, such as the traction battery of an electric car. We show using experimental data from a 1:5 scale model car as well as data from a Fiat 500e car that the proposed ML approach is able to outperform the classical model estimation by means of ARX and ARMAX models. Moreover, we evaluate the performance of a hybrid-ML concept for combination of ML and ARMAX. Our promising results motivate further research in the field of vibration load prediction using machine learning based approaches in order to facilitate design processes.

  3. Helge Grossert: A Hybrid Approach for Modeling of Multibody Systems with Nonlinear Force Elements.
    Due to the introduction of simplifications and idealizations during the modeling process of a real-world system, the created mathematical model will always behave slightly different compared to the real-world system. This might become problematic, depending e.g. on the use case of the model or the size of the deviation itself. In such a case, more complex models might produce relief, even though they cannot ensure satisfactory results. Furthermore, such modeling is not always possible, e.g. due to a lack of information about the real world system. In this talk, an approach for solving that kind of problems is presented. By inserting neural networks into the model created before, it is possible to reduce the deviation between model and real-world system without the need of more information except the measured data that is used to compare the model and the real-world system. The approach is presented by comparison of different modeling approaches of a nonlinear single mass oscillator.

  4. Daniel Schoepflin: Bilddatengenerierung als Trainingsdatensatz für eine KI-Objektidentifikation in der Intralogistik.
    Der massive Bedarf an Daten zum Training von neuronalen Netzwerken stellt den industriellen Transfer erforschter Ansätze vor hohe Herausforderungen. Frei verfügbare Datensätze sind oftmals nicht in der Lage, die spezifischen und individuellen Anforderungen von Unternehmen abzudecken. Die synthetische Erzeugung von Trainingsdaten zeigt sich hierbei als erfolgsversprechende Alternative. In diesem Vortrag wird die Generierung von Trainingsbildern für eine KI-Objektidentifikation im intralogistischen Umfeld beleuchtet und aufgezeigt, welche Hürden für eine erfolgreiche Implementierung genommen werden müssen.

  5. Tobias Knopp, Görschwin Fey, Robert Meissner: tbd.

  6. Kai Sellschopp, Tim Würger: Exploration of structure - property relationships with unsupervised ML.
    Many areas of applications – ranging from corrosion engineering to catalysis on inorganic surfaces and from drug design to polymer composites in organic materials – are influenced by the atomic structure of the materials involved. Luckily, due to modern experimental and simulation methods, it is often possible to obtain a detailed atomistic understanding of the achieved material properties. However, as the sheer number of potentially useful agents and their huge space of possible configurations renders comprehensive analyses resource- and time-consuming, other measures to predict the performance of yet untested molecules are required. One potential approach is the investigation of quantitative structure-property relationships (QSPR) using the Smooth Overlap of Atomic Positions (SOAP) kernel - a descriptor for atomic environments, that provides a translationally and rotationally invariant representation and therefore allows to calculate molecular similarities. Plotting these similarities on a map and combining them with experimental and theoretical results can then be used to intuitively explore structure-property relationships and predict yet unknown material properties.
    In our talk, we first explain the basics of the SOAP kernel and how it can be used to distinguish atomic structures and speed up the process of finding the most favorable configurations. Then we show how SOAP is used in real life applications, such as in the control of magnesium-electrolyte interface properties, to gain deeper insights into fundamental mechanisms on an atomistic level.

  7. Leon Kellner, Merten Stender: Explainable AI and its application to ice mechanics.
    Criticism of data based models evolves around the problem of causation/correlation and the lack of knowledge generation when using those models. Naturally, and particularly for large black box models, this criticism is strongly connected to discussions under the umbrella of explainable or interpretable AI (XAI). After all, understanding why a model makes a prediction is key for, among others, trust, accountability, debugging and generalizability. A lack of understanding impedes improvement of models and input data as well as insight into the process being modeled.
    To begin with, we give a general motivation and overview on interpretability of data based models. This includes why interpretability is important, possible perspectives on interpretability, and lastly interpretability-related methods and tools.
    Secondly, we show-case machine learning and the SHAP (SHapley Additive exPlanation) interpretability toolbox to understand and predict the behavior of ice under compressive loads. Specifically, we are not interested in the best model but in which features drive model predictions, e.g. in a feature importance ranking. The identification of these features will be used as an addition to domain knowledge to create better material models for ice using a large experimental data base.

  8. Fin Hendrik Bahnsen: Emulation von neuronalen Netzen unter Hardwarefehlern.
    Neueste Errungenschaften in verschiedenen Bereichen werden durch den Einsatz künstlicher neuronaler Netze (NN) erzielt, z.B. im Bereich der Spracherkennung oder der Bildverarbeitung. Ein NN löst Probleme durch statistisches Lernen mit ressourcenlastigen Berechnungen. Um NN für mobile Geräte, eingebettete oder IoT-Systeme zu implementieren, wird Hardwarebeschleunigung immer wichtiger, um Energie-, Kosten- oder Rechenzeitanforderungen zu erfüllen. In einem Hardwarebeschleuniger werden die arithmetischen Operationen des NN sequentiell auf wenigen Recheneinheiten berechnet, so dass ein Fehler in der Verarbeitungshardware einen erheblichen Einfluss auf die Ausgabe des NNs haben kann. Die Zuverlässigkeit eines NNs und damit auch der zugehörigen Anwendung hängt dann nicht mehr ausschließlich von statistischen Fehlern im NN-Modell ab - die Zuverlässigkeit wird vielmehr durch das Zusammenspiel von NN-Modell und Hardware bestimmt. In dem Vortrag wird eine Technik zur Emulation von NN-Inferenz auf Hardware-Ressourcenbeschreibungen erläutert. Anschließend werden die Injektion von Hardwarefehlern und deren Auswirkung an verschieden Beispielen erörtert.

  9. Tobias Knopp, Görschwin Fey, Robert Meißner: tbd.

  10. Morten Schierholz: Application of Artificial Neural Networks for Power Integrity Evaluation.
    Increasing demands on modern electronic systems with respect to Signal and Power Integrity on printed circuit boards require many simulations during an optimization process. The necessity of additional and more complex simulations requires new and advanced simulation and optimization techniques. Using machine learning is one attempt to improve the efficiency of these optimization processes. The high dimensional problem of the power integrity analysis is especially challenging. The approach to improve the power delivery network of printed circuit boards with decoupling capacitors is analysed with artificial neural networks. The focus is based on the importance of preprocessing the input data and exploit the available domain knowledge to increase the accuracy of the artificial neural network.

  11. Sebastian Lindner: Predictive medium access techniques for wireless networks.
    Spectrum scarcity requires novel approaches for sharing frequency resources between different radio systems. Where coordination is not possible, intelligent approaches are needed, allowing a novel “secondary” system to access unused resources of a legacy (primary) system without requiring modifications of this primary system. Machine Learning is a promising approach to recognize patterns of the primary system and adapt the channel access accordingly. In this contribution we investigate the capability of Feed-Forward Deep Learning and Long Short Term Memory (LSTM) Recurrent Neural Networks (RNNs) to detect communication patterns of the primary user.
    Therefore, we take the example of a new aeronautical system (LDACS) coexisting with three different systems. Firstly, the coexistence with the Distance Measurement Equipment (DME) providing a deterministic interference to the secondary user and secondly with two synthetic channel access patterns, realized by a 2-state Markov model, modeling a bursty channel access behavior, as well as through a sequential channel access model.
    It can be shown that the Markov property of a Gilbert-Elliot channel model limits the predictability; nonetheless, we show that the model characteristics can be fully learned, which could leverage the design of interference avoidance systems that make use of this knowledge. The determinism of DME allows an error-free prediction, and it is shown that the reliability of sequential access model prediction depends on the model’s parameter.
    The limits of Feed-Forward Deep Neural Networks are highlighted, and why LSTM RNNs are state-of-the-art models in this problem domain. We show that these models are capable of online learning, as well as of learning correlations over long periods of time.

  12. Maximilian Stark: End-to-end learning in Wireless Communications.

  13. Rüdiger Schmitz: tbd.

  14. Niklas Jahn: ML-unterstützte Problembeschreibungen in digitalen Assistenzsystemen.
    Im industriellen Umfeld ermöglichen Augmented-Reality-Anwendungen die Erstellung am Bauteil dreidimensional verorteter Rückmeldungen. Diese dokumentieren mit kurzen Texten und Fotos Montageprobleme und Bauteilfehler in der Produktion. Allerdings schwankt die Informationsqualität der Rückmeldungen in Abhängigkeit des Erstellers und dessen Zeit zur Eingabe der Beschreibungen auf dem mobilen Endgerät. Auf maschinellem Lernen basierende Empfehlungsdienste bieten einem Nutzer die unterstützende Möglichkeit, Vorschläge für sinnvolle Textbausteine einer Problembeschreibung zu erhalten.
    Ich werde einen Prototyp für einen dafür geeigneten hybriden Empfehlungsdienst vorstellen, welcher sich aus einer Bildklassifikation mittels Deep Learning und einer Textverarbeitung mittels Data Mining und Natural Language Processing zusammensetzt.
    Einen weiteren Schwerpunkt stellt die Integration des Prototyps in Form eines ML-Microservices in eine Cloud-Infrastruktur am Beispiel von Kubernetes und Python-Webservices dar, sodass dieser von externen Anwendungen genutzt und gleichzeitig leicht weiterentwickelt werden kann.