Stage-oe-small.jpg

Vortrag Graduiertenkolloquium4: Unterschied zwischen den Versionen

Aus Aifbportal
Wechseln zu:Navigation, Suche
(Die Seite wurde neu angelegt: „{{Veranstaltung |Titel DE=Vortrag Graduiertenkolloquium |Titel EN=Vortrag Graduiertenkolloquium |Beschreibung DE=folgt |Beschreibung EN=folgt |Veranstaltungsar…“)
 
 
Zeile 1: Zeile 1:
 
{{Veranstaltung
 
{{Veranstaltung
|Titel DE=Vortrag Graduiertenkolloquium
+
|Titel DE=Managing Stream Processing Pipelines in Heterogeneous Fog Infrastructures
|Titel EN=Vortrag Graduiertenkolloquium
+
|Titel EN=Managing Stream Processing Pipelines in Heterogeneous Fog Infrastructures
|Beschreibung DE=folgt
+
|Beschreibung DE=The steady increase in digitalization has lead to a deluge of generated data with the Internet of Things (IoT) as a key enabler. Thereby, its promise to realize data-driven decision-making is a major innovation driver offering great opportunities for companies. In this regards, Stream Processing is a widely adopted paradigm to process event streams in real-time to account for time-sensitive actions. Most recently, to significantly lower rather high technological entry barriers, flow-based approaches have been introduces allowing non-technical domain experts to model applications in a self-service manner.
|Beschreibung EN=folgt
+
 
 +
Still, today’s stream processing pipelines are focused on static deployments in centralized cloud environments that come with inevitable downsides, particularly in the context of IoT scenarios that require fast results, are limited by the available bandwidth, or bound to regulations regarding data sovereignty and ownership. In recent years, a new decentralized computing paradigm referred to as Fog Computing allows to overcome the shortcomings of previous cloud-only approaches by offloading certain processing in closer proximity to the data source. This offers possibilities for a next generation of stream processing applications that are centrally modeled, and deployed over a pool of geographically distributed compute resources. However, unlike the cloud, fog and edge nodes are highly heterogeneous in terms of hardware specifications and are potentially exposed to the physical world. Deployment-wise, current systems still require deep technical knowledge in infrastructure management and lack an approach for explicitly exploiting heterogeneous computational resources available in the underlying fog infrastructure allowing to autonomously select suitable deployment configurations in order to better assist domain experts along the deployment process.
 +
 
 +
In this presentation, we show how to abstract application specialists from the technical complexities of deploying, executing and adapting stream processing pipelines in heterogeneous fog infrastructures. Our main contributions are (i) a generic node model describing relevant resource characteristics and additional metadata, (ii) a node controller incorporating the node model for pipeline element life cycle management, as well as (iii) a fog cluster management framework to flexibly deploy, refine and relocate individual pipeline elements to registered nodes along the cloud-edge continuum while handling messaging between adjacent elements. We have evaluated resource consumption and deployment metrics of our work in two application domains, manufacturing and urban logistics.
 +
|Beschreibung EN=The steady increase in digitalization has lead to a deluge of generated data with the Internet of Things (IoT) as a key enabler. Thereby, its promise to realize data-driven decision-making is a major innovation driver offering great opportunities for companies. In this regards, Stream Processing is a widely adopted paradigm to process event streams in real-time to account for time-sensitive actions. Most recently, to significantly lower rather high technological entry barriers, flow-based approaches have been introduces allowing non-technical domain experts to model applications in a self-service manner.
 +
 
 +
Still, today’s stream processing pipelines are focused on static deployments in centralized cloud environments that come with inevitable downsides, particularly in the context of IoT scenarios that require fast results, are limited by the available bandwidth, or bound to regulations regarding data sovereignty and ownership. In recent years, a new decentralized computing paradigm referred to as Fog Computing allows to overcome the shortcomings of previous cloud-only approaches by offloading certain processing in closer proximity to the data source. This offers possibilities for a next generation of stream processing applications that are centrally modeled, and deployed over a pool of geographically distributed compute resources. However, unlike the cloud, fog and edge nodes are highly heterogeneous in terms of hardware specifications and are potentially exposed to the physical world. Deployment-wise, current systems still require deep technical knowledge in infrastructure management and lack an approach for explicitly exploiting heterogeneous computational resources available in the underlying fog infrastructure allowing to autonomously select suitable deployment configurations in order to better assist domain experts along the deployment process.
 +
 
 +
In this presentation, we show how to abstract application specialists from the technical complexities of deploying, executing and adapting stream processing pipelines in heterogeneous fog infrastructures. Our main contributions are (i) a generic node model describing relevant resource characteristics and additional metadata, (ii) a node controller incorporating the node model for pipeline element life cycle management, as well as (iii) a fog cluster management framework to flexibly deploy, refine and relocate individual pipeline elements to registered nodes along the cloud-edge continuum while handling messaging between adjacent elements. We have evaluated resource consumption and deployment metrics of our work in two application domains, manufacturing and urban logistics.
 
|Veranstaltungsart=Graduiertenkolloquium
 
|Veranstaltungsart=Graduiertenkolloquium
 
|Start=2020/10/28 15:45:00
 
|Start=2020/10/28 15:45:00
 
|Ende=2020/10/28 17:15:00
 
|Ende=2020/10/28 17:15:00
 
|Gebäude=05.20
 
|Gebäude=05.20
 +
|Raum=Onlineveranstaltung
 
|Vortragender=Patrick Wiener
 
|Vortragender=Patrick Wiener
 +
|PDF=Wiener 28-10-2020.pdf
 
|Forschungsgruppe=Web Science
 
|Forschungsgruppe=Web Science
 
|In News anzeigen=Ja
 
|In News anzeigen=Ja
 
}}
 
}}

Aktuelle Version vom 8. Oktober 2020, 06:47 Uhr

Managing Stream Processing Pipelines in Heterogeneous Fog Infrastructures

Veranstaltungsart:
Graduiertenkolloquium




The steady increase in digitalization has lead to a deluge of generated data with the Internet of Things (IoT) as a key enabler. Thereby, its promise to realize data-driven decision-making is a major innovation driver offering great opportunities for companies. In this regards, Stream Processing is a widely adopted paradigm to process event streams in real-time to account for time-sensitive actions. Most recently, to significantly lower rather high technological entry barriers, flow-based approaches have been introduces allowing non-technical domain experts to model applications in a self-service manner.

Still, today’s stream processing pipelines are focused on static deployments in centralized cloud environments that come with inevitable downsides, particularly in the context of IoT scenarios that require fast results, are limited by the available bandwidth, or bound to regulations regarding data sovereignty and ownership. In recent years, a new decentralized computing paradigm referred to as Fog Computing allows to overcome the shortcomings of previous cloud-only approaches by offloading certain processing in closer proximity to the data source. This offers possibilities for a next generation of stream processing applications that are centrally modeled, and deployed over a pool of geographically distributed compute resources. However, unlike the cloud, fog and edge nodes are highly heterogeneous in terms of hardware specifications and are potentially exposed to the physical world. Deployment-wise, current systems still require deep technical knowledge in infrastructure management and lack an approach for explicitly exploiting heterogeneous computational resources available in the underlying fog infrastructure allowing to autonomously select suitable deployment configurations in order to better assist domain experts along the deployment process.

In this presentation, we show how to abstract application specialists from the technical complexities of deploying, executing and adapting stream processing pipelines in heterogeneous fog infrastructures. Our main contributions are (i) a generic node model describing relevant resource characteristics and additional metadata, (ii) a node controller incorporating the node model for pipeline element life cycle management, as well as (iii) a fog cluster management framework to flexibly deploy, refine and relocate individual pipeline elements to registered nodes along the cloud-edge continuum while handling messaging between adjacent elements. We have evaluated resource consumption and deployment metrics of our work in two application domains, manufacturing and urban logistics.

(Patrick Wiener)




Start: 28. Oktober 2020 um 15:45
Ende: 28. Oktober 2020 um 17:15


Im Gebäude 05.20, Raum: Onlineveranstaltung

Veranstaltung vormerken: (iCal)


Veranstalter: Forschungsgruppe(n) Web Science
Information: Media:Wiener 28-10-2020.pdf