Talk Details

The solution to gather data from different data sources (SQL, NoSQL, REST) related to the customer API platform. Also, data were transformed and prepared for reporting and an&n"/>

ETL pipeline with GCP Dataflow​

Small Talk
Architecture

The solution to gather data from different data sources (SQL, NoSQL, REST) related to the customer API platform. Also, data were transformed and prepared for reporting and an analytic tool like Tableau or Data Studio. The developed solution includes the reliable and flexible architecture of the data pipeline, the data model design and data dictionary for reporting, the framework for data extraction and transformation from different sources, the orchestration engine for the data pipeline, the collection of reports in Tableau.

Scheduled on Saturday from 10:00 to 10:25 (Europe/Kiev) in Stream 3

Data Processing Pipelines
Dataflow Programming Model
GCP

Oleksandr Reshetnik

Epam Systems

In IT for about 15 years. Now works as a solution architect in financial services and integration domains. Head of Java competency in Vinnytsya. Also, I am a resident of API and Integration competency centers. In recent 5 years, my projects are connected with integrations, REST API, developers experience, API management