Zero code based metadata-driven data pipeline automation (by A. Mamun & A. Hossen)

preview_player
Показать описание
The London Clojurians are happy to present:

Title: **Zero code based metadata-driven data pipeline automation**
Speaker: **Abdullah Mamun**

"Zero code based metadata driven data pipeline automation"

As a company is becoming more and more data-driven, data needs to
represent in different shapes for process, tools, and
people. Different type of business needs data in different shape. Data
needs to be transactional for storing, processing, and capturing in
real-time. Data needs to aggregate for a historical overview. Data
needs to be linkable for better search and find results. Data needs to
be shareable, mutable internally or externally.

Using a metadata-driven data-pipeline automation approach, users can
create any shape of a model (data-vault, data mart, knowledge graph
etc) for end-to-end dataflow across organisations. Users will know
different types of challenges and different solutions like datalake,
azure synapse etc.

There will be a demo in the session.

Mamun has been working in Clojure for last 3 years. His interests are
automation, data engineering, data-driven product development etc.

experience in IT, most of which are at Ericsson. Currently, he is
pursuing a Master's degree in Cloud Computing at the University of
Leicester, which is expected to be completed in Sep 2022. He started
working in LISP/Clojure in 2020. He had vast experience in the
business support system domain of Ericsson solutions. His current
focus is on the cloud-native based solution, architecture, engineering
and various security aspects.

If you missed this event, you can watch the recording on our YouTube
will be uploaded a couple of days after the event.)

Please, consider supporting the London Clojurians with a small donation:

Your contributions will enable the sustainability of the London
Clojurians community and support our varied set of online and
in-person events:

- ClojureBridge London: supports under-represented groups discover Clojure
- re:Clojure: our **free** to attend annual community conference
- monthly meetup events with speakers from all over the world
- subscription and admin costs such as domain name & Zoom plan for
larger online meetups

Thank you to our sponsors:

- And many individual sponsors
Рекомендации по теме
Комментарии
Автор

Very interesting topic. This is going to reduce costs for data driven/engineering projects.

RupomRazzaque
Автор

This is great, , , making technology stack management more easier...

amintalukder