Summary
Overview
Work History
Education
Skills
Languages
Work Availability
Work Preference
Hobbies and Interests
Quote
Interests
Websites
Timeline
Generic

Baye Ndiaga NDAO

Dakar

Summary

Data Engineer with a demonstrated history of success at Rubyx, specializing in improving data quality and pipeline efficiency through innovative ETL processes, complex algorithm and advanced SQL query optimization. Proficient in Python, Apache Airflow, DBT, BigQuery and APIs with a strong analytical mindset and exceptional problem-solving skills. A collaborative team player, dedicated to enhancing data-driven decision-making and delivering impactful results in dynamic environments.

Overview

3
3
years of professional experience

Work History

Data Engineer

Rubyx
10.2022 - Current
  • Creating and maintaining technical documentation.
  • Implementing new DQC checks and data validation functions throughout the pipelines with DBT test functions, and Great Expectations.
  • Building and maintaining efficient, reusable, and reliable Python code modules to construct Airflow DAGs.
  • Leading the development of data pipelines, significantly improving data integration from diverse sources for our new clients.
  • Implemented a monitoring DAG for the data warehouse to measure the daily duration, resource usage, cost, and error rate of BigQuery jobs, as well as the rows and volumes of tables, and the metadata of GCS files.
  • Identifying bottlenecks and improving them to reduce the airflow DAGs' duration.
  • Maintaining code quality and updating deprecated components.
  • Significantly optimized the SQL queries to enhance performance and minimize costs.
  • Implemented a comprehensive alerting system for data pipeline issues, ensuring immediate response to avoid scoring delay and workflow reliability.

Data Engineer

Orange Digital Center
Dakar
10.2021 - 09.2022
  • Implemented ETL processes, such as data transformation using tools including Python, Airflow, DBT, Beam, BigQuery, and SQL.
  • Explored available technologies and developed solutions to continuously improve the data quality, workflow reliability, and scalability.
  • Implemented an alerting system to notify the team on Slack immediately whenever a data pipeline task fails, or the data ingestion is delayed.

Education

Certificate - Data Science

Sonatel Academy
Dakar, Senegal
09.2022

Bachelor's Degree of Applied Physics - Electronics & Telecoms

Gaston Berger University
Saint-Louis, Senegal
05.2018

Undergraduate diploma - technology - specialty : telecoms & computer networking

Polytechnic School
Dakar, Senegal
10.2016

Skills

  • Ownership mentality
  • Learning by doing ability
  • Curious and fast learner
  • Critical thinking
  • Problem-solving aptitude
  • Teamwork
  • PostgreSQL
  • MongoDB
  • Django and Flask
  • Git and GitHub
  • Spark/PySpark
  • Apache Airflow
  • DBT
  • BigQuery and Snowflake
  • Docker
  • API
  • SQL
  • Python
  • Bash
  • Experience working with financial data

Languages

English
First Language

Work Availability

monday
tuesday
wednesday
thursday
friday
saturday
sunday
morning
afternoon
evening
swipe to browse

Work Preference

Work Type

Full TimePart TimeContract Work

Work Location

RemoteOn-SiteHybrid

Important To Me

Career advancementFlexible work hoursWork from home optionHealthcare benefitsPersonal development programsCompany CulturePaid time off

Hobbies and Interests

  • Football
  • Music
  • Play Station

Quote

Success is not final; failure is not fatal: It is the courage to continue that counts.
Winston S. Churchill

Interests

Football

Timeline

Data Engineer

Rubyx
10.2022 - Current

Data Engineer

Orange Digital Center
10.2021 - 09.2022

Certificate - Data Science

Sonatel Academy

Bachelor's Degree of Applied Physics - Electronics & Telecoms

Gaston Berger University

Undergraduate diploma - technology - specialty : telecoms & computer networking

Polytechnic School

Similar Profiles

CREATE PROFILE
Baye Ndiaga NDAO