Data engineer | Content creator
Senior Data Engineer with 7 years of experience building scalable data pipelines across Databricks, AWS, and Azure for industry leaders like Total Energies, Schneider Electric, and Airbus. Alten's 2024 Data Engineer Specialist of the Year, specializing in PySpark, Python, and processing billions of rows of data to drive critical business operations.
- 🔎 Pyspark-AntiPattern: A cli tool to check all the pyspark antipattern.
✈️ TunisairAlert: A flight price alert system for Tunisair flights.- 🐻❄️ SparkPolars: A library to convert Spark DataFrames to Polars DataFrames and vice versa.
- ✅ SpakrCheck: A data validation library for PySpark DataFrames using a simple and intuitive syntax.
- Building scalable data pipelines and ETL processes using PySpark, Databricks, and AWS.
- Exploring new technologies and tools in the data engineering ecosystem.
- Engaging with the data engineering community through forums, meetups, and conferences.
- Mentoring junior data engineers and sharing knowledge with peers.
- Many contributions to private projects and enterprise github repositories.
- 🏆 Alten Data Engineer Specialist of the Year 2024: Awarded for exceptional performance and contributions to data engineering excellence.
- 📰 Featured in Managers Magazine: Local newspaper coverage highlighting the TunisairAlert project, which uses data science to track and calculate daily flight delays for Tunisair flights.
"Data is the new oil." - Clive Humby