Lead AI Engineer

Create and maintain optimal data pipeline architectures Optimize data delivery for greater scalability Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using PySpark, SQL and AWS/Azure cloud services Work with internal and external stakeholders to assist with data-related technical issues and support data infrastructure needs enabling and running data ingestions from different sources like DB, streaming, files, SFTP. performing thorough testing and validation in order to support the accuracy of data transformations and data verification to be used by downstream applications Recommend different ways to constantly improve data reliability and quality.