Data Engineer

What’s important to us: We are looking for a skilled and experienced Data Engineer with over 4 years of professional experience in What’s important to us: Key RESPONSIBILITIES: Design, build, and maintain end-to-end ETL/ELT pipelines using both on-premise and cloud-based technologies. Architect and operate data storage and streaming solutions leveraging cloud-based services on AWS , Azure , or GCP . Design and implement data ingestion and transformation workflows using Airflow , AWS Glue , or Azure Data Factory . Develop and optimize data pipelines using Python and Py Spark for large-scale distributed data processing. Build data models — normalized, denormalized, and dimensional ( Star/Snowflake ) — for analytics and warehousing solutions. Implement data quality , lineage , and governance using metadata management and monitoring tools. Collaborate with cross-functional teams to deliver clean, reliable, and timely data for analytics and machine learning use cases. Integrate CI/CD pipelines for data infrastructure deployment using Git Hub Actions , Jenkins , or Azure Dev Ops . Automate infrastructure provisioning using Infrastructure as Code (Ia C) tools such as AWS Cloud Formation or Terraform . Monitor and optimize data processing performance for scalability, reliability, and cost-efficiency. Enforce data security policies and ensure compliance with standards such as GDPR and HIPAA . Must-Have Skills & QUALIFICATIONS: EDUCATION: Bachelor’s or Master’s degree in Computer Science, Information Technology, Data Engineering, or a related field. Experience: Minimum 4 years of hands-on experience as a Data Engineer or in data-intensive environments. SQL Expertise: Advanced proficiency in SQL for complex queries, joins, window functions, and performance tuning. Analytical Databases: Experience working with Snowflake, Amazon Redshift, Google Big Query, Azure Synapse, and Postgre SQL . Query Optimization: Skilled in query optimization, indexing, and execution plan analysis for high-performance analytics workloads. Programming: Proficient in Python and Py Spark for data manipulation, automation, and pipeline orchestration. Data Processing Frameworks: Strong understanding of Apache Spark (RDD, Data Frame, Spark SQL, optimization), Hive, Hadoop, and Flink for large-scale distributed data processing. ETL/ELT Frameworks: Hands-on experience designing and maintaining pipelines using Airflow, AWS Glue, or Azure Data Factory. Data Integration Patterns: Familiar with incremental loading, Slowly Changing Dimensions (SCD), Change Data Capture (CDC), and error handling in data pipelines. Data Modeling: Expertise in data modeling, schema design, and building normalized, denormalized, and dimensional ( Star/Snowflake ) schemas. Data Architecture: Strong understanding of Data Warehousing, Data Lakes, and Lakehouse architectures, including Delta Lake, ACID transactions, and partitioning strategies . Cloud Platforms: Practical experience with major cloud ecosystems — AWS: S3, Glue, Redshift, Athena, Lambda, Step Functions, EMR Azure: Data Factory, Data Lake Gen2, Synapse, Databricks Cloud Security: Experience managing IAM roles, access control, and encryption in cloud environments. Pipeline Optimization: Skilled in optimizing data pipelines for performance, scalability, and cost-efficiency. CI/CD and Dev Ops: Hands-on experience with CI/CD tools such as Git Hub Actions, Git Lab CI, or Azure Dev Ops. Version Control: Proficient with Git and familiar with agile development practices. Good-to-Have Skills: Experience with containerization and orchestration . Exposure to data cataloging and governance tools . Experience with monitoring tools . Familiarity with data APIs and microservices architecture . Certification in cloud data engineering (e.g., AWS Certified Data Engineer, Azure Data Engineer Associate, or GCP Professional Data Engineer). Experience supporting machine learning and analytics pipelines . Soft Skills: Strong analytical and problem-solving mindset. Excellent communication and documentation skills. Ability to work collaboratively in a cross-functional, fast-paced environment. Strong attention to detail with a focus on data accuracy and reliability. Eagerness to learn and adopt emerging data technologies. Job Category: AI/ML Job Type: Full Time Job Location: Trivandrum Kochi Apply for this position Full Name * Email * Phone * Bio * Upload CV/Resume * Allowed Type(s): .pdf, .doc, .docx I accept the Terms & Conditions and Privacy Policy * Need a winning digital strategy? Contact us today! Services Artificial Intelligence Web Application Mobile Application IT Consulting & Support Data Science & Engineering Cyber Security Business Intelligence Quick Links Who we are Customer Stories Awards & Certifications Contact Us DPA Privacy Policy Get in Touch USA | UK | Australia | Canada | UAE | India [email protected] +91 484 4014666 | +91 471 4014953 Facebook X-twitter Youtube Linkedin © 2026 Techversant . All rights reserved. 🍪 This website uses cookies to ensure you get the best experience. By continuing, you agree to our policy. Accept Reject Settings Cookie Settings Manage how cookies are used on this website. Necessary Cookies Always Active Close