Data Engineer

Role overview

Data Engineer at Techversant Infotech

Design, build, and maintain end-to-end ETL/ELT pipelines using both on-premise and cloud-based technologies.

What’s important to us: We are looking for a skilled and experienced Data Engineer with over 4 years of professional experience in

Responsibilities

• Architect and operate data storage and streaming solutions leveraging cloud-based services on AWS , Azure , or GCP .
• Design and implement data ingestion and transformation workflows using Airflow , AWS Glue , or Azure Data Factory .
• Develop and optimize data pipelines using Python and Py Spark for large-scale distributed data processing.
• Build data models — normalized, denormalized, and dimensional ( Star/Snowflake ) — for analytics and warehousing solutions.
• Implement data quality , lineage , and governance using metadata management and monitoring tools.
• Collaborate with cross-functional teams to deliver clean, reliable, and timely data for analytics and machine learning use cases.
• Integrate CI/CD pipelines for data infrastructure deployment using Git Hub Actions , Jenkins , or Azure Dev Ops .
• Automate infrastructure provisioning using Infrastructure as Code (Ia C) tools such as AWS Cloud Formation or Terraform .
• Monitor and optimize data processing performance for scalability, reliability, and cost-efficiency.
• Enforce data security policies and ensure compliance with standards such as GDPR and HIPAA .
• Must-Have
• Skills &

Required qualifications

• Bachelor’s or Master’s degree in Computer Science, Information Technology, Data Engineering, or a related field.
• Minimum 4 years of hands-on experience as a Data Engineer or in data-intensive environments.
• SQL Expertise: Advanced proficiency in SQL for complex queries, joins, window functions, and performance tuning.
• Analytical Databases: Experience working with Snowflake, Amazon Redshift, Google Big Query, Azure Synapse, and Postgre SQL .
• Query Optimization: Skilled in query optimization, indexing, and execution plan analysis for high-performance analytics workloads.
• Programming: Proficient in Python and Py Spark for data manipulation, automation, and pipeline orchestration.
• Data Processing Frameworks: Strong understanding of Apache Spark (RDD, Data Frame, Spark SQL, optimization), Hive, Hadoop, and Flink for large-scale distributed data processing.
• ETL/ELT Frameworks: Hands-on experience designing and maintaining pipelines using Airflow, AWS Glue, or Azure Data Factory.
• Data Integration Patterns: Familiar with incremental loading, Slowly Changing Dimensions (SCD), Change Data Capture (CDC), and error handling in data pipelines.
• Data Modeling: Expertise in data modeling, schema design, and building normalized, denormalized, and dimensional ( Star/Snowflake ) schemas.
• Data Architecture: Strong understanding of Data Warehousing, Data Lakes, and Lakehouse architectures, including Delta Lake, ACID transactions, and partitioning strategies .
• Cloud Platforms: Practical experience with major cloud ecosystems — AWS: S3, Glue, Redshift, Athena, Lambda, Step Functions, EMR Azure: Data Factory, Data Lake Gen2, Synapse, Databricks Cloud Security: Experience managing IAM roles, access control, and encryption in cloud environments.
• Pipeline Optimization: Skilled in optimizing data pipelines for performance, scalability, and cost-efficiency.
• CI/CD and Dev Ops: Hands-on experience with CI/CD tools such as Git Hub Actions, Git Lab CI, or Azure Dev Ops.
• Version Control: Proficient with Git and familiar with agile development practices.
• Good-to-Have Skills: Experience with containerization and orchestration .
• Exposure to data cataloging and governance tools .
• Experience with monitoring tools .
• Familiarity with data APIs and microservices architecture .
• Certification in cloud data engineering (e.g., AWS Certified Data Engineer, Azure Data Engineer Associate, or GCP Professional Data Engineer).
• Experience supporting machine learning and analytics pipelines .
• Soft Skills: Strong analytical and problem-solving mindset.
• Excellent communication and documentation skills.
• Ability to work collaboratively in a cross-functional, fast-paced environment.
• Strong attention to detail with a focus on data accuracy and reliability.
• Eagerness to learn and adopt emerging data technologies.
• Job Category: AI/ML
• Employer experience: 4+ years

Employment details

• Job Type: Full Time
• Job Location: Trivandrum Kochi Apply for this position Full Name Email Phone Bio Upload CV/Resume Allowed Type(s): .pdf, .doc, .docx I accept the Terms & Conditions and Privacy Policy Need a winning digital strategy?
• Contact us today!
• Services Artificial Intelligence Web Application Mobile Application IT Consulting & Support Data Science & Engineering Cyber Security Business Intelligence Quick Links Who we are Customer Stories Awards & Certifications Contact Us DPA Privacy Policy Get in Touch USA | UK | Australia | Canada | UAE | India [email protected] +91 484 4014666 | +91 471 4014953 Facebook X-twitter Youtube Linkedin © 2026 Techversant .
• All rights reserved. 🍪 This website uses cookies to ensure you get the best experience.
• By continuing, you agree to our policy.
• Accept Reject Settings Cookie Settings Manage how cookies are used on this website.
• Necessary Cookies Always Active Close
• Location: Kochi, Trivandrum

Additional role details

• What’s important to us: