Senior Data Engineer

Role overview

Senior Data Engineer at InfoCusp Innovations

We are seeking a highly skilled Senior Data Engineer with strong hands-on experience in Google Cloud Platform (GCP), cloud infrastructure, data ingestion, and Python .

The ideal candidate will have a proven track record of designing and implementing scalable data platforms, organizing GCP environments to meet data sovereignty requirements , and building secure and reliable data ingestion and transfer solutions.

Responsibilities

• 1.
• GCP Architecture & Infrastructure Design, develop, and maintain scalable GCP infrastructure for enterprise data workloads.
• Architect and organize GCP environments to support data sovereignty and data residency requirements .
• Design appropriate GCP projects, environments, networking, storage, IAM, and security configurations for data platforms.
• Establish scalable and reliable cloud infrastructure patterns for data processing and storage. 2.
• Data Ingestion & Pipeline Engineering Design and implement robust data ingestion pipelines for structured and unstructured data sources.
• Build production-grade ingestion frameworks to reliably process and move data into GCP or similar storage.
• Develop scalable and fault-tolerant data pipelines with appropriate validation, monitoring, and error handling.
• Optimize data ingestion workflows for performance, reliability, and cost.
• Ensure data pipelines maintain data quality, integrity, and traceability throughout the ingestion process. 3.
• Python Development & Automation Develop production-grade data engineering applications and automation using Python .
• Build reusable libraries, services, and utilities to support data ingestion and processing workflows.
• Automate infrastructure and data engineering processes to improve operational efficiency.
• Implement appropriate logging, monitoring, error handling, and testing for Python-based services and pipelines. 4.
• Collaboration & Ownership Work closely with Data Engineers, Software Engineers, Cloud/Infrastructure Engineers, Security teams, and business stakeholders.
• Take ownership of technical initiatives from architecture and design through production deployment and ongoing support.
• Requirements 5+ years of experience in Data Engineering, Cloud Engineering, or a related field.
• Strong hands-on experience with Google Cloud Platform (GCP) .
• Proven experience designing and implementing GCP architecture and infrastructure for data workloads.
• Good understanding of GCP services such as Google Cloud Storage (GCS), BigQuery, Pub/Sub, Dataflow, Cloud Run/GKE, VPC, IAM, and Cloud Monitoring .
• Experience with cloud networking, security, authentication, authorization, and access control.
• Experience with infrastructure automation and Infrastructure as Code (IaC) , preferably Terraform.
• Strong understanding of data quality, monitoring, observability, and production operational best practices.
• Experience organizing GCP environments to meet data sovereignty and data residency requirements .
• Strong experience building data ingestion pipelines and data processing workflows.
• Hands-on experience designing and implementing secure data transfer and proxy solutions .
• Strong proficiency in Python and experience building production-grade applications and data pipelines.
• Excellent communication skills and ability to work independently with minimal supervision.
• Work

Employment details

• Location: Ahmedabad/Pune Benefits Group Health Insurance Flexible working hours WFH Flexibility
• Location: Ahmedabad [Pune] [India]