Engineer Sr., Software
Giant Eagle · Karnātaka
Collected role description
Role overview
Engineer Sr., Software at Giant Eagle
Education Desired: Bachelors Degree.
The role is responsible for enterprise Marketing Technology.
Responsibilities
- Design, build, and maintain scalable batch and streaming data pipelines on Databricks using PySpark, Spark SQL, and Delta Lake.
- Build and maintain curated data models using the medallion (bronze/silver/gold) architecture for analytics, reporting, and marketing use cases.
- Implement data governance, security, and access control using Unity Catalog.
- Build data quality checks, validation, and monitoring to ensure the accuracy, completeness, and reliability of data.
- Support the migration and modernization of legacy Oracle-based ETL and PL/SQL processes to Databricks.
Required qualifications
- Experience Required: 5 to 10 years.
Employment details
- Location: Karnātaka [India]
Application details
- Collaborate with data analysts, data scientists, business stakeholders, and application teams to deliver data solutions.
Additional role details
- The Software Engineer Team Member is part of the Marketing Technology Team; under general direction, they will design, develop, and implement systems to ensure customer requirements are met in a timely and cost-effective manner.
- Key development responsibilities include the development of internal systems, management & integration of third-party software systems, and systems support.
- Experience Desired: Experience working in Data Engineering + retail supply chain environment.
- Develop ingestion frameworks to bring data from databases, APIs, files, and third-party marketing platforms into the Lakehouse.
- Orchestrate and schedule pipelines using Databricks Workflows/Jobs and Azure Data Factory where applicable.
- Optimize Spark jobs, cluster configurations, and Delta tables (partitioning, Z-ordering, file compaction) for performance and cost.
- Troubleshoot and resolve pipeline failures, data issues, and performance bottlenecks.
Collected minimum qualification
Education Desired: Bachelors Degree.
Collected experience requirement
5 to 10 years