Browse current jobs

Engineer Sr., Software

Giant Eagle · Karnātaka

Apply on employer website

Collected role description

Role overview

Engineer Sr., Software at Giant Eagle

Education Desired: Bachelors Degree.

The role is responsible for enterprise Marketing Technology.

Responsibilities

  • Design, build, and maintain scalable batch and streaming data pipelines on Databricks using PySpark, Spark SQL, and Delta Lake.
  • Build and maintain curated data models using the medallion (bronze/silver/gold) architecture for analytics, reporting, and marketing use cases.
  • Implement data governance, security, and access control using Unity Catalog.
  • Build data quality checks, validation, and monitoring to ensure the accuracy, completeness, and reliability of data.
  • Support the migration and modernization of legacy Oracle-based ETL and PL/SQL processes to Databricks.

Required qualifications

  • Experience Required: 5 to 10 years.

Employment details

  • Location: Karnātaka [India]

Application details

  • Collaborate with data analysts, data scientists, business stakeholders, and application teams to deliver data solutions.

Additional role details

  • The Software Engineer Team Member is part of the Marketing Technology Team; under general direction, they will design, develop, and implement systems to ensure customer requirements are met in a timely and cost-effective manner.
  • Key development responsibilities include the development of internal systems, management & integration of third-party software systems, and systems support.
  • Experience Desired: Experience working in Data Engineering + retail supply chain environment.
  • Develop ingestion frameworks to bring data from databases, APIs, files, and third-party marketing platforms into the Lakehouse.
  • Orchestrate and schedule pipelines using Databricks Workflows/Jobs and Azure Data Factory where applicable.
  • Optimize Spark jobs, cluster configurations, and Delta tables (partitioning, Z-ordering, file compaction) for performance and cost.
  • Troubleshoot and resolve pipeline failures, data issues, and performance bottlenecks.

Collected minimum qualification

Education Desired: Bachelors Degree.

Collected experience requirement

5 to 10 years