Software Engineer II

Role overview

Software Engineer II at American Express

Responsibilities

• Build and maintain dashboards, alerts, recording rules, and queries across Prometheus, Grafana, Mimir, and Loki.
• Create Python scripts and small utilities to automate routine monitoring, validation, reporting, and integration tasks.
• Collaborate with infrastructure, application, and platform teams to onboard services and improve monitoring coverage and alert quality.

Required qualifications

• 5-7 years of relevant experience in software engineering, platform engineering, DevOps, site reliability engineering, observability, or infrastructure operations.
• Observability stack: Hands-on experience with Prometheus, Grafana, Mimir, and Loki in production or enterprise environments.
• Query languages: Practical experience writing and troubleshooting PromQL and LogQL queries for metrics, logs, recording rules, alerts, and operational analysis.
• Grafana: Experience creating and maintaining dashboards, variables, panels, visualizations, alerts, and reusable monitoring views.
• Python: Basic understanding of Python for scripting, automation, API usage, and operational tooling.
• Kubernetes: Working knowledge of Kubernetes resources, deployments, services, configuration, troubleshooting, and workload operations.
• Helm and CI/CD: Experience creating or maintaining Helm charts and deploying applications through CI/CD pipelines using GitHub Actions.
• Linux administration: Hands-on Linux administration and troubleshooting experience, including processes, filesystems, networking, system services, packages, and performance.
• VMware: Working knowledge of VMware vSphere, virtual machines, provisioning concepts, and virtual infrastructure operations.
• Engineering practices: Understanding of version control, code review, testing, documentation, incident response, and secure change management.
• Collaboration: Good analytical, troubleshooting, written communication, and teamwork skills.
• Technology Prometheus Grafana Mimir Loki PromQL LogQL Python Kubernetes Helm Charts GitHub Actions Linux / RHEL VMware vSphere

Employment details

• Location: Gurugram [HR] [India]

Additional role details

• This is an engineering role focused on building, operating, and enhancing enterprise observability and cloud-native platforms.
• The engineer will develop monitoring and logging capabilities, dashboards, alerts, deployment automation, and platform integrations while supporting Linux and VMware-based environments.
• Develop PromQL and LogQL for infrastructure and application monitoring, capacity analysis, troubleshooting, and service health.
• Operate and troubleshoot observability components, data collection pipelines, integrations, and platform dependencies.
• Deploy and maintain Kubernetes applications using Helm charts, deployments, configuration, and GitHub Actions workflows.
• Support Linux systems and VMware virtual machines used by observability and platform services.
• Investigate incidents using metrics, logs, dashboards, and infrastructure data, and document root causes and corrective actions.
• Minimum