Browse current jobs

Senior Databricks Engineer with Python

Luxoft · Pune

Apply on employer website

Source and collection record

Read the employer source

Last observed by our collector: . This is not a manual review or a confirmation from the employer.

Employer requisition: VR-125093

Job type and experience labels are automated discovery categories. The employer determines eligibility. Original experience wording was not retained separately; check the current employer page.

How sourcing and classification work · Report a discrepancy

Your application evidence checklist

Mark the statements you can support after reading the employer source. This checklist stays on this page; it does not score your eligibility or submit an application.

0 of 2 checks marked. Keep unresolved requirements as questions for the employer.

Collected role description

Project description We are looking for a Senior Databricks Engineer. The primary focus of this role is built in Python, while also leading the migration to Azure Databricks to improve performance, scalability, and efficiency. This role involves developing, optimizing, and automating reporting processes using PySpark and SQL, ensuring accurate and timely regulatory report generation. This is an exciting opportunity to work on. Responsibilities Implement high-quality solutions that address business needs and adhere to industry standards Drive automation of manual processes to the next level Closely collaborate within an agile team and a global agile organization Translate high-level business requirements into technical requirements addressing reliability, scalability, and performance needs Skills Must have Minimum 6+ years of hands-on application development experience using Databricks with Python Experience with PySpark, Pandas, NumPy, and unit testing Hands-on experience with SQL Server/ PostgreSQL database Practical experience with microservice architectures, CI/CD pipelines (preferably with GitLab) Good to have exposure to cloud native services on Azure Experience in translating high-level business requirements into IT requirements Excellent communication skills Nice to have Azure Data Services ETL & Data Processing Financial Data Processing, experience handling risk, compliance, and regulatory data in an investment banking environment. Data Modeling, metadata management Git, GitHub, GitLab Jenkins Regulatory compliance knowledge: Basel, MiFID, GDPR Big Data Cloud security and access controls (IAM, RBAC) Familiarity with Docker, Kubernetes, Apache Other Languages English: C1 Advanced Seniority Senior

Collected experience requirement

6+ years