Data Engineer (GCP, Azure)
Artefact · Pune
Collected role description
Role overview
Data Engineer (GCP, Azure) at Artefact
What you will be doing?
Preferred qualifications and skills
- Experience with Data Pipelines ETL, Cloud Services ( MS Azure, GCP preferred) , ML Modeling, Spark & Kafka.
Employment details
- Location: Pune [Maharashtra] [India]
About the employer
- Artefact is a new generation of data service providers specialising in data consulting and data-driven digital marketing.
Additional role details
- It is dedicated to transforming data into business impact across the entire value chain of organisations.
- We are proud to say we’re enjoying skyrocketing growth.
- The backbone of our consulting missions, today our Data consulting team has more than 400 consultants covering all Artefact's offers (and more): data marketing, data governance, strategy consulting, product owner…
- As a Data Engineer, your role involves crafting and maintaining robust data pipelines, utilising Python and SQL, to ensure efficient extraction, transformation, and loading (ETL) of data.
- Your responsibilities will include:
- Data Pipeline Development: Building and optimising data pipelines to facilitate seamless data flow across systems and platforms.
- Database Management: Managing databases, ensuring their integrity, and implementing data storage and retrieval solutions.
- Cloud Services Integration: Leveraging cloud services such as MS Azure, GCP, and AWS to architect and deploy scalable data solutions.
- Machine Learning Integration: Collaborating with teams to integrate machine learning models into data pipelines for enhanced data processing.
- Utilising Spark & Kafka: Implementing and working with Spark and Kafka for real-time data processing and analytics.
- What we are looking for?
- Proficiency in Python, SQL, and database management.
- Proven problem-solving skills and a solution-oriented mindset.
- Excellent communication skills to collaborate effectively within teams and with stakeholders.
- Strong business acumen with an interest in business-facing roles.
- Adaptability and a start-up mentality to thrive in a dynamic environment.
- Candidates with similar skill sets and experiences have excelled in technology firms or consultancy firms.
- Successful candidates often possess Computer Science, Electronics, and Communication Engineering degrees.