Snowflake Cortex AWS Glue
Infocepts.AI · Bangalore
Collected role description
Role overview
Snowflake Cortex AWS Glue at Infocepts.AI
Position : Data Engineer -Snowflake Cortex- AWS Glue Purpose of the Position: To lead the data engineering team in architecting and delivering enterprise-scale Snowflake solutions for retail analytics, ensuring alignment with strategic business goals and modernization initiatives.
Employment details
- Location: Chennai/ Bangalore/ Pune/ Nagpur Key Result Areas and Activities: Data Pipeline Development: Drive ingestion and transformation of multi-source retail data (MMS, CRM, Workday, Courion etc).
- Architecture Leadership: Define and implement Snowflake architecture for multi-layered retail data processing.
- ETL Strategy: Lead migration strategy from Talend to AWS Glue, ensuring automation and scalability.
- ETL Development: Build and optimize ETL workflows using Talend, AWS Glue and SQL stored procedures.
- Strategic Alignment: Align data engineering practices with retail business priorities (sales, customer, workforce, inventory) Data Modelling: Create and maintain Snowflake tables and layered views for business consumption.
- Cortex Agent Creation: Build, configure and deploy Cortex Agents that use Cortex Analyst (semantic models/views) for structured data and Cortex Search for unstructured content, with Streamlit in Snowflake as the user-facing conversational interface.
- Cortex Use-Case Delivery: Identify, prototype, and take Cortex use cases from POC to production (e.g., natural-language sales/inventory insights, product review and customer feedback analysis, document intelligence, demand forecasting).
- AI Readiness & Semantic Layer: Prepare AI-ready data foundations, including semantic models, curated views and metadata, so Cortex-based solutions give accurate, trusted responses.
- Data Governance: Implement standards for lineage, documentation, and compliance.
- Collaboration: Coordinate with team members, work closely with data analysts, business stakeholders, and regulatory teams to understand data needs and deliver solutions.
- Performance Optimization: Ensure efficient query performance, storage management and cost-effective data processing in Snowflake.
- Documentation & Governance: Maintain clear documentation of data models, transformations, and lineage to support audit and compliance requirements.
- Team Leadership: Mentor and manage engineers across different levels, ensuring delivery excellence.
- Innovation: Explore snowflake features like dynamic tables, automation, and advanced Snowflake features for efficiency.
- Location: Bangalore [Karnataka] [India]
Additional role details
- The role will also drive Snowflake Cortex AI development, building AI agents and GenAI use cases that turn governed retail data into conversational, insight-driven experiences for business users.
Collected experience requirement
6 to 10 years