Overview The candidate must have more than 7+ years of experience in IT. This role is for a Snowflake Data Engineer with strong experience in design/data modeling/development and performance tuning. The candidate will be working on building cloud-based data warehouse solutions for F2B clients. What You Will Be Responsible For Design, build and test end-to-end data pipelines including data ingestion (streaming, events, and batch), data integration, and data curation. Design, develop, and deploy scalable data pipelines and ETL processes on cloud-based infrastructure using Azure, Snowflake, DBT, Airflow, Cosmos DB. Define and implement automation of jobs and testing. Optimize the data pipeline to support workloads and use cases. Support mission-critical applications and near real-time data needs from the data platform. Address data issues, environment issues, perform impact analysis, root cause analysis, and corrective/adaptive/perfective maintenance. Implement data models, transformations, and schema designs to support analytical and reporting needs. Optimize and tune Snowflake performance, including query optimization, resource management, and scaling strategies. What We Value Experience in microservices architecture and understanding of cloud computing. Experience with MicroServices - API/Event Driven Architecture/Development. Hands-on troubleshooting experience with DevOps pipelines and Azure services. Experience with DBT (Data Build Tool) for data modeling and transformation and Apache Airflow for workflow orchestration and scheduling. Experience with Snowflake utilities (SnowSQL, Snowpipe, Snowflake) for handling streaming data is a plus. Expertise in Snowflake advanced concepts such as resource monitors, RBAC controls, virtual warehouse sizing, query performance tuning, zero-copy cloning, time travel, and related features. Experience in reclustering Snowflake data with understanding of micro-partitioning. Experience deploying Snowflake features such as data sharing, events, and lake-house patterns. Experience handling semi-structured data (JSON, XML) in Snowflake. Education & Preferred Qualifications Bachelor’s Degree in computer science or IT-related subject. 7+ years of experience in professional database and data warehouse development. 7+ years of development experience writing SQL queries/stored procedures for relational databases (e.g., Oracle, SQL Server). 5+ years of experience on Snowflake development including Snowpipes, Snowflake Tasks, Streams, UDFs and procedures. 5+ years of experience in cloud-based development including Azure Services, Azure DevOps, Kubernetes, Docker. Additional Requirements Experience with Databricks or Scala is a plus. Exposure to working in financial services; front- or middle-office, or fund management business areas is ideal. Experience dealing with users or clients from technical or business areas. Ability to communicate effectively in written and oral form. Team player with a positive attitude, initiative, and self-motivation. Ability to multi-task, meet timelines, and maintain strong work ethics. Experience of working in the financial industry. Experience with agile development methodology. #J-18808-Ljbffr
Senior Snowflake Data Engineer, Avp
STATE STREET
toronto, toronto
Published 27 days ago
Report job