Azure DevOps Engineer with D365 and F&O experience As a Data Engineer, you will be responsible for building and maintaining the systems and processes that allow for the extraction, transformation, and loading (ETL) of data from various sources into our Azure-based data ecosystem. Responsibilities Provide a detailed review and assessment of the enterprise data warehouse environment and proposed changes and implementation plan to improve scalability and performance. Design and develop SSIS ETL process using table partitioning with a focus on performance improvement of large tables. Perform data analysis and provide suggestions and feedback to the team to design and develop optimized SQL queries and stored procedures (SCD Type1, SCD Type2 using hash bytes) to improve performance. Design and implement an operational process to provide a high-level summary of SQL Server and database environment to assist in the upgrade and migration of SQL Server databases to newer versions. Requirements 3+ years of proven experience as a Data Engineer, with a focus on Microsoft Azure technologies. Experience with Azure Data Factory, Azure Synapse Analytics, Azure Stream Analytics, Azure Event Hubs, OneLake, and MS Fabric. Proficient in SQL and scripting languages (e.g., Python). Strong understanding of data modeling and database design principles. Experience with data warehousing concepts and methodologies. Familiarity with data integration and ETL tools. Excellent problem-solving and communication skills. #J-18808-Ljbffr
Senior Business Intelligence Consultant
YOUSH CONSULTING
toronto, toronto
Published 28 days ago
Report job