Toronto, ON, CanadaContractWorkspaceOn-SiteStart Date APPLICATIONS FOR THIS POSITION ARE NOW CLOSEDJob TypeClientHealth Services ClusterHourly Wage73-85End Date Job DescriptionResponsibilities:Design, develop, test, implement, and troubleshoot:data pipelines using various tools such as Databricks, Azure Data Factory, AWS Gluecomplex data transformation proceduresdata models for data warehouses and lakehousesSkillsExperience and Skill Set RequirementsData engineering ExperienceProgramming & scripting: Python, SQL, Linux shell, PowerShell.Data manipulation/analysis using pandas and pyspark.Working with XLSX, CSV, JSON files, relational databases, cloud storage, structured and unstructured data40%Cloud experienceAWS and/or Azure services.Cloud data warehouse solutions such as AWS Redshift.Data lakehouse solutions such as Databricks (Delta Lake).Data processing orchestration/automation25%Data WarehouseETL tools (such as Azure Data Factory, AWS Glue) as well as cloud agnostic tools such as Informatica IDMC.Data modeling & architecture: relational and dimensional modeling.Data reporting/visualization.25%Other SkillsFull SDLC from requirements gathering, design, implementation, testing to deployment and production supportProject management (agile/scrum and waterfall)Change and Incident managementCommunication, presentation and negotiation skillsConsulting, problem-solving and decision-making skills5%Public SectorExperience working in OPS and/or public sector in general5%Supplier CommentsClosing Date/Time: , 12:00 p.m.Max submission: 1 (one)5 days onsiteAssignment Type: This position is listed as Onsite; the resource is expected to work 7.25 hours per calendar day between the standard working hours of 8:00-5:00 PM (excluding lunch breaks) every Monday to Friday inclusive at the identified OPS office location.MUST HAVES:Data engineering (pandas, pyspark)Data lakehouse solutions such as Databricks (Delta Lake).Working with XLSX, CSV, JSON files, relational databases, cloud storage, structured and unstructured dataExperience using AWS Services such as Glue, StepFunctions, Lambda, S3Extract/Transform/Load data using tools such as Informatica IDMCMUST HAVES#J-18808-Ljbffr
Dataops Cloud Data Engineer - Senior
THECODECRACKERS
toronto, toronto
Published 19 days ago
Report job