QualificationsStrong hands-on experience withDatabricks (PySpark, Delta Lake, notebooks)– core requirementProven ability to build and optimizeETL/ELT data pipelinesin a lakehouse environmentExperience withAzure Data Lake Storage (ADLS Gen2)for scalable data storageHands-on development usingAzure Data Factory (ADF)for orchestration and pipelinesExperience withAzure Functionsfor serverless data processingSolid understanding oflakehouse architecture (Databricks + ADLS integration)Strong proficiency inPython and SQLfor data transformation and pipeline logicExperience withdata modeling, partitioning, and performance optimizationFamiliarity withDatabricks Unity Catalog (data governance, access control)Experience integrating Databricks withSnowflake, APIs, or downstream BI systemsExposure toCI/CD pipelines(Azure DevOps, GitHub Actions) for data workflowsExperience withinfrastructure-as-code tools(Terraform or similar) is an assetFamiliarity withorchestration tools(Airflow, dbt, or ADF pipelines)Strong communication skills withclient-facing / consulting experienceDatabricks certifications preferred(strong indicator of hands-on expertise)#J-18808-Ljbffr
Databricks Engineer (Data Engineer)
MYTICAS CONSULTING
winnipeg, winnipeg
Published 28 days ago
Report job