Take the stage as a Senior Databricks Architect and drive the optimization of ETL pipelines on cloud platforms. Your strong experience in Databricks, Spark, SQL, and real-time data processing will be essential.This role is designed for leaders in data engineering who excel in building efficient ETL pipelines. Utilize your skills with Python and PySpark while integrating APIs and supporting real-time streaming solutions. Collaborate with cross-functional teams to manage projects and improve data workflows using Azure DevOps and Airflow.Key Responsibilities:• Build and manage ETL pipelines with Databricks• Develop data processing strategies using SQL and Python• Implement CI/CD processes via Azure DevOps• Utilize Airflow for effective workflow management• Support real-time data integration and streaming solutionsRequirements:• Extensive experience with Databricks and Spark• Strong capabilities in SQL and Python for ETL development• Experience with AWS or Azure platforms is essential• Familiarity with Delta Lake for data processing needed• Proven track record in leading data engineering initiativesDrive innovation in data processing and engineering with your deep expertise in cloud technologies.#J-18808-Ljbffr
Senior Databricks Architect Specializing In Cloud Data Solutions
ACUNOR
, , canada, , , canada
Published 27 days ago
Report job