Candid8

Job Title: Databricks Architect

Location: Remote

Share your Updated resume [email protected] / 346 358 3386

Databricks Architect with 10–15 years of overall experience in IT services and at least 3 years of hands-on experience in building modern data solutions using Databricks. The ideal candidate should have excellent communication skills, a proven record of architecting scalable data platforms, and the ability to lead both technical teams and client engagements.

Guide the implementation of the Lakehouse, ELT/ETL pipelines, structured/unstructured data handling, performance optimization, and automation within the Databricks environment.

Promote best practices in data modeling, security, DevOps/CI-CD for Databricks, and cost-effective cloud utilization.

Utilize Azure Databricks to perform complex data transformation, aggregation, and machine learning tasks.

Assist with designing the architecture and workflow for an Enterprise Data Warehouse in Databricks that leverages a growing Citizen Development population who wish to build their own Data Marts.

Leverage Azure data services (Data Lake, SQL DB, Service Bus, Cosmos DB, OLTP) for ingestion, transformation, and pipeline orchestration

Implement and manage Change Data Capture (CDC) processes, including change tracking and change data feed, to support incremental updates

Plug into and extend a custom metadata-driven Databricks accelerator framework used to manage Lakehouse operations

Required Skills

Strong expertise in Databricks (Spark, Delta Lake, MLFlow, Workflows, Unity Catalog)

Experience with cloud platforms: Azure, AWS, or GCP

Expertise in Spark (PySpark/Scala), SQL, and data modeling concepts

Good understanding of data ingestion tools (ADF, Kafka, REST APIs, etc.)

Proven experience in architecting enterprise-scale data platforms

Familiarity with DevOps practices in Databricks (CI/CD, notebooks versioning, automation scripts)

Strong communication and presentation skills

Job Types: Full-time, Contract

Pay: $70.00 - $85.00 per hour

Experience:

• Data Pipeline: 6 years (Required)
• Spark: 6 years (Required)
• Databricks Architect: 10 years (Required)
• Apache: 6 years (Required)

License/Certification:

• Databricks Certified Data Engineer Professional (Required)

Work Location: Remote