Databricks Platform Administrator

AGS / GDL · I · FULL TIME · Remote

Databricks Platform Administrator

Level: Senior / Intermediate
Location: TBD
Engagement: Contract
Rate: Desired Rate/Hour
Support Model: Participation in 24×7 on-call rotation

Position Overview

We are seeking experienced Databricks Platform Administrators at the Senior and Intermediate levels to design, implement, administer, maintain, and provide operational support for enterprise Databricks environments.

The role will be responsible for ensuring the availability, performance, security, governance, reliability, and cost efficiency of the Databricks platform.

The successful candidate will work closely with the Team Lead, Databricks Administrators, System Administrators, Data Engineers, Data Scientists, Architects, Data Modelers, Analysts, and application/integration teams.

Key Responsibilities

Databricks Platform Administration

Administer, configure, maintain, and optimize the Databricks platform supporting data analytics, machine learning, and data engineering workloads.

Create and configure Databricks workspaces and cloud resources.

Install, configure, maintain, and support Databricks clusters and workspaces.

Manage Databricks administration at the:

Account level

Workspace level

Unity Catalog level

SQL Warehouse level

Manage account identities, settings, subscriptions, and platform usage information.

Maintain platform currency in accordance with security, compliance, patching, and operational best practices.

Security & Governance

Implement and maintain access controls, privileges, and security policies.

Manage permissions and security across Databricks accounts, workspaces, Unity Catalog, and SQL Warehouses.

Administer Unity Catalog, including:

Catalogs and schemas

External storage

Storage configuration

Access permissions

Data governance controls

Administer integrations with Azure Active Directory / Microsoft Entra ID and Amazon AWS.

Support platform security and change-management processes.

Monitoring, Performance & Cost Optimization

Monitor Databricks clusters, workspaces, and platform services.

Monitor and optimize:

Cluster performance

Resource utilization

Platform capacity

Databricks/cloud costs

Identify performance bottlenecks and implement appropriate corrective actions.

Production & Operational Support

Provide production support for the Databricks platform.

Troubleshoot platform and service-related incidents.

Perform restores and recoveries when required.

Investigate incidents, determine root causes, and implement resolutions.

Provide technical support to:

Data Engineering teams

Data Science / Machine Learning teams

Application teams

Integration teams

Participate in the 24×7 production support/on-call rotation.

Data Engineering Collaboration

Collaborate with Data Engineering teams on:

Data ingestion

Data transformation

Data orchestration

Platform integration

Support scalable and reliable data-processing workloads running on Databricks.

Required Qualifications

Databricks

3+ years of hands-on production support and administration of the Databricks platform.
Strong experience with Databricks platform and workspace administration.
Experience administering Databricks clusters and production workloads.
Experience with platform monitoring, troubleshooting, performance optimization, and operational support.
Strong understanding of Databricks security and access management.
Experience with Unity Catalog administration and governance.

Education

Four-year college degree, preferably in:
Information Systems
Computer Science
Engineering
Related technical discipline

Preferred Qualifications

Cloud

2+ years of AWS and/or Azure PaaS experience.

Experience integrating Databricks with Azure and/or AWS cloud services.

Infrastructure Automation

2+ years of experience with Terraform or a comparable infrastructure automation framework.

Hadoop

2+ years of Hadoop administration experience, preferably:

Cloudera

Hortonworks

Apache Kafka

2+ years of Apache Kafka / streaming platform administration experience is desirable.

Ideal Candidate Profile

The ideal candidate is a hands-on Databricks Platform Administrator with substantial production support experience—not solely a Databricks Data Engineer or Developer.

Strong candidates should demonstrate experience with:

Databricks Administration • Workspace Administration • Cluster Administration • Unity Catalog • Security & Access Controls • AWS/Azure • Terraform • Monitoring & Performance • Cost Optimization • Production Support • Incident Management • Root Cause Analysis • Backup/Recovery • Data Engineering Support

Experience with Hadoop administration and Apache Kafka is an additional advantage.

Key Technologies

Apply now