Databricks Workspace Enablement Lead

Droisys is an innovation technology company focused on helping companies accelerate their digital initiatives from strategy and planning through execution. We leverage deep technical expertise, Agile methodologies, and data-driven intelligence to modernize systems of engagement and simplify human/tech interaction.

Amazing things happen when we work in environments where everyone feels a true sense of belonging and when candidates have the requisite skills and opportunities to succeed. At Droisys, we invest in our talent and support career growth, and we are always on the lookout for amazing talent who can contribute to our growth by delivering top results for our clients. Join us to challenge yourself and accomplish work that matters.

Databricks Workspace Enablement Lead

12+ Months

Hartford, CT (4 days in a week)

Engagement type Statement of Work SOW short duration defined outcomes with potential to transition to ongoing execution support

CONTEXT CURRENT STATE

Bains Polaris 20 program is a firmwide data platform transformation built on Databricks with a medallion architecture Bronze Silver Gold and Unity Catalog governance The platform is in active execution multiple data domains are progressing through Silver ingestion with Gold layer certification underway for priority business products including the Commercial Dashboard Revenue Reporting and GROM

While the platform infrastructure is established and delivery is accelerating we do not yet have consistent repeatable operational processes in place to support the growing footprint The program needs an experienced Databricks practitioner to bring structure and standards to how the workspace is managed and monitored creating the operational backbone that the team and downstream business users will rely on

Currently we have one custom application in production pulling from Databricks with several data owners accessing the gold layer to certify data We have already seen early requests to get into the platform and the transparency and enablement doesnt seem to be sustainable Our business goal by end of the year is to have all functional teams on the workspace and support requests by report writers and data consumers to leverage our certified enterprise data We need a clean foundation that is scalable and low overhead to manage

SCOPE OF WORK

The Workspace Enablement Lead will design and implement the operational standards and tooling required to run Polaris 20 at scale Core deliverables include

Workspace governance setup Workspace governance setup

Define and enforce naming conventions folder structures and access control patterns within Unity Catalog

Set up and standardize cluster policies compute configurations and cost allocation tagging

Provide best practices around data request access processes data consumer data owner

Data quality standards Data quality standards

Implement automated quality checks integrated into the ingestion pipeline

Establish escalation and remediation workflows when quality checks fail

Monitoring observability dashboards Monitoring observability dashboards

Build operational dashboards covering pipeline health SLA performance compute costs and data freshness

Set up proactive ing for platform engineering and data ownership teams

Define KPIs and SLAs for platform operations eg ETL run time uptime targets

Handoff knowledge transfer Handoff knowledge transfer

Produce comprehensive documentation for all standards templates and configurations

Conduct structured handoff to the internal team andor incoming maintenance resource

IDEAL PROFILE

7 years handson Databricks platform oversight experience Unity Catalog Delta Lake DLT SQL Warehouses

Demonstrated experience building operational standards and governance frameworks not delivering pipelines

Experience with monitoring and observability in data platforms ing dashboards SLA management

Excellent documentation and communication skills this role produces artifacts others will use long after the engagement ends

Prior professional services or management consulting environment experience is a plus

Mandatory Skills : Databricks

Droisys is an equal opportunity employer. We do not discriminate based on race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law. Droisys believes in diversity, inclusion, and belonging, and we are committed to fostering a diverse work environment.