We are seeking a Senior Databricks Engineer to join our Data Engineering team and support our enterprise data modernization initiatives. This role will work closely with Application Leads, Data Engineers, Architects, and business stakeholders to design, implement, optimize, and govern solutions on the Databricks Lakehouse Platform.
The ideal candidate will be a hands-on Databricks SME who can guide teams on implementation best practices, governance, security, performance optimization, cost management, and CI/CD enablement while supporting the migration of Oracle-based data warehouse workloads to Databricks.
location: Plano, Texas
job type: Contract
salary: $59.75 - 69.75 per hour
work hours: 8am to 5pm
education: Bachelors
responsibilities:
- Design and implement scalable data solutions using the Databricks Lakehouse Platform.
- Partner with Application Leads and Engineering teams to define implementation approaches and best practices.
- Optimize Databricks environments for performance, scalability, reliability, and cost efficiency.
- Implement and support Unity Catalog, data governance, lineage, and security controls.
- Design and manage data access controls.
- Implement Delta Sharing for secure internal and external data sharing.
- Support Oracle-to-Databricks modernization and migration initiatives.
- Establish and enhance CI/CD processes, deployment automation, and DevOps best practices.
- Design, build, and manage semantic data models and business layers to support Databricks SQL, AI/BI Dashboards, Genie, Power BI, and enterprise analytics.
- Develop standards, reusable patterns, and implementation guidance for application teams.
qualifications:
Required Skills Experience
5+ years of Data Engineering experience.
3+ years of hands-on Databricks implementation experience.
Strong knowledge of Databricks Lakehouse Platform, Delta Lake, Unity Catalog, and Delta Sharing.
Experience implementing RBAC, security, governance, and data lineage solutions.
Proven experience with Databricks performance tuning and cost optimization.
Experience implementing CI/CD pipelines using Git, Azure DevOps, GitHub, Jenkins, or similar tools.
Experience supporting cloud-based data platforms (Azure, AWS, or GCP).
Strong understanding of data warehousing concepts and modern data architectures.
Excellent communication and stakeholder collaboration skills.
Soft Skills
Strong problem-solving and analytical skills.
Ability to influence and guide technical teams through expertise and collaboration.
Passion for mentoring teams and promoting engineering best practices.
Self-motivated with a continuous improvement mindset.
Strong teamwork and communication skills.
Experience Level: 7+ Years Overall
Role Type: Individual Contributor / Technical SME
Focus Areas: Databricks Platform, Governance, Delta Sharing, CI/CD, Cost Optimization, Analytics Enablement, and Oracle Modernization.
Preferred Skills
Experience supporting Oracle to Databricks migration and modernization programs.
Familiarity with Informatica PowerCenter and/or Informatica IDMC environments.
Experience with Databricks Genie, AI/BI Dashboards, and Databricks SQL.
Experience integrating Databricks with Power BI.
Knowledge of Databricks Workflows, Auto Loader, Delta Live Tables (DLT), Lakeflow, and MLflow.
Experience with Infrastructure as Code tools such as Terraform.
Databricks certifications are a plus.
skills:
AWS,AI,cloud-based data platforms,CI/CD,Analytics,data architectures,data governance,Delta Lake,data lineage,data sharing,data warehouse,data warehousing concepts,Databricks,Databricks SQL,Databricks Platform,deployment automation,DevOps best practices,Git,GitHub,Informatica PowerCenter,Data Engineering,Infrastructure as Code tools,Jenkins,MLflow,Azure DevOps,Azure,Oracle,performance optimization,performance tuning,Power BI,RBAC,integrating,Terraform,analytical skills,communication,communication skills,Soft Skills,Passion,Ability to influence,Strong problem-solving,reliability,Self-motivated,collaboration,Strong teamwork,data access controls,enterprise analytics,continuous improvement mindset,cost management,cost optimization,BI Dashboards,data models,mentoring teams,governance,collaboration skills,security,scalability,security controls,semantic,implementation experience,cost efficiency,Workflows
Equal Opportunity Employer: Race, Color, Religion, Sex, Sexual Orientation, Gender Identity, National Origin, Age, Genetic Information, Disability, Protected Veteran Status, or any other legally protected group status.
At Randstad Digital, we welcome people of all abilities and want to ensure that our hiring and interview process meets the needs of all applicants. If you require a reasonable accommodation to make your application or interview experience a great one, please contact HRsupport@randstadusa.com.
Pay offered to a successful candidate will be based on several factors including the candidate's education, work experience, work location, specific job duties, certifications, etc. In addition, Randstad Digital offers a comprehensive benefits package, including: medical, prescription, dental, vision, AD&D, and life insurance offerings, short-term disability, and a 401K plan (all benefits are based on eligibility).
This posting is open for thirty (30) days.
