Databricks Solutions Architect

540 is seeking a Databricks Solutions Architect to serve as an embedded technical leader for customer engagements as part of the Databricks Partner Program (DPP). In this role, you will provide deep architectural expertise and hands-on leadership for complex Databricks implementations, operating as a long-term extension of the Databricks Professional Services team.

You will act as the primary technical authority on Databricks for assigned customer engagements, guiding architecture, delivery, and best practices while working side by side with customer teams, Databricks PS, and partner consultants. This role is ideal for a senior data platform expert who thrives in complex environments, enjoys mentoring delivery teams, and drives large-scale data platform success.

Location: Remote within the continental United States. Core collaboration hours align with Eastern Time, with flexibility. Occasional travel Citizenship & Clearance Requirement: per client requirements, must be a U.S. Citizen with the ability to obtain a DoD Secret clearance Education Requirement: Bachelor’s Degree in Computer Science or related engineering field (preferred) 540 Internal Thrive Level: Senior Data Engineer

WHY 540?

540 is a forward-thinking company that the government turns to in order to #getshitdone. We don’t just talk about innovation – we deliver it. We break down barriers, build impactful technology, and solve mission-critical problems.

HOW YOU’LL DRIVE IMPACT

• Serve as the embedded technical lead for Databricks customer engagements
• Own Databricks platform architecture, design decisions, and technical standards
• Lead delivery of complex data pipelines and analytics workloads on Databricks
• Provide deep expertise in Apache Spark internals, optimization, and scalability
• Guide customers on Databricks best practices across ingestion, transformation, and analytics
• Partner closely with Databricks Professional Services leadership on delivery strategy
• Mentor and oversee partner and customer delivery teams
• Ensure solutions meet Databricks PS governance, security, and quality standards
• Drive adoption, platform maturity, and long-term customer success

REQUIRED SKILLS & EXPERIENCE

• 10+ years of experience in consulting or related client facing roles
• 7+ years of experience in data engineering or related technical roles
• Databricks Data Engineering Professional certification
• 6+ Databricks projects delivered with hands-on architectural leadership
• Deep expertise in Apache Spark, including runtime internals and optimization
• Strong experience designing large-scale, distributed data platforms
• Advanced SQL and Python expertise (Scala strongly preferred)
• Deep working knowledge of at least one major cloud platform (AWS, Azure, or GCP)
• Experience operating in regulated or enterprise-scale environments

NICE TO HAVE

• Experience serving as a Solutions Architect or long-term embedded consultant
• Expertise across multiple cloud platforms (AWS, Azure, GCP)
• Familiarity with CI/CD, infrastructure-as-code, and production deployment patterns
• Working knowledge of MLOps and advanced analytics workloads
• Experience with Unity Catalog, data governance, and security architectures
• Prior experience enabling or mentoring consulting teams at scale
• Exposure to Databricks enablement programs, Partner Academy, or Train-the-Trainer models

BENEFITS & PERKS

• Flexible PTO + all Federal holidays off
• Health, dental and vision insurance plans
• Flexible Spending Account (FSA)
• 401k with employer match
• Company-sponsored life insurance, short- and long-term disability
• Professional development (training, certifications, conferences)
• Paid cloud developer accounts
• Referral bonuses
• HQ office perks (parking / metro reimbursement, nitro coffee & lunches)
• Annual social events (540 Week, hackathon, charity golf tournament, etc.)
• Access to 540’s Washington Capitals & Nationals tickets

EQUAL EMPLOYMENT OPPORTUNITY (EEO)

540's policy is to provide equal employment opportunity to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws.

This policy applies to all terms and conditions of employment, including recruiting, hiring, placement, promotion, termination, layoff, recall, transfer, leaves of absence, compensation and training.