[Remote] Databricks Data Engineer - Senior - Consulting - Miami
Note: The job is a remote job and is open to candidates in USA. EY is a global leader in assurance, consulting, tax, strategy, and transactions, dedicated to building a better working world. They are seeking a highly skilled Senior Consultant Data Engineer with expertise in cloud data engineering, specifically Databricks, to design and build analytics solutions that deliver significant business value while collaborating with various stakeholders.
Responsibilities
- Designing, building, and operating scalable on-premises or cloud data architecture
- Analyzing business requirements and translating them into technical specifications
- Optimizing data flows for target data platform designs
- Design, develop, and implement data engineering solutions using Databricks on cloud platforms (e.g., AWS, Azure, GCP)
- Collaborate with clients to understand their data needs and provide tailored solutions that meet their business objectives
- Lead end-to-end data pipeline development, including data ingestion, transformation, and storage
- Ensure data quality, integrity, and security throughout the data lifecycle
- Provide technical guidance and mentorship to junior data engineers and team members
- Communicate effectively with stakeholders, including technical and non-technical audiences, to convey complex data concepts
- Manage client relationships and expectations, ensuring high levels of satisfaction and engagement
- Stay updated with the latest trends and technologies in data engineering and cloud computing
Skills
- A Bachelor's degree in Computer Science, Engineering, or a related field required (4-year degree). Master's degree preferred
- Typically, no less than 2 - 4 years relevant experience in data engineering, with a focus on cloud data solutions
- 5+ years of experience in data engineering, with a focus on cloud data solutions
- Expertise in Databricks and experience with Spark for big data processing
- Proven experience in at least two end-to-end data engineering implementations, including: Implementation of a data lake solution using Databricks, integrating various data sources, and enabling analytics for business intelligence. Development of a real-time data processing pipeline using Databricks and cloud services, delivering insights for operational decision-making
- Strong programming skills in languages such as Python, Scala, or SQL
- Experience with data modeling, ETL processes, and data warehousing concepts
- Excellent problem-solving skills and the ability to work independently and as part of a team
- Strong communication and interpersonal skills, with a focus on client management
- Ability to align data engineering solutions with business strategies and objectives
- Experience in managing multiple projects simultaneously, ensuring timely delivery and adherence to project scope
- Proficiency in engaging with various stakeholders, including executives, to understand their needs and present solutions effectively
- Skills in guiding clients through change processes related to data transformation and technology adoption
- Ability to identify potential risks in data projects and develop mitigation strategies
- Experience in leading technical discussions and making architectural decisions that impact project outcomes
- Proficiency in creating comprehensive documentation and reports to communicate project progress and outcomes to clients
- Experience with data quality management
- Familiarity with semantic layers in data architecture
- Familiarity with cloud platforms (AWS, Azure, GCP) and their data services
- Knowledge of data governance and compliance standards
- Experience with machine learning frameworks and tools
Benefits
- Medical and dental coverage
- Pension and 401(k) plans
- A wide range of paid time off options
- Team-led and leader-enabled hybrid model
- Flexible vacation policy
- Time off for designated EY Paid Holidays, Winter/Summer breaks, Personal/Family Care, and other leaves of absence when needed to support your physical, financial, and emotional well-being
Company Overview
Company H1B Sponsorship