Databricks Data Engineer
Job Title: Databricks Data Engineer
Location: Remote
Experience: 6+ Years Notice Period: Immediate Joiners PreferredAbout the Role
We are looking for a skilled Databricks Data Engineerto design, develop, and optimize scalable data solutions using Databricks SQL. The ideal candidate should have strong expertise in SQL, performance tuning, and cloud-based data platforms such as AWS, Azure, or GCP.
Key Responsibilities
- Develop, maintain, and optimize SQL queries and notebooks in Databricks for data transformation, aggregation, and analytics.
- Optimize Databricks SQL workloads for performance, scalability, and cost efficiency.
- Monitor, debug, and troubleshoot SQL queries, dashboards, and workflows.
- Work with large-scale datasets in distributed computing environments.
- Collaborate with data engineers, analysts, and stakeholders to deliver data-driven solutions.
- Implement best practices for query performance tuning, caching, and indexing strategies.
- Build and maintain data pipelines using Databricks Workflows and Delta Live Tables.
Required Qualifications
- 6years of hands-on experience in SQL development and query optimization.
- Strong expertise in Databricks SQL, Delta Lake, and Lakehouse architecture.
- Experience with cloud platforms such as AWS, Azure, or GCP (preferably Azure Databricks or AWS Databricks).
- Good understanding of performance tuning, caching strategies, and query optimization techniques.
- Familiarity with ETL/ELT frameworks, Data Warehousing, and BI tools.
- Hands-on experience with:
- Databricks Notebooks
- Databricks Workflows
- Delta Live Tables
- Ability to handle large datasets and distributed systems.
- Strong analytical, problem-solving, and communication skills.
Preferred Qualifications
- Experience using SQL for advanced data processing and analytics.
- Knowledge of Medallion Architecture (Bronze, Silver, Gold layers).
- Exposure to data visualization tools like Power BI, Tableau, or similar.