[Remote] Databricks / Azure Engineer
Note: The job is a remote job and is open to candidates in USA. IT Associates is looking for a skilled and self-driven Databricks/Azure Engineer to design, build, and support scalable data solutions in the Azure cloud. The role focuses on developing high-performance data pipelines using Azure Databricks and/or Azure Synapse, leveraging Spark and Python to deliver reliable, production-ready data platforms.
Responsibilities
- Design, develop, and maintain scalable cloud-based data pipelines using Azure Databricks and/or Azure Synapse
- Implement data processing solutions using Spark (PySpark and/or Scala) and Python
- Build and optimize data ingestion, transformation, and aggregation workflows in Azure environments
- Work with data lakes, Delta Lake, and distributed processing frameworks to support analytics and downstream use cases
- Write and optimize complex SQL queries for data validation, transformation, and reporting
- Participate in solution design discussions, technical reviews, and Agile ceremonies (stand-ups, sprint planning, retrospectives)
- Take ownership of assigned data engineering solutions and deliver end-to-end implementations with minimal oversight
- Troubleshoot, optimize, and support production workloads, ensuring performance, reliability, and scalability
Skills
- 5+ years of professional data engineering experience
- Hands-on experience with Azure Databricks and/or Azure Synapse Analytics
- Strong expertise in Apache Spark (PySpark and/or Scala) and Python for large-scale data processing
- Experience building and maintaining scalable data pipelines in cloud environments (Azure preferred)
- Solid understanding of data lakes, Delta Lake, and distributed data processing concepts
- Strong SQL skills and experience working with relational databases
- Ability to work independently, manage priorities, and deliver high-quality solutions with minimal guidance
- Experience supporting enterprise production data platforms
- Familiarity with data architecture best practices and performance tuning
- Strong problem-solving and troubleshooting abilities
Benefits
- Medical
- Dental
- Retirement
- Other benefits
Company Overview
- IT Associates provides businesses and organizations with IT, data, consulting, and communications services and equipment. It was founded in 1997, and is headquartered in Warrenville, Illinois, USA, with a workforce of 51-200 employees. Its website is https://www.itassociatesinc.com/.
Apply tot his job Apply To this Job