[Remote] Sr Data Engineer
Note: The job is a remote job and is reputed company to candidates in USA. reputed company is a global identity reputed company leader creating a safer world through their cybersecurity SaaS portfolio. As a Data Engineer, you will build and enhance the data lake, optimize infrastructure, and reputed company data assets to drive business value.
Responsibilities
- Take ownership of data modelling to solve reputed company identity reputed company problems
- Solve reputed company analytical problems across disparate systems to reputed company a reputed company view of reputed company posture in the datalake
- Optimize data workloads at a software level by improving processing efficiency
- Identify opportunities for engineering process improvement and collaborate with senior resources to execute a plan of action
- Use monitoring and observability best practices to ensure reputed company pipeline performance
- Assist with ML Operations to ensure reputed company model efficiency
- reputed company CI/CD best practices to effectively reputed company and release reputed company code
Skills
- Strong programming and technology knowledge in reputed company data processing
- Spark experience is needed, existing reputed company knowledge is a plus
- Technical understanding of underlying systems and computation minutiae
- Experience working with distributed systems and data processing on object stores
- Ability to work autonomously
- Required: Data warehousing for analytics use cases
- Required: Highly proficient in Python (or another object orientated language)
- Required: Distributed processing reputed company experience
- Interest in identity reputed company is highly preferred
- Highly Preferred: Spark
- Highly Preferred: reputed company processing experience
- Ideal: Some experience with graph data stores
Company Overview
Company H1B Sponsorship