Experienced Associate Data Engineer – Data Pipeline Development and Management
At arenaflex, we're revolutionizing the way businesses operate by harnessing the power of data-driven insights. As a leading player in the private sector, we're committed to innovation and excellence in everything we do. Our team of experts is dedicated to delivering cutting-edge solutions that drive business growth and success. We're seeking an experienced Associate Data Engineer to join our Data Pipeline Development and Management team. As a key member of our team, you'll play a critical role in designing, developing, and maintaining our data pipelines, ensuring seamless data flow and high-quality insights for our business stakeholders.
Job Summary:
As an Associate Data Engineer at arenaflex, you'll be responsible for providing technical support for the design, development, and deployment of our data pipelines. You'll work closely with our cross-functional teams to identify business requirements, design and develop data pipelines, and ensure high-quality data delivery. Your expertise in data engineering, data science, and software development will enable you to drive innovation and excellence in our data pipeline development and management.
Key Responsibilities:
* Provide technical support for the design, development, and deployment of data pipelines, including data ingestion, processing, and delivery
- Collaborate with business stakeholders to identify requirements and design data pipelines that meet their needs
- Develop and maintain data pipelines using a range of technologies, including UIs, SQL, PL/SQL, Python, and Shell
- Work with our production support team to ensure high-quality data delivery and resolve any issues that arise
- Test and investigate data pipelines using test and live client data, using Jenkins, Python, and Java to automate these tests
- Analyze logs to identify issues and determine next steps
- Use dashboards for Kubernetes/OpenShift to analyze high-level issues and ensure services are stable
- Support execution following go-live and work with the execution team to change support
- Work with data suppliers to explain requirements and eliminate barriers
- Drive automation into routine activities
- Perform other work duties as directed by Representative's Chiefs
Information, Abilities, and Competencies:
* Knowledge of the practical application of design science and technology, including applying principles, methods, methodology, and equipment to the design and creation of different labor and products
- Knowledge of design methods, tools, and standards involved in the creation of accurate technical plans, outlines, drawings, and models
- Ability to use reasoning and thinking to identify the strengths and weaknesses of alternative solutions, ends, or approaches to problems
- Ability to see new information for both current and future critical thinking and direction
- Talented in recognizing complex issues and exploring related data to create and assess choices and implement solutions
- Ability to tell when something is wrong or is likely to go wrong. It doesn't include solving the problem, just perceiving there is a problem
- Ability to join pieces of information to form general principles or conclusions (includes finding a relationship between apparently insignificant events)
- Ability to move back and forth between at least two activities or sources of information (like speech, sounds, contact, or other sources)
- Ability to organize things or activities in a specific order or sequence according to a particular rule or set of rules (e.g., patterns of numbers, letters, words, pictures, numerical tasks)
- Ability to identify or recognize a known pattern (a figure, object, word, or sound) that is hidden in other distracting material
What We Offer:
* Competitive salary of $25/hour
- Opportunity to work with a leading company in the private sector
- Collaborative and dynamic work environment
- Professional development and growth opportunities
- Comprehensive benefits package, including health insurance, retirement plan, and paid time off
- Flexible work arrangements, including remote work options
- Access to cutting-edge technology and tools
- Collaborative and supportive team environment
How to Apply:
If you're a motivated and experienced data engineer looking for a new challenge, we encourage you to apply for this exciting opportunity. Please submit your resume and a cover letter outlining your experience and qualifications for the role. We can't wait to hear from you! Apply To This Job Apply for this job