Senior Data Engineer Reporting
This is Adyen
Adyen provides payments, data, and financial products in a single solution for customers like Meta, Uber, H&M, and Microsoft - making us the financial technology platform of choice. At Adyen, everything we do is engineered for ambition.
For our teams, we create an environment with opportunities for our people to succeed, backed by the culture and support to ensure they are enabled to truly own their careers. We are motivated individuals who tackle unique technical challenges at scale and solve them as a team. Together, we deliver innovative and ethical solutions that help businesses achieve their ambitions faster.
Senior Data Engineer - Reporting
We are looking for a Senior Data Engineer to join the Payment Engine Data team in Bengaluru, our newest Adyen office. The main goal of the Payment Engine Data (PED) team is to provide insightful data and solutions for processing payments using all of Adyen's payment options. These consist of various data pipelines between various systems, dashboards offering insights into payment processing, internal and external reporting, additional data products, and infrastructure. The ideal candidate is able to understand the business context and relate it to the underlying data requirements. You should also excel at building top-notch data pipelines on our big data platform. You'll also work in creating and maintaining robust reporting solutions that provide concise, reliable, and trustworthy intelligence to our customers.
What youâll do
- Collaborative Solution Development- Engage with a diverse range of stakeholders, including analysts, software engineers, product managers, and customers, to understand their requirements and craft effective solutions.
- State-of-the-Art Pipelines and Architecture- Design, develop, deploy and operate high-quality production ELT pipelines and data architectures. Integrate data from various sources and formats, ensuring compatibility, consistency, and reliability. Design scalable architectures.
- Champion Data Best Practices- Proactively establish and advocate for best practices in performance, code quality, data validation, data governance, and discoverability across Adyen through mentoring, training, and knowledge sharing.
- High Quality Data and Code- Ensure data is accurate, complete, reliable, relevant, and timely. Implement rigorous testing, monitoring and validation protocols for your code and data, leveraging tools such as Pytest.
- Performance Optimization- Identify and resolve performance bottlenecks in data pipelines and systems. Optimize query performance and resource utilization to meet SLAs and performance requirements, using technologies such as caching, indexing, partitioning, and other Spark optimizations.
Who you are
- Experienced in Big Data: You have solid experience in the data domain working towards building robust and scalable data environments.
- Data & Engineering practices: You possess a high-level understanding of both Software and Data Engineering practices.
- Technical Super Star: Highly proficient in tools and languages such as: Python, PySpark, Airflow, Hadoop, Spark, Kafka, SQL, K8âs,