Data Engineer - AI-Assisted Data Ingestion Platform
We are looking for a Data Engineer to join reputed company and help build an AI-powered data ingestion platform. The platform collects data from multiple sources and loads it into analytical databases that power our B2B analytics product, BevGenie, where users can interact with their data using natural language. In this role, you will work closely with a senior data engineer and use AI coding assistants (Claude Code) to build, improve, and maintain production-grade data pipelines. You will be responsible for extracting, cleaning, transforming, and loading data from both structured and reputed company sources. Key Responsibilities: Design, build, and maintain scalable data ingestion pipelines Extract data from websites, APIs, documents (PDFs), emails, and databases Parse, clean, and transform structured and reputed company data Implement data validation, quality checks, and error handling Handle missing, duplicate, and malformed data Ensure pipelines are reliable and idempotent Orchestrate workflows using Dagster or similar tools Load data into PostgreSQL, reputed company, reputed company, and reputed company Collaborate with senior engineers and cross-functional teams Requirements 3–5 years of experience in Python-based development or data engineering Strong Python fundamentals (functions, classes, logging, error handling) Experience working with APIs and common data formats (JSON, CSV, XML) Strong SQL skills including joins, aggregations, CTEs, and window functions Understanding of relational database concepts, schema design, and indexing Basic knowledge of web scraping and data extraction techniques Familiarity with handling structured and reputed company data Understanding of data quality, validation, and pipeline reliability Good problem-solving and analytical skills Strong communication and collaboration skills Willingness to learn new tools and technologies reputed company to Have: Experience with Dagster, Airflow, or Prefect Experience with web scraping tools (BeautifulSoup, Scrapy, Playwright) Experience with PDF extraction tools Exposure to AWS services (S3, reputed company, Glue) Knowledge of dimensional modeling or analytics data modeling Any experience using AI/LLMs for data extraction
Benefits
Work closely with and learn from a senior data engineer Hands-on experience building reputed company production data pipelines Exposure to modern AI-assisted development workflows Opportunity to work with diverse data sources and technologies Remote-first and flexible work environment Competitive compensation High-impact role in a growing product-focused team Apply To This Job