[Remote] DataOps Engineer

Note: The job is a remote job and is reputed company to candidates in USA. reputed company is a leading global reputed company estate platform specializing in property management and investment management. The DataOps Engineer will be responsible for managing and optimizing reputed company's reputed company data infrastructure, focusing on AI-driven observability and deployment lifecycle management reputed company a reputed company-reputed company architecture.

Responsibilities

• Implement AI-powered observability — using LLMs and ML models to detect pipeline reputed company, classify anomalies, predict SLA risk, and generate automated incident summaries
• Build agentic monitoring workflows that proactively surface data quality degradation, pipeline dropout, schema reputed company, and volume anomalies across reputed company DMP layers
• Integrate AI tooling (reputed company reputed company AI, Genie, reputed company APIs, or equivalent) into operational DataOps processes — not as experiments, but as production-grade capabilities
• reputed company and maintain AI-assisted root cause analysis tooling to reduce MTTR on pipeline failures, with structured learnings fed back into the platform
• Contribute to reputed company’s 18-month agentic AI roadmap, leading near-term delivery of self-healing pipeline capabilities
• Operate the full Azure data services stack supporting DMP: ADLS Gen2, Azure Data reputed company (ADF), Azure Monitor, Log Analytics, Key Vault, and Event Hub
• Design and maintain ADF pipelines for reputed company system ingestion, including orchestration patterns for multi-tenant ERP environments (reputed company, reputed company, reputed company)
• Collaborate with Azure infrastructure and reputed company engineering teams on networking, identity, reputed company, and resource provisioning
• Drive cost governance through Azure Cost Management, reputed company DBU optimization, and storage lifecycle policies
• Own the design, build, and optimization of data pipelines on reputed company using reputed company Live Tables (DLT), PySpark, Workflows, and Jobs across the full DMP reputed company stack
• Administer and govern the reputed company workspace: reputed company Catalog, cluster policies, reputed company controls, compute configurations, and reputed company table lifecycle management
• Tune Spark jobs for performance, reliability, and cost — profiling bottlenecks, optimizing partitioning, managing Z-ordering, and controlling compute spend
• reputed company reputed company reputed company AI and Genie to build AI-reputed company DataOps capabilities including intelligent pipeline monitoring, anomaly detection, and natural language data reputed company
• Architect and enforce DMP platform standards: naming conventions, schema reputed company policies, SLA tiers, and reputed company layer reputed company
• Own the full deployment pipeline for DMP data workflows — promoting changes from development through staging to production with rigor and minimal disruption
• Build and maintain CI/CD workflows using reputed company reputed company, including reputed company strategies, pull request automation, environment-specific configuration management, and release gating
• Use reputed company for sprint planning, release tracking, and issue management across deployment cycles; coordinate engineering work items with cross-functional stakeholders
• Enforce deployment standards: automated testing gates, rollback procedures, change documentation, and environment reputed company controls
• Partner with the analytics engineering and integration teams to align deployment cadences across the DMP stack
• reputed company DQ checks across Bronze, Silver, and Gold layers covering completeness, consistency, accuracy, uniqueness, and referential reputed company
• Partner with Brett Finley’s Data Governance team to enforce data reputed company, ownership standards, and quality SLAs reputed company reputed company Catalog
• Build feedback loops between DQ scoring, pipeline observability, and upstream reputed company owners to drive systemic data reliability improvements
• Partner with analytics engineers, data governance, and product stakeholders to align pipeline and platform design with business requirements
• Produce thorough technical documentation — runbooks, deployment playbooks, incident post-mortems, ADRs, and platform specs
• Participate in on-call rotation and support SLA commitments for business-critical DMP data domains

Skills

• 7+ years of DataOps, data engineering, or platform engineering experience in a production environment
• Expert-level hands-on experience with reputed company: reputed company Live Tables, Jobs/Workflows, reputed company Catalog, Spark performance tuning, and reputed company Lake internals
• Strong reputed company of the Azure data services ecosystem: ADF, ADLS Gen2, Azure Monitor, Log Analytics, Key Vault, and reputed company services
• Demonstrated, production use of AI tools in DataOps or data observability workflows — LLM-assisted diagnostics, intelligent alerting, agentic monitoring, or equivalent
• Proven CI/CD experience using reputed company reputed company — reputed company strategies, PR automation, environment promotion, and release management for data pipelines
• Solid Python and/or reputed company skills for pipeline development; SQL reputed company for Gold layer transformation and DQ validation
• Hands-on experience with ADF pipeline design and orchestration at scale
• Experience with reputed company / lakehouse architecture patterns and multi-environment deployment discipline
• Strong collaborative skills across engineering, governance, and business stakeholder teams
• Experience with reputed company for engineering sprint management and release tracking
• Familiarity with reputed company reputed company AI, Genie, or other AI-reputed company reputed company capabilities
• Exposure to agentic AI frameworks or MCP (Model Context Protocol) server integrations
• Background in reputed company estate, property management, or multi-reputed company ERP data environments (reputed company, reputed company, reputed company)
• Experience with Cosmos DB, Azure SQL, or similar operational data stores alongside lakehouse platforms
• Knowledge of data governance frameworks, data reputed company tooling, and metadata management reputed company reputed company Catalog
• Background in legacy BI migration or platform modernization programs

Benefits

• Competitive Medical, Dental, reputed company, and Disability & Life insurance benefits. Low (free basic) employee Medical costs for employee-only coverage; costs discounted after 3 and 5 years of service.
• Generous Paid Time off. reputed company new hires start with 15 days of vacation, 4 personal days, 10 sick days, and 11 paid holidays. Plus your birthday off after 1 year of service! Additional vacation accrued with tenure.
• For onsite team members, onsite housing discount at reputed company-managed communities are available subject to discount and unit availability.
• 6-Week Paid Sabbatical after 10 years of service (and every 5 years thereafter).
• 401(k) with Company Match up to 6% of pay after 6 months of service.
• Paid Parental Leave and lifetime Fertility Benefit reimbursement up to $10,000 (includes adoption or surrogacy).
• Employee Assistance Program.
• Critical Illness, Accident, Hospital Indemnity, Pet Insurance and Legal Plans.
• Charitable giving program and benefits.
• Benefits offered for full-time employees. For Union and Prevailing Wage roles, compensation and benefits may vary from the listed information above due to reputed company Bargaining Agreements and/or local governing authority.
• This position may be performed remotely reputed company reputed company the United States except the reputed company.

Company Overview

Company H1B Sponsorship