Job Opportunities API

Position Summary The Data & Integration Ops Engineer is an experienced data engineering professional responsible for the stable, secure, and efficient operation of Focus's data platforms and integration pipelines. This role bridges data engineering and operations - applying DataOps and DevOps best practices to own SLAs, monitor systems proactively, and resolve issues before they impact the business. You'll work closely with data engineers, analytics engineers, and platform teams to ensure data is delivered accurately and on time. The ideal candidate is a data engineering expert with a passion for operational excellence, a keen eye for detail, and the ability to troubleshoot complex systems in real-time. This is a hybrid role with 3 days/week onsite in St. Louis. Primary Responsibilities Data Pipeline Operations & Reliability: Oversee the end-to-end operation of data pipelines (ELT workflows) across development, UAT, and production environments. Monitor pipeline schedules (e.g., Airflow DAGs) and ensure on-time data delivery to meet or exceed defined SLAs for data availability and quality. Integration Pipeline Operations: Monitor and troubleshoot integration workflows across Azure Integration Services (Logic Apps, Event Hub, AKS-based transformation jobs) that move data between source systems (e.g., Salesforce FSC) and downstream targets. Diagnose failures in integration code and coordinate with Infrastructure/Cloud Engineering and Cyber teams when issues trace back to underlying Azure infrastructure. Incident Response & Recovery: Act as the primary point of contact for data platform incidents during business hours, diagnosing issues in real-time and coordinating rapid recovery efforts. Lead root cause analysis and implement preventive measures to minimize future disruptions. Operational Governance & Compliance: Serve as a steward of the data platform, managing production data access and governance. Administer Snowflake RBAC and access policies, and audit write-access permissions to production datasets and systems to ensure data integrity, security, and compliance with internal policies and industry regulations. Deployment Support & Release Management: Collaborate with data engineers and analytics engineers to facilitate deployments of new data models, transformations (e.g., dbt models), and pipeline code. Conduct code reviews and enforce deployment gates to ensure that only well-tested, high-quality code moves into production. Work with DevOps and platform teams to refine continuous integration/continuous deployment (CI/CD) processes for data pipelines, using GitHub Actions and GitHub-native deployment workflows. Troubleshooting & Performance Optimization: Identify and troubleshoot pipeline failures or data quality issues, including root cause diagnosis of failed dbt transformations or upstream data problems. Optimize pipeline performance (e.g., query tuning, resource scaling) across both data pipelines and integration workflows to improve throughput and reduce latency, ensuring robust performance of the data platform. Platform Monitoring & Improvement: Implement monitoring, logging, and alerting for data workflows and platforms, using these tools to proactively detect anomalies. Analyze performance metrics and incident patterns to drive continuous improvements, such as enhancing resiliency, refining SLAs, and updating processes to prevent recurring issues. Cross-Team Collaboration: Work closely with Data Engineering, Analytics, Infrastructure/Cloud Engineering, Cyber, and IT Ops teams to prioritize and address production data issues. Provide guidance and mentorship on operational best practices to other data team members, fostering a culture of reliability and quality. Required Skills Data Pipeline & Orchestration: Strong hands-on experience with data workflow management systems