Lead Data Engineer
Opportunity Overview: We are seeking a Lead Data Engineer to drive the design and delivery of our cloud-native healthcare data platform. You will lead the implementation of scalable data solutions built on AWS, Apache Iceberg, Lake Formation, Glue Catalog, Athena, dbt, and modern orchestration frameworks. This role combines deep hands-on engineering with technical leadership and collaboration across platform, analytics, and business teams. What you’ll do: Lead Data Engineering Initiatives Lead delivery of complex data engineering projects across multiple teams Drive technical execution from design through production deployment Establish scalable implementation patterns Build and Optimize Data Platforms Design and implement batch and near-real-time pipelines Build reusable ingestion, transformation, validation, and publishing frameworks Support modernization of legacy workloads Lakehouse Engineering Lead Apache Iceberg implementation and optimization Define standards for schema evolution, partitioning, compaction, and metadata management Ensure efficient storage and query performance Data Quality and Reliability Implement data quality frameworks Drive observability and monitoring practices Improve operational excellence and reliability Technical Leadership Review architecture and design proposals Conduct code reviews and engineering reviews Mentor engineers and establish best practices Required Qualifications: 8–12 years of Data Engineering experience. Experience leading enterprise-scale data initiatives Cloud Technologies AWS S3, Glue, Athena, Lake Formation IAM and security controls Modern Data Stack Apache Iceberg (preferred) Delta Lake / Hudi • dbt • Airflow or Step FunctionsProgramming Python SQL PySpark / Spark Interview Process*: Connect with Talent Acquisition Meet with the Hiring Manager Behavioral Interview(s) Case Study Interview with Senior Leadership *Subject to change About Cohere Health: Cohere Health’s clinical intelligence platform and agentic AI-powered solutions connect health plans’ strategic goals and providers’ needs, optimizing the speed, cost, and quality of care. With an enterprise approach that streamlines payer-provider decision-making across the care continuum–including policy, prior authorization, payment accuracy, and more–the company improves collaboration and reduces burden, resulting in up to 8x ROI and 94% provider satisfaction. With the acquisition of ZignaAI, we expanded our AI-native platform with a comprehensive Payment Integrity Suite that spans data mining, clinical and coding validation, authorization and claims reconciliation, and end-to-end payment integrity services across pre- and post-pay workflows. By connecting clinical and payment insights, our transparent, AI-powered solutions help health plans proactively improve payment accuracy, reduce waste and vendo...