Data Engineer
NIQ is a publicly traded company, the world’s leading consumer intelligence company, delivering the most complete understanding of consumer buying behavior and revealing new pathways to growth. In 2023, NIQ combined with GfK, bringing together the two industry leaders with unparalleled global reach. With a holistic retail read and the most comprehensive consumer insights, delivered with advanced analytics through state-of-the-art platforms. NIQ delivers the Full View (TM). We're looking for an experienced Data Engineer to join our growing Machine Learning team. You'll build and maintain the data infrastructure that powers our ML workflows, from raw data ingestion to model deployment. ResponsibilitiesDesign and build data pipelines/flows for ML use casesImplement data versioning practicesDeploy and manage flows in orchestration toolsImprove and maintain CI/CD pipelinesManage Python dependencies (Poetry, uv)Deploy data scientists' scripts and models from notebooks to productionImplement data quality checks to ensure pipeline reliabilityOptimize data processing jobs for performance and cost, particularly on distributed systems and cloud data services Qualifications3–5 years of experience as a Data EngineerStrong proficiency in PythonExperience with distributed systems for big data processing (Dask, Spark)Experience building ETL pipelinesExperience building reliable, maintainable data pipelinesHands-on experience with GCP core data services (Cloud Storage, BigQuery, Cloud Build, GKE)Experience with orchestration tools (Airflow, Dagster, or similar)Comfortable working in a Linux environment with Jupyter, Python, Git, Docker, SQL, and NoSQLStrong experience with Pandas, SQL, and writing DockerfilesProfessional-level EnglishNice to haveExperience with ML datasetsExperience building data pipelines for AI modelsExperience with LangGraph and RAG systems Our BenefitsFlexible working environmentVolunteer time offLinkedIn LearningEmployee-Assistance-Program (EAP)NIQ may utilize artificial intelligence (AI) tools at various stages of the recruitment process, including résumé screening, candidate assessments, interview scheduling, job matching, communication support, and certain administrative tasks that help streamline workflows. These tools are intended to improve efficiency and support fair and consistent evaluation based on job-related criteria. All use of AI is governed by NIQ’s principles of fairness, transparency, human oversight, and inclusion. Final hiring decisions are made exclusively by humans. NIQ regularly reviews its AI tools to help mitigate bias and ensure compliance with applicable laws and regulations. If you have questions, require accommodations, or wish to request human review were permitted by law, please contact your local HR representative. For more information, please visit NIQ’s AI Safety Policies and Guiding Principles: https://nielseniq.com/global/en/info/niqs-ai-safety-policies/ About NIQNIQ is the world’s leading consumer ...