Principal Data Engineer- Databricks & AI platform
Where you’ll work: Bangalore, KA, INEngineering at GoTo We’re trailblazers in remote work technology—building powerful, flexible solutions that empower everyone to live their best life, both at work and beyond. With us, you’ll have the opportunity to chart new paths and help redefine how the world works. For us, AI isn’t just a buzzword; it’s a tool we use to deliver real, practical value to our customers and teams. We focus on solving meaningful problems, not just adding features for the sake of using AI. Here, growth takes many forms: you can expand your skills, take on new challenges, lead initiatives, and explore creative ideas. Join a GoTo product team and play a key role in transforming the workplace for millions of users worldwide—your work will truly make a difference. About the RoleWe're looking for a Principal Data Engineer to own our Databricks data platform. You'll be the go-to expert on Unity Catalog, Delta Lake, and Spark, and you'll set the technical direction for how our teams build, govern, and scale data pipelines. This is a hands-on role: you'll write code, review designs, and fix hard problems.We're looking for a Principal Data Engineer who operates at architect level across our data platform and ML/AI infrastructure. You'll own the technical vision and multi-year roadmap for our Databricks Lakehouse, set the architectural standards that govern how Data Engineering teams build and ship, and be an active contributor to our ML and AI platform.You won't be maintaining someone else's architecture. You'll be designing the next version of it, and you'll have the scope to make it matter.Your Day to Day Own the architecture and roadmap for our Databricks platform: Unity Catalog, Delta Lake, cluster configuration, and workflow orchestration.Lead the architecture of our data platform, pipelines, and AI-ready datasets, so they're built to support GenAI and ML use cases, not just BI.Design and evolve our medallion (Bronze/Silver/Gold) lakehouse architecture so it scales with the business.Set standards for data quality, security, and access control across the platform, and make sure teams actually follow them.Tune Spark jobs and cluster configs for performance and cost. Find the waste, right-size the clusters, kill the idle spend.Build and maintain the core ETL frameworks and reusable components other teams build on top of.Lead migrations from legacy platforms onto Databricks, including data modeling and pipeline redesign.Embed infrastructure-as-code and CI/CD practices into how we build, deploy, and run pipelines and platform infrastructure, so deployments stay consistent and repeatable.Troubleshoot production issues, do root cause analysis, and put fixes in place that prevent repeat incidents.Mentor senior engineers and act as the technical escalation point across the Data teams.You'll set the standard for spec-driven development and agentic AI tooling, then driv...