Senior Software Engineer – Foundational Data Systems for AI
THE MISSION
AI today is limited not only by model design but by the inefficiency of the data that feeds it. At scale, each redundant byte, each poorly organized dataset, and each inefficient data path slows progress and compounds into enormous cost, latency, and energy waste.
Granica’s mission is to remove that inefficiency. We combine new research in information theory, probabilistic modeling, and distributed systems to design self-optimizing data infrastructure: systems that continuously improve how information is represented and used by AI.
This engineering team partners closely with the Granica Research group led by Prof. Andrea Montanari (Stanford), bridging advances in information theory and learning efficiency with large-scale distributed systems. Together, we share a conviction that the next leap in AI will come from breakthroughs in efficient systems, not just larger models.
WHAT YOU’LL BUILD
- Global Metadata Substrate. Architect the transactional and metadata substrate that supports time-travel, schema evolution, and atomic consistency across petabyte-scale tabular datasets.
- Adaptive Engines. Build systems that reorganize data autonomously, learning from access patterns and workloads to maintain peak efficiency without manual tuning.
- Intelligent Data Layouts. Optimize bit-level organization (encoding, compression, layout) to extract maximal signal per byte read.
- Autonomous Compute Pipelines. Develop distributed compute systems that scale predictively, adapt to dynamic load, and maintain reliability under failure.
- Research to Production. Implement new algorithms in compression, representation, and optimization emerging from ongoing research. Opportunities to publish and open-source are encouraged.
- Latency as Intelligence. Design for minimal time between question and insight, enabling models and humans to learn faster from data.
WHAT YOU BRING
- Depth in distributed systems: consensus, partitioning, replication, fault t...