Sundial Company Overview

Deep Comprehensible Insights from any Data

Sundial is a top VC-backed early-stage startup headquartered at San Francisco Bay Area, US with a second office in Bengaluru, India. Our founders are industry veterans Chandra Narayanan, previously Chief Data Scientist at Sequoia Capital, and Julie Zhuo, previously VP, Design and Research at Facebook, author of a bestselling management book.
We are a small team of top talent, high caliber Engineers, Data Scientists, Designers and PMs (currently 46 in India, 4 in US) and rapidly growing.
We are on a mission to help builders make meaningful use of data to fulfil their vision. Sundial automatically diagnoses a product's data to explain the "what" and the "why" to enable faster and better decision making.

Our Vision for Sundial

By now, you've probably visited our website and browsed around the profiles of our team members. If you haven't yet, please take a moment to do so. We'll wait 🙂
Now you would probably know that we are focused on data storytelling. The data space has over $100B in market opportunity ahead of it, and modern Business Intelligence tools are growing at over 15% year over year.
We've seen this evolution firsthand. Our co-founders Chandra Narayanan and Julie Zhuo cut their teeth scaling Facebook from a few million college students to billions of people.
To make the best decisions possible, companies are investing more and more into understanding their data. And yet, demand far outpaces supply for Data Scientists and Data Platform Engineers who can construct useful narratives out of the growing firehose of raw data, tables and charts. Currently most data-centric organizations have a large Data Platform and Data Science team that builds Big Data Platforms, Insights Data stores to bring data into dashboards and manually generates reports to communicate the product story broadly. But a large part of this process can be easily productised.
At Sundial, we're building a Sundial’s Insights Data Platform. This platform converts raw data in large Data Warehouses into a universe of deep product insights that product teams—including PMs, data scientists, executives and engineers—consume easily. This involves Highly Scalable, Robust Distributed Data Platform which can consistently, repeatably run complex Data Science and Transformation algorithms at Cloud Scale.

We envision a future where every organization becomes a data-informed organization through our work of:

Productising the diagnostic analysis of yesterday so teams can focus on the strategic bets for tomorrow.
Making data understanding easy and accessible to everyone, not just data scientists.
Surfacing opportunities of improvement in growth across segments

We believe better usage of data leads to better products, and better products lead to better experiences for people.

Why You’ll Love Working with Us

You like the ownership, camaraderie and chaos of a start-up environment

Work at start-ups is very dynamic. Things move quickly and change frequently. We must be scrappy and flexible. Everyone will wear lots of hats.
If you have future aspirations of being an entrepreneur or leader, you'll find few better learning grounds. You'll be given a ton of trust and responsibility. You'll see very transparently how we operate and make decisions. Your work will absolutely matter to the success of our company.
Start-ups haven't "made it" yet. We have to convince customers we are valuable enough to them. You'll learn by doing and seeing how to operate in such ambiguous environments.

You love to build complex engineering systems at the intersection of data science and big data problems in the booming data analytics space.

Engineers/Data scientists unlock the secrets of data using complex algorithms. We believe that how they are presented are as important as the quality of secrets themselves.
This poses novel and unique engineering challenges that require a creative and inquisitive mind for solving them. Some of the challenges are building a platform that enables many different ways to explore and explain the data.

You value learning and have a growth mindset

Sundial is founded on the idea that slope is far more important than intercept. We are a learning environment, and all of us have something to teach and learn from each other. We invest heavily in learning sessions, sharing insights, and reflecting on our growth.
We are also very well connected within the open-source frontend developer community (React, next.js etc) and lean heavily into that network to learn and make good decisions. Wondering what went into designing d3? Let's get on a call with Mike Bostock. ;)

You're interested in understanding how companies grow, and how data plays a role

Unlocking the secrets of data is our bread and butter. How do successful companies grow? How do different types of businesses create value for users in an economically scalable way?
If you find this area to be as fascinating as we do, that's awesome, because you're going to become an expert in this domain. :)

Sundial Insights Platform Overview

We are building a data insights platform that can process data at any scale to generate deep, comprehensible insights. This involves working with big data processing, fast OLAP systems, data science, and AI engines. The Sundial Insights Platform helps our clients derive actionable insights and drive effective decisions through data that powers their company’s goals.

At the core, we are building a warehouse-native SaaS data platform on AWS. The platform generates deep insights through Sundial’s ingestion, data lake stores, and insights layers. Together, these components perform large-scale data transformations and run data science models on vast data lakes. The result is an easy-to-use, exploratory insights platform designed for leading data-driven companies.

Sundial has 5 primary Layers

Data Ingestion and ETL Layer
- This layer is a low-code/no-code ETL layer built on Spark. This can pull and transform Petabytes of data from Cloud Datawarehouses / Datalakes to Generate Metrics, Entity and Event Tables
- This layer typically processes 100s of Terrabytes of data daily to generate structured Sundial Data Models.
Sundial Datalake Store - Events, Entity and Metric Stores
- These are Datalakes which house structured Metrics, Entity Tables and Events.
- Sundial’s Insights Algorithms and Visualisations run on top of this Datalake Store.
- This mulit-tenant store is designed to scale to 100s of TBs of storage.
Sundial’s Insights Layer
- Sundial’s complex Data Science Algorithms are executed in this layer.
- This highly performant data processing layer is designed to execute complex Data Science Models to generate Insights.
Sundial’s AI layer
- Framework to build Generative AI Agents / Tools.
- These are used to serve complex Generative AI use-cases involving multi-step / dynamic AI Agent use cases like Insights Report Generation, Data Modelling and Ad-Hoc Insights Exploration
Sundial’s Visualisation Layer
- Representing Insights are easily comprehensible and explorable for anyone.
- The Visualisation layer is rich and complex . With latest technologies powering a seamless experience.

The technologies which power the above systems are :

AWS Services like EKS, EMR Spark, S3, RDS, Athena and Opensearch
Our stack is built using frameworks in Go, Python, Pyspark, Pandas, Typescript, Terraform etc.
We use advanced Devops systems and practices for the best developer productivity.
We deal with Big Data Processing systems and OLAP systems which has to process Petabytes of data for some of the fastest growing companies.
Frontend is built using Typescript, React, Redux and GraphQL
Quality is something we care about a lot. We expect every module to maintain a very high bar through all best practices related to Code Quality and Test Driven Development.

Job Description

As a Software Engineer (Data Platform), you will be working on...

Sundial’s Big Data Ingestion and Processing System and Sundial’s Datalakehouse which stores the Metric, Entity and Event Stores.
You will work on Big Data technologies like Spark, Athena, Delta Lake, Cloud Data Warehouses etc.
Building out Sundial’s Petabyte Scale Data Processing systems, No-Code / Low-Code Transformation systems etc.
Building the Analytics-as-a-Platform engine that runs novel algorithms and frameworks through transforming clients data to Sundial Data Models.
Building out Sundial’s SaaS Data Platform in Public Cloud.
Work with customers and data scientists to understand the data gaps and expand the Analytics Model
Designing and building systems and features from scratch at rapid pace and high quality.

You will have...

Strong Software Engineering fundamentals, Computer Science fundamentals, coding and design capabilities.
2- 5 years experience building Data Platforms, Data Engineering and Distributed Systems / Products for Analytics and Data-Science products.
Familiarity with big data processing engines like Spark, Athena, and popular Cloud Datawarehouses and Datalakes.
Familiarity with building backend systems and services for SaaS products in the Cloud using Cloud services. We use EMR, EKS, RDS, Opensearch, etc.
Experience working with various languages like Python, Golang, Pyspark, SQL etc.
A Bachelor’s or Master’s in Computer Science or work experience in related field.
Have prior experience working in a fast pace start up environment.

Software Engineer - Data Platform