Analytics:Platform Insights Group
Vision
The Platform Insights group is part of the Analytics section. We are focused on enabling GitLab customers to self-service their analytics by building a comprehensive dashboards-as-a-service framework, powered by AI and backed by scalable data infrastructure.
Our FY27 direction and roadmap is the single source of truth for what we are building and why.
Key initiatives
These are the key initiatives that the team own or are major contributors to:
- Dashboard Foundations
- Data Analyst Agent
- GitLab Query Language (GLQL)
- Data Insights Platform (DIP)
- Siphon data replication
The diagram below illustrates the typical flow of data through the analytics platform stack at a very high-level, from source to customer.
graph TD
subgraph Sources
PG[(PostgreSQL)]
end
subgraph Data platform
S[Siphon]
CH[(ClickHouse)]
DIP[Data Insights Platform]
end
subgraph GitLab application
RAILS[🦊 GitLab Rails Monolith]
GLQL[GitLab Query Language]
end
subgraph Customer experiences
DAA[Data Analyst Agent]
DF[Dashboard Foundations]
USER([👤 Customer])
end
PG --> S
S --> CH
CH --> DIP
DIP -->|Query API| RAILS
RAILS -->|GraphQL| GLQL
GLQL -->|GLQL| DAA
GLQL -->|GLQL| DF
DAA -->|Natural language query| USER
DF -->|Custom dashboard| USER
In addition to the analytics platform, the group includes the search team and is responsible for classic search features.
The team
| Name | Role |
|---|---|
Arun Sori
|
Senior Backend Engineer, Monitor:Platform Insights |
Daniele Rossetti
|
Senior Frontend Engineer, Analytics:Platform Insights |
Jiaan Louw
|
Senior Frontend Engineer, Monitor:Platform Insights |
John Mason
|
Senior Backend Engineer, Global Search |
Ravi Kumar
|
Backend Engineer, Global Search |
Robert Hunt
|
Staff Frontend Engineer, Analytics:Platform Insights |
Siddharth Dungarwal
|
Backend Engineer, Global Search |
Vineeth Ravi
|
Senior Backend Engineer |
Sreeram Narayanan
|
Senior Backend Engineer |
Stable counterparts
| Name | Role |
|---|---|
Principal Engineer
|
Principal Engineer, Monitor |
Ankit Bhatnagar
|
Staff Backend Engineer, Monitor:Platform Insights |
Diego Adams
|
Senior Product Designer |
Our values and principles
- We work in accordance with GitLab values.
- We collaborate closely both within our team and within the Analytics section.
- We take ownership of our products and roadmap.
- We have a strong bias for action.
- We make data-driven decisions.
Communication
Slack channels where we communicate transparently and can be reached:
- Primary: #g_monitor_platform_insights
- Standup: #g_monitor_platform_insights_standup
- Internal: #g_monitor_platform_insights_internal
Meetings
- Weekly team sync: Focused on organizing ongoing work or specific efforts such as rollouts or larger initiatives and to share important updates.
- Dev syncs: Engineer-organized meetings where ICs can discuss technical issues or coordinate technical work without requiring the EM or PM.
- 1:1 coffee chats: Each team member should schedule a coffee chat with every other team member in the team and within the wider Analytics section every couple of weeks. Work or non-work topics are both welcome. If timezones are a barrier, an async Slack thread works too. The goal is 1:1 connection.
How we work
We base our workflow on the company’s Product Development Flow. Any modifications or clarifications on how we apply the workflow are detailed below.
Milestone planning
We work in GitLab milestones aligned to the monthly release cadence. The FY27 roadmap wiki is the source of truth for planned priorities. Before the start of each milestone, the team refines and scopes issues to fit available capacity.
Async standups
Team members submit their weekly standups each Friday using Geekbot. We use these async standups to communicate what we have accomplished, any current blockers and what we plan to work on next.
Retrospectives
We run two types of retrospectives:
1. Milestone retrospective (automated)
Runs automatically after every milestone closes. Gives the team a structured moment to reflect on the milestone as a whole: what went well, what was painful, and what we want to do differently next time.
2. Feature or incident retrospective (as-needed)
Organized by the team after a major feature shipped or a significant incident occurs. For feature launches, this is a chance to take stock of what we accomplished and surface any follow-up tech debt or quality fixes we need to schedule. For incidents, the focus is on what went wrong without assigning blame, how we can prevent recurrence, and any remediations or monitoring improvements to action.
ClickHouse Datastore
Analytics features have big data and insert heavy requirements which are not a good fit for Postgres or Redis. ClickHouse was selected as a good fit to meet these features requirements. ClickHouse is an open-source column-oriented database management system. It is attractive for these use cases because it can efficiently filter, aggregate, and sum across large numbers of rows. ClickHouse is not intended to replace Postgres or Redis in GitLab’s stack.
We initially managed our own self-hosted Clickhouse instance, but decided to migrate to Clickhouse Cloud to enable the team to move quicker by offloading maintenance and scalability to Clickhouse.
Learn more: Clickhouse Datastore Working Group
25e2b90c)
Arun Sori
Daniele Rossetti
Jiaan Louw
John Mason
Ravi Kumar
Robert Hunt
Siddharth Dungarwal
Sreeram Narayanan
Principal Engineer
Ankit Bhatnagar
Diego Adams