Log obervability platform

Internal Softwares

We built a scalable, cloud-native log analytics platform for Zamuun that enables real-time log ingestion, dynamic querying across PPL, SQL, and DSL, and custom dashboards—all integrated with AWS services, MongoDB, OpenSearch, and Redis. It empowers teams to manage observability at scale with full control over their data workflows.

May 16, 2025

6 months

Log Analytics, MERN, Opensearch, AWS

Problem Statement

Hayanalysis needed a high-performance log analysis platform to ingest, search, and visualize application logs in real time. Existing solutions were expensive or inflexible. The challenge was to build a system that supported multiple query languages, scaled horizontally, and gave users the ability to create custom dashboards and alerts—all without vendor lock-in or reliance on external processing pipelines.

Problem Statement

Hayanalysis needed a high-performance log analysis platform to ingest, search, and visualize application logs in real time. Existing solutions were expensive or inflexible. The challenge was to build a system that supported multiple query languages, scaled horizontally, and gave users the ability to create custom dashboards and alerts—all without vendor lock-in or reliance on external processing pipelines.

Approach

We developed a full-stack MERN application with OpenSearch as the core query engine, Firebase authentication, and MongoDB for state management. Our architecture integrated Logstash, S3, and Redis for scalable log ingestion and caching. We implemented a Chevrotain-based parser for PPL, DSL, and SQL support, connected it to OpenSearch, and built dynamic dashboards using Apache ECharts, all hosted on AWS.

Solution Overview

Solution Overview

Hayanalysis Logs is a self-hosted, extensible log intelligence platform that supports custom queries, user-level dashboards, alerts, and reports. It features a modular execution engine, multi-format query parsing, AWS-based ETL pipelines, and a frontend built with React, Firebase, and ECharts. The system enables complete observability with no external dependencies.

Solution Overview

Hayanalysis Logs is a self-hosted, extensible log intelligence platform that supports custom queries, user-level dashboards, alerts, and reports. It features a modular execution engine, multi-format query parsing, AWS-based ETL pipelines, and a frontend built with React, Firebase, and ECharts. The system enables complete observability with no external dependencies.

Impact

Hayanalysis Logs delivered a robust observability layer that matched enterprise standards—at a fraction of the complexity and cost. With advanced querying, real-time visualizations, and scalable ingestion, it empowered engineering teams with end-to-end visibility and control over their application infrastructure.

Zero downtime at peak load

100% log indexing via ETL pipeline

Zero downtime at peak load

100% log indexing via ETL pipeline