Overview of the Grepr Platform
The Grepr platform enables efficient collection, storage, processing, and analysis of log data. Because Grepr is built on a general-purpose stream processing engine, you can create processing pipelines for your logs using standard observability pipeline capabilities, such as filtering, parsing, transforming, and routing of processed logs. The Grepr log processing functionality optimizes logs shipped to observability platforms, reducing log volume and observability costs.
This page provides an overview of the Grepr platform’s core components and how to access its features. This page also has an overview of how the platform handles security, high availability, and scalability. Links to more detailed documentation for each topic are included.
The Grepr platform uses a software as a service (SaaS) model. For larger deployments or for customers with strict compliance requirements, Grepr also offers a private cloud deployment model. Grepr runs in AWS for both models.
Supported regions
If you require an AWS region that Grepr does not support, contact support@grepr.ai.
The Grepr SaaS offering is available in the following AWS regions:
| Region | Location |
|---|---|
| us-east-1 | US East (Northern Virginia) |
| eu-central-1 | Europe (Frankfurt) |
Understanding the Grepr processing and data models
Grepr uses a flexible processing model that allows you to build complex log-processing pipelines and run queries. The processing model supports standard observability pipeline capabilities, including filtering, parsing, transforming, and routing of processed logs. Grepr also uses a standardized data model for processed log events, representing log data as records with fields and attributes. This data model enables efficient processing and querying of log data.
See The Grepr processing and data models.
Raw data storage in the Grepr data lake
The Grepr data lake uses Amazon S3 for low-cost object storage of your full raw logs. You can use an S3 bucket provided by Grepr or a bucket in your own account. Logs are stored using Apache Parquet files and the Apache Iceberg table format, enabling efficient storage and querying. To query logs stored in the data lake, the Data Explorer in the Grepr UI provides a user-friendly, visual interface.
To learn more about the data lake, see The Grepr data lake.
To learn more about querying log data in the data lake, see Query log data in the Grepr data lake.
For programmatic access, the Grepr CLI and REST API also support functionality for querying logs in the data lake. See The Grepr CLI and Automate Grepr processing with the Grepr REST APIs.
Security in the Grepr platform
The Grepr platform offers comprehensive security and compliance features to safeguard your data and fulfill enterprise security requirements. These features include secure authentication and identity management with OAuth 2.0, SOC 2 Type 2 compliance, HIPAA compliance, infrastructure and networking security, and data encryption.
See Security in the Grepr platform.
High availability and scalability
The Grepr platform is designed for high availability, ensuring minimal downtime for your log processing pipelines. The platform is also designed for scalability, automatically adding and removing capacity as needed to match processing loads.
See How does Grepr ensure high availability?.
Accessing Grepr functionality
Grepr offers three primary access methods to interact with the platform’s capabilities: a web-based user interface (UI), a comprehensive set of RESTful APIs, and a command-line interface (CLI). You can use any combination of these access methods based on your requirements and preferences.
The Grepr web-based user interface (UI)
The Grepr UI provides:
- A streamlined, task-oriented experience for creating and managing pipelines.
- Visual tools for searching and exploring log data.
- Dashboards that visualize pipeline performance and data flows.
- Guided workflows for common observability tasks.
The Grepr REST API
To access some advanced features and automate tasks, the REST API provides:
- Complete programmatic control over all Grepr capabilities.
- The ability to integrate Grepr into your existing workflows and tools.
- Customization options for complex observability pipelines.
- Support for infrastructure as code (IaC) and GitOps approaches.
See Automate Grepr processing with the Grepr REST APIs.
The Grepr command-line interface (CLI)
The Grepr CLI allows you to manage jobs and run queries in the Grepr platform from the command line. You can also use the CLI in your scripts or other clients to automate tasks.
See The Grepr CLI.