Integrations in Grepr

These integrations can be managed in the integrations page, which you can access by clicking on the Integrations link on the Grepr header.

What's an integration?

An integration is a connection to a third party like Datadog, S3, etc. In Grepr, integrations are distinguished in 2 main categories.

1. Observability vendors

An observability vendor integration allows you to setup your sources (and sinks) for Grepr to get the logs and send them back.

You can see more details below about each observability vendor supported in Grepr.

A. Datadog

Grepr supports Datadog as an observability vendor integration, allowing you to setup your agents and cloud sources to send logs to Grepr.

To create a Datadog integration, go to the integrations page and click on the Add new button in the Observability vendor section to see the following modal:

1. Add a name for your integration.
2. Select the site your datadog agent or cloud source is.
3. Go to Datadog (opens in a new tab) to get your API Key and paste it here. If you have trouble getting your keys or need more guidance you can follow the Datadog documentation (opens in a new tab).
4. If you want to set up a cloud source you will need to add an APP Key from Datadog (this is not required to setup agents).
5. Click on the create button to create your integration.

Once created, your Datadog integration is now ready to be used as a source and/or sink to pipelines.

2. Data Warehouse

A data warehouse integration allows you store the logs in services like S3. Grepr supports the following integrations:

A. Grepr-Hosted

This data warehouse is hosted by Grepr for you, the only thing you will have to do is choose the data warehouse name in the form as shown below:

Click on Next and you've created your Grepr hosted data warehouse.

B. External S3

If you want to have the logs stored in your own S3 bucket, this is the option you will want to select.

You will then need to add a name and bucket name for your data warehouse, as shown below:

Grepr provides 2 options for you to setup your S3 Data warehouse:

Automatic (recommended)

To set up an automatic bucket connection, click on the GO TO CLOUDFORMATION button.

This will open a new tab to a Cloud Formation website with forms already prefilled for you, as per the following screenshot:

On the CloudFormation page, you'll need to click on "Create Stack".

A Grepr Script is now running to validate your bucket, once done you can click Next to finish your data warehouse setup and proceed to the pipeline creation.

Manual

Manual setup requires you to go through the setup yourself.

S3 bucket

1. Go to AWS S3 (opens in a new tab).

2. Paste your bucket name in the bucket name field and then click on Create at the bottom of the page.

3. Click on your bucket name, go to the Permissions tab and click the Edit button on the Bucket Policy section.

Click on the JSON tab and paste the following JSON. Make sure to replace fields as needed.

{
  "Version": "2012-10-17",
  "Statement": [
    {
      "Effect": "Allow",
      "Principal": {
        "AWS": "arn:aws:iam::992382778380:role/customer-role-{YOUR_ORG_NAME}"
      },
      "Action": [
        "s3:ListBucket",
        "s3:GetBucketLocation"
      ],
      "Resource": "arn:aws:s3:::{YOUR_S3_BUCKET_NAME}"
    },
    {
      "Effect": "Allow",
      "Principal": {
        "AWS": "arn:aws:iam::992382778380:role/customer-role-{YOUR_ORG_NAME}"
      },
      "Action": [
        "s3:DeleteObjectTagging",
        "s3:PutObject",
        "s3:GetObject",
        "s3:PutObjectTagging",
        "s3:DeleteObject"
      ],
      "Resource": "arn:aws:s3:::{YOUR_S3_BUCKET_NAME}/*"
    }
  ]
}

{YOUR_ORG_NAME} is the name of your authenticated organization in Grepr. E.g. if the URL you are using is https://name.app.grepr.io/, your org name is 'name'

Finalize Creating Integration

Make sure the bucket name in the form matches the bucket name you created in S3, and Grepr will validate your bucket.

Once the validation is done, click on Create to finish your data warehouse setup.