﻿---
title: Custom Kafka Log integration
description: The custom Kafka log integration is used to read from topics in a Kafka cluster. To configure this integration, specify a list of one or more hosts in...
url: https://www.elastic.co/docs/reference/integrations/kafka_log
---

# Custom Kafka Log integration


|                                                                                                                                     |                                        |
|-------------------------------------------------------------------------------------------------------------------------------------|----------------------------------------|
| **Version**Version                                                                                                                  | 1.8.1 ([View all](#changelog)View all) |
| **Subscription level**Subscription level[What's this?](https://www.elastic.co/subscriptions)What's this?                            | Basic                                  |
| **Level of support**Level of support[What's this?](https://www.elastic.co/docs/reference/integrations/level-of-support)What's this? | Elastic                                |
| **Ingestion method(s)**Ingestion method(s)                                                                                          | Kafka                                  |

The custom Kafka log integration is used to read from topics in a Kafka cluster.
To configure this integration, specify a list of one or more hosts in the cluster to bootstrap the connection with, a list of topics to track, and a group_id for the connection.

## Compatibility

This Integration works with all Kafka versions in between 0.11 and 2.8.0. Older versions might work as well, but are not supported.

## Ingest Pipelines

Custom ingest pipelines may be added by adding the name to the pipeline configuration option, creating custom ingest pipelines can be done either through the API or the *Ingest Node Pipeline UI* (use the [global search field](https://staging-website.elastic.co/docs/get-started/the-stack#kibana-navigation-search) to search for "ingest pipelines").
**ECS Field Reference**
Please refer to the following [document](https://www.elastic.co/guide/en/ecs/current/ecs-field-reference.html) for detailed information on ECS fields.

## Changelog

<dropdown title="Changelog">


  | Version        | Details                                                                                                                                                                                                                                                                                                 | Kibana version(s)               |
  |----------------|---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|---------------------------------|
  | **1.8.1**1.8.1 | **Bug fix**Bug fix ([View pull request](https://github.com/elastic/integrations/pull/12727)View pull request)Updated SSL description to be uniform and to include links to documentation.                                                                                                               | 8.13.0 or higher9.0.0 or higher |
  | **1.8.0**1.8.0 | **Enhancement**Enhancement ([View pull request](https://github.com/elastic/integrations/pull/12468)View pull request)Add support for Kibana `9.0.0`.                                                                                                                                                    | 8.13.0 or higher9.0.0 or higher |
  | **1.7.0**1.7.0 | **Enhancement**Enhancement ([View pull request](https://github.com/elastic/integrations/pull/10162)View pull request)ECS version updated to 8.11.0. Update the kibana constraint to ^8.13.0. Modified the field definitions to remove ECS fields made redundant by the ecs@mappings component template. | 8.13.0 or higher                |
  | **1.6.0**1.6.0 | **Enhancement**Enhancement ([View pull request](https://github.com/elastic/integrations/pull/9321)View pull request)Enable secrets for sensitive fields. For more details, refer https://www.elastic.co/guide/en/fleet/current/agent-policy.html#agent-policy-secret-values                             | 8.12.0 or higher                |
  | **1.5.1**1.5.1 | **Bug fix**Bug fix ([View pull request](https://github.com/elastic/integrations/pull/9279)View pull request)Disable secrets for older stack versions due to errors.                                                                                                                                     | 7.16.0 or higher8.0.0 or higher |
  | **1.5.0**1.5.0 | **Enhancement**Enhancement ([View pull request](https://github.com/elastic/integrations/pull/9009)View pull request)Enable 'secret' for the sensitive fields, supported from 8.12.                                                                                                                      | 7.16.0 or higher8.0.0 or higher |
  | **1.4.0**1.4.0 | **Enhancement**Enhancement ([View pull request](https://github.com/elastic/integrations/pull/8171)View pull request)Update the package format_version to 3.0.0.                                                                                                                                         | 7.16.0 or higher8.0.0 or higher |
  | **1.3.0**1.3.0 | **Enhancement**Enhancement ([View pull request](https://github.com/elastic/integrations/pull/6840)View pull request)Add permissions to reroute events to logs-*-*- for generic datastream                                                                                                               | 7.16.0 or higher8.0.0 or higher |
  | **1.2.0**1.2.0 | **Enhancement**Enhancement ([View pull request](https://github.com/elastic/integrations/pull/6298)View pull request)Rename ownership from obs-service-integrations to obs-infraobs-integrations                                                                                                         | 7.16.0 or higher8.0.0 or higher |
  | **1.1.1**1.1.1 | **Enhancement**Enhancement ([View pull request](https://github.com/elastic/integrations/pull/5123)View pull request)Added categories and/or subcategories.                                                                                                                                              | 7.16.0 or higher8.0.0 or higher |
  | **1.1.0**1.1.0 | **Enhancement**Enhancement ([View pull request](https://github.com/elastic/integrations/pull/5057)View pull request)Update ECS version to 8.5.1                                                                                                                                                         | 7.16.0 or higher8.0.0 or higher |
  | **1.0.0**1.0.0 | **Enhancement**Enhancement ([View pull request](https://github.com/elastic/integrations/pull/2741)View pull request)Initial Release                                                                                                                                                                     | 7.16.0 or higher8.0.0 or higher |
</dropdown>
