我应该使用哪些数据类型将 Jaeger 日志从 Kafka 读取到 Clickhouse？

问题描述

我是 Clickhouse 的新手。我正在尝试将 Jaeger 日志从 Kafka 读入 Clickhouse 数据库。我有以下 Kafka 消息格式：

{
  "traceId": "omFv9AGFHOAfWQ+tJcxDZQ==","spanId": "Lai3jc8v6Pg=","operationName": "GET","startTime": "2021-02-24T09:26:12.771Z","duration": "0.006s","tags": [
    {
      "key": "component","vStr": "kong"
    },{
      "key": "http.method","vStr": "GET"
    },{
      "key": "http.path","vStr": "/static/bootstrap/js/bootstrap.min.js"
    },{
      "key": "http.status_code","vStr": "304"
    },{
      "key": "kong.node.id","vStr": "0b2d3a89-67c8-43b2-a56f-450c45689b7d"
    },{
      "key": "peer.service"
    },{
      "key": "peer.ipv4","vType": "INT64","vInt64": "2130706433"
    },{
      "key": "peer.port","vInt64": "44076"
    },{
      "key": "span.kind","vStr": "server"
    },{
      "key": "internal.span.format","vStr": "zipkin"
    }
  ],"logs": [
    {
      "timestamp": "2021-02-24T09:26:12.771Z","fields": [
        {
          "key": "event","vStr": "krf"
        }
      ]
    }
  ],"process": {
    "serviceName": "kong"
  }
}

我能够使用下表将 traceID、spanID 和 Operation 输入到 Clickhouse：

CREATE TABLE IF NOT EXISTS db1.jaeger
(
  traceId String,spanId  String,operationName String
) ENGINE = Kafka()
SETTINGS
    kafka_broker_list = 'broker.net:9092',kafka_topic_list = 'jaeger',kafka_group_name = 'sample_group',kafka_format = 'JSONEachRow';

但是我输入标签失败。知道我应该使用哪种 Clickhouse 数据类型吗？

解决方法

暂无找到可以解决该程序问题的有效方法，小编努力寻找整理中！

如果你已经找到好的解决方法，欢迎将解决方案带上本链接一起发送给小编。

小编邮箱:dio#foxmail.com (将#修改为@）

clickhouse jaeger