Parallel Consumer Performance Improvement

Overview

Parallel Consumer is an open source software to enable fast processing message with less instances
This article is to introduce the performance improvement for parallel consumer.

Work Flow Chart

Main Workflow

Explanation：

  • Previously to get the available workers, it has to go through all shards and get all workers and fill them out based on certain conditions
  • Now, we just to get from an atomic variable and it will be updated when the worker is newly-added / failed / finished
  • time improvement : O(n) -> O(1)

PR

https://github.com/confluentinc/parallel-consumer/pull/644

赏

谢谢你请我吃糖果

扫一扫，分享到微信

微信分享二维码

tag:

    缺失模块。
    1、请确保node版本大于6.2
    2、在博客根目录（注意不是yilia根目录）执行以下命令：
    npm i hexo-generator-json-content --save

    3、在根目录_config.yml里添加配置： 

      jsonContent:
    meta: false
    pages: false
    posts:
      title: true
      date: true
      path: true
      text: false
      raw: false
      content: false
      slug: false
      updated: false
      comments: false
      link: false
      permalink: false
      excerpt: false
      categories: false
      tags: true

Martyn's Playground