Practical problem with logical solution. Great!! What I am not able to understand though, is that what kind of configuration LogService is keeping? I mean you are not parsing the logs at that level, so what does this service provides? if only configuration management for the workers, you could have say LogConfigurationService and it should be not be placed between agents and kafka. I totally understand the need of the abstracting kafka details and reduce number of connections to it by introducing a service layer between agents and kafka, but that service (lets call it BusAPI (considering Kafka as event bus) and it does not need any UI to manage itself.

What am I missing here?