Observability Providers Streamline Visibility Tools for DevOps

C. Dunlap Research Director

Summary Bullets:

  • Open-source software (OSS) technologies are improving developer access to advanced services
  • Vendors are heeding the call for more streamlined access to telemetry data management

An increase in telemetry data management requirements associated with containerized applications and microservices across highly distributed systems has prompted the need for greater visibility among more DevOps team members.

As a result, technology providers are prepping observability solutions which address more enterprise IT roles through improved dashboards, OSS, and AI/GenAI integrations. Enterprise developers involved in Kubernetes container app modernization projects will benefit through greater access to sophisticated technologies.

The move towards improved developer and DevOps dashboards and hubs for delivering and managing advanced services was a trend that was particularly apparent across observability solutions during this month’s KubeCon conference in London. Improved user interfaces (UIs) will largely be fulfilled through new and evolving OSS innovations.

Specifically, open-source efforts are helping the industry move towards improved correlation and standardization, particularly through OpenTelemetry, an observability framework that helps standardize the collection and processing of telemetry data.

Other OSS updates highlighted at KubeCon include:

  • Perses, a little-known project growing in popularity for its progress as a lightweight, attractive UI which integrates well into dashboards and portals, making it a viable alternative to Grafana. Its integration with CICD pipelines and workflows provides developers with observability-as-code (for abstracting configuration complexities).
  • Fluent Bit, an OSS telemetry processor, released a new version 4.0, including improvements to performance, security, and flexibility, and emphasizing the ability to help streamline operational provisioning. The vendor neutral telemetry agent is popular across cloud providers for its lightweight design that can now support telemetry signals including logs, metrics, traces, and profiles, with in-streaming processing abilities.
  • Backstage, first released a few years ago, has made important strides in recent months. The OSS framework which is used to build developer portals has improved its developer experience (DX) while streamlining workflow creation. According to officials working closely with the project, future enhancements will focus on ongoing extension of various backend service integrations to ensure flexibility of developers’ tools of choice, improvements to frontend systems, and ongoing security enhancements.
  • Microsoft-backed Headlamp, a Kubernetes multi-cluster management UI, provides developers with greater participation in managing container deployments. It was announced during KubeCon that the unified management dashboard has received inclusion to the CNCF sandbox early-stage phase of OSS projects, increasing its significance to the KubeCon community. Its GUI environment makes Kubernetes cluster management much more accessible to developers, not just platform engineers and IT operations professionals.
  • Finally, OpenTelemetry Operator’s importance has significantly grown in terms of simplifying the deployment and management of the various OpenTelemetry components, by being able to automate instrumentation with minimal coding requirements, also referred to as monitoring-as-code and observability-as-code.

The overarching trend associated with these OSS innovations is significantly improved dashboards. This represents a key component in the adoption of DevOps platforms and tools. It is also the best route for acquiring enterprise developer loyalty by ensuring enhanced access to advanced technologies such as observability, AI agents, etc. The result will be a wider variety of roles working across the application lifecycle involved in app development, deployment, and management.

Leave a Reply