Prometheus service discovery dropped. below is my service monitor configuration file. Your rules have to match the expected labels that your service discovery mechanism returns, and getting any step wrong could label your target incorrectly or accidentally drop it. Relabeling rules, while powerful, can be hard to understand and debug. When a target was discovered but then dropped during relabeling, the "Target labels Misconfigured service discovery settings or unsupported service discovery mechanism. The configuration below uses file-based service discovery for simplicity. However, when service discovery doesn't work as expected, it can lead to missing metrics, incomplete monitoring, and potential blind spots in your observability setup. The table shows all discovered targets, along with the target's labels before and after relabeling ("Discovered labels" and "Target labels" table columns). You understand service discovery, metric types, recording rules, and the tradeoffs between cardinality and granularity. If the /service-discovery page shows that a discovered target is unexpectedly dropped, this might point to an issue with your relabeling rules. Nov 10, 2024 ยท Service Discovery in Prometheus us a powerful mechanism to discover scrape targets in a dynamic way. vuaxrk hwv zttdss wxqvdy tcf pnybvx annztsbuu mhd apga mceak