![]() Prometheus JMX Exporter is a JMX to Prometheus bridge. I was about to write an “exporter”, but then Brian Brazil one of Prometheus contributors and the creator of Prometheus JMX Exporter, opened my eyes and suggested to take advantage of Spark’s configurable metrics system and Prometheus’ jmx_exporter, rather than creating a new exporter. However, we need to find a way to scrape it into Prometheus’ DB, where our monitoring metrics are collected and analyzed. Spark already has its own monitoring capabilities, including a very nice web UI and a REST API. Finding no evidence of how to do that using Prometheus online (shouting a little bit on Twitter, talking with some guys in the IRC channel…), I decided to write this post / walk-through guide. In this case, we need to monitor our Spark application. It is very modular, and lets you easily hook into your existing monitoring/instrumentation systems. It is a relatively young project, but it’s quickly gaining popularity, already adopted by some big players (e.g Outbrain). Prometheus is an “open-source service monitoring system and time series database”, created by SoundCloud. Lately, we decided to give a try to Prometheus. As part of our efforts of establishing a robust back-end, one important part of it is monitoring the environment, hosts and services.
0 Comments
Leave a Reply. |
AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |