Ganglia: 10 years of monitoring clusters and grids

Channel: fosdemtalks   |   2010/02/14
Play Video
1
Ganglia: 10 years of monitoring clusters and grids
Ganglia: 10 years of monitoring clusters and grids
::2010/02/14::
Play Video
2
Physiology of nervous system. Motor. Cerebellum and basal ganglia.
Physiology of nervous system. Motor. Cerebellum and basal ganglia.
::2013/02/20::
Play Video
3
Ganglia Performance Monitoring Across Machines
Ganglia Performance Monitoring Across Machines
::2013/02/28::
Play Video
4
Hadoop Cluster Monitoring
Hadoop Cluster Monitoring
::2013/09/14::
Play Video
5
Mestis - "Basal Ganglia" EP Review
Mestis - "Basal Ganglia" EP Review
::2012/11/29::
Play Video
6
ganglia installation with 2 node apache cluster
ganglia installation with 2 node apache cluster
::2014/02/26::
Play Video
7
3D Brain from MRI   4   Basal ganglia
3D Brain from MRI 4 Basal ganglia
::2012/08/10::
Play Video
8
Running an OpenGL application on a GPU-accelerated Nova Instance
Running an OpenGL application on a GPU-accelerated Nova Instance
::2014/02/27::
Play Video
9
Motor System II Basal Ganglia (and a little cerebellum)
Motor System II Basal Ganglia (and a little cerebellum)
::2012/08/07::
Play Video
10
nagios ganglia monitoring
nagios ganglia monitoring
::2013/01/30::
Play Video
11
Monitoring Hadoop performance with Ganglia on a MapR cluster
Monitoring Hadoop performance with Ganglia on a MapR cluster
::2011/11/07::
Play Video
12
A simulation of the cortex-basal ganglia-thalamus circuit in Nengo going through a simple sequence
A simulation of the cortex-basal ganglia-thalamus circuit in Nengo going through a simple sequence
::2011/12/22::
Play Video
13
Instalar monit en linux Debian
Instalar monit en linux Debian
::2012/01/04::
Play Video
14
Lessons And 3D Anatomy Software: Anatomy Of Cerebellum 2
Lessons And 3D Anatomy Software: Anatomy Of Cerebellum 2
::2012/09/01::
Play Video
15
Ganglia - Human Cocoons [+ free download]
Ganglia - Human Cocoons [+ free download]
::2010/06/29::
Play Video
16
Basal Ganglia
Basal Ganglia
::2011/04/12::
Play Video
17
Dr. Leylah Delic M.D.  Testimonial
Dr. Leylah Delic M.D. Testimonial
::2014/01/16::
Play Video
18
Hadoop 2.0 Yarn Tutorial Training Through Live Classess and Projects
Hadoop 2.0 Yarn Tutorial Training Through Live Classess and Projects
::2013/11/15::
Play Video
19
Saum Mathur, Global Chief Information Officer of HP Software, talks about MapR
Saum Mathur, Global Chief Information Officer of HP Software, talks about MapR
::2014/02/19::
Play Video
20
Best of Velocity 2012: The sFlow Standard
Best of Velocity 2012: The sFlow Standard
::2013/04/01::
Play Video
21
Scott Russmann, Director of Software Development, Solutionary talks about MapR
Scott Russmann, Director of Software Development, Solutionary talks about MapR
::2014/02/15::
Play Video
22
11 Sesja Linuksowa: Ganglia & Nagios
11 Sesja Linuksowa: Ganglia & Nagios
::2014/04/08::
Play Video
23
Drawing Cerebellum 2/3
Drawing Cerebellum 2/3
::2012/01/27::
Play Video
24
Neuroanatomy - The Corticospinal Tract in 3D
Neuroanatomy - The Corticospinal Tract in 3D
::2009/07/19::
Play Video
25
Tutorial Cara Menggunakan Software Real Network Monitoring v1 4
Tutorial Cara Menggunakan Software Real Network Monitoring v1 4
::2013/11/02::
Play Video
26
Fish Monitoring
Fish Monitoring
::2009/07/20::
Play Video
27
The Human Brain (HD full documentary)
The Human Brain (HD full documentary)
::2013/12/08::
Play Video
28
Lessons And 3D Anatomy Software: Brain Stem Anatomy
Lessons And 3D Anatomy Software: Brain Stem Anatomy
::2012/08/31::
Play Video
29
Fish Visual Cluster Monitoring 2010-03-25
Fish Visual Cluster Monitoring 2010-03-25
::2010/03/25::
Play Video
30
San Francisco Surgical Arts and Anatomage
San Francisco Surgical Arts and Anatomage's Invivo Software on KRON 4
::2012/03/06::
Play Video
31
Horziontal Section Of The Brain
Horziontal Section Of The Brain
::2012/04/21::
Play Video
32
Dell Crowbar Software Overview (Rob Hirschfeld)
Dell Crowbar Software Overview (Rob Hirschfeld)
::2011/07/25::
Play Video
33
Internet Monitoring Software for Child Safety from United Parents (Sky Tv Italy)
Internet Monitoring Software for Child Safety from United Parents (Sky Tv Italy)
::2010/06/16::
Play Video
34
OpenNebulaConf 2013 - Monitoring Large-scale Cloud Infrastructures with OpenNebula by Simon Boulet
OpenNebulaConf 2013 - Monitoring Large-scale Cloud Infrastructures with OpenNebula by Simon Boulet
::2013/10/14::
Play Video
35
Anat - Diencephalon & 3rd Ventricle (part 6)...11/2/2010
Anat - Diencephalon & 3rd Ventricle (part 6)...11/2/2010
::2010/02/19::
Play Video
36
Hadoop Story - How Hadoop helped solve water problem in a village
Hadoop Story - How Hadoop helped solve water problem in a village
::2013/08/24::
Play Video
37
how to make installation silent for office2010 2013 Part 02
how to make installation silent for office2010 2013 Part 02
::2013/08/19::
Play Video
38
Service Science Management Engineering and Design - SSMED
Service Science Management Engineering and Design - SSMED
::2013/12/11::
Play Video
39
Neuroanatomy Lecture Part 1
Neuroanatomy Lecture Part 1
::2013/02/22::
Play Video
40
DEAWAY Inc
DEAWAY Inc
::2013/10/13::
Play Video
41
ABC World News Tonight about No Lie MRI.wmv
ABC World News Tonight about No Lie MRI.wmv
::2012/06/25::
Play Video
42
Practical Anatomy - Cerebellum - Part 1
Practical Anatomy - Cerebellum - Part 1
::2012/12/24::
Play Video
43
Lucio Macchia presenta: LA STRATEGIA AZIENDALE NEI MERCATI COMPLESSI (TRSP, 22 09 2010, parte 2)
Lucio Macchia presenta: LA STRATEGIA AZIENDALE NEI MERCATI COMPLESSI (TRSP, 22 09 2010, parte 2)
::2010/10/16::
Play Video
44
Privacy, Ethics, and Accountability
Privacy, Ethics, and Accountability
::2013/12/11::
Play Video
45
Soni Jiandani - VMworld 2013 - theCUBE
Soni Jiandani - VMworld 2013 - theCUBE
::2013/08/26::
Play Video
46
Lessons And 3D Anatomy Software:  Fetal Brain Development 2
Lessons And 3D Anatomy Software: Fetal Brain Development 2
::2012/09/01::
Play Video
47
Ticketing Tool: Better manage your IT-Tickets!
Ticketing Tool: Better manage your IT-Tickets!
::2013/11/20::
Play Video
48
Cerebellum Function Anatomy Cranial View Drawing by Teacher Flash
Cerebellum Function Anatomy Cranial View Drawing by Teacher Flash
::2012/05/23::
Play Video
49
CentOS 6.4 설정
CentOS 6.4 설정
::2014/01/14::
Play Video
50
Install OpenStack Havana on baremetalcloud with Chef.
Install OpenStack Havana on baremetalcloud with Chef.
::2013/10/25::
NEXT >>
RESULTS [51 .. 101]
From Wikipedia, the free encyclopedia
Jump to: navigation, search
Ganglia
Screenshot
Stable release 3.6.0 / 21 May 2013; 10 months ago (2013-05-21)
Written in C, Perl, PHP, Python
Operating system Cross-platform
Available in English
Type Distributed monitoring
License BSD license
Website www.ganglia.info

Ganglia is a scalable distributed system monitor tool for high-performance computing systems such as clusters and grids. It allows the user to remotely view live or historical statistics (such as CPU load averages or network utilization) for all machines that are being monitored.[1]

Ganglia[edit]

It is based on a hierarchical design targeted at federations of clusters. It relies on a multicast-based listen/announce protocol to monitor state within clusters and uses a tree of point-to-point connections amongst representative cluster nodes to federate clusters and aggregate their state. It leverages widely used technologies such as XML for data representation, XDR for compact, portable data transport, and RRDtool for data storage and visualization. It uses carefully engineered data structures and algorithms to achieve very low per-node overheads and high concurrency. The implementation is robust, has been ported to an extensive set of operating systems and processor architectures, and is currently in use on over 500 clusters around the world. It has been used to link clusters across university campuses and around the world and can scale to handle clusters with 2000 nodes.[2]

The ganglia system comprises two unique daemons, a PHP-based web front-end, and a few other small utility programs.

Ganglia Monitoring Daemon (gmond)[edit]

Gmond is a multi-threaded daemon which runs on each cluster node you want to monitor. Installation does not require having a common NFS filesystem or a database back-end, installing special accounts or maintaining configuration files.

Gmond has four main responsibilities:

  1. Monitor changes in host state.
  2. Announce relevant changes.
  3. Listen to the state of all other ganglia nodes via a unicast or multicast channel.
  4. Answer requests for an XML description of the cluster state.

Each gmond transmits in information in two different ways:

Ganglia Meta Daemon (gmetad)[edit]

Federation in Ganglia is achieved using a tree of point-to-point connections amongst representative cluster nodes to aggregate the state of multiple clusters. At each node in the tree, a Ganglia Meta Daemon (gmetad) periodically polls a collection of child data sources, parses the collected XML, saves all numeric, volatile metrics to round-robin databases and exports the aggregated XML over a TCP socket to clients. Data sources may be either gmond daemons, representing specific clusters, or other gmetad daemons, representing sets of clusters. Data sources use source IP addresses for access control and can be specified using multiple IP addresses for failover. The latter capability is natural for aggregating data from clusters since each gmond daemon contains the entire state of its cluster.

Ganglia PHP Web Front-end[edit]

The Ganglia web front-end provides a view of the gathered information via real-time dynamic web pages. Most importantly, it displays Ganglia data in a meaningful way for system administrators and computer users. Although the web front-end to ganglia started as a simple HTML view of the XML tree, it has evolved into a system that keeps a colorful history of all collected data.

The Ganglia web front-end caters to system administrators and users. For example, one can view the CPU utilization over the past hour, day, week, month, or year. The web front-end shows similar graphs for memory usage, disk usage, network statistics, number of running processes, and all other Ganglia metrics.

The web front-end depends on the existence of the gmetad which provides it with data from several Ganglia sources. Specifically, the web front-end will open the local port 8651 (by default) and expects to receive a Ganglia XML tree. The web pages themselves are highly dynamic; any change to the Ganglia data appears immediately on the site. This behavior leads to a very responsive site, but requires that the full XML tree be parsed on every page access. Therefore, the Ganglia web front-end should run on a fairly powerful, dedicated machine if it presents a large amount of data.

The Ganglia web front-end is written in PHP, and uses graphs generated by gmetad to display history information. It has been tested on many flavours of Unix (primarily Linux) with the Apache webserver and the PHP 4.1 module.

References[edit]

External links[edit]

Wikipedia content is licensed under the GFDL License

Mashpedia enables any individual or company to promote their own Youtube-hosted videos or Youtube Channels, offering a simple and effective plan to get them in front of our engaged audience.

Want to learn more? Please contact us at: hello@mashpedia.com

Powered by YouTube
LEGAL
  • Mashpedia © 2014