I have gotten a few comments and etc regarding whether or not I was able to get Hadoop to talk to Ganglia. Sadly I wasn’t able to get this to work properly either but I did contact the Hadoop mailing list (this thread) and got the following information. There is actually a bug. The link [...]
Entries Tagged as 'Clustering'
More on Hadoop Metrics In Ganglia.
July 28th, 2008 · 3 Comments
Tags: Clustering · Dev · Linux
More gexec.
June 4th, 2008 · No Comments
Bernard Li pushed a new version of gexec out in response to my inquiries on the mailing list, it includes the Ganglia switch.
I did some further code changes and was able to generate a tarball
which builds fine without any modification, can you please try it on
your system and see if it works? All you [...]
Tags: Clustering
NVIDIA GPU/CUDA Based Supercomputer.
May 31st, 2008 · No Comments
Check out this sweet machine that the University of Antwerp built.
http://www.youtube.com/watch?v=DnIvodB2RzU
Tags: Clustering
Ganglia, gexec, authd and libe Install Procedure.
May 30th, 2008 · No Comments
Install Ganglia
wget http://voxel.dl.sourceforge.net/sourceforge/ganglia/ganglia-3.0.7-1.src.rpm
rpm -Uhv http://apt.sw.be/redhat/el5/en/i386/rpmforge/RPMS/rpmforge-release-0.3.6-1.el5.rf.i386.rpm
yum install libpng-devel libart_lgpl-devel rrdtool-devel freetype-devel rrdtool-devel
rpmbuild –rebuild ganglia-3.0.7-1.src.rpm
rpm -ivh /usr/src/redhat/RPMS/x86_64/ganglia-gmetad-3.0.7-1.x86_64.rpm /usr/src/redhat/RPMS/x86_64/ganglia-gmond-3.0.7-1.x86_64.rpm /usr/src/redhat/RPMS/x86_64/ganglia-devel-3.0.7-1.x86_64.rpm
Install libe
wget http://www.theether.org/libe/libe-0.3.0-1.src.rpm
rpmbuild –rebuild libe-0.3.0-1.src.rpm
rpm -ivh /usr/src/redhat/RPMS/x86_64/libe-0.3.0-1.x86_64.rpm
Install authd
yum install openssl-devel
wget http://www.theether.org/authd/authd-0.2.2-1.src.rpm
rpmbuild –rebuild authd-0.2.2-1.src.rpm
You will run into an error like the following, don’t worry about it we clean it up next.
Installing authd-0.2.2-1.src.rpm
warning: user bnc does not exist - [...]
Tags: Clustering · Linux
gexec Success!
May 30th, 2008 · No Comments
I was finally able to get a clean build of gexec with the ‘–with-ganglia’ option. Here’s what I did:
I downloaded the tarball available at http://therealms.org/oss/ganglia/gexec-0.3.8.tar.gz (thanks to Bernard on the Ganglia mailing list). Then run:
rpmbuild -tb gexec-0.3.8.tar.gz
This created a RPM and SRPM, the RPM can be deleted and I installed the SRPM. Should be located [...]
Tags: Clustering · Linux