Status
- OVIS version 3.0 supports multiple concurrent shepherds for the distributed database and mysql inserts on the part of the sheep (on-component data collectors). It has the qt/vtk based interface only.
- We have a number of installs that use a single shepherd configuration. There are some features in the master git branch that are currently supported for single shepherd operation only (e.g., outlier analysis).
- The data collection version which uses LDMS rather than the sheep is being used on some collaborative installs. This eliminates the on-node mysql inserts.
Please contact ovis-help for more information.
Directory Structure
A specific directory structure is not mandated, however we have used the following in many deployments: OVIS source is in
~ovis/Source/ovis
and the binaries are in
~ovis/Build/ovis
and make install has been done to install to
/usr/local/ovis
with links from /usr/local/bin to the binaries there for shepherd, baron, and ovis-db and with
/etc/ld.so.conf.d/ovis.conf
created with contents /usr/local/ovis/lib and /usr/local/ovis/lib64. (Recall to run /sbin/ldconfig -v after, and restart mysqld)
Dependencies
- Avahi (or Bonjour) – avahi is only necessary for running OVIS with multiple databases. Avahi headers are necessary for building OVIS, even if intending a single database, but the avahi service does not need to be running for single shepherd operation. version around 0.6.27
- qt – 4.7.4
- qjson – 0.7.1 at least
- boost – version 1.44 at least
- MySQL – can use either PostgreSQL or MySQL
- PostgreSQL – can use either PostgreSQL or MySQL
- libevent – only if using LDMS. version 2.x
- readline
- CMake (if building)- version 2.8 at least
On systems such as FC16 all these dependencies can be resolved via yum (on others they may not be, or the version may not be correct). Assuming you are building everything, this would be:
yum install \ cmake readline-devel libevent-devel \ postgresql postgresql-devel postgresql-libs postgresql-server \ mysql-devel mysql-utilities mysql mysql-libs mysql-server \ avahi avahi-glib-devel avahi-gobject avahi-libs avahi-glib avahi-devel \ avahi-ui-devel avahi-qt4-devel avahi-qt4 \ qt qt-webkit-devel qt-webkit qt-devel qt-x11 qt-mysql qjson qjson-devel \ boost boost-devel # Required only to build baler: yum install perl-Algorithm-Diff
Note that for some of the installation steps you may want to do (e.g., changing the rpath for programs) you may also want:
yum install chrpath
Otherwise you can install the packages from source and set the appropriate paths in the CMAKE Flags of OVIS.
CMAKE
OVIS uses CMAKE to build. Flags of interest include:
- CMAKE_INSTALL_DIR – where you want to install ovis
- any dependencypaths suchas : BOOST_INCLUDE_DIR, BOOST_LIBRARY_DIRS, QJSON_LIBRARY, QJSON_INCLUDE_DIR, any of the AVAHI flags etc
- QT_QMAKE_EXECUTABLE
- OVIS_USE_MYSQL or OVIS_USE_POSTGRESQL – at least one or the other must be on
- OVIS_USE_AVAHI or OVIS_USE_BONJOUR – at least one or the other must be on
- If you are using static libraries for your dependendencies: CMAKE_CXX_FLAGS and CMAKE_C_FLAGS -fPIC
- OVIS_BUILD_BARON – set to yes for the install where you will run the baron (desired resolution and speed for the 3D interface requires NVIDIA card)
- OVIS_BUILD_SHEPHERD – set to yes for the install where you will run shepherd (shepherd must be co-located with the database)
In addition:
- BUILD_KOMONDOR = no
- USE_SYSTEM_LIBEXEC =yes
- anything to do with ldms currently no/off
Database
particular to FC16, from which you can extrapolate to your system:
- Start database daemons
# MySQL systemctl enable mysqld.service systemctl start mysqld.service # Be sure to change Foob to something you will remember: mysql -u root -e "UPDATE mysql.user SET Password=PASSWORD('Foob') WHERE User='root';FLUSH PRIVILEGES;" # If the above doesn't work, try adding "-p". # Drop the anonymous accounts (also verify afterward) mysql -u root -p -e "DROP USER (single quote here)(single quote here)@'localhost'" mysql -u root -p -e "DROP USER (single quote here)(single quote here)@'host_name_here'" #mysql -u root -p -e "CREATE DATABASE OVIS_Cluster; GRANT ALL ON OVIS_Cluster.* TO 'ovis'@'localhost';FLUSH PRIVILEGES;" #mysql -u root -p -e "CREATE DATABASE balerDemo;" #mysql -u root -p -e "GRANT ALL ON balerDemo.* TO 'baler'@'localhost' IDENTIFIED BY 'Foob'; FLUSH PRIVILEGES;" mysql -u root -p -e "GRANT ALL ON *.* TO 'ovis'@'localhost';FLUSH PRIVILEGES;" # PostgreSQL postgresql-setup initdb systemctl enable postgresql.service systemctl start postgresql.service su - postgres createuser -s -R -l ovis createdb -O ovis ovis exit systemctl stop postgresql.service su - postgres echo "# local access to ovis for all" > hba.tmp echo "local all ovis trust" >> hba.tmp mv /var/lib/pgsql/data/pg_hba.conf hba2.tmp cat hba.tmp hba2.tmp > /var/lib/pgsql/data/pg_hba.conf rm -f hba.tmp hba2.tmp # Turn off annoying informational messages that clutter real warning/error messages mv /var/lib/pgsql/data/postgresql.conf conf.tmp sed -e 's/max_connections = 100/max_connections = 500/g' \ -e 's/^#client_min_messages = notice.*/client_min_messages = warning/g' \ conf.tmp > /var/lib/pgsql/data/postgresql.conf exit # Turn up shared memory to 128 MiB (from 32 MiB) to allow more connections: sysctl -w kernel.shmmax=134217728 # ... and make the change survive reboots: echo " " >> /etc/sysctl.conf echo "# For OVIS's use of PostgreSQL, increase shared memory size" >> /etc/sysctl.conf echo "kernel.shmmax = 134217728" >> /etc/sysctl.conf # Restart postgres systemctl start postgresql.service
- Install database triggers and create a database
# PostgreSQL mkdir /usr/local/ovis chown ovis /usr/local/ovis su - ovis cd Build/ovis make install cd bin tar cf - libvtksys* libvtkCommon* libvtkFiltering* libovTriggerPSQL.so | (cd /usr/local/ovis/lib64; tar xf - ) cd /usr/local/ovis/lib64 chrpath -r /usr/local/ovis/lib64: libvtkCommon* libvtkFiltering* libvtkInfovis* libovTriggerPSQL.so exit cd /usr/local/ovis/lib64 for f in libovTriggerPSQL.so libvtksys.so.5.11.0 libvtkCommon.so.5.11.0 libvtkFiltering.so.5.11.0 libvtkInfovis.so.5.11.0; do semanage fcontext -a -t postgresql_exec_t /usr/local/ovis/lib64/$f restorecon -v /usr/local/ovis/lib64/$f done semanage fcontext -a -t lib_t '/usr/local/ovis/lib64' restorecon -v '/usr/local/ovis/lib64' su - ovis cd ~/Build/ovis ./bin/ovis-db -t 16383 -x data/test.ovdb exit
# MySQL cd ~ovis/Build/ovis/bin tar cf - libovTriggerMySQL.so | (cd /usr/lib64/mysql/plugin; tar xf - ) tar cf - libvtksys* libvtkCommon* libvtkFiltering* libvtkInfovis* libovTriggerMySQL.so | (cd /usr/lib64/mysql; tar xf - ) restorecon -v /usr/lib64/mysql/libvtk* restorecon -v /usr/lib64/mysql/plugin/libovTriggerMySQL.so cd /usr/lib64/mysql chrpath -r /usr/lib64/mysql: libvtkCommon* libvtkFiltering* libvtkInfovis* plugin/libovTriggerMySQL.so su - ovis cd ~/Build/ovis ./bin/ovis-db -t 16383 -x data/test.ovdb -u mysql://ovis@localhost/OVIS_Cluster exit
- Set any additional paths you need for OVIS libraries to be found.
echo "/usr/local/lib64" > /etc/ld.so.conf.d/ovis.conf echo "/usr/local/lib" >> /etc/ld.so.conf.d/ovis.conf ldconfig