Skip to main content

Send KPI Data to Zabbix from XML KPI File

Send Zabbix metric by reading from a XML file.
This needs package zbxsend from : https://github.com/zubayr/zbxsend
  1. Install zbxsend
  2. Install xmltodict
  3. Create items in zabbix using auto_zabbix_export_generator.py script.
  4. Import items to zabbix.
  5. Running the script zabbix_send_from_kpi_xml.py to send the data to zabbix server.

Zabbix Item Creation

Before we send the Data to Zabbix. We need to create Keys (Items) in Zabbix.
Use the script called auto_zabbix_export_generator.py. Script can be found the same location as the sender script.
This script will create a xml file, which can be imported into the zabbix directly.
Below are the usage for the zabbix item xml import generator.

To Generate XML Export file for Zabbix from a Properties file.

This properties file can be generated from the sender script zabbix_send_from_kpi_xml.py as in the option (1) below.
Once created then we can use this file to create specific KPI items import file, for the zabbix server which we want to monitor.
 python ggsn_auto_zabbix_export_generator.py  [ALL]  
     example: python ggsn_auto_zabbix_export_generator.py KPI_SOURCE_FILE.xml ALL ZABBIX-TMP DEVICE_X1_2

Create All KPI Key values from the Zabbix server.

This option is used to create import xml for all KPIs items which are present in the kpi xml.
Which we use to create items in the zabbix server. 
 python ggsn_auto_zabbix_export_generator.py  [FILE]   
     example:  python ggsn_auto_zabbix_export_generator.py KPI_SOURCE_FILE.xml FILE KPI_SOURCE_FILE.xml.properties ZABBIX-TMP DEVICE_X1_2
NOTE: items key is created based on the Module_SubCategory from the kpi xml file.

Parameter Information:

       : Is the XML KPI file for Device.
  : This is the file which is generated using option (1). '#' is comment in properties file.
             : Host name which needs to be created on zabbix.
       : Group name to which host needs to be assigned.
 [ALL]                  : Static value. Use as-is.
 [FILE]                 : Static Value. Use as-is.

Below is the Usage for Zabbix KPI Sender.

1. To Generate Properties file.

This is to generate a properties file, which can be used to send specific KPIs.
Instead of sending all KPI values. Putting a # before the line to comment the line.
python zabbix_send_from_kpi_xml.py --kpi-xml  --generate-properties
    example: python zabbix_send_from_kpi_xml.py --kpi-xml KPI_SOURCE_FILE.xml --generate-properties --debug

2. Send all KPI from the xml to server.

Using this option will send all the KPI values from the XML. Most of the time this is better.
python zabbix_send_from_kpi_xml.py --kpi-xml  --zabbix-server-ip  --zabbix-server-port  --host-name  --all --debug
    example: python zabbix_send_from_kpi_xml.py --kpi-xml KPI_SOURCE_FILE.xml --zabbix-server-ip 127.0.0.1 --zabbix-server-port 10051 --host-name ams-ggsn --all --debug

3. Send KPI from properties file.

Using this option script expects the properties file to be provided, which was create in option (1).
python zabbix_send_from_kpi_xml.py --kpi-xml  --zabbix-server-ip  --zabbix-server-port  --host-name  --properties-file  --debug
    example:  python zabbix_send_from_kpi_xml.py --kpi-xml KPI_SOURCE_FILE.xml --zabbix-server-ip 127.0.0.1 --zabbix-server-port 10051 --host-name ams-ggsn --properties-file KPI_SOURCE_FILE.xml.properties --debug

Parameter Information

Send Zabbix metric by reading from a XML file. This needs package zbxsend from : https://github.com/zubayr/zbxsend.
Install Packages - pip install zbxsend and pip install xmltodict 
python zabbix_send_from_kpi_xml.py        
   [-h] -x KPI_XML [-i ZABBIX_SERVER_IP] [-s ZABBIX_SERVER_PORT]
   [-n HOST_NAME] [-p PROPERTIES_FILE] [-a] [-g] [-d] [-v]

optional arguments:
  -h, --help            show this help message and exit
  -x KPI_XML, --kpi-xml KPI_XML
                        Is the XML KPI file for Device.
  -i ZABBIX_SERVER_IP, --zabbix-server-ip ZABBIX_SERVER_IP
                        IP address of the Zabbix Server to which this data
                        needs to be sent.
  -s ZABBIX_SERVER_PORT, --zabbix-server-port ZABBIX_SERVER_PORT
                        Port which Zabbix server is listening (Default :
                        10051).
  -n HOST_NAME, --host-name HOST_NAME
                        Host name as given in Zabbix server.
  -p PROPERTIES_FILE, --properties-file PROPERTIES_FILE
                        This is the file which is generated using option (1).
                        '#' is comment in properties file.
  -a, --all             Application Name in the Zabbix Server. (To organize
                        all items being imported)
  -g, --generate-properties
                        Include First line (Header) in the CSV file input,
                        [Default : False]
  -d, --debug           Running Debug mode - More Verbose

Code location

​
Labels:

Comments

Post a Comment

Popular posts from this blog

Cloudera Manager - Duplicate entry 'zookeeper' for key 'NAME'.

We had recently built a cluster using cloudera API’s and had all the services running on it with Kerberos enabled. Next we had a requirement to add another kafka cluster to our already exsisting cluster in cloudera manager. Since it is a quick task to get the zookeeper and kafka up and running. We decided to get this done using the cloudera manager instead of the API’s. But we faced the Duplicate entry 'zookeeper' for key 'NAME' issue as described in the bug below. https://issues.cloudera.org/browse/DISTRO-790 I have set up two clusters that share a Cloudera Manger. The first I set up with the API and created the services with capital letter names, e.g., ZOOKEEPER, HDFS, HIVE. Now, I add the second cluster using the Wizard. Add Cluster->Select Hosts->Distribute Parcels->Select base HDFS Cluster install On the next page i get SQL errros telling that the services i want to add already exist. I suspect that the check for existing service names does n
2 comments
Read more

Zabbix History Table Clean Up

Zabbix history table gets really big, and if you are in a situation where you want to clean it up. Then we can do so, using the below steps. Stop zabbix server. Take table backup - just in case. Create a temporary table. Update the temporary table with data required, upto a specific date using epoch . Move old table to a different table name. Move updated (new temporary) table to original table which needs to be cleaned-up. Drop the old table. (Optional) Restart Zabbix Since this is not offical procedure, but it has worked for me so use it at your own risk. Here is another post which will help is reducing the size of history tables - http://zabbixzone.com/zabbix/history-and-trends/ Zabbix Version : Zabbix v2.4 Make sure MySql 5.1 is set with InnoDB as innodb_file_per_table=ON Step 1 Stop the Zabbix server sudo service zabbix-server stop Script. echo "------------------------------------------" echo " 1. Stopping Zabbix Server &quo
1 comment
Read more

Access Filter in SSSD `ldap_access_filter` [SSSD Access denied / Permission denied ]

Access Filter Setup with SSSD ldap_access_filter (string) If using access_provider = ldap , this option is mandatory. It specifies an LDAP search filter criteria that must be met for the user to be granted access on this host. If access_provider = ldap and this option is not set, it will result in all users being denied access. Use access_provider = allow to change this default behaviour. Example: access_provider = ldap ldap_access_filter = memberOf=cn=allowed_user_groups,ou=Groups,dc=example,dc=com Prerequisites yum install sssd Single LDAP Group Under domain/default in /etc/sssd/sssd.conf add: access_provider = ldap ldap_access_filter = memberOf=cn=Group Name,ou=Groups,dc=example,dc=com Multiple LDAP Groups Under domain/default in /etc/sssd/sssd.conf add: access_provider = ldap ldap_access_filter = (|(memberOf=cn=System Adminstrators,ou=Groups,dc=example,dc=com)(memberOf=cn=Database Users,ou=Groups,dc=example,dc=com)) ldap_access_filter accepts standa
Post a Comment
Read more