Database archiving and maintenance in OpManager

Following are some of the database operations that can be carried out with OpManager.

1. Database archiving:

To effectively monitor the devices added to OpManager, and visualize their metrics in a user-friendly format, OpManager collects data from the managed devices at regular intervals. By default, OpManager collects the performance data as per the polling interval stored in a database and this is known as detailed statistics. The data is then aggregated at hourly intervals and is known as hourly statistics. The hourly data aggregated at daily intervals are known as daily statistics. These aggregated data as well as the raw data will be used in graphs and reports.

The process of aggregating data at each stage and moving them to the subsequent tables is known as database archiving.

How database archiving impacts report generation

Based on the database archiving, monitoring data will be stored in the hourly table as well as in the daily table.

Hourly data for a particular hour (say 12:00 AM to 1:00 AM) is calculated based on the configured polling interval. If the configured polling interval is 5 minutes, for each hour (sixty minutes) OpManager would have polled the device 12 times (12*5=60 minutes).

Then the average of the 12 values (got after 12 polls) will be calculated and stored as the hourly data for that particular hour. Likewise, for each hour the data will arrive.

For the daily table, the data for any particular day is generated by calculating the average value of the hourly data of that day.

Daily data = Sum of hourly data/24

While generating a report the data is taken from the hourly or daily table based on the duration for which the report is requested.

How a report generated using hourly table data

Based on the monitoring preferences users can modify the maintenance period of hourly table and daily table.

When a report is requested, the data will be taken either from the hourly or daily table considering the following two factors:

  • Configured period for hourly table maintenance
  • Report coverage period (Period for which the report is requested)

In general, the algorithm used is, if the period for which the report is requested is equal to or higher than the configured hourly table maintenance period, then the data will be taken from the daily table. If the report period is less than the hourly stats maintenance period, the data will be generated from the hourly table.

For example, let us consider that the configured period for hourly table maintenance is 30.

For 30 or less than 30 days

When a report is generated for 30 or less than 30 days, the data will be fetched from the hourly table and presented as a report.

For more than 30 days

When a report is generated for more than 30 days, the data is fetched from the daily table.

  • Report coverage period > Hourly table maintenance period ==> Generate report with daily table
  • Report coverage period < Hourly table maintenance period ==> Generate report with hourly table data

Please note that when the data is taken from the daily table, the time window option will not be available. The time window option will appear only for the hourly table data.

2. Database maintenance:

OpManager allows you to maintain the database with the required data. By default, the detailed data will be maintained for 7 days, the hourly data for 30 days and the daily data for 365 days. After the specified period, the database will be cleaned up automatically.

Database maintenance can be carried out by archiving the data and cleaning them up at regular intervals. Navigate to General settings -> Settings -> Database maintenance to avail this feature and define the values suited to you. Once past the deadline, OpManager will remove the archaic statistics data.

Why should we maintain database in OpManager?

The database size might vary based on a lot of factors such as number of monitors, number of instances in a monitor, polling interval, number of managed devices and interfaces etc. Hence it is of utmost importance to maintain your database. When the database maintenance values have been configured with higher values, more disk space might be required, thereby leading to performance-impacting issues. Kindly refer the below table for recommended values.

Values Raw data (Detailed data) Hourly data Daily data
Default Values(Days) 7 30 365
Maximum Recommended values(Days) 15 90 3650
NOTE: Kindly refrain from defining values greater than the recommended levels. Get in touch with our support team in case you need to assign values greater than the recommended levels.

How to configure database maintenance in OpManager?

To configure your own settings for database maintenance, follow the steps given below:

  1. Click Settings → General Settings → Database Maintenance.
  2. Specify the values for the following fields:
    • Maintain recent alarms in the database - the maximum number of recent alarms to be maintained must be specified here. By default, the recent 10,000 alarms will be maintained in the OpManager database.
    • Events will be maintained for the last N days - By default, 15 lakh events will be stored in a table in OpManager's database. If the table exceeds 15 lakh entries, a new table will be created, and the old data will be deleted after 7 days .
    • Detailed statistics will be maintained for the last N days -represents the number of days upto which the detailed data will be stored in the OpManager database.
    • Hourly statistics will be maintained for the last N days - represents the number of days upto which the hourly data will be stored in the OpManager database.
  3. Click Save to apply the changes.

Database maintenance in OpManager

 

Graph display settings

To maintain the granularity/ accuracy of data in a graph, graph display settings can be configured accordingly. You can access the graph display settings by navigating to Database maintenance -> Run Archive -> Graph display settings. The detailed, hourly and daily data limits give users some control over their desired granularity level of the graph. The graphs thus formed can be further studied to get insights into the performance of a device as well as an interface. To know more about graph display settings, kindly click here.

NOTE: The data used for displaying performance graphs will be controlled by both the Database Maintenance Settings and the Graph Display Settings. It is recommended that the values provided in Graph Display Settings are less than the corresponding value in Database Maintenance settings to ensure graphs are displayed properly.

For example, let's say that the Detailed statistics retention time in the database maintenance is set to 15 days and the Detailed statistics retention limit in the Graph Display Settings is set to 6 days. Then, the data fetched during the selected interval will be populated with detailed data points for days less than or equal to 6. For the rest of the days, the data will be populated with hourly data points.

3. Database cleanup

A huge database with a lot of records will be difficult to maintain and interpret owing to its size. Hence database must be cleaned up periodically. The data will be cleaned up automatically based on the value configured under database maintenance.

Thank you for your feedback!

Was this content helpful?

We are sorry. Help us improve this page.

How can we improve this page?
Do you need assistance with this topic?
By clicking "Submit", you agree to processing of personal data according to the Privacy Policy.