Engage - Reporting & Insights

This article describes how to use reporting and summary boards in Engage, for Training & Compliance Watchlist, User Performance and Efficacy reports. It is intended for Administrators.

Metrics for Test Campaigns are not included in Compliance Center tables and reports.

Introduction

The Reporting & Insights section contains the Training & Compliance Watchlist, User Performance and Efficacy reports.

• The Training & Compliance Watchlist and User Performance tables are accessed through the Compliance Center.
• This also includes a User Record drill-down view for both the Training & Compliance Watchlist and User Performance tables.
• The Efficacy graphs can be viewed via the new Efficacy Report.

Key features include:

• A granular approach, making it easier to search, filter and aggregate data across any linked directory attribute.
• A Filter fly-out menu.
• PDF reporting available directly in the console without needing to convert raw data into XLSX format.

There are summary boards in the Compliance Center:

• User Performance and Training & Compliance Watchlist tables show enhanced trend analytics behavior.
• These tables display interactive graphs, for easy "at-a-glance" key performance reporting.

Graphs in the Efficacy Report give a summary of the efficacy of the training based on your employee’s behavior towards threats. This displays interactive graphs for easy "at-a-glance" key performance reporting and allows you to see the impact of Engage, and provide helpful benchmarking against other Mimecast customers.

Prerequisites

• Engage enabled in your Mimecast account.
• You log in to Mimecast as a Basic Administrator (at a minimum).  
• You have linked attributes (e.g., Department, Location, Company, Supervisor) via the Mimecast Administration Console.

Compliance Center

You can access the Compliance Center by using the following steps:

1. Log in to Engage.

2. Navigate to Reporting & Insights | Compliance Center.

    
3. The Compliance Center displays high-level trended and consolidated monthly breakdown of the Training & Compliance Watchlist and User Performance data:

• The Training & Compliance Watchlist Summary graph shows the percentage of recorded users presently on the Training & Compliance Watchlist, and you can overlay data for up to three departments to view trends.
• The Company Wide User Performance Summary graph shows trends in assignments sent to participating employees and assignment completion.

Training & Compliance Watchlist

You can access the Training & Compliance Watchlist by using the following steps:

1. Log in to Engage.
2. Navigate to Reporting & Insights | Compliance Center.

3. Click on Watchlist Details.

    

•  
  • The top-level stats section aggregates and highlights data to give a high-level overview of the Training & Compliance Watchlist table. This will update continuously as you apply filters.
  • The Training & Compliance Watchlist table displays employees who have not completed their assignments within four weeks. 

4. You can customize the reporting columns by clicking on the gear icon. The logged-in Admin user's preferences are saved for this table using a cookie.

      

5. Click on the Filter button and use the Filter fly-out menu to filter values by up to ten unique attributes, and click on Apply to apply the filter. The reporting data will update, including the top-level stats.

      
6. Click on Search to search the whole query list by user name or user's email address.

7. Click on Report to create a report based on your filtered data/search criteria. You can then click on Generate PDF to download the report.

    
8. Select a row to view user record details for the user:

• Summary and details are shown for the user's performance.

 

•  
  • You can then click on Generate PDF to download the report, which includes Training Performance and Phishing Performance.

User Performance

You can access the User Performance Details by using the following steps:

1. Log in to Engage.
2. Navigate to Reporting & Insights | Compliance Center.

3. Click on User Performance Details.

      

• The top-level stats section aggregates and highlights data to give a high-level overview of the User Performance table. This will update continuously as you apply filters.
• The User Performance table displays a list of employees and their engagement patterns across all of their assignments.

4. You can use the same features in User Performance as for the Training & Compliance Watchlist:

• Customize the reporting columns, and preferences are saved for this table.
• Use the Filter fly-out menu to filter values by up to ten unique attributes, and click on Apply to apply the filter. The reporting data will update, including the top-level stats.
• Click on Search to search the whole query list by user name or user's email address.
• Click on Report to create a report based on your filtered data/search criteria. You can then click on Generate PDF to download the report.

 

•  
  • Select a row to view user record details for the selected user, then Generate PDF to save (which includes Training Performance and Phishing Performance).

 

Exporting Raw Data

Exported Raw Data is available for download only in Excel spreadsheet format (XLSX file), ensuring compatibility for analysis.

You can access the Export Raw Data, by using the following steps:

1. Log in to Engage.
2. Select Reporting & Insights | Compliance Center.
3. Click on User Performance Details.

 

4. Click on Export Raw Data.

 

Efficacy Report

You can access the Efficacy Report by using the following steps:

1. Log in to Engage.

2. Navigate to Reporting & Insights | Efficacy Report.

    
3. The Efficacy  Report displays interactive graphs that show the efficacy of the training based on your employee’s behavior towards threats and allow you to compare your company against your industry and other companies without Engage.

• Dangerous URL Clicks:  This shows end-user dangerous URL clicks observed by Mimecast Email Security. The numbers displayed on the graph represent the total number of clicks divided by the total number of end user licenses at the time of calculation.
• Reported Messages: This shows end-user reported messages observed by Mimecast Email Security. The numbers displayed on the graph represent the total number of reported messages divided by the total number of end user licenses at the time of calculation.
• Phishing Campaign Clicked Comparison: This shows end-user phishing simulation clicks for the campaigns run during the selected timeframe. The bars displayed on the graph represent the percentage of employees who clicked the phishing URL link for the corresponding campaign.
• Phishing Campaign Reported Comparison: This shows end-user reported messages for phishing simulation during the selected timeframe. The bars displayed on the graph represent the percentage of employees who reported the phishing simulation for the corresponding campaign.

4. Click on Report to create a report based on your filtered data/search criteria. You can then click on Generate PDF to download the report.

• The Dangerous URL Clicks graph offers industry benchmarking as well as comparisons against customers without Engage. This provides a control group against which you can understand and contextualize the impact of security awareness.
• The Phishing Campaign Click Comparison and Phishing Campaign Reported Comparison graphs provide benchmarking against Engage customers.