Configuring a Metrics Scorecard

A metrics scorecard is a special type of metric in that it typically contains a collection of other metrics/scores. The configuration tool allows you to experiment with weights and thresholds for each metric that will contribute to the total score, allowing you to visualize how your point system affects your actual fleet data.

Not sure what to measure? Consider planning your scorecard goals before getting your feet wet.

You can only see vehicle data for the groups/hierarchies that you are allowed to see; however, you can see all scorecards that other users have created. Use caution when editing the properties of another user’s scorecard without their knowledge.

Example
The corporate fleet manager at Company XYZ wants to implement a scoring system for aggressive driving, which includes posted speed events (11MPH over), acceleration events (.45g), and deceleration events (.45g). He wants to score his fleet on a monthly basis to isolate regions who need the most coaching.

Add a Metrics Scorecard

A metrics scorecard is not required in order to create a Vehicle Scorecard metric. It’s a visualization tool that allows you to experiment how different weights and thresholds apply to actual data in your fleet so that you can set realistic baselines.

To add a metrics scorecard:

  1. From the portal, hover over the More menu, click Manage Metrics, and click Scorecard Configuration Tool.

The Scorecard Configuration Tool page opens in a new browser tab.

  1. From the New Scorecard window, enter a Name for the Scorecard. (We used “Aggressive Driving.”)

  1. Add the metrics you want to include in the scorecard (i.e., Count Speeding Events, Count Acceleration Events, and Count Deceleration Events).

The available metrics to use here may not reflect all of the available metrics to use. If a metric is not listed, you’ll need to manually create the Scorecard metric using the Metrics Manager.

  1. For each metric, click Edit to modify the properties. The first thing you should do is edit the name to be meaningful. Other edits you can make include clicking on the scale to add another range value. Click a color to modify the color ranges to suit your preferences. In this example, a high score is desirable (i.e., fewer speeding events above 11MPH posted).

The number of events you use for your thresholds apply to ONE vehicle per DAY. In this example, we’re saying that one vehicle triggering 6+ speeding events per day is still worthy of 34 points. If it’s easier to define thresholds for a longer time period, you can adjust the date range above the scorecard. If you do, you are still setting thresholds that apply to ONE vehicle, but it can be for one WEEK or one MONTH (or whatever range you choose). If you do change the date range, be sure to click reset score under each metric to auto-calculate a range based on current worst/best. Keep in mind, however, that you should base your lowest score on YOUR preferences for acceptability rather than what your worst driver happens to define.

  1. Click Done when finished modifying the preferences for each metric.
  2. Click the weight for each metric to adjust the percentage toward the total score. For example, you might want speeding to impact the score more heavily that accel/decel events.

All percentages in the scorecard should total 100%.

  1. Click Save Edits. (Do NOT click Save Scorecard yet.)

The data in the report updates based on the settings in the scorecard. To modify the data used in the report, adjust the vehicle Group, Date Range, Average/Sum option, and Show Unutilized Vehicles option.

Data must process for each day for each vehicle included in the date range each time you change settings in your scorecard. It’s often best to experiment with weights and thresholds on a subset of vehicle (e.g., one hierarchy branch or group) rather than the entire fleet. If you change the date range, you should reset the thresholds (or manually adjust) that you applied in step 4 to reflect the days in the range.

In the Company XYZ example, the points assigned to the various thresholds in each metric provide an overall fleet score of 74 (sorted by lowest Final Score). From here, you can decide if you want to adjust thresholds or if you’re satisfied with this baseline.

img_579f79e3a3383

Additionally, you can use the Quick Overview at the top of the page to view the scorecard using various chart types: Overall Combined, Line, Stacked, Overall, and Count (for each event on scorecard).

img_579f7a954a982

Save Metric Score

When you’re satisfied with the scorecard you created, you can save the metric scores that make up the scorecard. Once you click Save Scorecard, you can edit the weights on the scorecard after clicking Save Edits without affecting the metric score or creating any new custom metrics; however, if you modify the weights or any of the settings within each metric after clicking Save Scorecard, a new metric score will be created each time.

You can only see vehicle data for the groups/hierarchies that you are allowed to see; however, when you save a scorecard, the portal generates metrics for all vehicles in the account (even if you can’t see that data) for the date(s) specified. In other words, if the saving process is taking longer than you’d expect, keep in mind that the process may be running against a much larger data set than you can view. Similarly, if other users create scorecards, metrics for your vehicles will also automatically be back-filled for the date specified at the time of the save.

To save metric scores:

  1. From the Scorecard Configuration Tool, use the Scorecard drop-down to open the scorecard you finished editing.
  2. Click Save Scorecard.

The new metric score will be listed in the Active Custom Metrics grid on the Manage Custom Metrics page. By default, Vehicle Scorecard metrics are automatically available for reporting.

 

View the Scorecard in Reports

After you create a scorecard, you can view it in report format in two places: The Metrics Reports (dynamic report) or the Metrics Scorecard Report (traditional report). It’s highly encouraged to use Metrics Reports to view scorecard data so that you can better visualize trends and drill deeper into the data. It’s considered an Executive Dashboard.

Metrics Scorecard Report (traditional)

The Metrics Scorecard report shows scores based on summarization data from the previous day. Metrics are calculated overnight for the day prior (12:00 AM – 11:59 PM).

To run a Metrics Scorecard report:

  1. From the dashboard, click the Reports menu, and click Metrics Scorecard.
  2. Choose the Group of vehicles to include in the report.
  3. Choose the Scorecard metric to apply to the report. (We chose “Vehicle Scorecard Aggressive Driving.”)
  4. Click Run Report.

The report opens in a new browser tab.

img_56e840ee83eb0

If you plan to use this data to compare trends over time, export the report to Excel. The next time you run the report for another date range, you can export the data again and compare it to the first export.