Auto Finetune

Auto Finetune analyses the alerts that WebOrion raised for your webpages over a period you choose, looks for changes that keep repeating, and turns them into suggestions that you review and apply in a few clicks. It automates the manual tuning described in Reducing False Positives: setting element-count thresholds and adding do-not-monitor rules to policies. Auto Finetune produces two kinds of suggestions:

​

How suggestions are generated

1. WebOrion counts the alerts raised for each webpage within the analysis window. Only webpages that raised at least as many alerts as the Alert Threshold are analysed.
2. For each analysed webpage, WebOrion compares the changes detected across its alerts:
   • Element counts — Href Links, Images, Javascripts, Cascading Style Sheets, Iframes, Divisions, Forms, and # of HTML Lines. The change amount that appears most often becomes the suggested threshold.
   • Integrity elements — individual scripts, stylesheets, images, and links. Elements that changed in at least the Frequency threshold percentage of alerts become do-not-monitor rule suggestions.
3. Suggestions are grouped by domain and by policy, so you can apply related changes together.

Every analysis, whether one-time or scheduled, uses the following settings.

​

Run a one-time analysis

1. Go to Auto Finetune → Run / Schedule. The Run Once tab is selected by default.
2. Set the Start datetime and End datetime of the analysis window. The window defaults to the previous day, can span at most 7 days, and can’t end in the future.
3. Adjust the Alert Threshold and Frequency threshold, or keep the defaults.
4. Under Email Notification Contact Group, select the group to notify when the results are ready.
5. Click Enqueue Suggest.

WebOrion queues the job and shows a confirmation with a View details link. Results are usually ready within a few minutes, depending on how many alerts fall within the window.

​

Schedule recurring analyses

A schedule runs the analysis automatically and creates a new suggestion report each time.

1. Go to Auto Finetune → Run / Schedule and select the Schedule tab.
2. Under Create New Schedule, select a Frequency: Daily or Weekly. For a weekly schedule, also select the Day of Week.
3. Set the Time at which the analysis runs.
4. Enter the Lookback amount and select the Lookback unit: from 1 to 168 hours, or from 1 to 7 days. Each run analyzes the period that ends at the run time and starts that far back. For example, a daily schedule with a lookback of 24 hours analyzes the previous 24 hours.
5. Adjust the Alert Threshold, Frequency threshold, and Email Notification Contact Group.
6. Click Create Schedule.

The schedule appears under Active Schedules, together with its Next Run, Last Run, and Next Analysis Window. To change a schedule, click the pencil icon, edit the fields, and click Save. To remove a schedule, click the trash icon and confirm with Yes.

​

Review a suggestion report

Go to Auto Finetune → Suggestions to see every analysis run, one-time and scheduled, with its Job ID, Status, Analysis window, and Created and Completed times. You can search by job ID, filter by date range, and filter by status. The list refreshes automatically while jobs are in progress. Click a Job ID, or click ⋮ → View Detail, to open the report. To remove reports you no longer need, click ⋮ → Delete on a row, or select several rows and click Delete Selected. You can delete up to 50 reports at a time, and only reports with the Completed or Failed status. Deleting a report doesn’t undo changes you already applied from it.

​

Report summary

The report header shows the job’s settings and outcome: the analysis window, the Alert Threshold and Frequency threshold used, and Total URLs, the number of webpages that met the Alert Threshold and were analyzed. The Suggestion review card summarizes what was found:

• Threshold Suggestions — the number of threshold changes suggested and the number of webpages they affect.
• Do-not-monitor items — the number of policy rules suggested and the number of webpages they cover.
• Coverage — how many of the analyzed webpages received at least one suggestion.

Below the summary are two tabs, Threshold and Do not monitor, where you review and apply the suggestions.

​

Why some suggestions start unchecked

Auto Finetune pre-selects the suggestions that are safe to apply as they are, and leaves the rest unchecked. You can still select an unchecked suggestion manually.

​

Apply threshold suggestions

On the Threshold tab, suggestions are grouped by domain. Within a domain, webpages that share the same suggestions are grouped into Suggestion Group 1, Suggestion Group 2, and so on. Each group lists its Affected URLs and a table of suggestions: To apply threshold suggestions:

1. Expand a domain, then expand a suggestion group.
2. Check the rows you want to apply and uncheck the rest. Use Select all at the top of the tab to select every suggestion in the report.
3. Optionally, change the New Threshold value of a row.
4. Click Apply N suggestion(s) within the group to apply that group only, or click the same button at the bottom of the tab to apply every selected suggestion in the report.
5. Click Apply to confirm.

WebOrion sets each affected webpage’s threshold to the New Threshold value, replacing the current value. Webpages that are archived, or where that element’s check or the Content Engine is turned off, are skipped and listed in the confirmation message.

​

Apply thresholds to related webpages

When a group has at least one selected suggestion, an Apply to related URLs panel appears below it. Use it to extend the selected values to other webpages as minimum thresholds:

• Apply to domain applies the values to every webpage on the same domain. A leading www. is ignored when matching.
• Apply to tag applies the values to every webpage with the selected tag. If the affected webpages have several tags, choose one from the list first.

Minimum thresholds only raise values. A webpage whose threshold is already at or above the selected value is left unchanged.

​

Apply do-not-monitor suggestions

The Do not monitor tab turns recurring integrity changes into policy rules. Because each webpage can have only one policy, suggestions are grouped by policy:

• Policy name (N) — webpages that already have a policy. Only rules that the policy doesn’t contain yet are listed, under New Rules to Add.
• New policy (N URLs) — webpages without a policy. The rules are listed under Rule List.

Each rule has an Element, Condition, Keyword, and Action, the same fields as a rule you add manually. Rules whose keywords share a common prefix are collapsed into a single row labeled N matching rules. Edit the keyword on that row to apply one broader keyword to every rule in the group, or expand the row to see the individual elements and the code snippets where they occurred. To apply do-not-monitor suggestions:

1. Select the tab of the policy you want to update.
2. Review the rules. Click the remove icon on a row to drop it from the selection, or the undo icon to restore it. Edit the Keyword where a more specific or more general match is appropriate. Use Select all at the top of the tab to select every rule in the report.
3. Apply the rules:
   • For an existing policy, click Apply N rule(s) to add the selected rules to the policy immediately, then click Apply to confirm. The policy’s existing rules, webpages, and settings are preserved. To review the policy before saving, click Open Policy and Add Rules instead: the policy editor opens in a new tab with the rules added, and you click Save there.
   • For webpages without a policy, click Create Policy with Suggested Rules. The Add Policy page opens with the rules and the affected webpages pre-filled. Enter a policy name and click Save.

To add the selected rules to all existing policies in the report at once, click Apply N item(s) at the bottom of the tab. New policies are always created through the Add Policy page.

​

Finetune from a single alert

You can also generate suggestions from one alert, without running an analysis.

1. Go to Alerts and open the alert.
2. Click Adjust Finetuning.

The Adjust Finetuning dialog shows two tabs based on the changes detected in that alert:

• Threshold lists the element counts that changed. The Alert Value, the change detected in this alert, is used as the New Threshold, so an identical change no longer triggers an alert. Select the rows to apply and click Apply N threshold(s). The Apply to related URLs panel works the same way as in a report.
• Do not monitor lists the integrity elements that changed, as rules for the webpage’s policy or for a new policy. Review the rules, then click Open Policy and Add Rules or Create Policy with Suggested Rules.