Unclear target
Define the outcome and the information available when the system must predict it.
Use historical data to support a specific prediction or classification task. ACW assesses the available evidence, develops the selected model, and tests whether its output is useful enough for the intended workflow.
Contact UsDefine the outcome and the information available when the system must predict it.
Check missing values, inconsistent labels, and gaps between historical records and current use.
Compare the model with an existing rule, simple forecast, or current process before expanding development.
A task and data assessment, including gaps and permitted uses.
A baseline and the model implementation in scope.
Evaluation findings on examples kept separate from development.
Integration and deployment work where included.
Documented limitations and responsibility for monitoring or retraining.
Review sample records, outcome definitions, access rights, and retention requirements. Identify data preparation or labelling work before committing to training.
Develop the selected approach against the baseline. Exclude input features that would be unavailable when a prediction is made.
Examine performance across relevant groups of examples. Agree what happens when inputs are missing, conditions change, or results fall outside accepted limits.
Confirm integration, running cost, operating owner, and checks for changes in input data or performance.
Acceptance should identify the evaluation data, error measures, processing time, and operating cost. Record which situations are unsupported and who reviews them. A good overall score should not hide failure on an important category of cases.
This example describes a possible scope, not an ACW client result.
A model proposes a category for an incoming request. Existing rules handle known cases; ambiguous or unsupported requests go to a person. Evaluation compares routing errors and review effort with the current process before automatic routing is considered.
It depends on the task, available labels, and acceptable error. A sample review establishes whether the current data supports a meaningful test.
A target can guide evaluation. Achievability depends on the data and task; it needs evidence before becoming an acceptance commitment.
The assessment compares suitable existing approaches and a custom model where justified. Training from scratch is not the default.
Tell us the decision, the data available today, and the consequences of an incorrect result.