The specific shape of a system's dispositional performance — where it is trustworthy, where it breaks down, and under what conditions the difference matters.
A reliability profile is a dispositional concept in the Rylean sense: a characterization of how reliably a system exercises its dispositions across the range of conditions it encounters. Every disposition has a profile — solubility is reliable across most aqueous solutions but fails in saturated ones; a surgeon's diagnostic disposition is reliable for common presentations but may fail for rare ones. The profile is the practical information that matters. It tells the user how much independent verification the system's outputs require, under what circumstances the system can be trusted, and where its limitations demand human compensation. Claude has a specific reliability profile — extremely reliable for fluent prose, highly reliable for working code, notably less reliable for substantive philosophical accuracy, poor at self-correction — and understanding this profile is the practical precondition for productive collaboration.
Reliability Profile
In The You On AI Field Guide
The reliability profile is the empirical content of the dispositional analysis. Once we stop asking whether the machine 'really' thinks and start asking what its behavioral dispositions actually