The breakout box it states: Quick data gathering and analysis can provide the basis for later rigorous evaluations.
Studies on telehealth and remote home visiting show it is feasible to collect and analyze data on virtual human services.
Programs can identify outcomes of interest and corresponding data sources to inform program management decisions.
Measurement strategies can be used even after virtual services begin
|Outcome of Interest||Example Data Sources|
|Service utilization||Administrative data on service usage|
|Technology skills and comfort||Participant / provider surveys; staff-reported participant outcomes|
|Participant satisfaction||Surveys during and/or after intervention|
|Provider satisfaction||Interviews (Information technology staff, administrators, case managers)|
|Provider-participant relationship||Participant and provider surveys; enrollment data|
|Cost-effectiveness||Per-person annual program costs/savings|
|Participant outcomes||Staff direct observation (e.g. of coping skills); participant self-reports (e.g. anxiety, income); parent reports of children’s outcomes|
|Program design and implementation||Focus groups with private / public stakeholders; program reports and documentation|
Where possible, compare data from before and after services went virtual.
Return to Measuring the Effectiveness of Virtual Human Services page.