Benefits of Providing Feedback and Utilisation Metrics to Specialists on Their Participation in eConsult

Figures & data

Figure 1. An example eConsult Specialist Report.

Figure 2. Process for Preparation and Distribution of eConsult Specialist Reports.

Table 1. Survey Questions and Response Options.

Question:	Response Options:
How do you use the feedback report? Please check all that apply.	I do not use it	Iglance at it	I make referenceto itperiodically		I keep a copy for my records	I review in detail	I use it for promotion/  hospital privileges		I review and submit to RCPSC for Section 3 eligible activity credits			Other:______
(2) What do you find to be the most useful components of the report? Please check all that apply.	My utilization data (i.e. number of eConsults, response rate and self-reported billing time)		Impact on Patient Care data (i.e. direct feedback from primary care providers through close-out survey on the outcome for the patient and the effect on need for referral)				Comparison between my data and data from my specialty	Comparison between my data and data from the entire eConsult service	Comparison between data from my specialty and data from the entire eConsult service		Overall eConsult Service data	I don’t know
(3) Please indicate your level of agreement with the following statements:
a. The reports validate the effort I put into answering eConsults	Strongly Disagree		Disagree			Neither Agree norDisagree	Agree		Strongly Agree
b. The information I receive in these reports is surprising.
c. The report reduces the amount of time I spend on answering eConsults.
d. Receiving reports makes me more likely to continue participating in the eConsult service
e. Receiving reports makes me feel like I am providing the advice required.
f. The reports are easy to understand
g. The format I receive the report in is acceptable
h. I would like these reports to continue to be provided on a regular basis
(4) Does the reported median billing time for your specialty influence your billing time for eConsults?	No		Yes, I think I should bill more minutes	Yes, I think I should bill less minutes		Unsure	Option to provide additional comments: __________________________________
(5) Do you have any concerns about the reports? Please check all that apply.	Receiving these reports causes me distress		Receiving these reports makes me feel judged			I am concerned these reports could be used against me by a regulatory body, hospital administration, or other			Other: ________
(6) How often you would like to receive reports?	Never		Every 6 months				Once a year		Other: ________
(7) Is there other information or data you would like to see included on the reports?	Free text comment field
(8) Do you have any additional comments regarding the distribution process, content or format of these reports?	Free text comment field
(9) For what specialty do you provide eConsults?	List of top 20 specializations from distribution list					Other: ____________			Do not wish to disclose
(10) For which service(s) do you provide eConsults? (check all that apply)	Champlain BASE™ (hosted on HealthWorks)					Ontario eConsult Service (hosted on OTNhub)			Not sure
(11) Please indicate which Ontario Health region you are located in.	West		Central			Toronto	East		North	Not Sure

Figure 3. Distribution Workflow MS Power Automate.