The Study of AI-Mediated Communication and Socio-Cultural Language-Related Variables: Gmail Reply Suggestions

Figures & data

Figure 1. Process of Email Reply Suggestions (adopted from Strope and Kurzweil 2017).

Table 1. Distribution Frequencies of the Study Sample according to Variables.

Variable	Category	N
Job	Education	583
	Trade	468
	Industry	327
	Health	129
Specialization	Humanities	969
	Sciences	538
Gender	Male	966
	Female	541
Age	Less than 30	285
	Between 31–50	984
	Above 50	238
Total	All	1507

Table 2. Coefficients of Cronbach’s Alpha and Test-retest (Pearson).

Domain	Items	Cronbach’s Alpha coefficient	Re-test (Pearson)
1.Usability	8	0.91	0.93
2. Language	13	0.89	0.90
3. Culture & society	13	0.93	0.91
Overall	34	0.96	0.95

Figure 2. Means and Standard Deviations of Responses.

Table 3. Descriptive Statistics.

Order	Domain	N	M	SD	Level
1	Usability	1507	3.54	.837	High
2	Language	1507	3.24	.417	Medium
3	Culture & society	1507	3.09	.335	Medium
-	Total	1507	3.25	.329	Medium

Table 4. Variance Analysis of Responses according to Job.

		Sum of Squares	df	Mean Square	F	Sig.
Usability	Between Groups	5.788	3	1.929	2.764	.041
	Within Groups	1049.030	1503	.698
	Total	1054.818	1506
Language	Between Groups	.591	3	.197	1.137	.333
	Within Groups	260.666	1503	.173
	Total	261.258	1506
Culture & society	Between Groups	.433	3	.144	1.288	.277
	Within Groups	168.317	1503	.112
	Total	168.749	1506
Overall	Between Groups	.820	3	.273	2.531	.056
	Within Groups	162.353	1503	.108
	Total	163.174	1506

Table 5. Multiple Comparisons - Scheffe.

(I) job	(J) job	Mean Difference (I-J)	Std. Error	Sig.
Education	Trade	.030	.052	.936
	Industry	.160*	.058	.029
	Health	.004	.081	1.000

Table 6. T-Test Analysis of Responses according to Specialization.

Domain	Specialization	N	M	SD	t	df	Sig. (2-tailed)
Usability	Humanities	969	3.66	.742	7.778	1505	.000
	Sciences	538	3.32	.947
Language	Humanities	969	3.18	.420	−.022-	1505	.982
	Sciences	538	3.18	.411
Culture & society	Humanities	969	3.13	.313	9.527	1505	.000
	Sciences	538	2.96	.346
Overall	Humanities	969	3.28	.299	8.294	1505	.000
	Sciences	538	3.13	.360

Table 7. Variance Analysis of Responses according to Age.

		Sum of Squares	df	Mean Square	F	Sig.
Usability	Between Groups	20.086	2	10.043	14.598	.000
	Within Groups	1034.732	1504	.688
	Total	1054.818	1506
Language	Between Groups	2.040	2	1.020	5.919	.003
	Within Groups	259.217	1504	.172
	Total	261.258	1506
Culture & society	Between Groups	1.758	2	.879	7.918	.000
	Within Groups	166.991	1504	.111
	Total	168.749	1506
Overall	Between Groups	2.237	2	1.118	10.451	.000
	Within Groups	160.937	1504	.107
	Total	163.174	1506

Table 8. Multiple Comparisons - Scheffe.

Dependent Variable	(I) age	(J) age	Mean Difference (I-J)	Std. Error	Sig.
		above 50	.305*	.073	.000
	between 31–50	less than 30	.015	.056	.965
		above 50	.320*	.060	.000
	above 50	less than 30	−.305-*	.073	.000
		between 31–50	−.320-*	.060	.000
Language	less than 30	between 31–50	−.092-*	.028	.004
		above 50	−.100-*	.036	.024
	between 31–50	less than 30	.092*	.028	.004
		above 50	−.008-	.030	.969
	above 50	less than 30	.100*	.036	.024
		between 31–50	.008	.030	.969
Culture & society	less than 30	between 31–50	−.086-*	.022	.001
		above 50	−.042-	.029	.364
	between 31–50	less than 30	.086*	.022	.001
		above 50	.044	.024	.183
	above 50	less than 30	.042	.029	.364
		between 31–50	−.044-	.024	.183
Overall	less than 30	between 31–50	−.071-*	.022	.005
		above 50	.019	.029	.795
	between 31–50	less than 30	.071*	.022	.005
		above 50	.091*	.024	.001
	above 50	less than 30	−.019-	.029	.795
		between 31–50	−.091-*	.024	.001

Table 9. T-test Analysis of Responses according to Gender.

	Gender	N	M	SD	t	df	Sig. (2-tailed)
Usability	male	966	3.49	.858	−3.122-	1505	.002
	female	541	3.63	.790
Language	male	966	3.19	.424	.960	1505	.337
	female	541	3.16	.404
Culture & society	male	966	3.04	.343	−4.275-	1505	.000
	female	541	3.12	.314
Overall	male	966	3.21	.329	−3.021-	1505	.003
	female	541	3.26	.328

Table 10. Pearson Correlation between Usability and Language.

		Usability	Language
Usability	Pearson Correlation	1	−.108-**
	Sig. (2-tailed)		.000
	N	1507	1507

Table 11. Pearson Correlation between Usability, and Culture and Society.

		Usability	Culture & society
Usability	Pearson Correlation	1	.487**
	Sig. (2-tailed)		.000
	N	1507	1507
Culture	Pearson Correlation	.487**	1
	Sig. (2-tailed)	.000
	N	1507	1507

Note: **. Correlation is significant at the 0.01 level (2-tailed).

Figure 3. Use categories of e-mail reply suggestions.

Figure 4. Useful Perspectives of E-mail Reply Suggestions.

Strope, B., and R. Kurzweil. 2017. Efficient Smart Reply, now for Gmail. Retrieved from https://ai.googleblog.com/2017/05/efficient-smart-reply-now-for-gmail.html

 Google Scholar