Performance assessment of primary health care services using data envelopment analysis and the quality-adjusted malmquist index

References

• Adang, E. M. M., Gerritsma, A., Nouwens, E., Lieshout, J., & Wensing, M. (2015). Efficiency of the implementation of cardiovascular risk management in primary care practices: An observational study. Implementation Science, 11(1), 67. https://doi.org/10.1186/s13012-016-0434-2
   Google Scholar
• Alfradique, M. E., Bonolo, P. F., Dourado, I., Lima-Costa, M. F., Macinko, J., Mendonça, C. S., Oliveira, V. B., Sampaio, L. F. R., Simoni, C., & Turci, M. A. (2009). Internações por condições sensíveis à atenção primária: A construção da lista brasileira como ferramenta para medir o desempenho do sistema de saúde (Projeto ICSAP - Brasil). Cadernos De Saúde Pública, 25(6), 1337–1349. https://doi.org/10.1590/S0102-311X2009000600016
   PubMedGoogle Scholar
• Allen, R., Athanassopoulos, A., Dyson, R. G., & Thanassoulis, E. (1997). Weights restrictions and value judgements in Data Envelopment Analysis: Evolution, development and future directions. Annals of Operations Research, 73, 13–34. https://doi.org/10.1023/A:1018968909638
   Web of Science ®Google Scholar
• Amado, C. A. E. F., & Dyson, R. G. (2008). On comparing the performance of primary care providers. European Journal of Operational Research, 185(3), 915–932. https://doi.org/10.1016/j.ejor.2006.02.052
   Web of Science ®Google Scholar
• Amado, C. A. E. F., & Dyson, R. G. (2009). Exploring the use of DEA for formative evaluation in primary diabetes care: An application to compare English practices. Journal of the Operational Research Society, 60(11), 1469–1482. https://doi.org/10.1057/jors.2008.160
   Web of Science ®Google Scholar
• Amado, C. A. E. F., & Santos, S. P (2009). Challenges for performance assessment and improvement in primary health care: The case of the Portuguese health centres. Health Policy, 91(1), 43–56. https://doi.org/10.1016/j.healthpol.2008.11.008
   PubMed Web of Science ®Google Scholar
• Andersen, P., & Petersen, N. C. (1993). A procedure for ranking efficient units in data envelopment analysis. Management Science, 39(10), 1261–1264. https://doi.org/10.1287/mnsc.39.10.1261
   Web of Science ®Google Scholar
• Araújo, A. B. G., Silva, C. M., Marcelino, E. M., Silva, J. K. A., Brandão, G. C. G. (2016). Atenção Primária à Saúde em municípios de pequeno porte: Como acontece o processo de trabalho em saúde? Anais I CONBRACIS. Retrieved March 10, 2021, from https://editorarealize.com.br/artigo/visualizar/18939
   Google Scholar
• Banker, R. D. (1996). Hypothesis tests using data envelopment analysis. Journal of Productivity Analysis, 7(2–3), 139–159. https://doi.org/10.1007/BF00157038
   Web of Science ®Google Scholar
• Banker, R. D., & Chang, H. (2006). The super-efficiency procedure for outlier identification, not for ranking efficient units. European Journal of Operational Research, 175(2), 1311–1320. https://doi.org/10.1016/j.ejor.2005.06.028
   Web of Science ®Google Scholar
• Banker, R. D., & Gifford, J. L. (1988). A relative efficiency model for the evaluation of public health nurse productivity. Carnegie Mellon University.
   Google Scholar
• Bates, J. M., Baines, D., & Whynes, D. K. (1996). Measuring the efficiency of prescribing by general practitioners. Journal of the Operational Research Society, 47(12), 1443–1451. https://doi.org/10.1057/jors.1996.188
   Web of Science ®Google Scholar
• Brasil. (1997). Saúde da Família: uma estratégia para a reorientação do modelo assistencial. Ministério da Saúde.
   Google Scholar
• Brasil. (2011). Índice de Desempenho do Sistema Único de Saúde (IDSUS). Ministério da Saúde. Retrieved August 9, 2020 from http://idsus.saude.gov.br/index.html
   Google Scholar
• Brasil. (2015). Programa mais médicos - dois anos mais saúde para os brasileiros. Ministério da Saúde.
   Google Scholar
• Brasil, V. P., & Costa, J. S. D. D. (2016). Hospitalizações por condições sensíveis à atenção primária em Florianópolis, Santa Catarina - estudo ecológico. De 2001 a 2011. Epidemiologia e Serviços De Saúde, 25(1), 75–84. https://doi.org/10.5123/S1679-49742016000100008
   Google Scholar
• Brinckmann, R., Heinzen, K. H., Andrett, M. C. S., & Pfitscher, E. D. (2019). Análise de Eficiência dos Gastos Públicos com Saúde dos Municípios de Santa Catarina entre 2008 e 2014. Contabilometria - Brazilian Journal of Quantitative Methods Applied to Accounting, 6(2), 77–91.
   Google Scholar
• Cabral, K. F. D., Batista, R. S., Ferreira, M. A. M., & Cerqueira, F. R. (2016). Análise da eficiência na atenção primária à saúde sob a ótica dos profissionais da área. Revista De Gestão Em Sistemas De Saúde, 5(2), 71–83. https://doi.org/10.5585/rgss.v5i2.263
   Google Scholar
• Cabral, K. F. D., Ferreira, M. A. M., Batista, R. S., & Cerqueira, F. R. (2019). Atenção primária à saúde: Uma análise a luz da eficiência técnica dos recursos no Estado de Minas Gerais. Revista De Gestão Em Sistemas De Saúde, 8(2), 137–150. https://doi.org/10.5585/rgss.v8i2.14923
   Google Scholar
• Campos, G. W. S. (2007). Reforma política e sanitária: A sustentabilidade do SUS em questão? Ciencia & Saude Coletiva, 12(2), 301–306. https://doi.org/10.1590/S1413-81232007000200002
   PubMedGoogle Scholar
• Caves, D., Christensen, L., & Diewert, W. E. (1982). The economic theory of index numbers and the measurement of input, output, and productivity. Econometrica, 50(6), 1393–1414. https://doi.org/10.2307/1913388
   Web of Science ®Google Scholar
• Charnes, A., Cooper, W. W., & Rhodes, E. L. (1978). Measuring the efficiency of decision making units. European Journal of Operational Research, 2(6), 429–444. https://doi.org/10.1016/0377-2217(78)90138-8
   Web of Science ®Google Scholar
• Cordero, J. M., Alonso-Morán, E., Nuño-Solinis, R., Orueta, J. F., & Arce, R. S. (2015). Efficiency assessment of primary care providers: A conditional nonparametric approach. European Journal of Operational Research, 240(1), 235–244. https://doi.org/10.1016/j.ejor.2014.06.040
   Web of Science ®Google Scholar
• Cordero-Ferrera, J. M., Cebada, E. C., & Zamorano, L. R. M. (2014). The effect of quality and socio-demographic variables on efficiency measures in primary health care. The European Journal of Health Economics, 15(3), 289–302. https://doi.org/10.1007/s10198-013-0476-1
   PubMed Web of Science ®Google Scholar
• Curtin, L. R., & Klein, R. J. (1995). Direct Standardization (Age-Adjusted Death Rates). Healthy People 2000 Statistical Notes (No. 6). US Department of Health and Human Services, Public Health Service, Centers for Disease Control and Prevention, National Center for Health Statistics.
   Google Scholar
• Donabedian, A. (1980). The definition of quality and approaches to its assessment. Explorations in quality assessment and monitoring volume 1. Health Administration Press.
   Google Scholar
• Dourado, I., Oliveira, V. B., Aquino, R., Bonolo, P., Lima-Costa, M. F., Medina, M. G., Mota, E., Turci, M. A., & Macinko, J. (2011). Trends in primary health care-sensitive conditions in Brazil: The role of the family health program (Project ICSAP-Brazil). Medical Care, 49(6), 577–584. https://doi.org/10.1097/MLR.0b013e31820fc39f
   PubMed Web of Science ®Google Scholar
• Dyson, R. G., & Thanassoulis, E. (1988). Reducing weight flexibility in data envelopment analysis. Journal of the Operational Research Society, 39(6), 563–576. https://doi.org/10.1057/jors.1988.96
   Web of Science ®Google Scholar
• Facchini, L. A., Piccini, R. X., Tomasi, E., Thumé, E., Silveira, D. S., Siqueira, F. V., & Rodrigues, M. A. (2006). Desempenho do PSF no Sul e no Nordeste do Brasil: Avaliação institucional e epidemiológica da Atenção Básica à Saúde. Ciência & Saúde Coletiva, 11(3), 669–681. https://doi.org/10.1590/S1413-81232006000300015
   Google Scholar
• Färe, R., Grosskopf, S., Lindgren, B., & Roos, P. (1992). Productivity changes in swedish pharamacies 1980-1989: A non-parametric malmquist approach. Journal of Productivity Analysis, 3(1-2), 85–101. https://doi.org/10.1007/BF00158770
   Google Scholar
• Färe, R., Grosskopf, S., Lindgren, B., & Roos, P. (1994). Productivity developments in Swedish hospitals: A malmquist output index approach. In Data envelopment analysis: Theory, methodology, and applications (pp. 253–272). https://doi.org/10.1007/978-94-011-0637-5_13
   Google Scholar
• Färe, R., Grosskopf, S., & Roos, P. (1995). Productivity and quality changes in Swedish pharmacies. International Journal of Production Economics, 39(1-2), 137–144. https://doi.org/10.1016/0925-5273(94)00063-G
   Web of Science ®Google Scholar
• Farrell, M. J. (1957). The measurement of productive efficiency. Journal of the Royal Statistical Society. Series A (General), 120(3), 253–290. https://doi.org/10.2307/2343100
   Web of Science ®Google Scholar
• Ferreira, D. C., & Marques, R. C. (2019). Do quality and access to hospital services impact on their technical efficiency? Omega, 86, 218–236. https://doi.org/10.1016/j.omega.2018.07.010
   Web of Science ®Google Scholar
• Ferreira, C., Marques, R. C., & Nicola, P. (2013). On evaluating health centers groups in Lisbon and Tagus Valley: Efficiency, equity and quality. BMC Health Services Research, 13(1), 1–17. https://doi.org/10.1186/1472-6963-13-529
   PubMedGoogle Scholar
• Gill, J. M., & Mainous, A. G. (1998). The role of provider continuity in preventing hospitalizations. Archives of Family Medicine, 7(4), 352–357. https://doi.org/10.1001/archfami.7.4.352
   PubMedGoogle Scholar
• Gonçalves, M. A., Santos, L. M., Dias, A. T., & Ferreira, M. A. M. (2012). Uma Análise da Mudança de Produtividade da Alocação de Recursos Públicos na Atenção Básica da Saúde em Municípios da Região Sudeste Brasileira. Revista De Ciências Da Administração, 14(34), 60–74. https://doi.org/10.5007/2175-8077.2012v14n34p60
   Google Scholar
• Henrique, F., & Calvo, M. C. M. (2009). Grau de implantação do Programa Saúde da Família e indicadores sociais. Ciência & Saúde Coletiva, 14(suppl 1), 1359–1365. https://doi.org/10.1590/S1413-81232009000800008
   PubMedGoogle Scholar
• Hollingsworth, B., Dawson, P. J., & Maniadakis, N. (1999). Efficiency measurement of health care: A review of nonparametric methods and applications. Health Care Management Science, 2(3), 161–172. https://doi.org/10.1023/A:1019087828488
   PubMedGoogle Scholar
• Hollingsworth, B. (2003). Non-parametric and parametric applications measuring efficiency in health care. Health Care Management Science, 6(4), 203–218. https://doi.org/10.1023/A:1026255523228
   PubMedGoogle Scholar
• Hollingsworth, B. (2008). The measurement of efficiency and productivity of health care delivery. Health Economics, 17(10), 1107–1128. https://doi.org/10.1002/hec.1391
   PubMed Web of Science ®Google Scholar
• Karagiannis, R., & Velentzas, K. (2012). Productivity and quality changes in Greek public hospitals. Operational Research, 12(1), 69–81. https://doi.org/10.1007/s12351-010-0080-4
   Web of Science ®Google Scholar
• Kluthcovsky, F. A., & Kluthcovsky, A. C. G. C. (2007). Análise da avaliação do PSF em municípios de pequeno porte. Revista Brasileira De Medicina De Família e Comunidade, 3(10), 116–124. https://doi.org/10.5712/rbmfc3(10)354
   Google Scholar
• Lobo, M. S. C., & Araujo, E. C. (2017). Efficiency analysis of public health spending in Brazilian capitals using network data envelopment analysis (DEA). The Central European Review of Economics and Management, 1(4), 147–173. https://doi.org/10.29015/cerem.538
   Google Scholar
• Marschall, P., & Flessa, S. (2011). Efficiency of primary care in rural Burkina Faso. A two-stage DEA analysis. Health Economics Review, 1(1), 1–15. https://doi.org/10.1186/2191-1991-1-5
   PubMedGoogle Scholar
• Mastromarco, C., Stastna, L., & Votapkova, J. (2019). Efficiency of hospitals in the Czech Republic: Conditional efficiency approach. Journal of Productivity Analysis, 51(1), 73–89. https://doi.org/10.1007/s11123-019-00543-y
   Web of Science ®Google Scholar
• Mazon, L. M., Freitas, S. F. T., & Colussi, C. F. (2021). Financiamento e gestão: A eficiência técnica dos municípios catarinenses de pequeno porte nos gastos públicos com saúde. Ciencia & Saude Coletiva, 26(4), 1521–1532. https://doi.org/10.1590/1413-81232021264.09712019
   PubMedGoogle Scholar
• Miclos, P. V., Calvo, M. C. M., & Colussi, C. F. (2015a). Avaliação do desempenho da Atenção Básica nos municípios brasileiros com indicador sintético. Saúde Em Debate, 39(107), 984–996. https://doi.org/10.1590/0103-110420151070386
   Google Scholar
• Miclos, P. V., Calvo, M. C. M., & Colussi, C. F. (2015b). Avaliação do desempenho da atenção primária em saúde através da análise envoltória de dados. Revista Eletronica Gestão & Saúde, 6(2), 1749. https://doi.org/10.18673/gs.v6i2.22498
   Google Scholar
• Miclos, P. V., Calvo, M. C. M., & Colussi, C. F. (2017). Evaluation of the performance of actions and outcomes in primary health care. Revista De Saúde Pública, 51, 86. https://doi.org/10.11606/s1518-8787.2017051006831
   PubMedGoogle Scholar
• Murillo-Zamorano, L. R., & Petraglia, C. (2011). Technical efficiency in primary health care: Does quality matter? The European Journal of Health Economics : HEPAC : Health Economics in Prevention and Care, 12(2), 115–125. https://doi.org/10.1007/s10198-010-0232-8
   PubMed Web of Science ®Google Scholar
• Nedel, F. B., Mendonça, C. S., Calvo, M. C. M. (2017). O Programa Mais Médicos e internações evitáveis pela Atenção Primária. Cadernos de Saúde Pública. http://rededepesquisaaps.org.br/wp-content/uploads/2017/11/SUMULA-ICSAP.pdf
   Google Scholar
• Pelone, F., Kringos, D. S., Valerio, L., Romaniello, A., Lazzari, A., Ricciardi, W., & de Belvis, A. G. (2012). The measurement of relative efficiency of general practice and the implications for policy makers. Health Policy (Amsterdam, Netherlands), 107(2–3), 258–268. https://doi.org/10.1016/j.healthpol.2012.05.005
   PubMed Web of Science ®Google Scholar
• Pelone, F., Kringos, D. S., Spreeuwenberg, P., De Belvis, A. G., & Groenewegen, P. P. (2013). How to achieve optimal organization of primary care service delivery at system level: Lessons from Europe. International Journal for Quality in Health Care: Journal of the International Society for Quality in Health Care, 25(4), 381–393. https://doi.org/10.1093/intqhc/mzt020
   PubMed Web of Science ®Google Scholar
• Pelone, F., Kringos, D. S., Romaniello, A., Archibugi, M., Salsiri, C., & Ricciardi, W. (2015). Primary care efficiency measurement using data envelopment analysis: A systematic review. Journal of Medical Systems, 39(1), 1–14. https://doi.org/10.1007/s10916-014-0156-4
   PubMed Web of Science ®Google Scholar
• Podinovski, V. V. (2004). Production trade-offs and weight restrictions in data envelopment analysis. Journal of the Operational Research Society, 55(12), 1311–1322. https://doi.org/10.1057/palgrave.jors.2601794
   Web of Science ®Google Scholar
• Politelo, L., Rigo, V. P., & Hein, N. (2014). Eficiência da Aplicação de Recursos no Atendimento do Sistema Único de Saúde (SUS) nas Cidades de Santa Catarina. Revista De Gestão Em Sistemas De Saúde, 03(02), 45–60. https://doi.org/10.5585/rgss.v3i2.105
   Google Scholar
• Puig-Junoy, J. (2000). Eficiencia en la atención primaria de salud: Una revisión crítica de las medidas de frontera. Revista Española De Salud Pública, 74(5-6), 00–00. https://scielo.isciii.es/pdf/resp/v74n5-6/efici.pdf https://doi.org/10.1590/S1135-57272000000500005
   Google Scholar
• Rabetti, A. C., & Freitas, S. F. T. (2011). Evaluation of actions concerning systemic arterial hypertension in primary healthcare. Revista De Saude Publica, 45(2), 258–268. https://doi.org/10.1590/S0034-89102011005000007
   PubMed Web of Science ®Google Scholar
• Ramalho, A., Souza, J., Castro, P., Lobo, M., Santos, P., & Freitas, A. (2021). Portuguese primary healthcare and prevention quality indicators for diabetes mellitus–A data envelopment analysis. International Journal of Health Policy and Management, 11(9), 1725–1734. https://doi.org/10.34172/ijhpm.2021.76
   PubMedGoogle Scholar
• Rocha, T. A. H., da Silva, N. C., Barbosa, A. C. Q., & Rodrigues, J. M. (2014). Human resource management in health and performance of work process in the primary health care—An efficiency analysis in a Brazilian municipality. Journal of Health Management, 16(3), 365–379. https://doi.org/10.1177/0972063414539611
   Google Scholar
• Rosano, A., Loha, C. A., Falvo, R., Van der Zee, J., Ricciardi, W., Guasticchi, G., & De Belvis, A. G. (2013). The relationship between avoidable hospitalization and accessibility to primary care: A systematic review. European Journal of Public Health, 23(3), 356–360. https://doi.org/10.1093/eurpub/cks053
   PubMed Web of Science ®Google Scholar
• Rosenblatt, R. A., Wright, G. E., Baldwin, L. M., Chan, L., Clitherow, P., Chen, F. M., & Hart, L. G. (2000). The effect of the doctor-patient relationship on emergency department use among the elderly. American Journal of Public Health, 90(1), 97–102. https://doi.org/10.2105/AJPH.90.1.97
   PubMed Web of Science ®Google Scholar
• Rumball-Smith, J., Wodchis, W. P., Koné, A., Kenealy, T., Barnsley, J., & Ashton, T. (2014). Under the same roof: Co-location of practitioners within primary care is associated with specialised chronic care management. BMC Family Practice, 15(1), 149. https://doi.org/10.1186/1471-2296-15-149
   PubMedGoogle Scholar
• Salinas-Jiménez, J., & Smith, P. (1996). Data envelopment analysis applied to quality in primary health care. Annals of Operations Research, 67(1), 141–161. https://doi.org/10.1007/BF02187027
   Web of Science ®Google Scholar
• Santos, A. J. R., Santos, S. P., Amado, C. A. F., Rebelo, E. L., & Mendes, J. C. (2020). Labor inspectorates’ efficiency and effectiveness assessment as a learning path to improve work-related accident prevention. Annals of Operations Research, 288(2), 609–651. https://doi.org/10.1007/s10479-019-03287-y
   Web of Science ®Google Scholar
• Saver, B. G., Martin, S. A., Adler, R. N., Candib, L. M., Deligiannidis, K. E., Golding, J., Mullin, D. J., Roberts, M., & Topolski, S. (2015). Care that matters: quality measurement and health care. PLoS Medicine, 12(11), e1001902. https://doi.org/10.1371/journal.pmed.1001902
   PubMed Web of Science ®Google Scholar
• Scaratti, D., & Calvo, M. C. M. (2012). Composite indicator to evaluate quality of municipal management of primary health care. Revista De Saude Publica, 46(3), 446–455. https://doi.org/10.1590/S0034-89102012005000034
   PubMed Web of Science ®Google Scholar
• Scheel, H. (2000). EMS: Efficiency measurement system user’s manual, version 1.3. University of Dortmund.
   Google Scholar
• Schiøtz, M., Price, M., Frølich, A., Søgaard, J., Kristensen, J. K., Krasnik, A., Ross, M. N., Diderichsen, F., & Hsu, J. (2011). Something is amiss in Denmark: A comparison of preventable hospitalisations and readmissions for chronic medical conditions in the Danish Healthcare system and Kaiser Permanente. BMC Health Services Research, 11(1), 1–10. https://doi.org/10.1186/1472-6963-11-347
   PubMedGoogle Scholar
• Sherman, H. D., & Zhu, J. (2006). Benchmarking with quality-adjusted DEA (Q-DEA) to seek lower-cost high-quality service: Evidence from a U.S. bank application. Annals of Operations Research, 145(1), 301–319. https://doi.org/10.1007/s10479-006-0037-4
   Web of Science ®Google Scholar
• Shimshak, D. G., & Lenard, M. L. (2007). A two-model approach to measuring operating and quality efficiency with DEA. INFOR: Information Systems and Operational Research, 45(3), 143–151. https://doi.org/10.3138/infor.45.3.143
   Web of Science ®Google Scholar
• Simar, L., & Wilson, P. (2022). Modern Tools for Evaluating the Performance of Health-Care Providers (No. 2022006). Université Catholique de Louvain, Institute of Statistics, Biostatistics and Actuarial Sciences (ISBA).
   Google Scholar
• Sommersguter-Reichmann, M. (2022). Health care quality in nonparametric efficiency studies: A review. Central European Journal of Operations Research, 30(1), 67–131. https://doi.org/10.1007/s10100-021-00774-1
   Web of Science ®Google Scholar
• Souza, L. L. D., & Costa, J. S. D. D. (2011). Internações por condições sensíveis à atenção primária nas coordenadorias de saúde no RS. Revista De Saúde Pública, 45(4), 765–772. https://doi.org/10.1590/S0034-89102011000400017
   PubMedGoogle Scholar
• Starfield, B. (1994). Is primary care essential? Lancet (London, England), 344(8930), 1129–1133. https://doi.org/10.1016/S0140-6736(94)90634-3
   PubMed Web of Science ®Google Scholar
• Thanassoulis, E. (2001). Introduction to the theory and application of data envelopment analysis: A foundation text with integrated software. Springer US.
   Google Scholar
• Tomasi, E., Facchini, L. A., Thumé, E., Piccini, R. X., Osorio, A., Silveira, D. S., Siqueira, F. V., Teixeira, V. A., Dilélio, A. S., & Maia, M. F. S. (2011). Características da utilização de serviços de atenção básica à saúde nas regiões Sul e Nordeste do Brasil: Diferenças por modelo de atenção. Ciência & Saúde Coletiva, 16(11), 4395–4404. https://doi.org/10.1590/S1413-81232011001200012
   PubMedGoogle Scholar
• Varabyova, Y., Blankart, C. R., & Schreyögg, J. (2017). Using nonparametric conditional approach to integrate quality into efficiency analysis: empirical evidence from cardiology departments. Health Care Management Science, 20(4), 565–576. https://doi.org/10.1007/s10729-016-9372-4
   PubMed Web of Science ®Google Scholar
• Viana, A. L. D.Á., Rocha, J. S. Y., Elias, P. E., Ibañez, N., & Novaes, M. H. D. (2006). Modelos de atenção básica nos grandes municípios paulistas: Efetividade, eficácia, sustentabilidade e governabilidade. Ciência & Saúde Coletiva, 11(3), 577–606. http://www.scielo.br/pdf/csc/v11n3/30976.pdf https://doi.org/10.1590/S1413-81232006000300009
   Google Scholar
• World Health Organization (WHO), & United Nations Children’s Fund (UNICEF) (2018). A vision for primary health care in the 21st century: Towards universal health coverage and the Sustainable Development Goals. Geneva.
   Google Scholar
• Zakowska, I., & Godycki-Cwirko, M. (2020). Data envelopment analysis applications in primary health care: A systematic review. Family Practice, 37(2), 147–153. https://doi.org/10.1093/fampra/cmz057
   PubMed Web of Science ®Google Scholar