Validation of an assessment instrument for Latin American projects

This is an outdated version published on 2024-04-11. Read the most recent version.

PDF (Spanish) EPUB (Spanish)

Published: Apr 11, 2024

Updated: 2024-04-11

Versions:

2024-04-18 (4)

2024-04-18 (3)

2024-04-11 (2)

2024-03-26 (1)

DOI: https://doi.org/10.17163/ret.n27.2024.09

Keywords:

project management, performance, critical success factors, success criteria, Latin America

María Elizabeth Arteaga-García

https://orcid.org/0000-0003-4786-0094

Cecilia Alexandra Portalanza-Chavarría

https://orcid.org/0000-0002-9782-5089

Abstract

This research aims to adapt and validate the Project Implementation Profile (PIP) instrument for evaluating projects carried out in Latin America. Four hundred twenty professionals participated as leaders or team members in projects completed in 2020-2021. As the instrument was developed in English, a translation and retranslation procedure was used, in which professional and academic experts in project management participated, along with certified translators, for its adaptation to the Spanish-speaking population in Latin America. For the exploratory factor analysis, the unweighted least squares extraction method was selected, obtaining four critical success factors: Communication with the client, monitoring and planning, senior management, and technical capabilities, with Cronbach Alpha coefficients between .876 and 933. Subsequently, confirmatory factor analysis was applied, demonstrating that the instrument has convergent and discriminant validity and, consequently, can be used in academia for future research on project management and professionally to evaluate the performance of Ecuadorian projects, considering the limitation that the percentage of participation of projects from other Latin American countries in the study sample was 22%.

Issue

Vol. 14 No. 27 (2024): (April-September)

Section

Miscellaneous Section

This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.

Authorship: The list of authors signing must include only those people who have contributed intellectually to the development of the work. Collaboration in the collection of data is not, by itself, a sufficient criterion of authorship. "Retos" declines any responsibility for possible conflicts arising from the authorship of the works that are published.

Copyright: The Salesian Polytechnic University preserves the copyrights of the published articles, and favors and allows their reuse under the Creative Commons Attribution-NonCommercial-ShareAlike 3.0 Ecuador license. They may be copied, used, disseminated, transmitted and publicly displayed, provided that: i) the authorship and the original source of their publication (journal, editorial and work URL) are cited; (Ii) are not used for commercial purposes; Iii) mention the existence and specifications of this license.

References

Albert, M., Balve, P., y Spang, K. (2017). Evaluation of Project Success: A Structured Literature Review. International Journal of Managing Projects in Business, 10(4), 796-821. https://doi.org/10.1108/IJMPB-01-2017-0004

Aldrich, D. S. (1986). A Sequential Procedure for Implementing a Computer-Based Information System. Journal of the American Dietetic Association, 86(9), 1228-1231.

Amies, P., Jin, X., y Senaratne, S. (2023). Systematic Literature Review on Success Criteria for Dam Engineering Projects [Review]. Journal of Construction Engineering and Management, 149(1), Article 03122012-1. https://doi.org/10.1061/(ASCE)CO.1943-7862.0002421

Avots, I. (1969). Why Does Project Management Fail? California Management Review, 12(1), 77-82. https://doi.org/10.2307/41164208

Ayat, M., Imran, M., Ullah, A., y Kang, C. W. (2021). Current Trends Analysis and Prioritization of Success Factors: A Systematic Literature Review of Ict Projects. International Journal of Managing Projects in Business, 14(3), 652-679. https://doi.org/10.1108/ijmpb-02-2020-0075

Baccarini, D. (1999). The Logical Framework Method for Defining Project Success. Project Management Journal, 30(4), 25-32.

Bagozzi, R. P., Yi, Y., y Nassen, K. D. (1998). Representation of Measurement Error in Marketing Variables: Review of Approaches and Extension to Three-Facet Designs. Journal of Econometrics, 89(1-2), 393-421.

Belassi, W., y Tukel, O. I. (1996). A New Framework for Determining Critical Success/Failure Factors in Projects. International Journal of Project Management, 14(3), 141-151. https://doi.org/10.1016/0263-7863(95)00064-X

Belout, A., y Gauvreau, C. (2004). Factors Influencing Project Success: The Impact of Human Resource Management. International Journal of Project Management, 22(1), 1-11. https://doi.org/10.1016/S0263-7863(03)00003-6

Bentler, P. M., y Bonett, D. G. (1980). Significance Tests and Goodness of Fit in the Analysis of Covariance Structures. Psychological bulletin, 88(3), 588.

Berssaneti, F. T., y Carvalho, M. M. (2015). Identification of Variables That Impact Project Success in Brazilian Companies. International Journal of Project Management, 33(3), 638-649. https://doi.org/10.1016/j.ijproman.2014.07.002

Burgan, S. C., y Burgan, D. S. (2014). One Size Does Not Fit All: Choosing the Right Project Approach.

Chu, C., y Bannister, B. J. (1992). Managing Information Technology Projects: Chart(Ii) Development in a Large Hong Kong Company. International Journal of Information Management, 12(2), 142-157. https://doi.org/https://doi.org/10.1016/0268-4012(92)90020-Q

Cooke-Davies, T. (2002). The "Real" Success Factors on Projects. International Journal of Project Management, 20(3), 185-190. https://doi.org/10.1016/S0263-7863(01)00067-9

Correia, S. R. V., y Martens, C. D. P. (2023). Cloud Computing Projects: Critical Success Factors [Article]. RAUSP Management Journal, 58(1), 5-21. https://doi.org/10.1108/RAUSP-06-2021-0107

Costantino, F., Di Gravio, G., y Nonino, F. (2015). Project Selection in Project Portfolio Management: An Artificial Neural Network Model Based on Critical Success Factors. International Journal of Project Management, 33(8), 1744-1754. https://doi.org/https://doi.org/10.1016/j.ijproman.2015.07.003

Cronbach, L. J. (1951). Coefficient Alpha and the Internal Structure of Tests. psychometrika, 16(3), 297-334.

de Carvalho, M. M., Patah, L. A., y de Souza Bido, D. (2015). Project Management and Its Effects on Project Success: Cross-Country and Cross-Industry Comparisons. International Journal of Project Management, 33(7), 1509-1522. https://doi.org/10.1016/j.ijproman.2015.04.004

Dvir, D., Sadeh, A., y Malach-Pines, A. (2006). Projects and Project Managers: The Relationship between Project Managers' Personality, Project Types, and Project Success. Project Management Journal, 37(5), 36-48.

Fornell, C., y Larcker, D. F. (1981). Structural Equation Models with Unobservable Variables and Measurement Error: Algebra and Statistics. In: Sage Publications Sage CA: Los Angeles, CA.

Fortune, J., y White, D. (2006). Framing of Project Critical Success Factors by a Systems Model. International Journal of Project Management, 24(1), 53-65. https://doi.org/10.1016/j.ijproman.2005.07.004

Hair, J. F. (2009). Multivariate Data Analysis.

Hair, J. F., Anderson, R. E., Tatham, R. L., y Black, W. C. (2004). Análisis Multivariante.

Hair Jr, J. F., Hult, G. T. M., Ringle, C. M., Sarstedt, M., Danks, N. P., y Ray, S. (2021). Partial Least Squares Structural Equation Modeling (Pls-Sem) Using R: A Workbook. Springer Nature.

Hu, L. t., y Bentler, P. M. (1999). Cutoff Criteria for Fit Indexes in Covariance Structure Analysis: Conventional Criteria Versus New Alternatives. Structural equation modeling: a multidisciplinary journal, 6(1), 1-55.

Hughes, D. L., Rana, N. P., y Dwivedi, Y. K. (2020). Elucidation of Is Project Success Factors: An Interpretive Structural Modelling Approach. Annals of Operations Research, 285(1-2), 35-66. https://doi.org/10.1007/s10479-019-03146-w

Hulland, J. (1999). Use of Partial Least Squares (Pls) in Strategic Management Research: A Review of Four Recent Studies. Strategic Management Journal, 20(2), 195-204.

Ika, L. A. (2009). Project Success as a Topic in Project Management Journals. Project Management Journal, 40(4), 6-19. https://doi.org/10.1002/pmj.20137

Ika, L. A., y Pinto, J. K. (2022). The “Re-Meaning” of Project Success: Updating and Recalibrating for a Modern Project Management. International Journal of Project Management, 40(7), 835-848. https://doi.org/https://doi.org/10.1016/j.ijproman.2022.08.001

Ika, L. A., y Pinto, J. K. (2023). Dont Ask What Makes Projects Successful, but under What Circumstances They Work: Recalibrating Project Success Factors. In Research Handbook on Project Performance (pp. 75-91). Edward Elgar Publishing.

Iriarte, C., y Bayona, S. (2020). It Projects Success Factors: A Literature Review. Ijispm-International Journal of Information Systems and Project Management, 8(2), 49-78. https://doi.org/10.12821/ijispm080203

Jitpaiboon, T., Smith, S. M., y Gu, Q. (2019). Critical Success Factors Affecting Project Performance: An Analysis of Tools, Practices, and Managerial Support. Project Management Journal, 50(3), 271-287. https://doi.org/10.1177/8756972819833545

Khatatbeh, A. A. (2023). Quantifying the Impact of Iso 9001 Standard on the Project and Engineering Management and Success Factors; a Case of Construction Industry [Article]. Engineering, Construction and Architectural Management, 30(6), 2564-2581. https://doi.org/10.1108/ECAM-07-2021-0656

Lamprou, A., y Vagiona, D. G. (2022). Identification and Evaluation of Success Criteria and Critical Success Factors in Project Success. Global Journal of Flexible Systems Management, 23(2), 237-253. https://doi.org/10.1007/s40171-022-00302-3

Leung, M. Y., Wei, X., y Wang, C. (2023). Demystifying Critical Success Factors for Applying Value Management in Construction Projects Along the Belt and Road Regions: Focus Group Study [Article]. Journal of Construction Engineering and Management, 149(8), Article 04023066-1. https://doi.org/10.1061/JCEMD4.COENG-12990

Mughal, M. A., Bahaudin, A. Y., y Salleh, N. A. (2019). Behavioral Factors for It Project Success in Pakistan: Moderating Effect of Leadership Styles. Management Science Letters.

Müller, R., y Turner, J. R. (2007). The Influence of Project Managers on Project Success Criteria and Project Success by Type of Project. European Management Journal, 25(4), 298-309. https://doi.org/10.1016/j.emj.2007.06.003

Müller, R., y Turner, J. R. (2010). Attitudes and Leadership Competences for Project Success. Baltic Journal of Management, 5(3), 307-329. https://doi.org/10.1108/17465261011079730

Müller, R., y Turner, J. R. (2010). Leadership Competency Profiles of Successful Project Managers. International Journal of Project Management, 28(5), 437-448. https://doi.org/10.1016/j.ijproman.2009.09.003

Nishimwe, C., y McHunu, G. G. (2021). Stakeholders Perceptions Regarding Implementing Maternal and Newborn Health Care Programs in Rwanda. BMC Health Services Research, 21(1), 796. https://doi.org/10.1186/s12913-021-06824-3

Padilla, W. F., Pino, R. M., y Amaya, A. A. (2021). Factores Que Impactan En Los Criterios De Éxito De Los Proyectos En Perú Y Ecuador: El Rol Moderador De Las Competencias Del Director De Proyecto. Información tecnológica, 32, 133-146. bit.ly/3OK4cSX

Pinto, J. K. (1986). Project Implementation: A Determination of Its Critical Success Factors, Moderators, and Their Relative Importance across the Project Life Cycle. University of Pittsburgh.

Pinto, J. K. (1990). Project Implementation Profile: A Tool to Aid Project Tracking and Control. International Journal of Project Management, 8(3), 173-182.

Pinto, J. K., y Covin, J. G. (1989). Critical Factors in Project Implementation: A Comparison of Construction and R&D Projects. Technovation, 9(1), 49-62. https://doi.org/10.1016/0166-4972(89)90040-0

Pinto, J. K., y Mantel, S. J. (1990). The Causes of Project Failure. Ieee Transactions on Engineering Management, 37(4), 269-276.

Pinto, J. K., y Prescott, J. E. (1988). Variations in Critical Success Factors over the Stages in the Project Life Cycle. Journal of Management, 14(1), 5-18. https://doi.org/10.1177/014920638801400102

Pinto, J. K., y Prescott, J. E. (1990). Planning and Tactical Factors in the Project Implementation Process. Journal of Management Studies, 27(3), 305-327. https://doi.org/10.1111/j.1467-6486.1990.tb00249.x

Pinto, J. K., y Slevin, D. P. (1987). Critical Factors in Successful Project Implementation. Ieee Transactions on Engineering Management(1), 22-27.

Pinto, J. K., y Slevin, D. P. (1988). Project Success: Definitions and Measurements Techniques. Project Management Journal, 19(1), 67-72.

Pinto, J. K., y Slevin, D. P. (1989). Critical Success Factors in R&D Projects. Research-technology management, 32(1), 31-35.

Pollack, J., Helm, J., y Adler, D. (2018). What Is the Iron Triangle, and How Has It Changed? International Journal of Managing Projects in Business, 11(2), 527-547. https://doi.org/10.1108/ijmpb-09-2017-0107

Rosacker, K. M., y Olson, D. L. (2008). Public Sector Information System Critical Success Factors. Transforming Government: People, Process and Policy, 2(1), 60-70. https://doi.org/10.1108/17506160810862955

Rusare, M., y Jay, C. I. (2015). The Project Implementation Profile: A Tool for Enhancing Management of Ngo Projects. Progress in Development Studies, 15(3), 240-252. https://doi.org/10.1177/1464993415578976

Sanchez, O. P., Terlizzi, M. A., y de Moraes, H. R. D. O. C. (2017). Cost and Time Project Management Success Factors for Information Systems Development Projects. International Journal of Project Management, 35(8), 1608-1626. https://doi.org/10.1016/j.ijproman.2017.09.007

Shenhar, A., y Holzmann, V. (2017). The Three Secrets of Megaproject Success: Clear Strategic Vision, Total Alignment, and Adapting to Complexity. Project Management Journal, 48(6), 29-46. https://doi.org/10.1177/875697281704800604

Shenhar, A., Levy, O., y Dvir, D. (1997). Mapping the Dimensions of Project Success. Project Management Journal, 28(2), 5-13.

Sinesilassie, E. G., Tripathi, K. K., Tabish, S. Z. S., y Jha, K. N. (2019). Modeling Success Factors for Public Construction Projects with the Sem Approach: Engineer’s Perspective. Engineering, Construction and Architectural Management, 26(10), 2410-2431. https://doi.org/10.1108/ECAM-04-2018-0162

Slevin, D. P., y Pinto, J. K. (1986). The Project Implementation Profile: New Tool for Project Managers. Project Management Journal, 18, 57-70.

Slevin, D. P., y Pinto, J. K. (1987). Balancing Strategy and Tactics in Project Implementation. Sloan management review, 29(1), 33-41. bit.ly/45hIM6x

Thomas, G., y Fernández, W. (2008). Success in It Projects: A Matter of Definition? International Journal of Project Management, 26(7), 733-742. https://doi.org/10.1016/j.ijproman.2008.06.003

Thompson, B. (2004). Exploratory and Confirmatory Factor Analysis: Understanding Concepts and Applications. Washington, DC, 10694(000), 3.

Tilburg, U., y Hambleton, R. K. (1996). Translating Tests: Some Practical Guidelines. European Psychologist, 1(2), 89-99.

Varajão, J., Magalhães, L., Freitas, L., y Rocha, P. (2022). Success Management – from Theory to Practice. International Journal of Project Management, 40(5), 481-498. https://doi.org/10.1016/j.ijproman.2022.04.002

Wateridge, J. (1998). How Can Is/It Projects Be Measured for Success? International Journal of Project Management, 16(1), 59-63. https://doi.org/10.1016/S0263-7863(97)00022-7

Watkins, M. W. (2021). A Step-by-Step Guide to Exploratory Factor Analysis with Spss. Routledge.

Westerveld, E. (2003). The Project Excellence Model®: Linking Success Criteria and Critical Success Factors. International Journal of Project Management, 21(6), 411-418. https://doi.org/10.1016/S0263-7863(02)00112-6

Williams, T. (2016). Identifying Success Factors in Construction Projects: A Case Study. Project Management Journal, 47(1), 97-112. https://doi.org/10.1002/pmj.21558

Yasin, M. M., Gomes, C. F., y Miller, P. E. (2009). Characteristics of Portuguese Public-Sector Project Managers: Toward Closing the Effectiveness Gap. Project Management Journal, 40(3), 47-55. https://doi.org/10.1002/pmj.20114

Yeo, K. T. (2002). Critical Failure Factors in Information System Projects. International Journal of Project Management, 20(3), 241-246. https://doi.org/10.1016/S0263-7863(01)00075-8

Article Sidebar

Main Article Content

Abstract

Article Details

References