Research opportunities about measuring agility in software development: a constructivist perspective

Rogério Tadeu de Oliveira Lacerda; Ewerton Sacco Calvetti; Mayara Lucia Bernardes; Júlia Fraga Cargnin da Silveira

doi:10.5585/gep.v11i2.17947

Autores

Rogério Tadeu de Oliveira Lacerda Universidade Federal de Santa Catarina https://orcid.org/0000-0002-5151-172X
Ewerton Sacco Calvetti Federal University of Santa Catarina.
Mayara Lucia Bernardes Federal University of Santa Catarina. https://orcid.org/0000-0003-0055-9480
Júlia Fraga Cargnin da Silveira Federal University of Santa Catarina.

DOI:

https://doi.org/10.5585/gep.v11i2.17947

Palavras-chave:

Performance evaluation, Agile software development, Decision aiding, Agility

Resumo

This paper investigates research opportunities in an agile software development process according to constructivist performance evaluation lenses, based on a portfolio of 24 scientific articles relevant to the topic. The instrument used to carry out the systemic analysis was the Proknow-C method (Knowledge Development Process - Constructivist). It was observed in the portfolio that the performance evaluation to measure agility in the context of software development has focused practically on critical success factors and on inflexible models that rank in maturity levels, but without clearly evaluating how much agility is employed. This study addresses relevant research opportunities that seek to identify criteria and to build performance scales for measuring agility based on the values and preferences of the decision makers, who wish to implement the agile philosophy, aligned with the specific strategic of the decision makers objectives and using their singular resources, competences and own organizational culture in order to improve their software development process.

Biografias Autor

Rogério Tadeu de Oliveira Lacerda, Universidade Federal de Santa Catarina

Professor of the postgraduate program in management at UFSC. Federal University of Santa Catarina.

Ewerton Sacco Calvetti, Federal University of Santa Catarina.

Master of management – UFSC. Federal University of Santa Catarina.

Mayara Lucia Bernardes, Federal University of Santa Catarina.

PhD student in the postgraduate program in management – PPGA/UFSC. Federal University of Santa Catarina.

Júlia Fraga Cargnin da Silveira, Federal University of Santa Catarina.

Graduate Student in Executive Secretariat – UFSC. Federal University of Santa Catarina.

Referências

Afonso, M. H. F., de Souza, J. V., Ensslin, S. R., & Ensslin, L. (2012). Building knowledge on themed research: using the proknow-c process to find literature on sustainable development. Revista de Gestão Social e Ambiental, 5(2), 47-62. DOI: 10.5773/rgsa.v5i2.424

Baines, T., Lightfoot, H., Williams, G. M., & Greenough, R. (2006). State-of-the-art in lean design engineering: a literature review on white collar lean. Proceedings of the Institution of Mechanical Engineers, Part B: Journal of Engineering Manufacture, 220(9), 1539-1547.DOI: 10.1243/09544054JEM613

Basili, V. R., & Rombach, H. D. (1988). The TAME project: Towards improvement-oriented software environments. IEEE Transactions on software engineering, 14(6), 758-773. DOI:10.1109/32.6156

Behn, R. D. (2003). Why measure performance? Different purposes require different measures. Public administration review, 63(5), 586-606. DOI:10.1111/1540-6210.00322

Beck, K., Beedle, M., van Bennekum, A., Cockburn, A., Cunningham, W., Fowler, M., Grenning, J., Highsmith, J., Hunt, A., Jeffries, R., Kern, J., Marick, B., Martin, R. C., Mellor, S., Schwaber, K., Sutherland, J. & Thomas, D. (2001). Manifesto for agile software development. 2001. URL: http://www.agilemanifesto.org.

Boehm, B. W. (1988). A spiral model of software development and enhancement. Computer, 21(5), 61-72. DOI: 10.1109/2.59

Calvetti, E. S., de Oliveira Lacerda, R. T., & Bernardes, M. L. (2019). Um estudo bibliométrico sobre avaliação de desempenho no processo de desenvolvimento ágil de software sob a perspectiva do construtivismo. Revista Brasileira de Gestão e Inovação (Brazilian Journal of Management & Innovation), 6(3), 1-28. DOI: 10.18226/23190639.v6n3.01

Casarin, H. d. C. S., & Casarin, S. J. (2011). Scientific research: from theory to practice. Curitiba: Ibpex.

Cockburn, A., (2002) Agile software development. Boston, MA: Pearson Education, Inc;

Chow, T., & Cao, D.-B. (2008). A survey study of critical success factors in agile software projects. Journal of Systems and Software, 81(6), 961-971. DOI: 10.1016/j.jss.2007.08.020

Conforto, E. C., & Amaral, D. C. (2016). Agile project management and stage-gate model—A hybrid framework for technology-based companies. Journal of Engineering and Technology Management, 40, 1-14. DOI: 10.1016/j.jengtecman.2016.02.003

Conforto, E. C., Amaral, D. C., da Silva, S. L., Di Felippo, A., & Kamikawachi, D. S. L. (2016). The agility construct on project management theory. International Journal of Project Management, 34(4), 660-674. DOI: 10.1016/j.ijproman.2016.01.007

Cohn, M., (2009) Succeeding with Agile: Software Development using Scrum., , Boston, MA: Addison-Wesley Professional;

Crawford, L., & Pollack, J. (2004). Hard and soft projects: a framework for analysis. International Journal of Project Management, 22(8), 645-653. DOI: 10.1016/j.ijproman.2004.04.004

da Rosa, I. O., Ensslin, L., & Ensslin, S. R. (2011). A conceptual vision of enterprise risk management models. Revista Eletrônica de Ciência Administrativa, 10(2), 124. DOI: https://doi.org/10.5329/RECADM.20111002009

de Azevedo, R. C., Lacerda, R. T. O., Ensslin, L., Jungles, A. E., & Ensslin, S. R. (2012). Performance measurement to aid decision making in the budgeting process for apartment-building construction: case study using MCDA-C. Journal of Construction Engineering and Management, 139(2), 225-235. DOI: 10.1061/(ASCE)CO.1943-7862.0000587

de Oliveira, L. V., Lacerda, R. T. O., Fiates, G. G. S., & Ensslin, S. R. (2016). Decision aid in project management: a bibliometric analysis. Gestão e Projetos: GeP, 7(1), 95-113. DOI: 10.5585/gep.v7i1.329

Dias, L. C., & Tsoukiàs, A. (2003). On the constructive and other approaches in decision aiding. Paper presented at the Proceedings of the 57th meeting of the EURO MCDA working group. to appear.

Diebold, P., Theobald, S., Wahl, J., & Rausch, Y. (2019). Stepwise transition to agile: From three agile practices to Kanban adaptation. Journal of Software-Evolution and Process, 31. DOI:10.1002/smr.2167

Dingsøyr, T., Nerur, S., Balijepally, V., & Moe, N. B. (2012). A decade of agile methodologies: Towards explaining agile software development. In: Elsevier.

Ensslin, L., Ensslin, S. R., & de Souza, M. V. (2014). Product portfolio management in industry: status quo. Revista Produção Online, 14(3), 790-821. DOI: 10.14488/1676-1901.v14i3.1050

Ensslin, L., Ensslin, S. R., Lacerda, R. T. O., & Tasca, J. E. (2010). ProKnow-C, knowledge development process-constructivist. Processo técnico com patente de registro pendente junto ao INPI. Brasil, 10(4), 2015.

Ensslin, S. R., Back, F., Ensslin, L., & Lacerda, R. T. O. (2013). Improved decision aiding in human resource management: a case using constructivist multi-criteria decision aiding. International Journal of Productivity and Performance Management, 62(7), 735-757. DOI: 10.1108/IJPPM-04-2012-0039

Ensslin, S. R., Ensslin, L., Lacerda, R. T. O., & Matos, L. d. S. (2013). Disclosure of the state of art of the topic performance measurement in public utilities regulation according to the researcher’s perception. Gestão Pública: Práticas e Desafios, 4(1).

Fontana, R. M., Meyer, V., Jr., Reinehr, S., & Malucelli, A. (2015). Progressive Outcomes: A framework for maturing in agile software development. Journal of Systems and Software, 102, 88-108. DOI:10.1016/j.jss.2014.12.032

Gandomani, T. J., & Nafchi, M. Z. (2014). Agility assessment model to measure Agility degree of Agile software companies. Indian Journal of Science and Technology, 7(7), 955-959. doi:http://www.ijcsi.org/papers/IJCSI-9-4-3-127-133.pdf;

Gren, L., Torkar, R., & Feldt, R. (2015). The prospects of a quantitative measurement of agility: A validation study on an agile maturity model. Journal of Systems and Software, 107, 38-49. DOI:10.1016/j.jss.2015.05.008

Jalali, S., Wohlin, C., & Angelis, L. (2014). Investigating the applicability of Agility assessment surveys: A case study. Journal of Systems and Software, 98, 172-190. DOI:10.1016/j.jss.2014.08.067

Keeney, R. L. (1996). Value-focused thinking: Identifying decision opportunities and creating alternatives. European journal of operational research, 92(3), 537-549. DOI: 10.1016/0377-2217(96)00004-5

Keeney, R. L. (2009). Value-focused thinking: A path to creative decisionmaking: Harvard University Press.

Kennerley, M., & Neely, A. (2002). A framework of the factors affecting the evolution of performance measurement systems. International journal of operations & production management, 22(11), 1222-1245. DOI: 10.1108/01443570210450293

Lacerda, R. T. O., Ensslin, L., & Ensslin, S. R. (2014). Research opportunities in strategic management field: a performance measurement approach. International Journal of Business Performance Management, 15(2), 158-174. DOI: 10.1504/IJBPM.2014.060165

Lacerda, R. T. O., Klein, B. L., Fulco, J. F., Santos, G., & Bittarello, K. (2017). Integração inovadora entre empresas incubadas e universidades para geração contínua de vantagens competitivas em ambientes dinâmicos. Navus-Revista de Gestão e Tecnologia, 7(2), 78-96. DOI: 10.22279/navus.2017.v7n2.p78-96.497

Landry, M. (1995). A note on the concept of'problem'. Organization studies, 16(2), 315-343.

Lee, G., & Xia, W. (2010). Toward agile: an integrated analysis of quantitative and qualitative field data. Management Information Systems Quarterly, 34(1), 7. DOI: 10.1142/9789814295628_0006

Mahnič, V., & Zabkar, N. (2008). Using COBIT indicators for measuring scrum-based software development. Wseas transactions on computers, 10(7), 1605-1617.

Marafon, A. D., Ensslin, L., Lacerda, R. T. O., & Ensslin, S. R. (2012). R&D management performance evaluation – systematic literature review. P&D em Engenharia de Produção, 10(2), 171-194.

Marafon, A. D., Ensslin, L., Lacerda, R. T. O., & Ensslin, S. R. (2015). The effectiveness of multi-criteria decision aid methodology: A case study of R&D management. European Journal of Innovation Management, 18(1), 86-109. DOI: 10.1108/EJIM-10-2013-0106

McCaffery, F., Taylor, P. S., & Coleman, G. (2007). Adept: A unified assessment method for small software companies. IEEE Software, 24(1), 24-31. DOI:10.1109/MS.2007.3

Melnyk, S. A., Bititci, U., Platts, K., Tobias, J., & Andersen, B. (2014). Is performance measurement and management fit for the future? Management Accounting Research, 25(2), 173-186. DOI: https://doi.org/10.1016/j.mar.2013.07.007

Miranda, E., & Bourque, P. (2010). Agile monitoring using the line of balance. Journal of Systems and Software, 83(7), 1205-1215. DOI:10.1016/j.jss.2010.01.043

Misra, S. C., Kumar, V., & Kumar, U. (2009). Identifying some important success factors in adopting agile software development practices. Journal of Systems and Software, 82(11), 1869-1890. DOI: 10.1016/j.jss.2009.05.052

Nierstrasz, O., Lungu, M., (2012) Agile software assessment (Invited paper)., , Paper presented at the 20th IEEE International Conference on Program Comprehension, ICPC 2012, Passau;

Olszewska, M., Heidenberg, J., Weijola, M., Mikkonen, K., & Porres, I. (2016). Quantitatively measuring a large-scale agile transformation. Journal of Systems and Software, 117, 258-273. DOI:10.1016/j.jss.2016.03.029

Patel, C., & Ramachandran, M. (2009). Story card Maturity Model (SMM): A process improvement framework for agile requirements engineering practices. Journal of Software, 4(5), 422-435. DOI: 10.4304/jsw.4.5.422-435

Paulk, M. C. (2001). Extreme programming from a CMM perspective. IEEE Software, 18(6), 19-26. DOI: 10.1109/52.965798

Paulk, M. C., Curtis, B., Chrissis, M. B., & Weber, C. V. (1993). Capability maturity model, version 1.1. IEEE Software, 10(4), 18-27.

Petersen, K., & Wohlin, C. (2011). Measuring the flow in lean software development. Software: Practice and experience, 41(9), 975-996. DOI: https://doi.org/10.1002/spe.975

Qumer, A., Henderson-Sellers, B., McBride, T., (2007) Agile adoption and improvement model., , Paper presented at the 4th European and Mediterranean Conference on Information Systems, EMCIS; Valencia;

Qumer, A., & Henderson-Sellers, B. (2008a). An evaluation of the degree of agility in six agile methods and its applicability for method engineering. Information and software technology, 50(4), 280-295. DOI:10.1016/j.infsof.2007.02.002

Qumer, A., & Henderson-Sellers, B. (2008b). A framework to support the evaluation, adoption and improvement of agile methods in practice. Journal of Systems and Software, 81(11), 1899-1919. DOI: 10.1016/j.jss.2007.12.806

Roy, B. (1993). Decision science or decision-aid science? European journal of operational research, 66(2), 184-203.

Rubin, K., Cohn, M., Williams, L., (2010) Comparative Agility (CA), http://comparativeagility.com/;

Sidky, A., Arthur, J., & Bohner, S. (2007). A disciplined approach to adopting agile practices: The agile adoption framework. Innovations in Systems and Software Engineering, 3(3), 203-216. DOI:10.1007/s11334-007-0026-z

Soundararajan, S., Arthur, J.D., (2011) A structured framework for assessing the "goodness" of agile methods., , Paper presented at the 18th IEEE International Conference and Workshops on Engineering of Computer-Based Systems, ECBS 2011; Las Vegas, NV;

Soundararajan, S., Arthur, J.D., Balci, O., (2012) A methodology for assessing agile software development methods., , Paper presented at the Agile Conference; Agile, Dallas, TX; (2010) Thoughtworks. Agile Assessments, , http://www.agileassessments.com/;

Spinellis, D., Agility drivers. (2011) IEEE Software., 28 (4);

Tarhan, A., & Yilmaz, S. G. (2014) Systematic analyses and comparison of development performance and product quality of Incremental Process and Agile Process. Information and software technology, 56(5), 477-494. DOI:10.1016/j.infsof.2013.12.002

Tsoukiàs, A. (2008) From decision theory to decision aiding methodology. European journal of operational research, 187(1), 138-161. DOI: 10.1016/j.ejor.2007.02.039

Williams, L., (2012) What agile teams think of agile principles. Communications of the ACM., 55 (4), pp. 71-76 DOI: 10.1145/2133806.2133823.

Williams, L., Rubin, K., Cohn, M., (2010) Driving process improvement via comparative agility assessment., , Paper presented at the Proceedings of the 2010 Agile Conference.