How experimental and strategic are Business Intelligence (BI) and Data Mining applications?

Rodrigo Fontes Cruz, Methanias Colaço Júnior, Victor Menezes Gois


Objective: Identify and characterize the methodologies used for the experimental development of intelligent applications aligned with strategic planning.

Methodology: A systematic mapping was carried out to characterize the research in the area, considering the last ten years.

Originality: No scientific studies were found with the same research object of this article, to identify and characterize the methodologies for the experimental development of intelligent applications aligned with strategic planning, which increases the importance of the results presented here.

Main results: As a result, no studies were found that presented any complete approach to discipline strategic alignment and experimentation, providing clear compliance with strategic objectives and an experimental phase in the validation of results. However, some trials of parts of these characteristics could be mapped, such as experimentation found in 28,57% of the studies. Among the countries, China, the United States and Brazil led the ranking of publications on the subject. As for the medium of publication, Journal was the most used option for publication. In addition, the "IEEE International Conference on Advanced Communications, Control and Computing Technologies" and the journal "Expert Systems with Applications" stood out as major publishers.

Theoretical Contributions: This research presents results relevant to academia and entrepreneurs, providing evidence that there is a gap in research on a formal method of BI and Data Mining applications experimental and strategy-driven development. In addition, this work is presented as a source of consultation to the existing method standards for the development of intelligent applications, as well as being replicable and extended by the applied systematization. Finally, there is a focus on research that proposes methods of creating experimental applications validated experimentally and aligned with strategy.


Strategic alignment; Business Intelligence; Data Mining; Data science.


Alexander, A. (2014). Case studies: Business Intelligence. Accounting Today. (June), 32.

Araújo, M. V. M., & Dornelas, J. S. (2017). Mapeamento perceptual da associação entre sucesso de projetos de TI e fatores promotores do alinhamento estratégico. EnANPAD.

Astley, W. G., Axelsson, R., Butler, R. J., Hickson, D. J., & Wilson, D. C. (2017). Complexity and cleavage: dual explanations of strategic decision-making. In The Bradford studies of strategic decision making (pp. 47-65). Ashgate.

Barbieri, C. (2011). BI2-Business intelligence: Modelagem & Qualidade. Elsevier Editora.

Basili, V. R. (1996, March). The role of experimentation in software engineering: past, current, and future. In Proceedings of IEEE 18th International Conference on Software Engineering (pp. 442-449). IEEE.

Basili, V. R., Lindvall, M., Regardie, M., Seaman, C., Heidrich, J., Münch, J., ... & Trendowicz, A. (2010). Linking software development and business strategy through measurement. Computer, 43(4), 57-65.

Basili, V. R., Trendowicz, M. Kowalczyk, J. Heidrich, C. Seaman, J. Münch, D. Rombach. (2014). Aligning Organizations Through Measurement: The GQM+Strategies Approach. Springer Publishing Company, Incorporated.

Bautista, R. M. (2018). Clustering failed courses of engineering students using association rule mining. Journal of Theoretical & Applied Information Technology, v. 96(4).

Bergin, S., & Wraight, P. (2006). Silver based wound dressings and topical agents for treating diabetic foot ulcers. Cochrane Database of Systematic Reviews, (1).

Berry, M. J., & Linoff, G. S. (2004). Data mining techniques: for marketing, sales, and customer relationship management. John Wiley & Sons.

Bock, C., Gumbsch, T., Moor, M., Rieck, B., Roqueiro, D., & Borgwardt, K. (2018). Association mapping in biomedical time series via statistically significant shapelet mining. Bioinformatics, 34(13), i438-i446.

Bosch-Sijtsema, P., & Bosch, J. (2015). User involvement throughout the innovation process in high‐tech industries. Journal of Product Innovation Management, 32(5), 793-807.

Brannon, N. (2010). Business intelligence and E-discovery. Intellectual Property & Technology Law Journal, 22(7), 1.

Cabena, P., Hadjinian, P., Stadler, R., Verhees, J., & Zanasi, A. (1998). Discovering data mining: from concept to implementation. Prentice-Hall, Inc.

Camilo, C. O., & Silva, J. C. D. (2009). Mineração de dados: Conceitos, tarefas, métodos e ferramentas. Universidade Federal de Goiás (UFC), 1(1), 1-29.

Campbell, B. R. (2005). Alignment: Resolving ambiguity within bounded choices. In Pacific Asia Conference on Information Systems. University of Hong King.

Castellion, G. (2008). Do it wrong quickly: how the web changes the old marketing rules by Mike Moran. Journal of Product Innovation Management, v. 25, n. 6, p. 633-635.

Chan, Y. E., Huff, S. L., Barclay, D. W., & Copeland, D. G. (1997). Business strategic orientation, information systems strategic orientation, and strategic alignment. Information systems research, 8(2), 125-150.

Chaudhuri, S., Dayal, U., & Narasayya, V. (2011). An overview of business intelligence technology. Communications of the ACM, 54(8), 88-98.

Cheng, H., Lu, Y. C., & Sheu, C. (2009). An ontology-based business intelligence application in a financial knowledge management system. Expert Systems with Applications, 36(2), 3614-3622.

Cios, K. J., Teresinska, A., Konieczna, S., Potocka, J., & Sharma, S. (2000). Diagnosing myocardial perfusion from PECT bull’s-eye maps-A knowledge discovery approach. IEEE Engineering in Medicine and Biology Magazine, 19(4), 17-25.

Clancy, T. (1995). The standish group report. Chaos report.

Cobit. (2016). What is Cobit 5? It's the leading framework for the governance and management of enterprise IT. Information Systems Audit and Control Foundation (ISACA). [Online] 20 de Junho de 2019.

Colaço Júnior, M., Cruz, R. F. & Lima, A. S. (2019). Proposta e Avaliação de um Processo para o Desenvolvimento de Aplicações de Business Intelligence Dirigido à Estratégia. In: International Conference on Information Systems and Technology Management, 2019, São Paulo. CONTECSI.

Côrte-Real, N., Oliveira, T., & Ruivo, P. (2017). Assessing business value of Big Data Analytics in European firms. Journal of Business Research, 70, 379-390.

Costa, E., Baker, R. S., Amorim, L., Magalhães, J., & Marinho, T. (2013). Mineração de dados educacionais: conceitos, técnicas, ferramentas e aplicações. Jornada de Atualização em Informática na Educação, 1(1), 1-29.

Costa, J. K. G., Santos, I. P. O., Nascimento, A. V. R., & Colaço Júnior, M. (2015, May). Experimentation at Industrial Setting to Improve the Effectiveness of the ETL Procedures Implementation in a Business Intelligence Environment. In SBSI (pp. 459-466).

Costa, J. K., Santos, I. P., Colaço Junior, M.., & Nascimento, A. V. (2016, May). An Experiment in an Industrial Business Intelligence environment to improve data loads maintenance. In Proceedings of the XII Brazilian Symposium on Information Systems on Brazilian Symposium on Information Systems: Information Systems in the Cloud Computing Era-Volume 1 (pp. 534-541).

Costa, S. C. M., de Mattos Pimenta, C. A., & Nobre, M. R. C. (2007). A estratégia PICO para a construção da pergunta de pesquisa e busca de evidências. Revista Latino-Americana de Enfermagem, 15(3).

CRISP-DM. (2003). Cross Industry Standard Process for Data Mining 1.0: Step by Step Data Mining Guide. [Online] 20 de Junho de 2019.

Dedić, N., & Stanier, C. (2016). An evaluation of the challenges of multilingualism in data warehouse development.

Dedić, N., & Stanier, C. (2017). Measuring the success of changes to Business Intelligence solutions to improve Business Intelligence reporting. Journal of Management Analytics, 4(2), 130-144.

Dittrich, Y., Nørbjerg, J., Tell, P., & Bendix, L. (2018, May). Researching cooperation and communication in continuous software engineering. In 2018 IEEE/ACM 11th International Workshop on Cooperative and Human Aspects of Software Engineering (CHASE) (pp. 87-90). IEEE.

Duan, L., & Da Xu, L. (2012). Business intelligence for enterprise systems: A survey. IEEE Transactions on Industrial Informatics, 8(3), 679-687.

Endres, A., & Rombach, H. D. (2003). A handbook of software and systems engineering: Empirical observations, laws, and theories. Pearson Education.

Fagerholm, F., Guinea, A. S., Mäenpää, H., & Münch, J. (2017). The RIGHT model for continuous experimentation. Journal of Systems and Software, 123, 292-305.

Farias, M. A., Xisto, R., Santos, M. S., Fontes, R. S., Colaço Júnior, M., Spínola, R., & Mendonça, M. (2019, May). Identifying technical debt through a code comment mining tool. In Proceedings of the XV Brazilian Symposium on Information Systems (pp. 1-8).

Fayyad, U. M., Piatetsky-Shapiro, G., & Smyth, P. (1996, August). Knowledge Discovery and Data Mining: Towards a Unifying Framework. In KDD (Vol. 96, pp. 82-88).

Goldratt, E. M., & Cox, J. (2016). The goal: a process of ongoing improvement. Routledge.

Hall, A. L., & Rist, R. C. (1999). Integrating multiple qualitative research methods (or avoiding the precariousness of a one‐legged stool). Psychology & Marketing, 16(4), 291-304.

Han, R., Nie, L., Ghanem, M. M., & Guo, Y. (2013, October). Elastic algorithms for guaranteeing quality monotonicity in big data mining. In 2013 IEEE International Conference on Big Data (pp. 45-50). IEEE.

Hans, R. T., & Mnkandla, E. (2013, September). Modeling software engineering projects as a business: A business intelligence perspective. In 2013 Africon (pp. 1-5). IEEE.

Hohnhold, H., O'Brien, D., & Tang, D. (2015, August). Focusing on the long-term: It's good for users and business. In Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (pp. 1849-1858).

IBM. (2005). Analytics solutions unified method.

Isaca. (2018). COBIT® 2019 Framework: Introduction & Methodology. Information Systems Audit and Control Foundation (ISACA).

Ju, J., Liu, L., & Feng, Y. (2018). Citizen-centered big data analysis-driven governance intelligence framework for smart cities. Telecommunications Policy, 42(10), 881-896.

Kanavos, A., Nodarakis, N., Sioutas, S., Tsakalidis, A., Tsolis, D., & Tzimas, G. (2017). Large scale implementations for twitter sentiment classification. Algorithms, 10(1), 33.

King, W. R. (1988). How effective is your information systems planning?. Long range planning, 21(5), 103-112.

Kitchenham, B. (2004). Procedures for performing systematic reviews. Keele, UK, Keele University, 33(2004), 1-26.

Kitchenham, B., Brereton, O. P., Budgen, D., Turner, M., Bailey, J., & Linkman, S. (2009). Systematic literature reviews in software engineering–a systematic literature review. Information and software technology, 51(1), 7-15.

Kohavi, R., Longbotham, R., Sommerfield, D., & Henne, R. M. (2009). Controlled experiments on the web: survey and practical guide. Data mining and knowledge discovery, 18(1), 140-181.

Kohavi, R., Deng, A., Frasca, B., Walker, T., Xu, Y., & Pohlmann, N. (2013, August). Online controlled experiments at large scale. In Proceedings of the 19th ACM SIGKDD international conference on Knowledge discovery and data mining (pp. 1168-1176).

Kohavi, R., Deng, A., Longbotham, R., & Xu, Y. (2014, August). Seven rules of thumb for web site experimenters. In Proceedings of the 20th ACM SIGKDD international conference on Knowledge discovery and data mining (pp. 1857-1866).

Kohavi, R., & Longbotham, R. (2017). Online Controlled Experiments and A/B Testing. Encyclopedia of machine learning and data mining, 7(8), 922-929.

Kohtamäki, M., & Farmer, D. (2017). Strategic Agility—Integrating Business Intelligence with Strategy. In Real-time Strategy and Business Intelligence (pp. 11-36). Palgrave Macmillan, Cham.

Kubina, M., Varmus, M., & Kubinova, I. (2015). Use of big data for competitive advantage of company. Procedia Economics and Finance, 26, 561-565.

Kurgan, L. A., & Musilek, P. (2006). A survey of knowledge discovery and data mining process models. Knowledge Engineering Review, 21(1), 1-24.

Laudon, K. C., Laudon, J. P., & Marques, A. S. (2004). Sistemas de informação gerenciais. Pearson Educación.

Ławrynowicz, A., & Potoniec, J. (2014). Pattern based feature construction in semantic data mining. International Journal on Semantic Web and Information Systems (IJSWIS), 10(1), 27-65.

Lima, Adriano, Colaço Júnior, Methanias, Nascimento & Andre Vinicius RP. (2017). Um Survey com Empresas Brasileiras acerca da Utilização de Business Intelligence (BI) e um diagnóstico sobre a infraestrutura e metodologias associadas. Conferência Ibero-Americana de Engenharia de Software – Trilha de Engenharia de Software Experimental.

Lin, Y. F., Huang, C. F., & Tseng, V. S. (2017). A novel methodology for stock investment using high utility episode mining and genetic algorithm. Applied Soft Computing, 59, 303-315.

Mandić, V., Basili, V., Harjumaa, L., Oivo, M., & Markkula, J. (2010, September). Utilizing GQM+ Strategies for business value analysis: An approach for evaluating business goals. In Proceedings of the 2010 ACM-IEEE International Symposium on Empirical Software Engineering and Measurement (pp. 1-10).

Manigandan, E., Shanthi, V., & Kasthuri, M. (2019). Parallel clustering for data mining in CRM. In Data Management, Analytics and Innovation (pp. 117-127). Springer, Singapore.

Mariscal, G., Marban, O., & Fernandez, C. (2010). A survey of data mining and knowledge discovery process models and methodologies. The Knowledge Engineering Review, 25(2), 137.

Matignon, R. (2007). Data mining using SAS enterprise miner (Vol. 638). John Wiley & Sons.

McCue, C. (2014). Data mining and predictive analysis: Intelligence gathering and crime analysis. Butterworth-Heinemann.

Medeiros Júnior, J. V., de Sousa Neto, M. V., Añez, M. E. M., & de Moraes, E. A. (2017). Identifying mechanisms to develop information technology capabilities. Revista Ibero-Americana de Estratégia, 16(4), 37-49.

Mola, L., Rossignoli, C., Carugati, A., & Giangreco, A. (2015). Business intelligence system design and its consequences for knowledge sharing, collaboration, and decision-making: an exploratory study. International Journal of Technology and Human Interaction (IJTHI), 11(4), 1-25.

More, S. (2014, May). Modified path traversal for an efficient web navigation mining. In 2014 IEEE International Conference on Advanced Communications, Control and Computing Technologies (pp. 940-945). IEEE.

Olsson, H. H., Alahyari, H., & Bosch, J. (2012, September). Climbing the" Stairway to Heaven"--A Mulitiple-Case Study Exploring Barriers in the Transition from Agile Development towards Continuous Deployment of Software. In 2012 38th euromicro conference on software engineering and advanced applications (pp. 392-399). IEEE.

Olsson, H. H., & Bosch, J. (2014). The HYPEX model: from opinions to data-driven software development. In Continuous software engineering (pp. 155-164). Springer, Cham.

Olszak, C. M., & Ziemba, E. (2012). Critical success factors for implementing business intelligence systems in small and medium enterprises on the example of upper Silesia, Poland. Interdisciplinary Journal of Information, Knowledge, and Management, 7(2), 129-150.

Petersen, K., Feldt, R., Mujtaba, S., & Mattsson, M. (2008, June). Systematic mapping studies in software engineering. In 12th International Conference on Evaluation and Assessment in Software Engineering (EASE) 12 (pp. 1-10).

Petersen, K., Vakkalanka, S., & Kuzniarz, L. (2015). Guidelines for conducting systematic mapping studies in software engineering: An update. Information and Software Technology, 64, 1-18.

Puppala, M., He, T., Chen, S., Ogunti, R., Yu, X., Li, F., ... & Wong, S. T. (2015). METEOR: an enterprise health informatics environment to support evidence-based medicine. IEEE Transactions on Biomedical Engineering, 62(12), 2776-2786.

Reich, B. H., & Benbasat, I. (1996). Measuring the linkage between business and information technology objectives. MIS quarterly, 55-81.

Rodríguez, P., Haghighatkhah, A., Lwakatare, L. E., Teppola, S., Suomalainen, T., Eskeli, J., ... & Oivo, M. (2017). Continuous deployment of software intensive products and services: A systematic mapping study. Journal of Systems and Software, 123, 263-291.

Ruggieri, S., Pedreschi, D., & Turini, F. (2010). Integrating induction and deduction for finding evidence of discrimination. Artificial Intelligence and Law, 18(1), 1-43.

Santos, I. P. O., Costa, J. K. G., Colaço Júnior, M., & Nascimento, A. V. R. (2017, April). Experimental Evaluation of Automatic Tests Cases in Data Analytics Applications Loading Procedures. In ICEIS (1) (pp. 304-311).

SAS. (2005). Semma data mining methodology.

Sharma, S., Osei-Bryson, K. M., & Kasper, G. M. (2012). Evaluation of an integrated Knowledge Discovery and Data Mining process model. In Expert Systems with Applications, 39(13), 11335-11348.

Shi, Y., & Lu, X. (2010, November). The role of business intelligence in business performance management. In 2010 3rd International Conference on Information Management, Innovation Management and Industrial Engineering (Vol. 4, pp. 184-186). IEEE.

Shmueli, G., Bruce, P. C., Yahav, I., Patel, N. R., & Lichtendahl Jr, K. C. (2017). Data mining for business analytics: concepts, techniques, and applications in R. John Wiley & Sons.

Silva Filho, R. L. L., Motejunas, P. R., Hipólito, O., & Lobo, M. B. D. C. M. (2007). A evasão no ensino superior brasileiro. Cadernos de pesquisa, 37, 641-659.

Singh, B. (2016). The Lean Startup: How Today's Entrepreneurs Use Continuous Innovation to Create Radically Successful Businesses. Bangalore Vol. 11, Ed. 2.

Sjøberg, D. I., Hannay, J. E., Hansen, O., Kampenes, V. B., Karahasanovic, A., Liborg, N. K., & Rekdal, A. C. (2005). A survey of controlled experiments in software engineering. IEEE transactions on software engineering, 31(9), 733-753.

Sun, Y., Bauer, B., & Weidlich, M. (2017, November). Compound trace clustering to generate accurate and simple sub-process models. In International Conference on Service-Oriented Computing (pp. 175-190). Springer, Cham.

Thamir, A., & Poulis, E. (2015). Business intelligence capabilities and implementation strategies. International Journal of Global Business, 8(1), 34.

Tonelli, A. O., Bermejo, P. H. D. S., & Zambalde, A. L. (2014). Using the bsc for strategic planning of it (information technology) in brazilian organizations. JISTEM-Journal of Information Systems and Technology Management, 11(2), 361-378.

Vitt, C. A., & Xiong, H. (2015, November). The impact of patent activities on stock dynamics in the high-tech sector. In 2015 IEEE International Conference on Data Mining (pp. 399-408). IEEE.

Yu, L., Zheng, J., Shen, W. C., Wu, B., Wang, B., Qian, L., & Zhang, B. R. (2012, August). BC-PDM: data mining, social network analysis and text mining system based on cloud computing. In Proceedings of the 18th ACM SIGKDD international conference on Knowledge discovery and data mining (pp. 1496-1499).

Wang, X., & Sun, Z. (2013, November). The design of water resources and hydropower cloud GIS platform based on big data. In International Conference on Geo-Informatics in Resource Management and Sustainable Ecosystem (pp. 313-322). Springer, Berlin, Heidelberg.

Weber, M., & Klein, A. Z. (2013). Gestão estratégica em empresas de tecnologia da informação: um estudo de caso. Revista Ibero Americana de Estratégia, 12(3), 37-65.

Wirth, R., & Hipp, J. (2000, April). CRISP-DM: Towards a standard process model for data mining. In Proceedings of the 4th international conference on the practical applications of knowledge discovery and data mining (Vol. 1). London, UK: Springer-Verlag.



  • There are currently no refbacks.

Copyright (c) 2022 Iberoamerican Journal of Strategic Management (IJSM)

Creative Commons License
This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.

Revista Iberoamericana de Gestão Estratégica (IJSM)
Revista Ibero-Americana de Estratégia (RIAE)
e-ISSN: 2176-0756

Revista Iberoamericana de Gestão Estratégica (IJSM) © 2022 Todos os direitos reservados.

Esta obra está licenciada com Licença
Creative Commons Atribuição-NãoComercial-CompartilhaIgual 4.0 Internacional