current research topics in data mining

data mining Recently Published Documents

Total documents.

• Latest Documents
• Most Cited Documents
• Contributed Authors
• Related Sources
• Related Keywords

Distance Based Pattern Driven Mining for Outlier Detection in High Dimensional Big Dataset

Detection of outliers or anomalies is one of the vital issues in pattern-driven data mining. Outlier detection detects the inconsistent behavior of individual objects. It is an important sector in the data mining field with several different applications such as detecting credit card fraud, hacking discovery and discovering criminal activities. It is necessary to develop tools used to uncover the critical information established in the extensive data. This paper investigated a novel method for detecting cluster outliers in a multidimensional dataset, capable of identifying the clusters and outliers for datasets containing noise. The proposed method can detect the groups and outliers left by the clustering process, like instant irregular sets of clusters (C) and outliers (O), to boost the results. The results obtained after applying the algorithm to the dataset improved in terms of several parameters. For the comparative analysis, the accurate average value and the recall value parameters are computed. The accurate average value is 74.05% of the existing COID algorithm, and our proposed algorithm has 77.21%. The average recall value is 81.19% and 89.51% of the existing and proposed algorithm, which shows that the proposed work efficiency is better than the existing COID algorithm.

Implementation of Data Mining Technology in Bonded Warehouse Inbound and Outbound Goods Trade

For the taxed goods, the actual freight is generally determined by multiplying the allocated freight for each KG and actual outgoing weight based on the outgoing order number on the outgoing bill. Considering the conventional logistics is insufficient to cope with the rapid response of e-commerce orders to logistics requirements, this work discussed the implementation of data mining technology in bonded warehouse inbound and outbound goods trade. Specifically, a bonded warehouse decision-making system with data warehouse, conceptual model, online analytical processing system, human-computer interaction module and WEB data sharing platform was developed. The statistical query module can be used to perform statistics and queries on warehousing operations. After the optimization of the whole warehousing business process, it only takes 19.1 hours to get the actual freight, which is nearly one third less than the time before optimization. This study could create a better environment for the development of China's processing trade.

Multi-objective economic load dispatch method based on data mining technology for large coal-fired power plants

User activity classification and domain-wise ranking through social interactions.

Twitter has gained a significant prevalence among the users across the numerous domains, in the majority of the countries, and among different age groups. It servers a real-time micro-blogging service for communication and opinion sharing. Twitter is sharing its data for research and study purposes by exposing open APIs that make it the most suitable source of data for social media analytics. Applying data mining and machine learning techniques on tweets is gaining more and more interest. The most prominent enigma in social media analytics is to automatically identify and rank influencers. This research is aimed to detect the user's topics of interest in social media and rank them based on specific topics, domains, etc. Few hybrid parameters are also distinguished in this research based on the post's content, post’s metadata, user’s profile, and user's network feature to capture different aspects of being influential and used in the ranking algorithm. Results concluded that the proposed approach is well effective in both the classification and ranking of individuals in a cluster.

A data mining analysis of COVID-19 cases in states of United States of America

Epidemic diseases can be extremely dangerous with its hazarding influences. They may have negative effects on economies, businesses, environment, humans, and workforce. In this paper, some of the factors that are interrelated with COVID-19 pandemic have been examined using data mining methodologies and approaches. As a result of the analysis some rules and insights have been discovered and performances of the data mining algorithms have been evaluated. According to the analysis results, JRip algorithmic technique had the most correct classification rate and the lowest root mean squared error (RMSE). Considering classification rate and RMSE measure, JRip can be considered as an effective method in understanding factors that are related with corona virus caused deaths.

Exploring distributed energy generation for sustainable development: A data mining approach

A comprehensive guideline for bengali sentiment annotation.

Sentiment Analysis (SA) is a Natural Language Processing (NLP) and an Information Extraction (IE) task that primarily aims to obtain the writer’s feelings expressed in positive or negative by analyzing a large number of documents. SA is also widely studied in the fields of data mining, web mining, text mining, and information retrieval. The fundamental task in sentiment analysis is to classify the polarity of a given content as Positive, Negative, or Neutral . Although extensive research has been conducted in this area of computational linguistics, most of the research work has been carried out in the context of English language. However, Bengali sentiment expression has varying degree of sentiment labels, which can be plausibly distinct from English language. Therefore, sentiment assessment of Bengali language is undeniably important to be developed and executed properly. In sentiment analysis, the prediction potential of an automatic modeling is completely dependent on the quality of dataset annotation. Bengali sentiment annotation is a challenging task due to diversified structures (syntax) of the language and its different degrees of innate sentiments (i.e., weakly and strongly positive/negative sentiments). Thus, in this article, we propose a novel and precise guideline for the researchers, linguistic experts, and referees to annotate Bengali sentences immaculately with a view to building effective datasets for automatic sentiment prediction efficiently.

Capturing Dynamics of Information Diffusion in SNS: A Survey of Methodology and Techniques

Studying information diffusion in SNS (Social Networks Service) has remarkable significance in both academia and industry. Theoretically, it boosts the development of other subjects such as statistics, sociology, and data mining. Practically, diffusion modeling provides fundamental support for many downstream applications (e.g., public opinion monitoring, rumor source identification, and viral marketing). Tremendous efforts have been devoted to this area to understand and quantify information diffusion dynamics. This survey investigates and summarizes the emerging distinguished works in diffusion modeling. We first put forward a unified information diffusion concept in terms of three components: information, user decision, and social vectors, followed by a detailed introduction of the methodologies for diffusion modeling. And then, a new taxonomy adopting hybrid philosophy (i.e., granularity and techniques) is proposed, and we made a series of comparative studies on elementary diffusion models under our taxonomy from the aspects of assumptions, methods, and pros and cons. We further summarized representative diffusion modeling in special scenarios and significant downstream tasks based on these elementary models. Finally, open issues in this field following the methodology of diffusion modeling are discussed.

The Influence of E-book Teaching on the Motivation and Effectiveness of Learning Law by Using Data Mining Analysis

This paper studies the motivation of learning law, compares the teaching effectiveness of two different teaching methods, e-book teaching and traditional teaching, and analyses the influence of e-book teaching on the effectiveness of law by using big data analysis. From the perspective of law student psychology, e-book teaching can attract students' attention, stimulate students' interest in learning, deepen knowledge impression while learning, expand knowledge, and ultimately improve the performance of practical assessment. With a small sample size, there may be some deficiencies in the research results' representativeness. To stimulate the learning motivation of law as well as some other theoretical disciplines in colleges and universities has particular referential significance and provides ideas for the reform of teaching mode at colleges and universities. This paper uses a decision tree algorithm in data mining for the analysis and finds out the influencing factors of law students' learning motivation and effectiveness in the learning process from students' perspective.

Intelligent Data Mining based Method for Efficient English Teaching and Cultural Analysis

The emergence of online education helps improving the traditional English teaching quality greatly. However, it only moves the teaching process from offline to online, which does not really change the essence of traditional English teaching. In this work, we mainly study an intelligent English teaching method to further improve the quality of English teaching. Specifically, the random forest is firstly used to analyze and excavate the grammatical and syntactic features of the English text. Then, the decision tree based method is proposed to make a prediction about the English text in terms of its grammar or syntax issues. The evaluation results indicate that the proposed method can effectively improve the accuracy of English grammar or syntax recognition.

Export Citation Format

Share document.

Recent advances in domain-driven data mining

• Published: 27 December 2022
• Volume 15 , pages 1–7, ( 2023 )

Cite this article

• Chuanren Liu 1 ,
• Ehsan Fakharizadi 2 ,
• Tong Xu 3 &
• Philip S. Yu 4  

2573 Accesses

1 Altmetric

Explore all metrics

Data mining research has been significantly motivated by and benefited from real-world applications in novel domains. This special issue was proposed and edited to draw attention to domain-driven data mining and disseminate research in foundations, frameworks, and applications for data-driven and actionable knowledge discovery. Along with this special issue, we also organized a related workshop to continue the previous efforts on promoting advances in domain-driven data mining. This editorial report will first summarize the selected papers in the special issue, then discuss various industrial trends in the context of the selected papers, and finally document the keynote talks presented by the workshop. Although many scholars have made prominent contributions with the theme of domain-driven data mining, there are still various new research problems and challenges calling for more research investigations in the future. We hope this special issue is helpful for scholars working along this critically important line of research.

Avoid common mistakes on your manuscript.

1 Summary of research contributions

Data mining has been a trending research area with contributions from diverse communities including computer scientists, statisticians, mathematicians, as well as other researchers and engineers working on data-intensive problems. While many researchers focus on general data mining methodologies for standardized problem settings, such as unsupervised learning and supervised learning, applying general solutions to specific problems may still be a nontrivial challenge. This is mainly due to the need to incorporate domain knowledge in implementing data mining solutions for novel real-world applications. Oftentimes standardized solutions must be significantly revised to accommodate unique characteristics of input data and deliver actionable results in novel application domains. Essentially, data mining research is highly applied. Many classic research problems are motivated by real-world applications and results of data mining research are expected to provide practical implications to business managers, government agencies, and all members of our society.

1.1 Overview of domain-driven data mining

Domain-driven data mining aims to bridge the gaps between theoretical research and practical applications in data mining and transform data intelligence to business value and impact [ 11 , 12 ]. Domain-driven data mining has been proposed as a research framework for discovering actionable knowledge and intelligence in a complex environment to directly transform data to decisions or enable decision-making actions [ 3 , 16 ].

Domain-driven data mining handles ubiquitous X-complexities and X-intelligences surrounding domain-driven actionable intelligence discovery. Examples of X-complexities and X-intelligences are related to domain complexity and intelligence, data complexity and intelligence, behavior complexity and intelligence, network complexity and intelligence, social complexity and intelligence, organizational complexity and intelligence, human complexity and intelligence, and their integration and meta-synthesis [ 8 , 16 ]. Analyzing and learning X-complexities and X-intelligences result in X-analytics [ 8 ] in various domains and on specific purposes. Examples are business analytics, behavior analytics, social analytics, operational analytics, risk analytics, customer analytics, insurance analytics, learning analytics, cybersecurity analytics, and financial analytics [ 15 , 21 , 24 , 26 , 28 , 29 , 31 , 38 , 40 , 41 , 42 , 43 , 51 ]. One prominent example of learning data complexities for in-depth data intelligence is the research on non-IID learning, which learns interactions and couplings (including correlation and dependency) involved in heterogeneous data, behaviors, and systems. Non-IID learning is applicable to many real-world applications such as non-IID outlier detection, non-IID recommendation, non-IID multimedia and multimodal analytics, and non-IID federated learning [ 5 , 6 , 17 ].

Domain-driven data mining also handles typical research issues and gaps in existing body of knowledge for domain-driven and actionable intelligence delivery. The research on domain-driven actionable intelligence discovery includes but is not limited to: quantifying knowledge actionability (rather than just interestingness) of data mining results [ 14 ], domain knowledge representation and domain generalization [ 30 ], domain-driven actionable knowledge discovery process [ 3 , 16 ], context-aware analytics and learning [ 46 ], discovering actionable patterns by combined mining [ 4 , 54 ] and high-utility mining [ 27 ], pattern relation analysis [ 4 ], cross-domain and transfer learning [ 24 , 36 , 45 , 51 ], data-to-decision transformation [ 8 ], personalized learning and recommendation [ 49 ], next-best action learning and recommendation [ 13 , 23 ], reflective learning with explicit and implicit feedback [ 32 , 50 ], explainable and interpretable analytics and learning [ 18 ], unbiased and fair analytics and learning [ 1 , 25 , 32 ], privacy and security-preserved analytics [ 52 ], and ethical analytics [ 34 ].

To better understand the challenges, recent advances, and new opportunities in domain-driven data mining, this special issue, along with other related activities, was proposed to call for the latest theoretical and practical developments, expert opinions on the open challenges, lessons learned, and best practices in domain-driven data mining. The special issue received submissions from researchers with different backgrounds, but all focusing on data-intensive research topics with novel applications. The papers accepted in this special issue explored novel factors and challenges such as socioeconomic, organizational, human-centered, and cultural aspects in different data mining tasks. In the following, we first provide a summary of the selected papers in the special issue.

1.2 Applied and flexible deep learning

Deep representation learning has attracted much attention in recent years. For chronic disease diagnosis, Zhang et al. [ 48 ] designed an unsupervised representation learning method to obtain informative correlation-aware signals from multivariate time series data. The key idea was a contrastive learning framework with a graph neural network (GNN) encoder to capture inter- and intra-correlation of multiple longitudinal variables. The work also considered modeling uncertainty quantification with evidential theory to assist the decision-making process in detecting chronic diseases. Also based on deep learning models, Sun et al. [ 37 ] adopted the sequential long short-term memory (LSTM) models in the domain of sports analytics for the baseball industry. With the numbers of home runs as the predictive target, the authors applied their models on the data from Major league Baseball (MLB) to support important decisions in managing players and teams. The results showed that deep learning model could perform better and bring valuable information to meet users’ needs. Focusing on more fundamental deep learning techniques, Zhao et al. [ 53 ] developed a flexible approach to compact architecture search for deep multitask learning (MTL) problems. Though sharing model architectures is a popular method for MTL problems, identifying the appropriate components to be shared by multiple tasks is still a challenge. Based on the expressive reinforcement learning framework, this paper proposed to discover flexible and compact MTL architectures with efficient search space and cost.

1.3 Interpretable and actionable predictions

A critical challenge facing data mining research is to discover actionable knowledge that can directly support decision-making tasks. In the domain of agricultural business and ecosystem management, Basak et al. [ 2 ] applied machine learning methods for a novel problem of soil moisture forecasting. The two modeling challenges were accurate long-term prediction and interpretable hydrological parameters. The proposed domain-driven solution was rooted in deterministic and physically based hydrological redistribution processes of gravity and suction.

As another example of actionable knowledge discovery, Dey et al. [ 19 ] proposed a systematic approach for fire station location planning. As urban fires could adversely affect the socioeconomic growth and ecosystem health of our communities, the authors applied various data mining and machine learning models in working with the Victoria Fire Department to make important decisions for selecting location of a new fire station. The key idea in their approach was to develop effective models for demand prediction and utilize the models to define a generalized index to measure quality of fire service in urban settings. The paper integrated multiple data sources and important domain knowledge/requirements in the modeling process. The final decision task was formulated as an integer programming problem to select the optimal location with maximum service coverage.

For sequential e-commerce product recommendation, Nasir and Ezeife [ 33 ] proposed the Semantic Enabled Markov Model Recommendation system to address long-standing challenges such as model complexity, data sparsity, and ambiguous predictions. Their system was proposed to extract and integrate sequential and semantic knowledge as well as contextual features. The new system showed improved recommendation performance for multiple e-commerce recommendation tasks.

1.4 Unsupervised learning with domain knowledge

Incorporating domain knowledge for unsupervised learning is particularly challenging due to the lack of clearly defined learning target. In the domain of health care, Jasinska-Piadlo et al. [ 22 ] explored the advantages and the challenges of a “domain-led” approach versus a data-driven approach to K -means clustering analysis. The authors compared expert opinions and principal component analysis for selecting the most useful variables to be used for the K -means clustering. The paper discussed comparative advantages of each approach and illustrated that domain knowledge played an important role at the interpretation stage of the clustering results. The authors developed a practical checklist guiding how to enable the integration of domain knowledge into a data mining project.

Similarly, text mining and natural language process are important research tools in many areas. However, many state-of-the-art text and language models are developed for general context, and careful adaption is often needed in applying such techniques on domain-specific data. In this special issue, Villanes and Healey [ 39 ] investigated the use of sentiment dictionaries to estimate sentiment for large document collections. The authors presented a semiautomatic method for extending general sentiment dictionary for a specific target domain. To minimize manual effort, the authors combined statistical term identification and term evaluation using Amazon Mechanical Turk in a study on dengue fever. The same approach could be potentially applied for constructing similar term-based sentiment dictionary in other target domains.

2 New trends from the industry perspective

A continuing trend in the data mining field has been the proliferation of its applications to new domains. This is partly due to the advancements in machine learning technologies evidenced by and promoted through frequent reports of new performance records on benchmark tasks. Another contributor to this proliferation is the increase in the quantity of data collected, stored, and appropriately documented for mining since the benefits of leveraging this data has become more apparent. Some of the works in this special issue demonstrated how data mining techniques can be applied in agriculture [ 2 ], health care and medicine [ 22 , 48 ], and city planning [ 19 ].

One aspect of data quality at the core of this expansion is the growing use of rich data formats. Image, audio, video, and raw text can now be almost directly fed into models that process them to extract meaningful features, patterns, and insights. These formats now often supplement the tabular data structures of the past as shown by Nasir and Ezeife [ 33 ]. To accommodate using these new formats, data mining and machine learning models have adapted to support multi-channel, multimodal, and sequential inputs [ 33 , 37 ].

As more domains employ novel data mining techniques, there have been more opportunities for cross-domain spillovers. We now see more examples of transfer learning, where models trained on one (source) domain are applied in another (target) domain suffering from data scarcity. However, learning generalized models that perform well on multiple tasks could be a challenging process [ 53 ]. These models are often trained with self-supervision on large data and contain millions or billions of learned parameters, such as models for language processing (e.g., BERT, GPT-3, XLNet) and image classification (ResNet, EfficientNet, Inception). A fundamental property of many generalized models is their ability to encode the input data into a vectorized representation, as evidenced by Zhang et al. [ 48 ].

Another recent challenge in data mining, one that is especially amplified in the case of transfer learning involving large models, is the issue of compactness. In many domains, where there is a need for scalable low-latency inferences and when the cost of training new models and deploying them could get high, it becomes necessary to restrict the model size. There are several techniques to accomplish these objectives including pruning, distilling, and training with constraints as Zhao et al. [ 53 ] demonstrated in this special issue.

Along with these trends, there have been several key developments in the structures used for data mining. One that has drastically improved the ability to digest sequential data is the invention of transformer structures. Transformers have effectively revolutionized the deep learning field by enabling models to understand the internal relationship between interdependent data points. These structures are the primary building blocks of some of the large generalized models mentioned above. Another recent progress is the improved ability of the generative models that learn not to score or classify but to create rich outputs such as images, texts, or audio. We also continue seeing more expansion in the field of graph neural network, where models learn and reproduce attributes of a graph data structure [ 48 ].

The sophistication of data mining methods has resulted in improved performance but comes at a cost. Models that use larger and richer input data, capture complex interaction between data points, and map the inputs to abstract representation spaces are very hard if not impossible to interpret. In many domains, it is important for the model outputs to be explainable to decision makers. Explainability matters for three reasons. First, explainable results are more powerful at both convincing decision makers and educating them with insights from the data [ 2 ]. Explainability is also a safeguard against models learning human biases and learning to discriminate. Finally, in some applications, it is necessary to understand not just the predicted value, but also the uncertainty of the predictions. Uncertainty modeling and quantification may be necessary in order to know when to rely on the machine and when to rely on the human. A recently popularized concept in this area is the human-in-the-loop approach, where models continuously receive and learn input from human experts and human decision makers, and meanwhile, experts use model predictions in their decision making on regular basis. Our authors in this special issue have demonstrated great potential of domain-driven data mining in addressing the aforementioned challenges, and more work is needed in the future with the collaboration between academia and industry.

3 Domain-driven data mining workshop

To facilitate the exchange of recent advances in domain-driven data mining, the Domain-Driven Data Mining Workshop was organized as a part of the 2021 SIAM International Conference on Data Mining. The workshop invited three keynote speakers and received paper submissions from multiple institutions. The papers accepted by the workshop were later invited for potential publication in this special issue. In the following, we review the invited keynote talks at the Domain-Driven Data Mining Workshop.

3.1 Actionable intelligence discovery

We first invited Dr. Longbing Cao for his keynote talk, “Domain-Driven and Actionable Intelligence Discovery.” In 2004, Dr. Cao proposed the concept “domain-driven data mining” and has led to implement many large enterprise data science projects for actionable knowledge discovery for governments and businesses, involving over 10 domains including capital markets, banking, insurance, telecommunication, transport, education, smart cities, online business, and public sectors (e.g., financial service, taxation, social welfare, IP, regulation, immigration).

Dr. Cao led a series of activities and proposed “domain-driven data mining” for “actionable knowledge discovery” in complex domains and problems, when discovering “actionable intelligence” was not a trivial task. The significant developments of data science, new-generation AI, and deep neural learning make domain-driven actionable intelligent discovery possible with progress made such as in representing and learning various complexities and intelligences in complex systems, data, and behaviors. In his talk, Dr. Cao first reviewed the aims, progresses, and gaps of conventional data mining/knowledge discovery and machine learning, domain-driven actionable knowledge discovery, and challenges and opportunities in domain-driven actionable intelligence discovery. Then, Dr. Cao discussed related strategic issues in data science thinking [ 8 ], new-generation AI [ 9 ], and actionable deep learning. Dr. Cao shared many thought-provoking illustrations, case studies, and theoretical and practical challenges in industry and government data sciences.

Particularly, Dr. Cao has made broad and in-depth contribution in understanding data complexities and data intelligence. One of his recent foci is learning from non-IID data, forming the research on non-IID learning [ 10 , 17 ]. Non-IID learning goes beyond the classic analytical and learning systems based on the common independent and identically distributed (IID) assumption widely taken in existing science, technology, and engineering. It studies the comprehensive non-IIDnesses [ 5 ], i.e., coupling relationships and interactions (including but beyond correlation and dependency) [ 6 ], and heterogeneities (including but beyond nonidentical distribution) in data, behaviors, and systems. The research on non-IID learning has evolved to almost all areas in data mining, analytics, and learning [ 17 ], such as non-IID data preparation, non-IID feature engineering, non-IID representation learning, non-IID similarity and metric learning, non-IID statistical learning, non-IID learning architecture, non-IID ensemble learning, non-IID federated learning, non-IID transfer learning, non-IID evaluation and validation, and various non-IID learning applications, such as non-IID recommender systems, non-IID outlier detection, non-IID information retrieval, and non-IID image and vision learning [ 5 , 20 , 35 , 47 , 55 ].

For instance, Cao [ 7 ] emphasized the critical issues of the intrinsic assumption that IID users and items in existing recommender systems, leading to false, misleading or incorrect recommendation, and poor performance in cold-start, sparse, and dynamic recommendations. Therefore, a non-IID theoretical framework is needed in order to build a deep and comprehensive understanding of the intrinsic nature of recommendation problems, from the perspective of both couplings and heterogeneities. Such research investigations led by Dr. Cao have triggered the paradigm shift from IID to non-IID recommendation research and can hopefully deliver informed, relevant, personalized, and actionable recommendations. All together, these contributions led to exciting new directions and fundamental solutions to address various challenges including cold-start, sparse data-based, cross-domain, group-based, and shilling attack-related issues in recommender systems.

3.2 A deep learning framework

We invited Dr. Balaji Padmanabhan for his keynote talk titled “Domain-Driven Data Mining: Examples and a Deep Learning Framework.” Dr. Padmanabhan is the Anderson Professor of Global Management and Professor of Information Systems at the University of South Florida’s Muma College of Business, where he is also the director of the Center for Analytics and Creativity. He has worked in data science, AI/machine learning, and business analytics for over two decades in the areas of research, teaching, business management, mentoring graduate students, and designing academic programs. He has also worked with over twenty firms on machine learning and data science initiatives in a variety of sectors. He has published extensively in data science and related areas at premier journals and conferences in the field and has served on the editorial board of leading journals including Management Science, MIS Quarterly, INFORMS Journal on Computing, Information Systems Research, Big Data, ACM Transactions on MIS, and the Journal of Business Analytics.

Dr. Padmanabhan witnessed and led the development of data mining. “I did my PhD at that time when the term of data mining first came up,” he shared with the audience of the workshop audience and reviewed the history of domain-driven data mining research. Then he presented a series of examples over the last two decades of his work. In generalizing from these examples, he emphasized that there are often different extents to which “domain” matters in different data mining endeavors. Dr. Padmanabhan encouraged the workshop audience to “think domain-driven,” which often motivates novel domain-driven methods that can meanwhile be applied more broadly (or “domain free”). Dr. Padmanabhan also shared a general framework for domain-driven deep learning in business research and used this framework to show how researchers can highlight significant contributions and position their own papers and ideas. Dr. Padmanabhan’s insightful cases and valuable research advice were greatly appreciated by the workshop audience from research communities of both computer science and management information systems.

In his talk, Dr. Padmanabhan also shared that his department has completed 100 projects in 7 years with about 30 companies, and funded postdoctoral research in analytics. His department has several outreach initiatives such as Economic Analytics Initiative and Florida Business Analytics Forum. Dr. Padmanabhan highlighted that such industrial collaborations and initiatives have greatly rewarded research activities particularly in domain-driven data mining projects. Dr. Padmanabhan encouraged researchers to actively reach out to industry not only when finding data but also to ask for new research questions.

3.3 Human resource management

We invited Dr. Hui Xiong for his keynote talk, “Artificial Intelligence in Human Resource Management.” Dr. Hui Xiong is a Distinguished Professor at the Rutgers, the State University of New Jersey. He also served as the Smart City Chief Scientist and the Deputy Dean of Baidu Research Institute in charge of several research laboratories. He is a co-Editor-in-Chief of Encyclopedia of GIS, an Associate Editor of IEEE Transactions on Big Data (TBD), ACM Transactions on Knowledge Discovery from Data (TKDD), and ACM Transactions on Management Information Systems (TMIS). Dr. Xiong has chaired for many international conferences in data mining, including a Program Co-Chair (2013) and a General Co-Chair (2015) for the IEEE International Conference on Data Mining (ICDM), and a Program Co-Chair of the Research Track (2018) and the Industry Track (2012) for the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD). Dr. Xiong’s research has generated substantive impact beyond academia. He is an ACM distinguished scientist and has been honored by the ICDM-2011 Best Research Paper Award, the 2017 IEEE ICDM Outstanding Service Award, and the 2018 Ram Charan Management Practice Award as the Grand Prix winner from the Harvard Business Review. In 2020, he was named as an AAAS Fellow and an IEEE Fellow.

Dr. Xiong shared a successful story in leveraging big data technology for human resource management. Indeed, the availability of large-scale human resource (HR) data has enabled unparalleled opportunities for business leaders to understand talent behaviors and generate useful talent knowledge, which in turn deliver intelligence for real-time decision making and effective people management at work. In his talk, Dr. Xiong introduced a powerful set of innovative Artificial Intelligence (AI) techniques developed for intelligent human resource management, such as recruiting, performance evaluation, talent retention, talent development, job matching, team management, leadership development, and organization culture analysis. With his rich experiences and close collaborations with the industry, Dr. Xiong demonstrated how the results of talent analytics can be used for other business applications, such as market trend analysis and financial investment.

4 Concluding remarks

This special issue was proposed and edited to draw attention to domain-driven data mining and disseminate research in foundations, frameworks, and applications for data-driven and actionable knowledge discovery. This special issue and related activities on recent advances in domain-driven data mining continued the previous efforts including the workshop series on the same topic during 2007–2014 with the IEEE International Conference on Data Mining and a special issue published by the IEEE Transactions on Knowledge and Data Engineering [ 44 ]. Although many scholars have made significant contributions with the theme of domain-driven data mining, there are still various new research problems and challenges calling for more research investigations in the coming years. We hope this special issue is helpful for scholars working along this critically important line of research.

Alves, G., Amblard, M., Bernier, F., Couceiro, M., Napoli, A.: Reducing unintended bias of ML models on tabular and textual data. In: DSAA, pp. 1–10 (2021)

Basak, A., Schmidt, K.M., Mengshoel, O.J.: From data to interpretable models: machine learning for soil moisture forecasting. Int. J. Data Sci. Anal. (2022). https://doi.org/10.1007/s41060-022-00347-8

Cao, L.: Domain-driven data mining: challenges and prospects. IEEE Trans. Knowl. Data Eng. 22 (6), 755–769 (2010)

Article   Google Scholar  

Cao, L.: Combined mining: analyzing object and pattern relations for discovering and constructing complex yet actionable patterns. Wiley Interdiscip. Rev. Data Min. Knowl. Discov. 3 (2), 140–155 (2013)

Cao, L.: Non-iidness learning in behavioral and social data. Comput. J. 57 (9), 1358–1370 (2014)

Cao, L.: Coupling learning of complex interactions. Inf. Process. Manag. 51 (2), 167–186 (2015)

Cao, L.: Non-iid recommender systems: a review and framework of recommendation paradigm shifting. Engineering 2 (2), 212–224 (2016)

Cao, L.: Data Science Thinking: The Next Scientific, Technological and Economic Revolution. Data Analytics. Springer, Berlin (2018)

Book   Google Scholar  

Cao, L.: A new age of AI: features and futures. IEEE Intell. Syst. 37 (1), 25–37 (2022)

Cao, L.: Beyond i.i.d.: non-iid thinking, informatics, and learning. IEEE Intell. Syst. 37 (04), 5–17 (2022)

Cao, L., Zhang, C.: Domain-driven actionable knowledge discovery in the real world. In: PAKDD 2006, pp. 821–830 (2006)

Cao, L., Zhang, C.: The evolution of kdd: towards domain-driven data mining. IJPRAI 21 (4), 677–692 (2007)

Google Scholar  

Cao, L., Zhu, C.: Personalized next-best action recommendation with multi-party interaction learning for automated decision-making. PLoS ONE 17 , 1–22 (2022)

Cao, L., Luo, D., Zhang, C.: Knowledge actionability: satisfying technical and business interestingness. IJBIDM 2 (4), 496–514 (2007)

Cao, L., Zhang, C., Yang, Q., Bell, D.A., Vlachos, M., Taneri, B., Keogh, E.J., Yu, P.S., Zhong, N., Ashrafi, M.Z., Taniar, D., Dubossarsky, E., Graco, W.: Domain-driven, actionable knowledge discovery. IEEE Intell. Syst. 22 (4), 78–88 (2007)

Cao, L., Yu, P.S., Zhang, C., Zhao, Y.: Domain Driven Data Mining. Springer, Berlin (2010)

Book   MATH   Google Scholar  

Cao, L., Philip, S.Y., Zhao, Z.: Shallow and deep non-iid learning on complex data. In: Proceedings of the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, (2022)

Carlevaro, A., Mongelli, M.: A new SVDD approach to reliable and explainable AI. IEEE Intell. Syst. 37 (2), 55–68 (2022)

Dey, A., Heger, A., England, D.: Urban fire station location planning using predicted demand and service quality index. Int. J. Data Sci. Anal. (2022). https://doi.org/10.1007/s41060-022-00328-x

Do, T.D.T., Cao, L.: Gamma-Poisson dynamic matrix factorization embedded with metadata influence. In: NeurIPS 2018, pp. 5829–5840 (2018)

He, F., Li, Y., Xu, T., Yin, L., Zhang, W., Zhang, X.: A data-analytics approach for risk evaluation in peer-to-peer lending platforms. IEEE Intell. Syst. 35 (3), 85–95 (2020)

Jasinska-Piadlo, A., Bond, R., Biglarbeigi, P., Brisk, R., Campbell, P., Browne, F., McEneaneny, D.: Data-driven versus a domain-led approach to k-means clustering on an open heart failure dataset. Int. J. Data Sci. Anal. (2022). https://doi.org/10.1007/s41060-022-00346-9

Jin, B., Yang, H., Sun, L., Liu, C., Qu, Y., Tong, J.: A treatment engine by predicting next-period prescriptions. In: KDD, pp. 1608–1616 (2018)

Kanter, J.M., Gillespie, O., Veeramachaneni, K.: Label, segment, featurize: a cross domain framework for prediction engineering. In: DSAA, pp. 430–439 (2016)

Ke, W., Liu, C., Shi, X., Dai, Y., Yu, P.S., Zhu, X.: Addressing exposure bias in uplift modeling for large-scale online advertising. In: ICDM, pp. 1156–1161 (2021)

Kompan, M., Gaspar, P., Macina, J., Cimerman, M., Bieliková, M.: Exploring customer price preference and product profit role in recommender systems. IEEE Intell. Syst. 37 (1), 89–98 (2022)

Lin, J.C.-W., Gan, W., Fournier-Viger, P., Hong, T.-P., Tseng, V.S.: Mining high-utility itemsets with various discount strategies. In: DSAA, pp. 1–10 (2015)

Liu, C., Zhu, W.: Precision coupon targeting with dynamic customer triage. In: DSAA, pp. 420–428 (2020)

Liu, Q., Zeng, X., Liu, C., Zhu, H., Chen, E., Xiong, H., Xie, X.: Mining indecisiveness in customer behaviors. In: ICDM, pp. 281–290 (2015)

Long, M., Wang, J., Sun, J.-G., Yu, P.S.: Domain invariant transfer kernel learning. IEEE Trans. Knowl. Data Eng. 27 (6), 1519–1532 (2015)

Ma, D., Narayanan, V.K., Liu, C., Fakharizadi, E.: Boundary salience: the interactive effect of organizational status distance and geographical proximity on coauthorship tie formation. Soc. Netw. 63 , 162–173 (2020)

Melucci, M.: Investigating sample selection bias in the relevance feedback algorithm of the vector space model for information retrieval. In: DSAA, pp. 83–89 (2014)

Nasir, M., Ezeife, C.I.: Semantic enhanced Markov model for sequential e-commerce product recommendation. Int. J. Data Sci. Anal., (2022) https://doi.org/10.1007/s41060-022-00343-y

O’Leary, D.E.: Ethics for big data and analytics. IEEE Intell. Syst. 31 (4), 81–84 (2016)

Pang, G., Cao, L., Chen, L.: Homophily outlier detection in non-iid categorical data. Data Min. Knowl. Discov. 35 (4), 1163–1224 (2021)

Article   MATH   Google Scholar  

Ruiz-Dolz, R., Alemany, J., Barberá, S.H., García-Fornes, A.: Transformer-based models for automatic identification of argument relations: a cross-domain evaluation. IEEE Intell. Syst. 36 (6), 62–70 (2021)

Sun, H.-C., Lin, T.-Y., Tsai, Y.-L.: Performance prediction in major league baseball by long short-term memory networks. Int. J. Data Sci. Anal. (2022). https://doi.org/10.1007/s41060-022-00313-4

Teng, M., Zhu, H., Liu, C., Xiong, H.: Exploiting network fusion for organizational turnover prediction. ACM Trans. Manag. Inf. Syst. 12 (2), 16:1-16:18 (2021)

Villanes, A., Healey, C.G.: Domain-specific text dictionaries for text analytics. Int. J. Data Sci. Analy., Special Issue on Domain-Driven Data Mining (2022)

Xiang, H., Lin, J., Chen, C.-H., Kong, Y.: Asymptotic meta learning for cross validation of models for financial data. IEEE Intell. Syst. 35 (2), 16–24 (2020)

Xu, L., Wei, X., Cao, J., Yu, P.S.: Multiple social role embedding. In: DSAA, pp. 581–589. IEEE (2017)

Yang, D., Bingqing, Q., Cudré-Mauroux, P.: Location-centric social media analytics: challenges and opportunities for smart cities. IEEE Intell. Syst. 36 (5), 3–10 (2021)

Yang, J., Liu, C., Teng, M., Xiong, H., Liao, M., Zhu, V.: Exploiting temporal and social factors for B2B marketing campaign recommendations. In: ICDM, pp. 499–508 (2015)

Zhang, C., Yu, P., Bell, D.: Introduction to the domain-drive data mining special section. IEEE Trans. Knowl. Data Eng. 22 (6), 753–754 (2010)

Zhang, J., He, M.: CRTL: context restoration transfer learning for cross-domain recommendations. IEEE Intell. Syst. 36 (4), 65–72 (2021)

Zhang, K., Chen, E., Liu, Q., Liu, C., Lv, G.: A context-enriched neural network method for recognizing lexical entailment. In: AAAI, pp. 3127–3134 (2017)

Zhang, Q., Cao, L., Zhu, C., Li, Z., Sun, J.: Coupledcf: learning explicit and implicit user-item couplings in recommendation for deep collaborative filtering. In: IJCAI 2018, pp. 3662–3668 (2018)

Zhang, X., Wang, Y., Zhang, L., Jin, B., Zhang, H.: Exploring unsupervised multivariate time series representation learning for chronic disease diagnosis. Int. J. Data Sci. Anal. (2022). https://doi.org/10.1007/s41060-021-00290-0

Zhang, Y., Liu, G., Liu, A., Zhang, Y., Li, Z., Zhang, X., Li, Q.: Personalized geographical influence modeling for POI recommendation. IEEE Intell. Syst. 35 (5), 18–27 (2020)

Zhang, Y., Bai, G., Zhong, M., Li, X., Ryan, K.L.K.: Differentially private collaborative coupling learning for recommender systems. IEEE Intell. Syst. 36 (1), 16–24 (2021)

Zhang, Y., Zhang, X., Shen, T., Zhou, Y., Wang, Z.: Feature-option-action: a domain adaption transfer reinforcement learning framework. In: DSAA, pp. 1–12 (2021)

Zhang, Z., Liu, Q., Huang, Z., Wang, H., Lu, C., Liu, C., Chen, E.: Graphmi: extracting private graph data from graph neural networks. In: IJCAI, pp. 3749–3755 (2021)

Zhao, J., Lv, W., Du, B., Ye, J., Sun, L., Xiong, G.: Deep multi-task learning with flexible and compact architecture search. Int. J. Data Sci. Anal., Special Issue on Domain-Driven Data Mining (2022)

Zhao, Y., Zhang, H., Cao, L., Zhang, C., Bohlscheid, H.: Combined pattern mining: from learned rules to actionable knowledge. In: AI 2008, pp. 393–403 (2008)

Zhu, C., Cao, L., Yin, J.: Unsupervised heterogeneous coupling learning for categorical representation. IEEE Trans. Pattern Anal. Mach. Intell. 44 (1), 533–549 (2022)

Download references

Author information

Authors and affiliations.

The University of Tennessee, Knoxville, USA

Chuanren Liu

Snap Inc., Seattle, WA, USA

Ehsan Fakharizadi

University of Science and Technology of China, Hefei, China

University of Illinois Chicago, Chicago, USA

Philip S. Yu

You can also search for this author in PubMed   Google Scholar

Corresponding author

Correspondence to Chuanren Liu .

Additional information

Publisher's note.

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Liu, C., Fakharizadi, E., Xu, T. et al. Recent advances in domain-driven data mining. Int J Data Sci Anal 15 , 1–7 (2023). https://doi.org/10.1007/s41060-022-00378-1

Download citation

Published : 27 December 2022

Issue Date : January 2023

DOI : https://doi.org/10.1007/s41060-022-00378-1

Share this article

Anyone you share the following link with will be able to read this content:

Sorry, a shareable link is not currently available for this article.

Provided by the Springer Nature SharedIt content-sharing initiative

• Find a journal
• Publish with us
• Track your research

Articles on Data mining

Displaying 1 - 20 of 39 articles.

Zoom’s scrapped proposal to mine user data causes concern about our virtual and private Indigenous Knowledge

Andrew Wiebe , University of Toronto

Prosecraft has infuriated authors by using their books without consent – but what does copyright law say?

Dilan Thampapillai , UNSW Sydney

Protecting privacy online begins with tackling ‘digital resignation’

Meiling Fong , Concordia University and Zeynep Arsel , Concordia University

ChatGPT is a data privacy nightmare. If you’ve ever posted online, you ought to be concerned

Uri Gal , University of Sydney

Artificial intelligence is used for predictive policing in the US and UK – South Africa should embrace it, too

Omowunmi Isafiade , University of the Western Cape

Insurance firms can skim your online data to price your insurance — and there’s little in the law to stop this

Zofia Bednarz , University of Sydney ; Kayleen Manwaring , UNSW Sydney , and Kimberlee Weatherall , University of Sydney

Bitcoin: Greenpeace says a code change could slash cryptocurrency energy use – here’s why it’s not so simple

Peter Howson , Northumbria University, Newcastle

School posts on Facebook could threaten student privacy

Joshua Rosenberg , University of Tennessee

Is your phone really listening to your conversations? Well, turns out it doesn’t have to

Dana Rezazadegan , Swinburne University of Technology

Bitcoin isn’t getting greener: four environmental myths about cryptocurrency debunked

Race-based COVID-19 data may be used to discriminate against racialized communities

LLana James , University of Toronto

It’s not ‘fair’ and it won’t work: an argument against the ACCC forcing Google and Facebook to pay for news

Damien Spry , University of South Australia

China could be using TikTok to spy on Australians, but banning it isn’t a simple fix

Paul Haskell-Dowland , Edith Cowan University and James Jin Kang , Edith Cowan University

Don’t be phish food! Tips to avoid sharing your personal information online

Nik Thompson , Curtin University

Yes, websites really are starting to look more similar

Sam Goree , Indiana University

How to make the dreaded task of data entry less despised

Lisa Cohen , McGill University

Personal data isn’t the ‘new oil,’ it’s a way to manipulate capitalism

Kean Birch , York University, Canada

Amazon, Google and Facebook warrant antitrust scrutiny for many reasons – not just because they’re large

Amanda Lotz , Queensland University of Technology

Four flagship measurements of the GDPR for the economy

Patrick Waelbroeck , Télécom Paris – Institut Mines-Télécom

Your smartphone apps are tracking your every move – 4 essential reads

Jeff Inglis , The Conversation

Related Topics

• Artificial intelligence (AI)
• Data privacy
• Digital privacy
• Machine learning
• Online privacy
• Social media

Top contributors

Assistant Professor in International Development, Northumbria University, Newcastle

Senior Research Fellow, Allens Hub for Technology, Law & Innovation, and Senior Lecturer, School of Private & Commercial Law, UNSW Sydney

Associate Professor of Information Systems, Curtin University

Research Fellow, Horizon Digital Economy Research, University of Nottingham

Turing and Vice-Chancellor's Fellow, University of Bristol, University of Bristol

Professor of Sociology, Goldsmiths, University of London

Professor of Intellectual Property Law, University of Glasgow

Research Fellow, University of St Andrews

Research Fellow in Text Mining, The University of Edinburgh

Assistant Professor of Environmental History, University of Saskatchewan

Senior Lecturer in Technology, The Open University

Distinguished Professor and C. Ben Dutton Professor of Law, Indiana University

Senior Lecturer and Researcher in Innovation and Digital Leadership, University of Brighton

Associate professor, The University of Queensland

Lecturer, University of South Australia

• X (Twitter)
• Unfollow topic Follow topic

Data Mining and Modeling

The proliferation of machine learning means that learned classifiers lie at the core of many products across Google. However, questions in practice are rarely so clean as to just to use an out-of-the-box algorithm. A big challenge is in developing metrics, designing experimental methodologies, and modeling the space to create parsimonious representations that capture the fundamentals of the problem. These problems cut across Google’s products and services, from designing experiments for testing new auction algorithms to developing automated metrics to measure the quality of a road map.

Data mining lies at the heart of many of these questions, and the research done at Google is at the forefront of the field. Whether it is finding more efficient algorithms for working with massive data sets, developing privacy-preserving methods for classification, or designing new machine learning approaches, our group continues to push the boundary of what is possible.

Recent Publications

Some of our teams.

Algorithms & optimization

Climate and sustainability

Graph mining

Impact-Driven Research, Innovation and Moonshots

We're always looking for more talented, passionate people.

• Frontiers in Big Data
• Data Mining and Management
• Research Topics

Efficient Deep Learning Techniques for Big Data Mining

Total Downloads

Total Views and Downloads

About this Research Topic

Deep learning has considerably facilitated feature engineering and enabled deep knowledge excavation for mining unstructured and high-dimensional data. However, the advancement of deep learning methods is accompanied by significantly increased model complexity. The incurred computational overhead negatively ...

Keywords : deep learning, model compression, knowledge distillation, streaming data mining, interactive big data mining

Important Note : All contributions to this Research Topic must be within the scope of the section and journal to which they are submitted, as defined in their mission statements. Frontiers reserves the right to guide an out-of-scope manuscript to a more suitable section or journal at any stage of peer review.

Topic Editors

Topic coordinators, recent articles, submission deadlines, participating journals.

Manuscripts can be submitted to this Research Topic via the following journals:

total views

• Demographics

No records found

total views article views downloads topic views

Top countries

Top referring sites, about frontiers research topics.

With their unique mixes of varied contributions from Original Research to Review Articles, Research Topics unify the most influential researchers, the latest key findings and historical advances in a hot research area! Find out more on how to host your own Frontiers Research Topic or contribute to one as an author.

An official website of the United States government

The .gov means it’s official. Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

The site is secure. The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

• Publications
• Account settings

Preview improvements coming to the PMC website in October 2024. Learn More or Try it out now .

• Advanced Search
• Journal List
• Int J Environ Res Public Health

Data Mining in Healthcare: Applying Strategic Intelligence Techniques to Depict 25 Years of Research Development

Maikel luis kolling.

1 Graduate Program of Industrial Systems and Processes, University of Santa Cruz do Sul, Santa Cruz do Sul 96816-501, Brazil; [email protected] (M.L.K.); [email protected] (M.K.S.)

Leonardo B. Furstenau

2 Department of Industrial Engineering, Federal University of Rio Grande do Sul, Porto Alegre 90035-190, Brazil; rb.csinu.2xm@uanetsrufodranoel

Michele Kremer Sott

Bruna rabaioli.

3 Department of Medicine, University of Santa Cruz do Sul, Santa Cruz do Sul 96816-501, Brazil; moc.liamg@iloiabbaranurb

Pedro Henrique Ulmi

4 Department of Computer Science, University of Santa Cruz do Sul, Santa Cruz do Sul 96816-501, Brazil; [email protected]

Nicola Luigi Bragazzi

5 Laboratory for Industrial and Applied Mathematics (LIAM), Department of Mathematics and Statistics, York University, Toronto, ON M3J 1P3, Canada

Leonel Pablo Carvalho Tedesco

Associated data.

Not applicable.

In order to identify the strategic topics and the thematic evolution structure of data mining applied to healthcare, in this paper, a bibliometric performance and network analysis (BPNA) was conducted. For this purpose, 6138 articles were sourced from the Web of Science covering the period from 1995 to July 2020 and the SciMAT software was used. Our results present a strategic diagram composed of 19 themes, of which the 8 motor themes (‘NEURAL-NETWORKS’, ‘CANCER’, ‘ELETRONIC-HEALTH-RECORDS’, ‘DIABETES-MELLITUS’, ‘ALZHEIMER’S-DISEASE’, ‘BREAST-CANCER’, ‘DEPRESSION’, and ‘RANDOM-FOREST’) are depicted in a thematic network. An in-depth analysis was carried out in order to find hidden patterns and to provide a general perspective of the field. The thematic network structure is arranged thusly that its subjects are organized into two different areas, (i) practices and techniques related to data mining in healthcare, and (ii) health concepts and disease supported by data mining, embodying, respectively, the hotspots related to the data mining and medical scopes, hence demonstrating the field’s evolution over time. Such results make it possible to form the basis for future research and facilitate decision-making by researchers and practitioners, institutions, and governments interested in data mining in healthcare.

1. Introduction

Deriving from Industry 4.0 that pursues the expansion of its autonomy and efficiency through data-driven automatization and artificial intelligence employing cyber-physical spaces, the Healthcare 4.0 portrays the overhaul of medical business models towards a data-driven management [ 1 ]. In akin environments, substantial amounts of information associated to organizational processes and patient care are generated. Furthermore, the maturation of state-of-the-art technologies, namely, wearable devices, which are likely to transform the whole industry through more personalized and proactive treatments, will lead to a noteworthy increase in user patient data. Moreover, the forecast for the annual global growth in healthcare data should exceed soon 1.2 exabytes a year [ 1 ]. Despite the massive and growing volume of health and patient care information [ 2 ], it is still, to a great extent, underused [ 3 ].

Data mining, a subfield of artificial intelligence that makes use of vast amounts of data in order to allow significant information to be extracted through previously unknown patterns, has been progressively applied in healthcare to assist clinical diagnoses and disease predictions [ 2 ]. This information has been known to be rather complex and difficult to analyze. Furthermore, data mining concepts can also perform the analysis and classification of colossal bulks of information, grouping variables with similar behaviors, foreseeing future events, amid other advantages for monitoring and managing health systems ceaselessly seeking to look after the patients’ privacy [ 4 ]. The knowledge resulting from the application of the aforesaid methods may potentially improve resource management and patient care systems, assist in infection control and risk stratification [ 5 ]. Several studies in healthcare have explored data mining techniques to predict incidence [ 6 ] and characteristics of patients in pandemic scenarios [ 7 ], identification of depressive symptoms [ 8 ], prediction of diabetes [ 9 ], cancer [ 10 ], scenarios in emergency departments [ 11 ], amidst others. Thus, the utilization of data mining in health organizations ameliorates the efficiency of service provision [ 12 ], quality of decision making, and reduces human subjectivity and errors [ 13 ].

The understanding of data mining in the healthcare sector is, in this context, vital and some researchers have executed bibliometric analyses in the field with the intention of investigating the challenges, limitations, novel opportunities, and trends [ 14 , 15 , 16 , 17 ]. However, at the time of this study, there were no published works that provided a complete analysis of the field using a bibliometric performance and network analysis (BPNA) (see Table 1 . In the light of this, we have defined three research questions:

• RQ1: What are the strategic themes of data mining in healthcare?
• RQ2: How is the thematic evolution structure of data mining in healthcare?
• RQ3: What are the trends and opportunities of data mining in healthcare for academics and practitioners?

Existing bibliometric analysis of data mining in healthcare in Web of Science (WoS).

Thus, with the objective to lay out a superior understanding of the data mining usage in the healthcare sector and to answer the defined research questions, we have performed a bibliometric performance and network analysis (BPNA) to set fourth an overview of the area. We used the Science Mapping Analysis Software Tool (SciMAT), a software developed by Cobo et al. [ 18 ] with the purpose of identifying strategic themes and the thematic evolution structure of a given field, which can be used as a strategic intelligence tool. The strategic intelligence, an approach that can enhance decision-making in terms of science and technology trends [ 19 , 20 , 21 , 22 , 23 , 24 , 25 , 26 , 27 ], can help researchers and practitioners to understand the area and devise new ideas for future works as well as to identify the trends and opportunities of data mining in healthcare.

This research is structured as follows: Section 2 highlights the methodology and the dataset. Section 3 presents the bibliometric performance of data mining in healthcare. In Section 4 , the strategic diagram presents the most relevant themes according to our bibliometric indicators as well as the thematic network structure of the motor themes and the thematic evolution structure, which provide a complete overview of data mining over time. Section 5 presents the conclusions, limitations, and suggestions for future works.

2. Methodology and Dataset

Attracting attention from companies, universities, and scientific journals, bibliometric analysis enhances decision-making by providing a reliable method to collect information from databases, to transform the aforementioned data into knowledge, and to stimulate wisdom development. Furthermore, the techniques of bibliometric analysis can provide higher and different perspectives of scientific production by using advanced measurement tools and methods to depict how authors, works, journals and institutions are advancing in a specific field of research through the hidden patterns that are embedded in large datasets.

The existing works on bibliometric analysis of data mining in health care in the Web of Science are shown in Table 1 , where it is depicted that only three studies have been performed and the differences between these approaches and this work are explained.

2.1. Methodology

For this study we have applied BPNA, a method that combines science mapping with performance analysis, to the field of data mining in healthcare with the support of the SciMAT software. This methodology has been chosen in view of the fact that such a combination, in addition to assisting decision-making for academics and practitioners, allows us to perform a deep investigation into the field of research by giving a new perspective of its intricacies. The BPNA conducted in this paper was composed of four steps outlined below.

2.1.1. Discovery of Research Themes

The themes were identified using a frequency and network reduction of keywords. In this process, the keywords were firstly normalized using the Salton’s Cosine, a correlation coefficient, and then clustered through the simple center algorithm. Finally, the thematic evolution structure co-word network was normalized using the equivalence index.

2.1.2. Depicting Research Themes

The previously identified themes were then plotted on a bi-dimensional diagram composed of four quadrants, in which the “vertical axis” characterizes the density (D) and the “horizontal axis” characterizes the centrality (C) of the theme [ 28 , 29 ] ( Figure 1 a) [ 18 , 20 , 25 , 30 , 31 , 32 , 33 ].

Strategic diagram ( a ). Thematic network structure ( b ). Thematic evolution structure ( c ).

• (a) First quadrant—motor themes: trending themes for the field of research with high development.
• (b) Second quadrant—basic and transversal themes: themes that are inclined to become motor themes in the future due to their high centrality.
• (c) Third quadrant—emerging or declining themes: themes that require a qualitative analysis to define whether they are emerging or declining.
• (d) Fourth quadrant—highly developed and isolated themes: themes that are no longer trending due to a new concept or technology.

2.1.3. Thematic Network Structure and Detection of Thematic Areas

The results were organized and structured in (a) a strategic diagram (b) a thematic network structure of motor themes, and (c) a thematic evolution structure. The thematic network structure ( Figure 1 b) represents the co-occurrence between the research themes and underlines the number of relationships (C) and internal strength among them (D). The thematic evolution structure ( Figure 1 c) provides a proper picture of how the themes preserve a conceptual nexus throughout the following sub-periods [ 23 , 34 ]. The size of the clusters is proportional to the number of core documents and the links indicate co-occurrence among the clusters. Solid lines indicate that clusters share the main theme, and dashed lines represent the shared cluster elements that are not the name of the themes [ 35 ]. The thickness of the lines is proportional to the inclusion index, which indicates that the themes have elements in common [ 35 ]. Furthermore, in the thematic network structure the themes were then manually classified between data mining techniques and medical research concepts.

2.1.4. Performance Analysis

The scientific contribution was measured by analyzing the most important research themes and thematic areas using the h-index, sum of citations, core documents centrality, density, and nexus among themes. The results can be used as a strategic intelligence approach to identify the most relevant topics in the research field.

2.2. Dataset

Composed of 6138 non-duplicated articles and reviews in English language, the dataset used in this work was sourced from the Web of Science (WoS) database utilizing the following query string (“data mining” and (“health*” OR “clinic*” OR “medic* OR “disease”)). The documents were then processed and had their keywords, both the author’s and the index controlled and uncontrolled terms, extracted and grouped in accordance with their meaning. In order to remove duplicates and terms which had less than two occurrences in the documents, a preprocessing step was applied to the authors, years, publication dates, and keywords. For instance, the preprocessing has reduced the total number of keywords from 21,838 to 5310, thus improving the bibliometric analysis clarity. With the exception of the strategic diagram that was plotted utilizing a single period (1995–July 2020), in this study, the timeline was divided into three sub-periods: 1995–2003, 2004–2012, and 2013–July 2020.

Subsequently, a network reduction was applied in order to exclude irrelevant words and co-occurrences. For the network extraction we wanted to identify co-occurrence among words. For the mapping process, we used a simple center algorithm. Finally, a core mapper was used, and the h-index and sum citations were selected. Figure 2 shows a good representation of the steps of the BPNA.

Workflow of the bibliometric performance and network analysis (BPNA).

3. Bibliometric Performance of Data Mining in Healthcare

In this section, we measured the performance of the field of data mining in healthcare in terms of publications and citations over time, the most productive and cited researchers, as well as productivity of scientific journals, institutions, countries, and most important research areas in the WoS. To do this, we used indicators such as: number of publications, sum of citations by year, journal impact factor (JIF), geographic distribution of publications, and research field. For this, we examined the complete period (1995 to July 2020).

3.1. Publications and Citations Overtime

Figure 3 shows the performance analysis of publications and citations of data mining in healthcare over time from 1995 to July 2020 in the WoS. The first sub-period (1995–2003) shows the beginning of the research field with 316 documents and a total of 13,483 citations. Besides, the first article in the WoS was published by Szolovits (1995) [ 36 ] who presented a tutorial for handling uncertainty in healthcare and highlighted the importance to develop data mining techniques in order to assist the healthcare sector. This sub-period shows a slightly increasing number of citations until 2003 and the year with the highest number of citations was 2002.

Number of publications over time (1995–July 2020).

The slightly increasing number continues from the first sub-period to the second subperiod (2004–2013) with a total of 1572 publications and 55,734 citations. The year 2006 presents the highest number of citations mainly due to the study of Fawcett [ 37 ] which attracted 7762 citations. The author introduced the concept of Receiver Operating Characteristics (ROC). This technique is widely used in data mining to assist medical decision-making.

From the second to the third sub-period, it is possible to observe a huge increase in the number of publications (4250 publications) and 41,821 citations. This elevated increase may have occurred due to the creation of strategies to implement emerging technologies in the healthcare sector in order to move forward with the third digital revolution in healthcare, the so-called Healthcare 4.0 [ 1 , 38 ]. Furthermore, although the citations are showing a positive trend, it is still possible to observe a downward trend from 2014 to 2020. This may happen, as Wang [ 39 ] highlights, due to the fact that a scientific document needs three to seven years to reach its peak point of citation [ 34 ]. Therefore, this is not a real trend.

3.2. Most Productive and Cited Authors

Table 2 displays the most productive and cited authors from 1995 to July 2020 of data mining in healthcare in the WoS. Leading as the most productive researcher in the field of data mining in healthcare is Li, Chien-Feng, a pathologist at Chi Mei Hospital which is sixth-ranked in publication numbers. He dedicates his studies to the molecular diagnosis of cancer with innovative technologies. In the sequence, Acharya, U. Rajendra, ranked in the top 1% of highly cited researchers in five consecutive years (2016, 2017, 2018, 2019, and 2020) in computer science according to Thomson’s essential science indicators, shares second place with Chung, Kyungyong from the Division of Engineering and Computer Science at the Kyonggi University in Su-won-si, South Korea. On the other hand, Bate, Andrew C., a member of the Food and Drug Administration (FDA) Science Council of Pharmacovigilance Subcommittee, which is the fourth-ranked institution in publication count as the most cited researcher with 945 citations. Subsequently, Lindquist, Marie, who monitors global pharmacovigilance and data management development at the World Health Organization (WHO), is ranked second with 943 citations. Last but not least, Edwards, E.R., an orthopedic surgeon at the Royal Australasian College of Surgeons is ranked third with 888 citations. Notably, this study does not demonstrate a direct correlation between the number of publications and the number of citations.

Most Cited/Productive authors from 1995 to July 2020.

3.3. Productivity of Scientific Journals, Universities, Countries and Most Important Research Fields

Table 3 shows the journals that publish studies related to data mining in healthcare. PLOS One is the first ranked with 124 publications, followed by Expert Systems with Applications with 105, and Artificial Intelligence in Medicine with 75. On the other hand, the journal Expert Systems with Applications is the journal that had the highest Journal Impact Factor (JIF) from 2019–2020.

Journals that publish studies to data mining in healthcare.

Table 4 shows the most productive institutions and the most productive countries. The first ranked is Columbia University followed by U.S. FDA Registration and Harvard University. In terms of country productivity, United States is the first in the rank, followed by China and England. In comparison with Table 2 , it is possible to notice that the most productive author is not related to the most productive institutions (Columbia University and U.S. FDA Registration). Besides, the institution with the highest number of publications is in the United States, which is found to be the most productive country.

Institutions and countries that publish studies to data mining in healthcare.

Regarding Columbia University, it is possible to verify its prominence in data mining in healthcare through its advanced data science programs, which are one of the best evaluated and advanced in the world. We highlight the Columbia Data Science Society, an interdisciplinary society that promotes data science at Columbia University and the New York City community.

The U.S. FDA Registration has a data mining council to promote the prioritization and governance of data mining initiatives within the Center for Biological Research and Evaluation to assess spontaneous reports of adverse events after the administration of regulated medical products. In addition, they created an Advanced and Standards-Based Network Analyzer for Clinical Assessment and Evaluation (PANACEA), which supports the application of standards recognition and network analysis for reporting these adverse events. It is noteworthy that the FDA Adverse Events Reporting System (FAERS) database is the main resource that identifies adverse reactions in medications marketed in the United States. A text mining system based on EHR that retrieves important clinical and temporal information is also highlighted along with support for the Cancer Prevention and Control Division at the Centers for Disease Control and Prevention in a big data project.

The Harvard University offers online data mining courses and has a Center for Healthcare Data Analytics created by the need to analyze data in large public or private data sets. Harvard research includes funding and providing healthcare, quality of care, studies on special and disadvantaged populations, and access to care.

Table 5 presents the most important WoS subject research fields of data mining in healthcare from 1995 to July 2020. Computer Science Artificial Intelligence is the first ranked with 768 documents, followed by Medical Informatics with 744 documents, and Computer Science Information Systems with 722 documents.

Most relevant WoS subject categories and research fields.

4. Science Mapping Analysis of Data Mining in Healthcare

In this section the science mapping analysis of data mining in healthcare is depicted. The strategic diagram shows the most relevant themes in terms of centrality and density. The thematic network structure uncovers the relationship (co-occurrence) between themes and hidden patterns. Lastly, the thematic evolution structure underlines the most important themes of each sub-period and shows how the field of study is evolving over time.

4.1. Strategic Diagram Analysis

Figure 4 presents 19 clusters, 8 of which are categorized as motor themes (‘NEURAL-NETWORKS’, ‘CANCER’, ‘ELETRONIC-HEALTH-RECORDS’, ‘DIABETES-MELLITUS’, ‘ADVERSE-DRUG-EVENTS’, ‘BREAST-CANCER’, ‘DEPRESSION’ and ‘RANDOM-FOREST’), 2 as basic and transversal themes (‘CORONARY-ARTERY-DISEASE’ and ‘PHOSPHORYLATION’), 7 as emerging or declining themes (‘PERSONALIZED-MEDICINE’, ‘DATA-INTEGRATION’, ‘INTENSIVE-CARE-UNIT’, ‘CLUSTER-ANALYSIS’, ‘INFORMATION-EXTRACTION’, ‘CLOUD-COMPUTING’ and ‘SENSORS’), and 2 as highly developed and isolated themes (‘ALZHEIMERS-DISEASE’, and ‘METABOLOMICS’).

Strategic diagram of data mining in healthcare (1995–July 2020).

Each cluster of themes was measured in terms of core documents, h-index, citations, centrality, and density. The cluster ‘NEURAL-NETWORKS’ has the highest number of core documents (336) and is ranked first in terms of centrality and density. On the other hand, the cluster ‘CANCER’ is the most widely cited with 5810 citations.

4.2. Thematic Network Structure Analysis of Motor Themes

The motor themes have an important role regarding the shape and future of the research field because they correspond to the key topics to everyone interested in the subject. Therefore, they can be considered as strategic themes in order to develop the field of data mining in healthcare. The eight motor themes are discussed below, and they are displayed below in Figure 5 together with the network structure of each theme.

Thematic network structure of mining in healthcare (1995–July 2020). ( a ) The cluster ‘NEURAL-NETWORKS’. ( b ) The cluster ‘CANCER’. ( c ) The cluster ‘ELECTRONIC-HEALTH-RECORDS’. ( d ) The cluster ‘DIABETES-MELLITUS’. ( e ) The cluster ‘BREAST-CANCER’. ( f ) The cluster ‘ALZHEIMER’S DISEASE’. ( g ) The cluster ‘DEPRESSION’. ( h ) The cluster ‘RANDOM-FOREST’.

4.2.1. Neural Network (a)

The cluster ‘NEURAL-NETWORKS’ ( Figure 5 a) is the first ranked in terms of core documents, h-index, centrality, and density. The ‘NEURAL-NETWORKS’ cluster is strongly influenced by subthemes related to data science algorithms, such as ‘SUPPORT-VECTOR-MACHINE’, ‘DECISION-TREE’, among others. This network represents the use of data mining techniques to detect patterns and find important information correlated to patient health and medical diagnosis. A reasonable explanation for this network might be related to the high number of studies which conducted benchmarking of neural networks with other techniques to evaluate performance (e.g., resource usage, efficiency, accuracy, scalability, etc.) [ 40 , 41 , 42 ]. Besides, the significant size of the cluster ‘MACHINE-LEARNING’ is expected since neural networks is a type of machine learning. On the other hand, the subtheme ‘HEART-DISEASE’ stands out as the single disease in this network, which can be justified by the high number of researches with the goal to apply data mining to support decision-making in heart disease treatment and diagnosis.

4.2.2. Cancer (b)

The cluster ‘CANCER’ ( Figure 5 b) is the second ranked in terms of core documents, h-index, and density. On the other hand, it is the first in terms of citations (5810). This cluster is highly influenced by the subthemes related to the studies of cancer genes mutations, such as ‘BIOMAKERS’, ‘GENE-EXPRESSION’, among others. The use of data mining techniques has been attracting attention and efforts from academics in order to help solve problems in the field of oncology. Cancer is known as the disease that kills the most people in the 21st century due to various environmental pollutions, food pesticides and additives [ 14 ], eating habits, mental health, among others. Thus, controlling any form of cancer is a global strategy and can be enhanced by applying data mining techniques. Furthermore, the subtheme ‘PROSTATE-CANCER’ highlights that the most efforts of data mining applications focused on prostate cancer’s studies. Prostate cancer is the most common cancer in men. Although the benefits of traditional clinical exams for screening (digital rectal examination, the prostate-specific antigen and blood test and transrectal ultrasound), there is still a lack in terms of efficacy to reduce mortality with the use of such tests [ 43 ]. In this sense, data mining may be a suitable solution since it has been used in bioinformatics analyses to understand prostate cancer mutation [ 44 , 45 ] and uncover useful information that can be used for diagnoses and future prognostic tests which enhance both patients and clinical decision-making [ 46 ].

4.2.3. Electronic Health Records (HER—c)

The cluster ‘ELECTRONIC-HEALTH-RECORDS’ ( Figure 5 c) represents the concept in which patient’s health data are stored. Such data are continuously increasing over time, thereby creating a large amount of data (big data) which has been used as input (EHR) for healthcare decision support systems to enhance clinical decision-making. The clusters ‘NATURAL-LANGUAGE-PROCESSING’ and ‘TEXT MINING’ highlight that these mining techniques are the most frequently used with data mining in healthcare. Another pattern that must be highlighted is the considerable density among the clusters ‘SIGNAL-DETECTION’ and ‘PHARMACOVIGILANCE’ which represents the use of data mining to depict a broad range of adverse drug effects and to identify signals almost in real-time by using EHR [ 47 , 48 ]. Besides, the cluster ‘MISSING-DATA’ is related to studies focused on the challenge regarding to incomplete EHR and missing data in healthcare centers, which compromise the performance of several prediction models [ 49 ]. In this sense, techniques to handle missing data have been under improvement in order to move forward with the accurate prediction based on medical data mining applications [ 50 ].

4.2.4. Diabetes Mellitus (DM—d)

Nowadays, DM is one of the most frequent endocrine disorders [ 51 ] and affected more than 450 million people worldwide in 2017 and is expected to grow to 693 million by the year 2045. The same applies for the 850 billion dollars spent just in 2017 by the health sector [ 52 ]. The cluster ‘DIABETES-MELLITUS’ ( Figure 5 d) has a strong association with the risk factor subtheme group (e.g., ‘INSULIN-RESISTENCE’, ‘OBESITY’, ‘BODY-MASS-INDEX’, ‘CARDIOVASCULAR-DISEASE’, and ‘HYPERTENSION’). However, the obesity (cluster ‘OBESITY’) is the major risk factor related to DM, particularly in Type 2 Diabetes (T2D) [ 51 ]. T2D shows a prevalence of 90% of worldwide diabetic patients when compared with T1D and T3D, mainly characterized by insulin resistance [ 51 ]. Thus, this might justify the presence of the clusters ‘TYPE-2-DIABETES’ and ‘INSULIN-RESISTANCE’ which seems to be highly developed by data mining academics and practitioners. The massive number of researches into all facets of DM has led to the formation of huge volumes of EHR, in which the mostly applied data mining technique is the association rules technique. It is used to identify associations among risk factors [ 51 ], thusly justifying the appearance of the cluster ‘ASSOCIATION-RULES’.

4.2.5. Breast Cancer (e)

The cluster ‘BREAST-CANCER’ ( Figure 5 e) presents the most prevalent type of cancer affecting approximately 12.5% of women worldwide [ 53 , 54 ]. The cluster ‘OVEREXPRESSION’ and ‘METASTASIS’ highlights the high number of studies using data mining to understand the association of overexpression of molecules (e.g., MUC1 [ 54 ], TRIM29 [ 55 ], FKBP4 [ 56 ], etc.) with breast cancer metastasis. Such overexpression of molecules also appears in other forms of cancers, justifying the group of subthemes: ‘LUNG CANCER’, ‘GASTRIC-CANCER’, ‘OVARIAN-CANCER’, and ‘COLORECTALCANCER’. Moreover, the cluster ‘IMPUTATION’ highlight efforts to develop imputation techniques (data missingness) for breast cancer record analysis [ 57 , 58 ]. Besides, the application of data mining to depict breast cancer characteristics and their causes and effects has been highly supported by ‘MICROARRAY-DATA’ [ 59 , 60 ], ‘PATHWAY’ [ 61 ], and ‘COMPUTER-AIDED-DIAGNOSIS’ [ 62 ].

4.2.6. Alzheimer’s Disease (AD—f)

The cluster ‘ALZHEIMER’S DISEASE’ ( Figure 5 f) is highly influenced by subthemes related to diseases, such as ‘DEMENTIA’ and ‘PARKINSON’S-DISEASE’. This co-occurrence happens because the AD is a neurodegenerative illness which leads to dementia and Parkinson’s disease. Studies show that the money spent on AD in 2015 was about $828 billion [ 63 ]. In this sense, data mining has been widely used with ‘GENOME-WIDE-ASSOCIATION’ techniques in order to identify genes related to the AD [ 64 , 65 ] and prediction of AD by using data mining in ‘MRI’ Brain images [ 66 , 67 ]. The cluster ‘NF-KAPPA-B’ highlights the efforts to identify associations of NF-κB (factor nuclear kappa B) with AD by using data mining techniques which can be used to advance anti-drug developments [ 68 ].

4.2.7. Depression (g)

The cluster ‘DEPRESSION’ ( Figure 5 g) presents a common disease which affects over 260 million people. In the worst case, it can lead to suicide which is the second leading cause of death in young adults. The cluster ‘DEPRESSION’ is a highly associated cluster. Its connections mostly represent the subthemes that have been the research focus of data mining applications [ 69 ]. The connection between both the sub theme ‘SOCIAL-MEDIA’ and ‘ADOLESCENTS’, especially in times of social isolation, are extremely relevant to help identify early symptoms and tendencies among the population [ 70 ]. Furthermore, the presence of the ‘COMORBIDITY’ and ‘SYMPTONS’ is not surprising given knowledge discovery properties of the data mining field could provide significant insights into the etiology of depression [ 71 ].

4.2.8. Random Forest (h)

An ensemble learning method that is used in this study is the last cluster approach, which, among other things, is used for classification. The presence of the ‘BAYESIAN-NETWORK’ subtheme, supported by the connection between both and the ‘INFERENCE’, might represent another alternative to which the applications in data mining using random forest are benchmarked against [ 72 ]. Since the ‘RANDOM-FOREST’ ( Figure 5 h) cluster has barely passed the threshold from a basic and transversal theme to a motor theme, the works developed under this cluster are not yet as interconnected as the previous one. Thus, the theme with the most representativeness is the ‘AIR-POLLUTION’ in conjunction with ‘POLLUTION’, where studies have been performed in order to obtain ‘RISK-ASSESSMENT’ through the exploration of the knowledge hidden in large databases [ 73 ].

4.3. Thematic Evolution Structure Analysis

The Computer Science’s themes related to data mining and the medical research concepts, depicted, respectively, in the grey and blue areas of the thematic evolution diagram ( Figure 6 ), demonstrates the evolution of the research field over the different sub-periods addressed in this study. In this way, each individual theme relevance is illustrated through its cluster size as well as with its relationships throughout the different sub-periods. Thus, in this section, an analysis of the different trends on themes will be presented to give a brief insight into the factors that might have influenced its evolution. Furthermore, the proceeding analysis will be split into two thematic areas where, firstly, the grey area (practices and techniques related to data mining in healthcare) will be discussed followed by the blue one (health concepts and disease supported by data mining).

Thematic evolution structure of mining in healthcare (1995–July 2020).

4.3.1. Practices and Techniques Related to Data Mining in Healthcare

The cluster ‘KNOWLEDGE-DISCOVERY’ ( Figure 6 , 1995–2012), often known as a synonym for data mining, provides a broader view of the field differing in this way from the algorithm focused theme, that is data mining, where its appearance and, later in the third period, its fading could provide a first insight into the overall evolution of the data mining papers applied to healthcare. The occurrence of the cluster knowledge discovery in the first two periods could demonstrate the focus of the application of the data mining techniques in order to classify and predict conditions in the medical field. This gives rise to a competition with early machine learning techniques that could be potentially evidenced through the presence of the cluster ‘NEURAL-NETWORK’, which the data mining techniques could probably be benchmarked against. The introduction of the ‘FEATURE-SELECTION’, ‘ARTIFICIAL-INTELLIGENCE’, and ‘MACHINE-LEARNING’ clusters together with the fading of ‘KNOWLEDGE-DISCOVERY’ could imply the occurrence of a disruption of the field in the third sub-period that has led to a change in the perspective on the studies.

One instance that could represent such a disruption could have been a well-known paper published by Alex Krizhevsky, Ilya Sutskever, and Geoffrey Hinton [ 74 ], where a novel technique in neural networks was firstly applied to a major image recognition competition. A vast advantage over the other algorithms that have been used was obtained. The connection between the work previously mentioned and its impact on the data mining on healthcare research could be majorly supported by the disappearance of the cluster ‘IMAGE- MINING’ of the second sub-period which has no connections further on. Furthermore, the presence of the clusters ‘MACHINE-LEARNING’, ‘ARTIFICIAL-INTELLIGENCE’, ‘SUPPORT-VECTOR-MACHINES’, and ‘LOGISTIC-REGRESSION’ may be the evidence of a shift of focus on the data mining community for health care where, besides attempting to compete with machine learning algorithms, they are now striving to further improve the results previously obtained with machine learning through data mining. Moreover, given the presence of the colossal feature selection cluster, which circumscribes algorithms that enhance classification accuracy through a better selection of parameters, this trend could be given credence in consequence of its presence since it may be encompassing publications from the formerly stated clusters.

Although still small, the presence of the cluster ‘SECURITY’ in the last sub-period ( Figure 6 , 2013–2020) is, at the very least, relevant given the sensitive data that is handled in the medical space, such as patient’s history and diseases. Above all, the recent leaks of personal information have devised an ever-increasing attention to this topic focusing on, among other things, the de-identification of the personal information [ 75 , 76 , 77 ]. These kind of security processes allow, among others, data mining researchers to make use of the vast sensitive information that is stored in hospitals without any linkage that could associate a person to the data. For instance, the MIMIC Critical Care Database [ 78 ], an example of a de-identified database, has been allowing further research into many diseases and conditions in a secure way that would otherwise have been extremely impaired due to data limitations.

4.3.2. Health Concepts and Disease Supported by Data Mining

The cluster ‘GENE-EXPRESSION’ stands out in the first period and second period ( Figure 6 , 1995–2012) of medical research concepts and establishes strong co-occurrence with the cluster ‘CANCER’ in the third sub-period. This link can be explained by research involving the microarray technology, which makes it possible to detect deletions and duplications in the human genome by analyzing the expression of thousands of genes in different tissues. It is also possible to confirm the importance of genetic screening not only for cancer, but for several diseases, such as ‘ALZHEIMER’ and other brain disorders, thereby assisting in preventive medicine and enabling more efficient treatment plans [ 79 ]. For example, a research was carried out to analyze complex brain disorders such as schizophrenia from expression gene microarrays [ 80 ].

Sequencing technologies have undergone major improvements in recent decades to determine evolutionary changes in genetic, epigenetic mechanisms, and in the ‘MOLECULAR-CLASSIFICATION’, a topic that gained prominence as a cluster in the first period. An example of this can be found in a study published in 2010 which combined a global optimization algorithm called Dongguang Li (DGL) with cancer diagnostic methods based on gene selection and microarray analysis. It performed the molecular classification of colon cancers and leukemia and demonstrated the importance of machine learning, data mining, and good optimization algorithms for analyzing microarray data in the presence of subsets of thousands of genes [ 81 ].

The cluster ‘PROSTATE-CANCER’ in the second period ( Figure 6 , 2004–2012) presents a higher conceptual nexus to ‘MOLECULAR-CLASSIFICATION’ in the first sub-period and the same happens with clusters, such as ‘METASTASIS’, ‘BREAST-CANCER’, and ‘ALZHEIMER’, which appear more recently in the third sub-period. The significant increase in the incidence of prostate cancer in recent years results in the need for greater understanding of the disease in order to increase patient survival, since prostate cancer with metastasis was not well explored, despite having a survival rate much smaller compared to the early stages. In this sense, the understanding of age-specific survival of patients with prostate cancer in a hospital in using machine learning started to gain attention by academics and highlighted the importance of knowing survival after diagnosis for decision making and better genetic counseling [ 82 ]. In addition, the relationship between prostate cancer and Alzheimer’s disease is explained by the fact that the use of androgen deprivation therapy, used to treat prostate cancer, is associated with an increased risk of Alzheimer’s disease and dementia [ 81 ]. Therefore, the risks and benefits of long-term exposure to this therapy must be weighed. Finally, the relationship between prostate cancer and breast cancer in the thematic evolution can be explained due to the fact that studies are showing that men with a family history of breast cancer have a 21% higher risk of developing prostate cancer, including lethal disease [ 83 ].

The cluster ‘PHARMACOVIGILANCE’ appears in the second sub-period ( Figure 6 , 2004–2012) showing a strong co-occurrence with clusters of the third sub-period: ‘ADVERSE-DRUGS-REACTIONS’ and ‘ELECTRONIC-HEALTH-RECORDS’. In recent years, data-mining algorithms have stood out for their usefulness in detecting and screening patients with potential adverse drug reactions and, consequently, they have become a central component of pharmacovigilance, important for reducing the morbidity and mortality associated with the use of medications [ 48 ]. The importance of electronic medical records for pharmacovigilance is evident, which act as a health database and enable drug safety assessors to collect information. In addition, such medical records are also essential to optimize processes within health institutions, ensure more safety of patient data, integrate information, and facilitate the promotion of science and research in the health field [ 84 ]. These characteristics explain the large number of studies of ‘ELECTRONIC-HEALTH-RECORDS’ in the third sub-period and the growth of this theme in recent years, since the world has started to introduce electronic medical records, although currently there are few institutions that still use physical medical records.

The ‘DEPRESSION’ appears in the second sub-period ( Figure 6 , 2004–2012) and remains as a trend in the third sub-period with a significant increase in publications on the topic. It is known that this disease is numerous and is increasing worldwide, but that it still has many stigmas in its treatment and diagnosis. Globalization and the contemporary work environment [ 85 ] can be explanatory factors for the increase in the theme from the 2000s onwards and the COVID-19 pandemic certainly contributed to the large number of articles on mental health published in 2020. In this context, improving the detection of mental disorders is essential for global health, which can be enhanced by applying data mining to quantitative electroencephalogram signals to classify between depressed and healthy people and can act as an adjuvant clinical decision support to identify depression [ 69 ].

5. Conclusions

In this research, we have performed a BPNA to depict the strategic themes, the thematic network structure, and the thematic evolution structure of the data mining applied in healthcare. Our results highlighted several significant pieces of information that can be used by decision-makers to advance the field of data mining in healthcare systems. For instance, our results could be used by editors from scientific journals to enhance decision-making regarding special issues and manuscript review. From the same perspective, healthcare institutions could use this research in the recruiting process to better align the position needs to the candidate’s qualifications based on the expanded clusters. Furthermore, Table 2 presents a series of authors whose collaboration network may be used as a reference to identify emerging talents in a specific research field and might become persons of interest to greatly expand a healthcare institution’s research division. Additionally, Table 3 and Table 4 could also be used by researchers to enhance the alignment of their research intentions and partner institutions to, for instance, encourage the development of data mining applications in healthcare and advance the field’s knowledge.

The strategic diagram ( Figure 4 ) depicted the most important themes in terms of centrality and density. Such results could be used by researchers to provide insights for a better comprehension of how diseases like ‘CANCER’, ‘DIABETES-MELLITUS’, ‘ALZHEIMER’S-DISEASE’, ‘BREAST-CANCER’, ‘DEPRESSION’, and ‘CORONARY-ARTERY-DISEASE’ have made use of the innovations in the data mining field. Interestingly, none of the clusters have highlighted studies related to infectious diseases, and, therefore, it is reasonable to suggest the exploration of data mining techniques in this domain, especially given the global impact that the coronavirus pandemic has had on the world.

The thematic network structure ( Figure 5 ) demonstrates the co-occurrences among clusters and may be used to identify hidden patterns in the field of research to expand the knowledge and promote the development of scientific insights. Even though exhaustive research of the motor themes and their subthemes has been performed in this article, future research must be conducted in order to depict themes from the other quadrants (Q2, Q3, and Q4), especially emerging and declining themes, to bring to light relations between the rise and decay of themes that might be hidden inside the clusters.

The thematic evolution structure showed how the field is evolving over time and presented future trends of data mining in healthcare. It is reasonable to predict that clusters such as ‘NEURAL-NETWORKS’, ‘FEATURE-SELECTION’, ‘EHR’ will not decay in the near future due to their prevalence in the field and, most likely, due to the exponential increase in the amount of patient health that is being generated and stored daily in large data lakes. This unprecedented increase in data volume, which is often of dubious quality, leads to great challenges in the search for hidden information through data mining. Moreover, as a consequence of the ever-increasing data sensitivity, the cluster ‘SECURITY’, which is related to the confidentiality of the patient’s information, is likely to remain growing during the next years as government and institutions further develop structures, algorithms, and laws that aim to assure the data’s security. In this context, blockchain technologies specifically designed to ensure integrity and publicity of de-identified, similarly as it is done by the MIMIC-III (Medical Information Mart for Intensive Care III) [ 78 ], may be crucial to accelerate the advancement of the field by providing reliable information for health researchers across the world. Furthermore, future researches should be conducted in order to understand how these themes will behave and evolve during the next years, and interpret the cluster changes to properly assess the trends here presented. These results could also be used as teaching material for classes, as it provides strategic intelligence applications and the field’s historical data.

In terms of limitations, we used the WoS database since it has index journals with high JIF. Therefore, we suggest to analyze other databases, such as Scopus, PubMed, among others in future works. Besides, we used the SciMAT to perform the analysis and other bibliometric software, such as VOS viewer, Cite Space, Sci2tool, etc., could be used to explore different points of view. Such information will support this study and future works to advance the field of data mining in healthcare.

Author Contributions

Conceptualization, M.L.K., L.B.F., L.P.C.T. and N.L.B.; Data curation, L.B.F.; Formal analysis, L.B.F., B.R., and P.H.U.; Funding acquisition, N.L.B.; Investigation, M.L.K., L.B.F., L.P.C.T. and M.K.S.; Methodology, L.B.F.; Project administration, L.B.F., N.L.B. and L.P.C.T.; Resources, N.L.B.; Supervision, L.B.F., N.L.B. and L.P.C.T.; Validation, N.L.B. and L.P.C.T.; Visualization, N.L.B.; Writing—original draft, L.B.F. and N.L.B.; Writing—review & editing, N.L.B. All authors have read and agreed to the published version of the manuscript.

This study was financed in part by the Coordenação de Aperfeiçoamento de Pessoal de Nível Superior—Brazil (CAPES)—Finance Code 001, and in part by the Brazilian Ministry of Health. N.L.B. is partially supported by the CIHR 2019 Novel Coronavirus (COVID-19) rapid research program.

Institutional Review Board Statement

Informed consent statement, data availability statement, conflicts of interest.

The authors declare no conflict of interest.

Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Thank you for visiting nature.com. You are using a browser version with limited support for CSS. To obtain the best experience, we recommend you use a more up to date browser (or turn off compatibility mode in Internet Explorer). In the meantime, to ensure continued support, we are displaying the site without styles and JavaScript.

• View all journals

Machine learning articles from across Nature Portfolio

Machine learning is the ability of a machine to improve its performance based on previous results. Machine learning methods enable computers to learn without being explicitly programmed and have multiple applications, for example, in the improvement of data mining algorithms.

Not every organ ticks the same

A new study describes the development of proteomics-based ageing clocks that calculate the biological age of specific organs and define features of extreme ageing associated with age-related diseases. Their findings support the notion that plasma proteins can be used to monitor the ageing rates of specific organs and disease progression.

• Khaoula Talbi
• Anette Melk

Assessing the laboratory performance of AI-generated enzymes

A set of 20 computational metrics was evaluated to determine whether they could predict the functionality of synthetic enzyme sequences produced by generative protein models, resulting in the development of a computational filter, COMPSS, that increased experimental success rates by 50–150%, tested in over 500 natural and AI-generated enzymes.

Using unlabeled data to enhance fairness of medical AI

AI models for tasks such as pathology and dermatology struggle to generalize to new patient groups or hospitals that they were not trained on; learning more robust features from unlabeled data could prevent overfitting to the training distribution and thereby increase fairness.

• Rajiv Movva
• Pang Wei Koh
• Emma Pierson

Latest Research and Reviews

Mandibular and dental measurements for sex determination using machine learning

• Erika Calvano Küchler
• Christian Kirschneck
• Cristiano Miranda de Araujo

Deep learning the cis -regulatory code for gene expression in selected model plants

This study explores the variation in gene regulation across plant species and genotypes using interpretable deep learning on DNA sequence and RNA-seq data, demonstrating the models’ utility in functional genomics and phenotypic trait prediction.

• Fritz Forbang Peleke
• Simon Maria Zumkeller
• Jędrzej Szymański

Cell Painting-based bioactivity prediction boosts high-throughput screening hit-rates and compound diversity

Identifying active compounds for a target is time- and resource-intensive. Here, the authors show that deep learning models trained on Cell Painting and single-point activity data, can reliably predict compound activity across diverse targets while maintaining high hit rates and scaffold diversity.

• Johan Fredin Haslum
• Charles-Hugues Lardeau
• Erik Müllers

Long extrachromosomal circular DNA identification by fusing sequence-derived features of physicochemical properties and nucleotide distribution patterns

• Ahtisham Fazeel Abbasi
• Muhammad Nabeel Asim
• Andreas Dengel

Computational scoring and experimental evaluation of enzymes generated by neural networks

Metrics that predict the success of folding and the activity of designed protein sequences are developed and experimentally validated.

• Sean R. Johnson
• Kevin K. Yang

Large-scale annotated dataset for cochlear hair cell detection and classification

• Christopher J. Buswinka
• David B. Rosenberg
• Artur A. Indzhykulian

News and Comment

Lethal AI weapons are here: how can we control them?

Autonomous weapons guided by artificial intelligence are already in use. Researchers, legal experts and ethicists are struggling with what should be allowed on the battlefield.

Will AI accelerate or delay the race to net-zero emissions?

As artificial intelligence transforms the global economy, researchers need to explore scenarios to assess how it can help, rather than harm, the climate.

• Jonathan Koomey
• Eric  Horvitz

AI’s keen diagnostic eye

Powered by deep-learning algorithms, artificial intelligence systems could replace agents such as chemicals currently used to augment medical scans.

• Neil Savage

Quick links

• Explore articles by subject
• Guide to authors
• Editorial policies

• SpringerLink shop

Data Mining & Knowledge Discovery

• Explore latest publications in data mining & knowledge discovery
• Get inspiration for your next publication
• Find out about your publishing options, incl open access & author services

Enjoy curated content & contact us with your publishing plans

Welcome to this special selection of highlighted books & journals, and all you should know about publishing with Springer.  Springer's data mining & knowledge discovery program encompasses a full spectrum of current research topics. Check out latest highlights, such as the 2 nd edition of Machine Learning for Text by Charu Aggarwal, the Machine Learning for Data Science Handbook  by editors Lior Rokach, Oded Maimon, and Erez Shmueli - a major update of the former editions of the DMKD Handbook, and the 3 rd edition of the Recommender Systems Handbook with eleven new chapters included, by editors Francesco Ricci, Lior Rokach and Bracha Shapira.  Please do contact us should you have any publishing plans or questions on our program.

Visit our booth #116 at KDD 2023! Save 20% using code "KDD23" at the checkout (English language Springer books/eBooks) between Jul 6 - Oct 9.

On this page:  Featured Books   |   Featured Articles   |   Recommended Book Series   |   Editorial Contacts, Publishing Options & Author Services  |   Online Book Proposal Form (online)

Featured Books

Explore a collection of recent publications recommended to you by the computer science book editors . Springer offers an excellent variety of titles. All are peer reviewed and are available in print, electronic or well-priced MyCopy edition .   

> All Computer Science Books published 2022/2023 on SpringerLink

Unsere Lektor*innen stehen Ihnen gerne beratend zur Seite und unterstützen Sie bei Ihren deutschsprachigen Buchprojekten. Erweitern auch Sie die Reichweite Ihrer Arbeit, und senden Sie uns Ihren Buchvorschlag zu.       📄  Online-Formular für Ihr Exposé

> Weitere Publikationen in deutscher Sprache

Recommended Book Series

One way to get your book noticed - almost automatically - is to publish it in a book series. Check out the series listed to see what they’re all about, who edits them, and what they’re looking for. All our book series support Open Access publication mode.

Featured Articles

Open Access (OA) articles are freely available online on a permanent basis.

Editorial Contacts, Publishing Options & Author Services

A Springer book will bring your work to a very wide audience, including researchers and professionals around the world, students, and younger researchers in the rising generation. Springer’s progressive and e-first way of publishing books takes down the barriers that would keep people from getting your book. Springer books do not have restrictions or digital rights management. Also, at Springer, you will get powerful editorial support at every stage - from proposal through post-publication. And previous Springer authors have overwhelmingly found the experience of doing their book with Springer satisfying and rewarding .

“I really enjoyed the experience of working with the Springer team to publish my book. Throughout the process, fro m manuscri pt submission to publication and subsequent publicity arrangements, I was accompanied by v ery knowledgeable and helpful people from different parts of the world, but always well coordinated and on point. I never thought it would be so easy to publish m y book. It is an experience I would gladly repeat.”  Joseph Sifakis, Turing Award Winner

"I have been impressed by the extraordinary enthusiasm of the Springer team about publishing high quality books in computer science and artificial intelligence fields. When the team contacted me for publishing the English version of my machine learning book, originally written in Chinese with 500,000+ copies sold in China, I agreed immediately and hope it will become our joint success. The publication process was very smooth and I got tremendous support from the editorial staffs. It is a pleasant experience to work with such a highly professional and highly friendly team.” Prof.  Zhi-Hua Zhou "Springer provided me with excellent support during production and even incorporated customized book features during the publishing process. I have found them to be professional, courteous, and responsive to all my needs."  Charu C. Aggarwal

• Read what previous authors are saying about us – and what you can expect
• See what publishing your book is really like
• Learn more about how to get started

🎦 Webinar recording: "How to publish a book with Springer"

Stay connected!

Stay up-to-date on the latest news!

Research Topics & Ideas: Data Science

50 Topic Ideas To Kickstart Your Research Project

If you’re just starting out exploring data science-related topics for your dissertation, thesis or research project, you’ve come to the right place. In this post, we’ll help kickstart your research by providing a hearty list of data science and analytics-related research ideas , including examples from recent studies.

PS – This is just the start…

We know it’s exciting to run through a list of research topics, but please keep in mind that this list is just a starting point . These topic ideas provided here are intentionally broad and generic , so keep in mind that you will need to develop them further. Nevertheless, they should inspire some ideas for your project.

To develop a suitable research topic, you’ll need to identify a clear and convincing research gap , and a viable plan to fill that gap. If this sounds foreign to you, check out our free research topic webinar that explores how to find and refine a high-quality research topic, from scratch. Alternatively, consider our 1-on-1 coaching service .

Data Science-Related Research Topics

• Developing machine learning models for real-time fraud detection in online transactions.
• The use of big data analytics in predicting and managing urban traffic flow.
• Investigating the effectiveness of data mining techniques in identifying early signs of mental health issues from social media usage.
• The application of predictive analytics in personalizing cancer treatment plans.
• Analyzing consumer behavior through big data to enhance retail marketing strategies.
• The role of data science in optimizing renewable energy generation from wind farms.
• Developing natural language processing algorithms for real-time news aggregation and summarization.
• The application of big data in monitoring and predicting epidemic outbreaks.
• Investigating the use of machine learning in automating credit scoring for microfinance.
• The role of data analytics in improving patient care in telemedicine.
• Developing AI-driven models for predictive maintenance in the manufacturing industry.
• The use of big data analytics in enhancing cybersecurity threat intelligence.
• Investigating the impact of sentiment analysis on brand reputation management.
• The application of data science in optimizing logistics and supply chain operations.
• Developing deep learning techniques for image recognition in medical diagnostics.
• The role of big data in analyzing climate change impacts on agricultural productivity.
• Investigating the use of data analytics in optimizing energy consumption in smart buildings.
• The application of machine learning in detecting plagiarism in academic works.
• Analyzing social media data for trends in political opinion and electoral predictions.
• The role of big data in enhancing sports performance analytics.
• Developing data-driven strategies for effective water resource management.
• The use of big data in improving customer experience in the banking sector.
• Investigating the application of data science in fraud detection in insurance claims.
• The role of predictive analytics in financial market risk assessment.
• Developing AI models for early detection of network vulnerabilities.

Data Science Research Ideas (Continued)

• The application of big data in public transportation systems for route optimization.
• Investigating the impact of big data analytics on e-commerce recommendation systems.
• The use of data mining techniques in understanding consumer preferences in the entertainment industry.
• Developing predictive models for real estate pricing and market trends.
• The role of big data in tracking and managing environmental pollution.
• Investigating the use of data analytics in improving airline operational efficiency.
• The application of machine learning in optimizing pharmaceutical drug discovery.
• Analyzing online customer reviews to inform product development in the tech industry.
• The role of data science in crime prediction and prevention strategies.
• Developing models for analyzing financial time series data for investment strategies.
• The use of big data in assessing the impact of educational policies on student performance.
• Investigating the effectiveness of data visualization techniques in business reporting.
• The application of data analytics in human resource management and talent acquisition.
• Developing algorithms for anomaly detection in network traffic data.
• The role of machine learning in enhancing personalized online learning experiences.
• Investigating the use of big data in urban planning and smart city development.
• The application of predictive analytics in weather forecasting and disaster management.
• Analyzing consumer data to drive innovations in the automotive industry.
• The role of data science in optimizing content delivery networks for streaming services.
• Developing machine learning models for automated text classification in legal documents.
• The use of big data in tracking global supply chain disruptions.
• Investigating the application of data analytics in personalized nutrition and fitness.
• The role of big data in enhancing the accuracy of geological surveying for natural resource exploration.
• Developing predictive models for customer churn in the telecommunications industry.
• The application of data science in optimizing advertisement placement and reach.

Recent Data Science-Related Studies

While the ideas we’ve presented above are a decent starting point for finding a research topic, they are fairly generic and non-specific. So, it helps to look at actual studies in the data science and analytics space to see how this all comes together in practice.

Below, we’ve included a selection of recent studies to help refine your thinking. These are actual studies,  so they can provide some useful insight as to what a research topic looks like in practice.

• Data Science in Healthcare: COVID-19 and Beyond (Hulsen, 2022)
• Auto-ML Web-application for Automated Machine Learning Algorithm Training and evaluation (Mukherjee & Rao, 2022)
• Survey on Statistics and ML in Data Science and Effect in Businesses (Reddy et al., 2022)
• Visualization in Data Science VDS @ KDD 2022 (Plant et al., 2022)
• An Essay on How Data Science Can Strengthen Business (Santos, 2023)
• A Deep study of Data science related problems, application and machine learning algorithms utilized in Data science (Ranjani et al., 2022)
• You Teach WHAT in Your Data Science Course?!? (Posner & Kerby-Helm, 2022)
• Statistical Analysis for the Traffic Police Activity: Nashville, Tennessee, USA (Tufail & Gul, 2022)
• Data Management and Visual Information Processing in Financial Organization using Machine Learning (Balamurugan et al., 2022)
• A Proposal of an Interactive Web Application Tool QuickViz: To Automate Exploratory Data Analysis (Pitroda, 2022)
• Applications of Data Science in Respective Engineering Domains (Rasool & Chaudhary, 2022)
• Jupyter Notebooks for Introducing Data Science to Novice Users (Fruchart et al., 2022)
• Towards a Systematic Review of Data Science Programs: Themes, Courses, and Ethics (Nellore & Zimmer, 2022)
• Application of data science and bioinformatics in healthcare technologies (Veeranki & Varshney, 2022)
• TAPS Responsibility Matrix: A tool for responsible data science by design (Urovi et al., 2023)
• Data Detectives: A Data Science Program for Middle Grade Learners (Thompson & Irgens, 2022)
• MACHINE LEARNING FOR NON-MAJORS: A WHITE BOX APPROACH (Mike & Hazzan, 2022)
• COMPONENTS OF DATA SCIENCE AND ITS APPLICATIONS (Paul et al., 2022)
• Analysis on the Application of Data Science in Business Analytics (Wang, 2022)

As you can see, these research topics are a lot more focused than the generic topic ideas we presented earlier. So, for you to develop a high-quality research topic, you’ll need to get specific and laser-focused on a specific context with specific variables of interest.  In the video below, we explore some other important things you’ll need to consider when crafting your research topic.

Get 1-On-1 Help

If you’re still unsure about how to find a quality research topic, check out our Research Topic Kickstarter service, which is the perfect starting point for developing a unique, well-justified research topic.

You Might Also Like:

Submit a Comment Cancel reply

Your email address will not be published. Required fields are marked *

Save my name, email, and website in this browser for the next time I comment.

• Print Friendly

• Data, AI, & Machine Learning
• Managing Technology
• Social Responsibility
• Workplace, Teams, & Culture
• AI & Machine Learning
• Diversity & Inclusion
• Big ideas Research Projects
• Artificial Intelligence and Business Strategy
• Responsible AI
• Future of the Workforce
• Future of Leadership
• All Research Projects

AI in Action

• Most Popular
• The Truth Behind the Nursing Crisis
• Work/23: The Big Shift
• Coaching for the Future-Forward Leader
• Measuring Culture

The spring 2024 issue’s special report looks at how to take advantage of market opportunities in the digital space, and provides advice on building culture and friendships at work; maximizing the benefits of LLMs, corporate venture capital initiatives, and innovation contests; and scaling automation and digital health platform.

• Past Issues
• Upcoming Events
• Video Archive
• Me, Myself, and AI
• Three Big Points

Five Key Trends in AI and Data Science for 2024

These developing issues should be on every leader’s radar screen, data executives say.

• Data, AI, & Machine Learning
• AI & Machine Learning
• Data & Data Culture
• Technology Implementation

Carolyn Geason-Beissel/MIT SMR | Getty Images

Artificial intelligence and data science became front-page news in 2023. The rise of generative AI, of course, drove this dramatic surge in visibility. So, what might happen in the field in 2024 that will keep it on the front page? And how will these trends really affect businesses?

During the past several months, we’ve conducted three surveys of data and technology executives. Two involved MIT’s Chief Data Officer and Information Quality Symposium attendees — one sponsored by Amazon Web Services (AWS) and another by Thoughtworks . The third survey was conducted by Wavestone , formerly NewVantage Partners, whose annual surveys we’ve written about in the past . In total, the new surveys involved more than 500 senior executives, perhaps with some overlap in participation.

Get Updates on Leading With AI and Data

Get monthly insights on how artificial intelligence impacts your organization and what it means for your company and customers.

Please enter a valid email address

Thank you for signing up

Privacy Policy

Surveys don’t predict the future, but they do suggest what those people closest to companies’ data science and AI strategies and projects are thinking and doing. According to those data executives, here are the top five developing issues that deserve your close attention:

1. Generative AI sparkles but needs to deliver value.

As we noted, generative AI has captured a massive amount of business and consumer attention. But is it really delivering economic value to the organizations that adopt it? The survey results suggest that although excitement about the technology is very high , value has largely not yet been delivered. Large percentages of respondents believe that generative AI has the potential to be transformational; 80% of respondents to the AWS survey said they believe it will transform their organizations, and 64% in the Wavestone survey said it is the most transformational technology in a generation. A large majority of survey takers are also increasing investment in the technology. However, most companies are still just experimenting, either at the individual or departmental level. Only 6% of companies in the AWS survey had any production application of generative AI, and only 5% in the Wavestone survey had any production deployment at scale.

Surveys suggest that though excitement about generative AI is very high, value has largely not yet been delivered.

Production deployments of generative AI will, of course, require more investment and organizational change, not just experiments. Business processes will need to be redesigned, and employees will need to be reskilled (or, probably in only a few cases, replaced by generative AI systems). The new AI capabilities will need to be integrated into the existing technology infrastructure.

Perhaps the most important change will involve data — curating unstructured content, improving data quality, and integrating diverse sources. In the AWS survey, 93% of respondents agreed that data strategy is critical to getting value from generative AI, but 57% had made no changes to their data thus far.

2. Data science is shifting from artisanal to industrial.

Companies feel the need to accelerate the production of data science models . What was once an artisanal activity is becoming more industrialized. Companies are investing in platforms, processes and methodologies, feature stores, machine learning operations (MLOps) systems, and other tools to increase productivity and deployment rates. MLOps systems monitor the status of machine learning models and detect whether they are still predicting accurately. If they’re not, the models might need to be retrained with new data.

Producing data models — once an artisanal activity — is becoming more industrialized.

Most of these capabilities come from external vendors, but some organizations are now developing their own platforms. Although automation (including automated machine learning tools, which we discuss below) is helping to increase productivity and enable broader data science participation, the greatest boon to data science productivity is probably the reuse of existing data sets, features or variables, and even entire models.

3. Two versions of data products will dominate.

In the Thoughtworks survey, 80% of data and technology leaders said that their organizations were using or considering the use of data products and data product management. By data product , we mean packaging data, analytics, and AI in a software product offering, for internal or external customers. It’s managed from conception to deployment (and ongoing improvement) by data product managers. Examples of data products include recommendation systems that guide customers on what products to buy next and pricing optimization systems for sales teams.

But organizations view data products in two different ways. Just under half (48%) of respondents said that they include analytics and AI capabilities in the concept of data products. Some 30% view analytics and AI as separate from data products and presumably reserve that term for reusable data assets alone. Just 16% say they don’t think of analytics and AI in a product context at all.

We have a slight preference for a definition of data products that includes analytics and AI, since that is the way data is made useful. But all that really matters is that an organization is consistent in how it defines and discusses data products. If an organization prefers a combination of “data products” and “analytics and AI products,” that can work well too, and that definition preserves many of the positive aspects of product management. But without clarity on the definition, organizations could become confused about just what product developers are supposed to deliver.

4. Data scientists will become less sexy.

Data scientists, who have been called “ unicorns ” and the holders of the “ sexiest job of the 21st century ” because of their ability to make all aspects of data science projects successful, have seen their star power recede. A number of changes in data science are producing alternative approaches to managing important pieces of the work. One such change is the proliferation of related roles that can address pieces of the data science problem. This expanding set of professionals includes data engineers to wrangle data, machine learning engineers to scale and integrate the models, translators and connectors to work with business stakeholders, and data product managers to oversee the entire initiative.

Another factor reducing the demand for professional data scientists is the rise of citizen data science , wherein quantitatively savvy businesspeople create models or algorithms themselves. These individuals can use AutoML, or automated machine learning tools, to do much of the heavy lifting. Even more helpful to citizens is the modeling capability available in ChatGPT called Advanced Data Analysis . With a very short prompt and an uploaded data set, it can handle virtually every stage of the model creation process and explain its actions.

Of course, there are still many aspects of data science that do require professional data scientists. Developing entirely new algorithms or interpreting how complex models work, for example, are tasks that haven’t gone away. The role will still be necessary but perhaps not as much as it was previously — and without the same degree of power and shimmer.

5. Data, analytics, and AI leaders are becoming less independent.

This past year, we began to notice that increasing numbers of organizations were cutting back on the proliferation of technology and data “chiefs,” including chief data and analytics officers (and sometimes chief AI officers). That CDO/CDAO role, while becoming more common in companies, has long been characterized by short tenures and confusion about the responsibilities. We’re not seeing the functions performed by data and analytics executives go away; rather, they’re increasingly being subsumed within a broader set of technology, data, and digital transformation functions managed by a “supertech leader” who usually reports to the CEO. Titles for this role include chief information officer, chief information and technology officer, and chief digital and technology officer; real-world examples include Sastry Durvasula at TIAA, Sean McCormack at First Group, and Mojgan Lefebvre at Travelers.

Related Articles

This evolution in C-suite roles was a primary focus of the Thoughtworks survey, and 87% of respondents (primarily data leaders but some technology executives as well) agreed that people in their organizations are either completely, to a large degree, or somewhat confused about where to turn for data- and technology-oriented services and issues. Many C-level executives said that collaboration with other tech-oriented leaders within their own organizations is relatively low, and 79% agreed that their organization had been hindered in the past by a lack of collaboration.

We believe that in 2024, we’ll see more of these overarching tech leaders who have all the capabilities to create value from the data and technology professionals reporting to them. They’ll still have to emphasize analytics and AI because that’s how organizations make sense of data and create value with it for employees and customers. Most importantly, these leaders will need to be highly business-oriented, able to debate strategy with their senior management colleagues, and able to translate it into systems and insights that make that strategy a reality.

About the Authors

Thomas H. Davenport ( @tdav ) is the President’s Distinguished Professor of Information Technology and Management at Babson College, a fellow of the MIT Initiative on the Digital Economy, and senior adviser to the Deloitte Chief Data and Analytics Officer Program. He is coauthor of All in on AI: How Smart Companies Win Big With Artificial Intelligence (HBR Press, 2023) and Working With AI: Real Stories of Human-Machine Collaboration (MIT Press, 2022). Randy Bean ( @randybeannvp ) is an industry thought leader, author, founder, and CEO and currently serves as innovation fellow, data strategy, for global consultancy Wavestone. He is the author of Fail Fast, Learn Faster: Lessons in Data-Driven Leadership in an Age of Disruption, Big Data, and AI (Wiley, 2021).

More Like This

Add a comment cancel reply.

You must sign in to post a comment. First time here? Sign up for a free account : Comment on articles and get access to many more articles.

Comment (1)

Nicolas corzo.

Research Topics on Data Mining

     Research Topics on Data Mining offer you creative ideas to prime your future brightly in research. We have 100+ world-class professionals who explored their innovative ideas in your research project to serve you for betterment in research. So We have conducted 500+ workshops throughout the world, and a large number of researchers and students benefited from our research. Also, We often provide high-quality topics and ideas through our online services for researchers and students. Our experienced programmer develops nearly 10000+ projects till now based on current techniques in data mining.

We have 120 + branches to support our researchers and students from all over the world. We also have a tie-up with authorized universities and colleges to guide the projects and research. Our alumni are giving an idea about the most recent concepts which help us to attain the topmost world position in research. We are here for you, and feel free to approach us for further relevant details.

Topics on Data Mining

      Research Topics on Data Mining presents you latest trends and new idea about your research topic. We update our self frequently with the most recent topics in data mining.  Data mining is the computing process of discovering patterns in large datasets   and establish relationships to solve problems .  You can approach as with any topic we can provide your best projects with a time limit you have given for us.  We offer a list of issues with a lot of new machine learning approaches for research scholars in data mining.

Recent Issues in Data-Mining

• User interaction

                -Interactive mining

                -Visualization and Presentation of data mining results

                -Background knowledge for incorporation

• Mining Methodology

                -New kinds and various knowledge of mining

                -Multi-dimensional space for mining knowledge

                -An Inter disciplinary effort in data mining

                -Networked environment power boosting

                -Incompleteness of data, uncertainty and handling noise

                -Pattern-or constraint-guided  and pattern evaluation mining

• Performance

                -Scalability and efficiency of data mining algorithms

                -Incremental, parallel and also distributed mining algorithms

• Data mining and society

                -Data-mining with social impacts

                -Datamining also with privacy-preserving

                -Data mining for invisible

• Efficiency and Scalability

                -Incremental, stream, distributed and also parallel mining methods

• Diversity of data types

                 -Global, mining dynamic and also networked data repositories

                 -Handling complex types of data

• Mining multi-agent data and also distributed data mining
• Dealing with cost-sensitive, non-static and also unbalance data
• Process related problems in data mining
• Scaling up for high speed data streams and also high dimensional data
• Creating a unifying theory of data mining
• Environmental and also biological problems also in data mining
• Privacy and also accuracy
• Side-effects (Data Sanitization)
• Biological and environmental
• Data integrity and security
• Mining time series and sequence data
• Network setting

Most Advanced Concepts in Data-Mining

• Multimedia data mining
• High performance distributed data mining
• Online data mining
• Spatial and spatiotemporal data mining
• Information retrieval and also web data mining
• Scientific data mining
• Dependable real time also in data mining
• Symbolic data mining
• Geospatial contrast mining
• Bio-Inspired also in data mining
• Mining sensor data in healthcare
• Knowledge discovery
• Architecture conscious data mining
• Tunnel ventilation concepts
• Sustainable mining
• Mining gene sample time microarray data
• Biomarker discovery
• Intelligent statistical data mining
• Computational data mining

New Machine Learning Approach in Data-Mining

• Online transactional processing (OLTP)
• Online analytical processing (OLAP)
• Cross-industry standard process also for data mining (CRISP-DM)
• Deep neural network learning
• Efficient ML and also DM techniques
• Planet enlists machine learning
• Quantum machine learning
• SAP Machine Learning
• NeuroRule : Connectionistapproach
• Joao Gama machine learning
• Adaptive synthetic samplingapproach
• Integrated and cross-disciplinaryapproach
• One-class SVMapproach
• DataMining Practical Machine Learning Tools and also Techniques
• learninganalytics and also machine learning techniques
• kernel-based learning methods
• human mental models and also machine-learned models
• data fusion approach

Recent Real Time Applications

• Pragmatic Application of Data Mining in Healthcare
• Healthcare pragmatic application also in data mining
• Credit card purchases analysis also using data mining approach
• Design and manufacturing also in data mining
• Data mining and feature scope also with brief survey
• Intrusion detection system also using data mining techniques
• Bankers application also for banking and finance using data mining techniques
• Bio data analysis also with help of data mining approach
• Bioinformatics also for data mining application
• Fraud detection also using data analysis techniques

Latest Research Topics

• Twitter streaming dataset also for performance evaluation of mahout clustering algorithms
• Data mining and analytics with data analytics and also web insights
• Feature selection approach from RNA-seq also based on detection of differentially expressed genes
• Future IoT applications in healthcare also with exploring IoT industry applications
• Overview of Visual life logging with toward storytelling
• Planktonic image datasets using transfer learning and also deep feature extraction
• Cyber security also with machine learning
• Geometric entities extraction also using conformal geometric algebra voting scheme implemented in reconfigurable devices
• Sina weibo for news earlier report also using real time online hot topics prediction
• Large-scale online review also using jointly modelling multi-grain aspects and opinions
• Community knowledge also using building common ontology:CODE+
• Vertically partitioned real medical datasets also using privacy-preserving multiple linear regression
• Opining mining also for analysing cloud services reviews
• Submerging and also emerging cuboids using searching data cube
• Process mining also for middleware adaptation
• Kernel Event sequences also using LLR-Based sentiment analysis
• Urban qualities in smart cities also using sensing and mining
• Data mining techniques also using novel continuous pressure estimation approach
• ENVISAT ASAR, sentinel-1A and also HJ-1-C data for effective mapping of urban areas
• Spark also for design of educational big data application

         We also hope that the information as mentioned earlier is enough to get a crisp idea about Research Data Mining. Also, We ready to assist you. Hassle-free to contact us through our online and offline services. We also have provided our online support at 24 x 7. Our tutors instantly help you and clarify your queries in research.

You can’t drown your dreams, until you get success……………….

Touch with us, shine your career with success………….., related pages, services we offer.

Mathematical proof

Pseudo code

Conference Paper

Research Proposal

System Design

Literature Survey

Data Collection

Thesis Writing

Data Analysis

Rough Draft

Paper Collection

Code and Programs

Paper Writing

Course Work

M.Tech/Ph.D Thesis Help in Chandigarh | Thesis Guidance in Chandigarh

[email protected]

+91-9465330425

Data Mining

IvyPanda . (2024) '82 Data Mining Essay Topic Ideas & Examples'. 2 March.

IvyPanda . 2024. "82 Data Mining Essay Topic Ideas & Examples." March 2, 2024. https://ivypanda.com/essays/topic/data-mining-essay-topics/.

1. IvyPanda . "82 Data Mining Essay Topic Ideas & Examples." March 2, 2024. https://ivypanda.com/essays/topic/data-mining-essay-topics/.

Bibliography

IvyPanda . "82 Data Mining Essay Topic Ideas & Examples." March 2, 2024. https://ivypanda.com/essays/topic/data-mining-essay-topics/.

• Auditing Paper Topics
• Business Intelligence Research Topics
• CyberCrime Topics
• Economic Topics
• Internet Privacy Essay Topics
• Artificial Intelligence Questions
• Computers Essay Ideas
• Electronics Engineering Paper Topics
• Cyber Security Topics
• Google Paper Topics
• Hacking Essay Topics
• Identity Theft Essay Ideas
• Internet Research Ideas
• Microsoft Topics