data science case study examples

10 Real World Data Science Case Studies Projects with Example

Top 10 Data Science Case Studies Projects with Examples and Solutions in Python to inspire your data science learning in 2023.

BelData science has been a trending buzzword in recent times. With wide applications in various sectors like healthcare , education, retail, transportation, media, and banking -data science applications are at the core of pretty much every industry out there. The possibilities are endless: analysis of frauds in the finance sector or the personalization of recommendations on eCommerce businesses.  We have developed ten exciting data science case studies to explain how data science is leveraged across various industries to make smarter decisions and develop innovative personalized products tailored to specific customers.

Walmart Sales Forecasting Data Science Project

Downloadable solution code | Explanatory videos | Tech Support

Table of Contents

Data science case studies in retail , data science case study examples in entertainment industry , data analytics case study examples in travel industry , case studies for data analytics in social media , real world data science projects in healthcare, data analytics case studies in oil and gas, what is a case study in data science, how do you prepare a data science case study, 10 most interesting data science case studies with examples.

So, without much ado, let's get started with data science business case studies !

With humble beginnings as a simple discount retailer, today, Walmart operates in 10,500 stores and clubs in 24 countries and eCommerce websites, employing around 2.2 million people around the globe. For the fiscal year ended January 31, 2021, Walmart's total revenue was $559 billion showing a growth of $35 billion with the expansion of the eCommerce sector. Walmart is a data-driven company that works on the principle of 'Everyday low cost' for its consumers. To achieve this goal, they heavily depend on the advances of their data science and analytics department for research and development, also known as Walmart Labs. Walmart is home to the world's largest private cloud, which can manage 2.5 petabytes of data every hour! To analyze this humongous amount of data, Walmart has created 'Data Café,' a state-of-the-art analytics hub located within its Bentonville, Arkansas headquarters. The Walmart Labs team heavily invests in building and managing technologies like cloud, data, DevOps , infrastructure, and security.

Walmart is experiencing massive digital growth as the world's largest retailer . Walmart has been leveraging Big data and advances in data science to build solutions to enhance, optimize and customize the shopping experience and serve their customers in a better way. At Walmart Labs, data scientists are focused on creating data-driven solutions that power the efficiency and effectiveness of complex supply chain management processes. Here are some of the applications of data science  at Walmart:

i) Personalized Customer Shopping Experience

Walmart analyses customer preferences and shopping patterns to optimize the stocking and displaying of merchandise in their stores. Analysis of Big data also helps them understand new item sales, make decisions on discontinuing products, and the performance of brands.

ii) Order Sourcing and On-Time Delivery Promise

Millions of customers view items on Walmart.com, and Walmart provides each customer a real-time estimated delivery date for the items purchased. Walmart runs a backend algorithm that estimates this based on the distance between the customer and the fulfillment center, inventory levels, and shipping methods available. The supply chain management system determines the optimum fulfillment center based on distance and inventory levels for every order. It also has to decide on the shipping method to minimize transportation costs while meeting the promised delivery date.

Here's what valued users are saying about ProjectPro

Tech Leader | Stanford / Yale University

Savvy Sahai

Data Science Intern, Capgemini

Not sure what you are looking for?

iii) Packing Optimization 

Also known as Box recommendation is a daily occurrence in the shipping of items in retail and eCommerce business. When items of an order or multiple orders for the same customer are ready for packing, Walmart has developed a recommender system that picks the best-sized box which holds all the ordered items with the least in-box space wastage within a fixed amount of time. This Bin Packing problem is a classic NP-Hard problem familiar to data scientists .

Whenever items of an order or multiple orders placed by the same customer are picked from the shelf and are ready for packing, the box recommendation system determines the best-sized box to hold all the ordered items with a minimum of in-box space wasted. This problem is known as the Bin Packing Problem, another classic NP-Hard problem familiar to data scientists.

Here is a link to a sales prediction data science case study to help you understand the applications of Data Science in the real world. Walmart Sales Forecasting Project uses historical sales data for 45 Walmart stores located in different regions. Each store contains many departments, and you must build a model to project the sales for each department in each store. This data science case study aims to create a predictive model to predict the sales of each product. You can also try your hands-on Inventory Demand Forecasting Data Science Project to develop a machine learning model to forecast inventory demand accurately based on historical sales data.

Get Closer To Your Dream of Becoming a Data Scientist with 70+ Solved End-to-End ML Projects

Amazon is an American multinational technology-based company based in Seattle, USA. It started as an online bookseller, but today it focuses on eCommerce, cloud computing , digital streaming, and artificial intelligence . It hosts an estimate of 1,000,000,000 gigabytes of data across more than 1,400,000 servers. Through its constant innovation in data science and big data Amazon is always ahead in understanding its customers. Here are a few data analytics case study examples at Amazon:

i) Recommendation Systems

Data science models help amazon understand the customers' needs and recommend them to them before the customer searches for a product; this model uses collaborative filtering. Amazon uses 152 million customer purchases data to help users to decide on products to be purchased. The company generates 35% of its annual sales using the Recommendation based systems (RBS) method.

Here is a Recommender System Project to help you build a recommendation system using collaborative filtering. 

ii) Retail Price Optimization

Amazon product prices are optimized based on a predictive model that determines the best price so that the users do not refuse to buy it based on price. The model carefully determines the optimal prices considering the customers' likelihood of purchasing the product and thinks the price will affect the customers' future buying patterns. Price for a product is determined according to your activity on the website, competitors' pricing, product availability, item preferences, order history, expected profit margin, and other factors.

Check Out this Retail Price Optimization Project to build a Dynamic Pricing Model.

iii) Fraud Detection

Being a significant eCommerce business, Amazon remains at high risk of retail fraud. As a preemptive measure, the company collects historical and real-time data for every order. It uses Machine learning algorithms to find transactions with a higher probability of being fraudulent. This proactive measure has helped the company restrict clients with an excessive number of returns of products.

You can look at this Credit Card Fraud Detection Project to implement a fraud detection model to classify fraudulent credit card transactions.

New Projects

Let us explore data analytics case study examples in the entertainment indusry.

Ace Your Next Job Interview with Mock Interviews from Experts to Improve Your Skills and Boost Confidence!

Netflix started as a DVD rental service in 1997 and then has expanded into the streaming business. Headquartered in Los Gatos, California, Netflix is the largest content streaming company in the world. Currently, Netflix has over 208 million paid subscribers worldwide, and with thousands of smart devices which are presently streaming supported, Netflix has around 3 billion hours watched every month. The secret to this massive growth and popularity of Netflix is its advanced use of data analytics and recommendation systems to provide personalized and relevant content recommendations to its users. The data is collected over 100 billion events every day. Here are a few examples of data analysis case studies applied at Netflix :

i) Personalized Recommendation System

Netflix uses over 1300 recommendation clusters based on consumer viewing preferences to provide a personalized experience. Some of the data that Netflix collects from its users include Viewing time, platform searches for keywords, Metadata related to content abandonment, such as content pause time, rewind, rewatched. Using this data, Netflix can predict what a viewer is likely to watch and give a personalized watchlist to a user. Some of the algorithms used by the Netflix recommendation system are Personalized video Ranking, Trending now ranker, and the Continue watching now ranker.

ii) Content Development using Data Analytics

Netflix uses data science to analyze the behavior and patterns of its user to recognize themes and categories that the masses prefer to watch. This data is used to produce shows like The umbrella academy, and Orange Is the New Black, and the Queen's Gambit. These shows seem like a huge risk but are significantly based on data analytics using parameters, which assured Netflix that they would succeed with its audience. Data analytics is helping Netflix come up with content that their viewers want to watch even before they know they want to watch it.

iii) Marketing Analytics for Campaigns

Netflix uses data analytics to find the right time to launch shows and ad campaigns to have maximum impact on the target audience. Marketing analytics helps come up with different trailers and thumbnails for other groups of viewers. For example, the House of Cards Season 5 trailer with a giant American flag was launched during the American presidential elections, as it would resonate well with the audience.

Here is a Customer Segmentation Project using association rule mining to understand the primary grouping of customers based on various parameters.

Get FREE Access to Machine Learning Example Codes for Data Cleaning , Data Munging, and Data Visualization

In a world where Purchasing music is a thing of the past and streaming music is a current trend, Spotify has emerged as one of the most popular streaming platforms. With 320 million monthly users, around 4 billion playlists, and approximately 2 million podcasts, Spotify leads the pack among well-known streaming platforms like Apple Music, Wynk, Songza, amazon music, etc. The success of Spotify has mainly depended on data analytics. By analyzing massive volumes of listener data, Spotify provides real-time and personalized services to its listeners. Most of Spotify's revenue comes from paid premium subscriptions. Here are some of the examples of case study on data analytics used by Spotify to provide enhanced services to its listeners:

i) Personalization of Content using Recommendation Systems

Spotify uses Bart or Bayesian Additive Regression Trees to generate music recommendations to its listeners in real-time. Bart ignores any song a user listens to for less than 30 seconds. The model is retrained every day to provide updated recommendations. A new Patent granted to Spotify for an AI application is used to identify a user's musical tastes based on audio signals, gender, age, accent to make better music recommendations.

Spotify creates daily playlists for its listeners, based on the taste profiles called 'Daily Mixes,' which have songs the user has added to their playlists or created by the artists that the user has included in their playlists. It also includes new artists and songs that the user might be unfamiliar with but might improve the playlist. Similar to it is the weekly 'Release Radar' playlists that have newly released artists' songs that the listener follows or has liked before.

ii) Targetted marketing through Customer Segmentation

With user data for enhancing personalized song recommendations, Spotify uses this massive dataset for targeted ad campaigns and personalized service recommendations for its users. Spotify uses ML models to analyze the listener's behavior and group them based on music preferences, age, gender, ethnicity, etc. These insights help them create ad campaigns for a specific target audience. One of their well-known ad campaigns was the meme-inspired ads for potential target customers, which was a huge success globally.

iii) CNN's for Classification of Songs and Audio Tracks

Spotify builds audio models to evaluate the songs and tracks, which helps develop better playlists and recommendations for its users. These allow Spotify to filter new tracks based on their lyrics and rhythms and recommend them to users like similar tracks ( collaborative filtering). Spotify also uses NLP ( Natural language processing) to scan articles and blogs to analyze the words used to describe songs and artists. These analytical insights can help group and identify similar artists and songs and leverage them to build playlists.

Here is a Music Recommender System Project for you to start learning. We have listed another music recommendations dataset for you to use for your projects: Dataset1 . You can use this dataset of Spotify metadata to classify songs based on artists, mood, liveliness. Plot histograms, heatmaps to get a better understanding of the dataset. Use classification algorithms like logistic regression, SVM, and Principal component analysis to generate valuable insights from the dataset.

Explore Categories

Below you will find case studies for data analytics in the travel and tourism industry.

Airbnb was born in 2007 in San Francisco and has since grown to 4 million Hosts and 5.6 million listings worldwide who have welcomed more than 1 billion guest arrivals in almost every country across the globe. Airbnb is active in every country on the planet except for Iran, Sudan, Syria, and North Korea. That is around 97.95% of the world. Using data as a voice of their customers, Airbnb uses the large volume of customer reviews, host inputs to understand trends across communities, rate user experiences, and uses these analytics to make informed decisions to build a better business model. The data scientists at Airbnb are developing exciting new solutions to boost the business and find the best mapping for its customers and hosts. Airbnb data servers serve approximately 10 million requests a day and process around one million search queries. Data is the voice of customers at AirBnB and offers personalized services by creating a perfect match between the guests and hosts for a supreme customer experience. 

i) Recommendation Systems and Search Ranking Algorithms

Airbnb helps people find 'local experiences' in a place with the help of search algorithms that make searches and listings precise. Airbnb uses a 'listing quality score' to find homes based on the proximity to the searched location and uses previous guest reviews. Airbnb uses deep neural networks to build models that take the guest's earlier stays into account and area information to find a perfect match. The search algorithms are optimized based on guest and host preferences, rankings, pricing, and availability to understand users’ needs and provide the best match possible.

ii) Natural Language Processing for Review Analysis

Airbnb characterizes data as the voice of its customers. The customer and host reviews give a direct insight into the experience. The star ratings alone cannot be an excellent way to understand it quantitatively. Hence Airbnb uses natural language processing to understand reviews and the sentiments behind them. The NLP models are developed using Convolutional neural networks .

Practice this Sentiment Analysis Project for analyzing product reviews to understand the basic concepts of natural language processing.

iii) Smart Pricing using Predictive Analytics

The Airbnb hosts community uses the service as a supplementary income. The vacation homes and guest houses rented to customers provide for rising local community earnings as Airbnb guests stay 2.4 times longer and spend approximately 2.3 times the money compared to a hotel guest. The profits are a significant positive impact on the local neighborhood community. Airbnb uses predictive analytics to predict the prices of the listings and help the hosts set a competitive and optimal price. The overall profitability of the Airbnb host depends on factors like the time invested by the host and responsiveness to changing demands for different seasons. The factors that impact the real-time smart pricing are the location of the listing, proximity to transport options, season, and amenities available in the neighborhood of the listing.

Here is a Price Prediction Project to help you understand the concept of predictive analysis which is widely common in case studies for data analytics. 

Uber is the biggest global taxi service provider. As of December 2018, Uber has 91 million monthly active consumers and 3.8 million drivers. Uber completes 14 million trips each day. Uber uses data analytics and big data-driven technologies to optimize their business processes and provide enhanced customer service. The Data Science team at uber has been exploring futuristic technologies to provide better service constantly. Machine learning and data analytics help Uber make data-driven decisions that enable benefits like ride-sharing, dynamic price surges, better customer support, and demand forecasting. Here are some of the real world data science projects used by uber:

i) Dynamic Pricing for Price Surges and Demand Forecasting

Uber prices change at peak hours based on demand. Uber uses surge pricing to encourage more cab drivers to sign up with the company, to meet the demand from the passengers. When the prices increase, the driver and the passenger are both informed about the surge in price. Uber uses a predictive model for price surging called the 'Geosurge' ( patented). It is based on the demand for the ride and the location.

ii) One-Click Chat

Uber has developed a Machine learning and natural language processing solution called one-click chat or OCC for coordination between drivers and users. This feature anticipates responses for commonly asked questions, making it easy for the drivers to respond to customer messages. Drivers can reply with the clock of just one button. One-Click chat is developed on Uber's machine learning platform Michelangelo to perform NLP on rider chat messages and generate appropriate responses to them.

iii) Customer Retention

Failure to meet the customer demand for cabs could lead to users opting for other services. Uber uses machine learning models to bridge this demand-supply gap. By using prediction models to predict the demand in any location, uber retains its customers. Uber also uses a tier-based reward system, which segments customers into different levels based on usage. The higher level the user achieves, the better are the perks. Uber also provides personalized destination suggestions based on the history of the user and their frequently traveled destinations.

You can take a look at this Python Chatbot Project and build a simple chatbot application to understand better the techniques used for natural language processing. You can also practice the working of a demand forecasting model with this project using time series analysis. You can look at this project which uses time series forecasting and clustering on a dataset containing geospatial data for forecasting customer demand for ola rides.

Explore More  Data Science and Machine Learning Projects for Practice. Fast-Track Your Career Transition with ProjectPro

7) LinkedIn 

LinkedIn is the largest professional social networking site with nearly 800 million members in more than 200 countries worldwide. Almost 40% of the users access LinkedIn daily, clocking around 1 billion interactions per month. The data science team at LinkedIn works with this massive pool of data to generate insights to build strategies, apply algorithms and statistical inferences to optimize engineering solutions, and help the company achieve its goals. Here are some of the real world data science projects at LinkedIn:

i) LinkedIn Recruiter Implement Search Algorithms and Recommendation Systems

LinkedIn Recruiter helps recruiters build and manage a talent pool to optimize the chances of hiring candidates successfully. This sophisticated product works on search and recommendation engines. The LinkedIn recruiter handles complex queries and filters on a constantly growing large dataset. The results delivered have to be relevant and specific. The initial search model was based on linear regression but was eventually upgraded to Gradient Boosted decision trees to include non-linear correlations in the dataset. In addition to these models, the LinkedIn recruiter also uses the Generalized Linear Mix model to improve the results of prediction problems to give personalized results.

ii) Recommendation Systems Personalized for News Feed

The LinkedIn news feed is the heart and soul of the professional community. A member's newsfeed is a place to discover conversations among connections, career news, posts, suggestions, photos, and videos. Every time a member visits LinkedIn, machine learning algorithms identify the best exchanges to be displayed on the feed by sorting through posts and ranking the most relevant results on top. The algorithms help LinkedIn understand member preferences and help provide personalized news feeds. The algorithms used include logistic regression, gradient boosted decision trees and neural networks for recommendation systems.

iii) CNN's to Detect Inappropriate Content

To provide a professional space where people can trust and express themselves professionally in a safe community has been a critical goal at LinkedIn. LinkedIn has heavily invested in building solutions to detect fake accounts and abusive behavior on their platform. Any form of spam, harassment, inappropriate content is immediately flagged and taken down. These can range from profanity to advertisements for illegal services. LinkedIn uses a Convolutional neural networks based machine learning model. This classifier trains on a training dataset containing accounts labeled as either "inappropriate" or "appropriate." The inappropriate list consists of accounts having content from "blocklisted" phrases or words and a small portion of manually reviewed accounts reported by the user community.

Here is a Text Classification Project to help you understand NLP basics for text classification. You can find a news recommendation system dataset to help you build a personalized news recommender system. You can also use this dataset to build a classifier using logistic regression, Naive Bayes, or Neural networks to classify toxic comments.

Get confident to build end-to-end projects

Access to a curated library of 250+ end-to-end industry projects with solution code, videos and tech support.

Pfizer is a multinational pharmaceutical company headquartered in New York, USA. One of the largest pharmaceutical companies globally known for developing a wide range of medicines and vaccines in disciplines like immunology, oncology, cardiology, and neurology. Pfizer became a household name in 2010 when it was the first to have a COVID-19 vaccine with FDA. In early November 2021, The CDC has approved the Pfizer vaccine for kids aged 5 to 11. Pfizer has been using machine learning and artificial intelligence to develop drugs and streamline trials, which played a massive role in developing and deploying the COVID-19 vaccine. Here are a few data analytics case studies by Pfizer :

i) Identifying Patients for Clinical Trials

Artificial intelligence and machine learning are used to streamline and optimize clinical trials to increase their efficiency. Natural language processing and exploratory data analysis of patient records can help identify suitable patients for clinical trials. These can help identify patients with distinct symptoms. These can help examine interactions of potential trial members' specific biomarkers, predict drug interactions and side effects which can help avoid complications. Pfizer's AI implementation helped rapidly identify signals within the noise of millions of data points across their 44,000-candidate COVID-19 clinical trial.

ii) Supply Chain and Manufacturing

Data science and machine learning techniques help pharmaceutical companies better forecast demand for vaccines and drugs and distribute them efficiently. Machine learning models can help identify efficient supply systems by automating and optimizing the production steps. These will help supply drugs customized to small pools of patients in specific gene pools. Pfizer uses Machine learning to predict the maintenance cost of equipment used. Predictive maintenance using AI is the next big step for Pharmaceutical companies to reduce costs.

iii) Drug Development

Computer simulations of proteins, and tests of their interactions, and yield analysis help researchers develop and test drugs more efficiently. In 2016 Watson Health and Pfizer announced a collaboration to utilize IBM Watson for Drug Discovery to help accelerate Pfizer's research in immuno-oncology, an approach to cancer treatment that uses the body's immune system to help fight cancer. Deep learning models have been used recently for bioactivity and synthesis prediction for drugs and vaccines in addition to molecular design. Deep learning has been a revolutionary technique for drug discovery as it factors everything from new applications of medications to possible toxic reactions which can save millions in drug trials.

You can create a Machine learning model to predict molecular activity to help design medicine using this dataset . You may build a CNN or a Deep neural network for this data analyst case study project.

Access Data Science and Machine Learning Project Code Examples

9) Shell Data Analyst Case Study Project

Shell is a global group of energy and petrochemical companies with over 80,000 employees in around 70 countries. Shell uses advanced technologies and innovations to help build a sustainable energy future. Shell is going through a significant transition as the world needs more and cleaner energy solutions to be a clean energy company by 2050. It requires substantial changes in the way in which energy is used. Digital technologies, including AI and Machine Learning, play an essential role in this transformation. These include efficient exploration and energy production, more reliable manufacturing, more nimble trading, and a personalized customer experience. Using AI in various phases of the organization will help achieve this goal and stay competitive in the market. Here are a few data analytics case studies in the petrochemical industry:

i) Precision Drilling

Shell is involved in the processing mining oil and gas supply, ranging from mining hydrocarbons to refining the fuel to retailing them to customers. Recently Shell has included reinforcement learning to control the drilling equipment used in mining. Reinforcement learning works on a reward-based system based on the outcome of the AI model. The algorithm is designed to guide the drills as they move through the surface, based on the historical data from drilling records. It includes information such as the size of drill bits, temperatures, pressures, and knowledge of the seismic activity. This model helps the human operator understand the environment better, leading to better and faster results will minor damage to machinery used. 

ii) Efficient Charging Terminals

Due to climate changes, governments have encouraged people to switch to electric vehicles to reduce carbon dioxide emissions. However, the lack of public charging terminals has deterred people from switching to electric cars. Shell uses AI to monitor and predict the demand for terminals to provide efficient supply. Multiple vehicles charging from a single terminal may create a considerable grid load, and predictions on demand can help make this process more efficient.

iii) Monitoring Service and Charging Stations

Another Shell initiative trialed in Thailand and Singapore is the use of computer vision cameras, which can think and understand to watch out for potentially hazardous activities like lighting cigarettes in the vicinity of the pumps while refueling. The model is built to process the content of the captured images and label and classify it. The algorithm can then alert the staff and hence reduce the risk of fires. You can further train the model to detect rash driving or thefts in the future.

Here is a project to help you understand multiclass image classification. You can use the Hourly Energy Consumption Dataset to build an energy consumption prediction model. You can use time series with XGBoost to develop your model.

10) Zomato Case Study on Data Analytics

Zomato was founded in 2010 and is currently one of the most well-known food tech companies. Zomato offers services like restaurant discovery, home delivery, online table reservation, online payments for dining, etc. Zomato partners with restaurants to provide tools to acquire more customers while also providing delivery services and easy procurement of ingredients and kitchen supplies. Currently, Zomato has over 2 lakh restaurant partners and around 1 lakh delivery partners. Zomato has closed over ten crore delivery orders as of date. Zomato uses ML and AI to boost their business growth, with the massive amount of data collected over the years from food orders and user consumption patterns. Here are a few examples of data analyst case study project developed by the data scientists at Zomato:

i) Personalized Recommendation System for Homepage

Zomato uses data analytics to create personalized homepages for its users. Zomato uses data science to provide order personalization, like giving recommendations to the customers for specific cuisines, locations, prices, brands, etc. Restaurant recommendations are made based on a customer's past purchases, browsing history, and what other similar customers in the vicinity are ordering. This personalized recommendation system has led to a 15% improvement in order conversions and click-through rates for Zomato. 

You can use the Restaurant Recommendation Dataset to build a restaurant recommendation system to predict what restaurants customers are most likely to order from, given the customer location, restaurant information, and customer order history.

ii) Analyzing Customer Sentiment

Zomato uses Natural language processing and Machine learning to understand customer sentiments using social media posts and customer reviews. These help the company gauge the inclination of its customer base towards the brand. Deep learning models analyze the sentiments of various brand mentions on social networking sites like Twitter, Instagram, Linked In, and Facebook. These analytics give insights to the company, which helps build the brand and understand the target audience.

iii) Predicting Food Preparation Time (FPT)

Food delivery time is an essential variable in the estimated delivery time of the order placed by the customer using Zomato. The food preparation time depends on numerous factors like the number of dishes ordered, time of the day, footfall in the restaurant, day of the week, etc. Accurate prediction of the food preparation time can help make a better prediction of the Estimated delivery time, which will help delivery partners less likely to breach it. Zomato uses a Bidirectional LSTM-based deep learning model that considers all these features and provides food preparation time for each order in real-time. 

Data scientists are companies' secret weapons when analyzing customer sentiments and behavior and leveraging it to drive conversion, loyalty, and profits. These 10 data science case studies projects with examples and solutions show you how various organizations use data science technologies to succeed and be at the top of their field! To summarize, Data Science has not only accelerated the performance of companies but has also made it possible to manage & sustain their performance with ease.

FAQs on Data Analysis Case Studies

A case study in data science is an in-depth analysis of a real-world problem using data-driven approaches. It involves collecting, cleaning, and analyzing data to extract insights and solve challenges, offering practical insights into how data science techniques can address complex issues across various industries.

To create a data science case study, identify a relevant problem, define objectives, and gather suitable data. Clean and preprocess data, perform exploratory data analysis, and apply appropriate algorithms for analysis. Summarize findings, visualize results, and provide actionable recommendations, showcasing the problem-solving potential of data science techniques.

About the Author

ProjectPro is the only online platform designed to help professionals gain practical, hands-on experience in big data, data engineering, data science, and machine learning related technologies. Having over 270+ reusable project templates in data science and big data with step-by-step walkthroughs,

© 2024

© 2024 Iconiq Inc.

Privacy policy

User policy

Write for ProjectPro

FOR EMPLOYERS

Top 10 real-world data science case studies.

Aditya Sharma

Aditya is a content writer with 5+ years of experience writing for various industries including Marketing, SaaS, B2B, IT, and Edtech among others. You can find him watching anime or playing games when he’s not writing.

Frequently Asked Questions

Real-world data science case studies differ significantly from academic examples. While academic exercises often feature clean, well-structured data and simplified scenarios, real-world projects tackle messy, diverse data sources with practical constraints and genuine business objectives. These case studies reflect the complexities data scientists face when translating data into actionable insights in the corporate world.

Real-world data science projects come with common challenges. Data quality issues, including missing or inaccurate data, can hinder analysis. Domain expertise gaps may result in misinterpretation of results. Resource constraints might limit project scope or access to necessary tools and talent. Ethical considerations, like privacy and bias, demand careful handling.

Lastly, as data and business needs evolve, data science projects must adapt and stay relevant, posing an ongoing challenge.

Real-world data science case studies play a crucial role in helping companies make informed decisions. By analyzing their own data, businesses gain valuable insights into customer behavior, market trends, and operational efficiencies.

These insights empower data-driven strategies, aiding in more effective resource allocation, product development, and marketing efforts. Ultimately, case studies bridge the gap between data science and business decision-making, enhancing a company's ability to thrive in a competitive landscape.

Key takeaways from these case studies for organizations include the importance of cultivating a data-driven culture that values evidence-based decision-making. Investing in robust data infrastructure is essential to support data initiatives. Collaborating closely between data scientists and domain experts ensures that insights align with business goals.

Finally, continuous monitoring and refinement of data solutions are critical for maintaining relevance and effectiveness in a dynamic business environment. Embracing these principles can lead to tangible benefits and sustainable success in real-world data science endeavors.

Data science is a powerful driver of innovation and problem-solving across diverse industries. By harnessing data, organizations can uncover hidden patterns, automate repetitive tasks, optimize operations, and make informed decisions.

In healthcare, for example, data-driven diagnostics and treatment plans improve patient outcomes. In finance, predictive analytics enhances risk management. In transportation, route optimization reduces costs and emissions. Data science empowers industries to innovate and solve complex challenges in ways that were previously unimaginable.

Hire remote developers

Tell us the skills you need and we'll find the best developer for you in days, not weeks.

For enquiries call:

+1-469-442-0620

• Data Science

Top 12 Data Science Case Studies: Across Various Industries

Home Blog Data Science Top 12 Data Science Case Studies: Across Various Industries

Data science has become popular in the last few years due to its successful application in making business decisions. Data scientists have been using data science techniques to solve challenging real-world issues in healthcare, agriculture, manufacturing, automotive, and many more. For this purpose, a data enthusiast needs to stay updated with the latest technological advancements in AI . An excellent way to achieve this is through reading industry data science case studies. I recommend checking out Data Science With Python course syllabus to start your data science journey. In this discussion, I will present some case studies to you that contain detailed and systematic data analysis of people, objects, or entities focusing on multiple factors present in the dataset. Aspiring and practising data scientists can motivate themselves to learn more about the sector, an alternative way of thinking, or methods to improve their organization based on comparable experiences. Almost every industry uses data science in some way. You can learn more about data science fundamentals in this data science course content . From my standpoint, data scientists may use it to spot fraudulent conduct in insurance claims. Automotive data scientists may use it to improve self-driving cars. In contrast, e-commerce data scientists can use it to add more personalization for their consumers—the possibilities are unlimited and unexplored. Let’s look at the top eight data science case studies in this article so you can understand how businesses from many sectors have benefitted from data science to boost productivity, revenues, and more. Read on to explore more or use the following links to go straight to the case study of your choice.

Examples of Data Science Case Studies

• Hospitality:  Airbnb focuses on growth by  analyzing  customer voice using data science.  Qantas uses predictive analytics to mitigate losses  
• Healthcare:  Novo Nordisk  is  Driving innovation with NLP.  AstraZeneca harnesses data for innovation in medicine  
• Covid 19:  Johnson and Johnson use s  d ata science  to fight the Pandemic  
• E-commerce:  Amazon uses data science to personalize shop p ing experiences and improve customer satisfaction  
• Supply chain management :  UPS optimizes supp l y chain with big data analytics
• Meteorology:  IMD leveraged data science to achieve a rec o rd 1.2m evacuation before cyclone ''Fani''  
• Entertainment Industry:  Netflix  u ses data science to personalize the content and improve recommendations.  Spotify uses big   data to deliver a rich user experience for online music streaming  
• Banking and Finance:  HDFC utilizes Big  D ata Analytics to increase income and enhance  the  banking experience  

Top 8 Data Science Case Studies  [For Various Industries]

1. data science in hospitality industry.

In the hospitality sector, data analytics assists hotels in better pricing strategies, customer analysis, brand marketing , tracking market trends, and many more.

Airbnb focuses on growth by analyzing customer voice using data science.  A famous example in this sector is the unicorn '' Airbnb '', a startup that focussed on data science early to grow and adapt to the market faster. This company witnessed a 43000 percent hypergrowth in as little as five years using data science. They included data science techniques to process the data, translate this data for better understanding the voice of the customer, and use the insights for decision making. They also scaled the approach to cover all aspects of the organization. Airbnb uses statistics to analyze and aggregate individual experiences to establish trends throughout the community. These analyzed trends using data science techniques impact their business choices while helping them grow further.  

Travel industry and data science

Predictive analytics benefits many parameters in the travel industry. These companies can use recommendation engines with data science to achieve higher personalization and improved user interactions. They can study and cross-sell products by recommending relevant products to drive sales and increase revenue. Data science is also employed in analyzing social media posts for sentiment analysis, bringing invaluable travel-related insights. Whether these views are positive, negative, or neutral can help these agencies understand the user demographics, the expected experiences by their target audiences, and so on. These insights are essential for developing aggressive pricing strategies to draw customers and provide better customization to customers in the travel packages and allied services. Travel agencies like Expedia and Booking.com use predictive analytics to create personalized recommendations, product development, and effective marketing of their products. Not just travel agencies but airlines also benefit from the same approach. Airlines frequently face losses due to flight cancellations, disruptions, and delays. Data science helps them identify patterns and predict possible bottlenecks, thereby effectively mitigating the losses and improving the overall customer traveling experience.  

How Qantas uses predictive analytics to mitigate losses  

Qantas , one of Australia's largest airlines, leverages data science to reduce losses caused due to flight delays, disruptions, and cancellations. They also use it to provide a better traveling experience for their customers by reducing the number and length of delays caused due to huge air traffic, weather conditions, or difficulties arising in operations. Back in 2016, when heavy storms badly struck Australia's east coast, only 15 out of 436 Qantas flights were cancelled due to their predictive analytics-based system against their competitor Virgin Australia, which witnessed 70 cancelled flights out of 320.  

2. Data Science in Healthcare

The  Healthcare sector  is immensely benefiting from the advancements in AI. Data science, especially in medical imaging, has been helping healthcare professionals come up with better diagnoses and effective treatments for patients. Similarly, several advanced healthcare analytics tools have been developed to generate clinical insights for improving patient care. These tools also assist in defining personalized medications for patients reducing operating costs for clinics and hospitals. Apart from medical imaging or computer vision,  Natural Language Processing (NLP)  is frequently used in the healthcare domain to study the published textual research data.     

A. Pharmaceutical

Driving innovation with NLP: Novo Nordisk.  Novo Nordisk  uses the Linguamatics NLP platform from internal and external data sources for text mining purposes that include scientific abstracts, patents, grants, news, tech transfer offices from universities worldwide, and more. These NLP queries run across sources for the key therapeutic areas of interest to the Novo Nordisk R&D community. Several NLP algorithms have been developed for the topics of safety, efficacy, randomized controlled trials, patient populations, dosing, and devices. Novo Nordisk employs a data pipeline to capitalize the tools' success on real-world data and uses interactive dashboards and cloud services to visualize this standardized structured information from the queries for exploring commercial effectiveness, market situations, potential, and gaps in the product documentation. Through data science, they are able to automate the process of generating insights, save time and provide better insights for evidence-based decision making.  

How AstraZeneca harnesses data for innovation in medicine.  AstraZeneca  is a globally known biotech company that leverages data using AI technology to discover and deliver newer effective medicines faster. Within their R&D teams, they are using AI to decode the big data to understand better diseases like cancer, respiratory disease, and heart, kidney, and metabolic diseases to be effectively treated. Using data science, they can identify new targets for innovative medications. In 2021, they selected the first two AI-generated drug targets collaborating with BenevolentAI in Chronic Kidney Disease and Idiopathic Pulmonary Fibrosis.   

Data science is also helping AstraZeneca redesign better clinical trials, achieve personalized medication strategies, and innovate the process of developing new medicines. Their Center for Genomics Research uses  data science and AI  to analyze around two million genomes by 2026. Apart from this, they are training their AI systems to check these images for disease and biomarkers for effective medicines for imaging purposes. This approach helps them analyze samples accurately and more effortlessly. Moreover, it can cut the analysis time by around 30%.   

AstraZeneca also utilizes AI and machine learning to optimize the process at different stages and minimize the overall time for the clinical trials by analyzing the clinical trial data. Summing up, they use data science to design smarter clinical trials, develop innovative medicines, improve drug development and patient care strategies, and many more.

C. Wearable Technology  

Wearable technology is a multi-billion-dollar industry. With an increasing awareness about fitness and nutrition, more individuals now prefer using fitness wearables to track their routines and lifestyle choices.  

Fitness wearables are convenient to use, assist users in tracking their health, and encourage them to lead a healthier lifestyle. The medical devices in this domain are beneficial since they help monitor the patient's condition and communicate in an emergency situation. The regularly used fitness trackers and smartwatches from renowned companies like Garmin, Apple, FitBit, etc., continuously collect physiological data of the individuals wearing them. These wearable providers offer user-friendly dashboards to their customers for analyzing and tracking progress in their fitness journey.

3. Covid 19 and Data Science

In the past two years of the Pandemic, the power of data science has been more evident than ever. Different  pharmaceutical companies  across the globe could synthesize Covid 19 vaccines by analyzing the data to understand the trends and patterns of the outbreak. Data science made it possible to track the virus in real-time, predict patterns, devise effective strategies to fight the Pandemic, and many more.  

How Johnson and Johnson uses data science to fight the Pandemic   

The  data science team  at  Johnson and Johnson  leverages real-time data to track the spread of the virus. They built a global surveillance dashboard (granulated to county level) that helps them track the Pandemic's progress, predict potential hotspots of the virus, and narrow down the likely place where they should test its investigational COVID-19 vaccine candidate. The team works with in-country experts to determine whether official numbers are accurate and find the most valid information about case numbers, hospitalizations, mortality and testing rates, social compliance, and local policies to populate this dashboard. The team also studies the data to build models that help the company identify groups of individuals at risk of getting affected by the virus and explore effective treatments to improve patient outcomes.

4. Data Science in E-commerce  

In the  e-commerce sector , big data analytics can assist in customer analysis, reduce operational costs, forecast trends for better sales, provide personalized shopping experiences to customers, and many more.  

Amazon uses data science to personalize shopping experiences and improve customer satisfaction.  Amazon  is a globally leading eCommerce platform that offers a wide range of online shopping services. Due to this, Amazon generates a massive amount of data that can be leveraged to understand consumer behavior and generate insights on competitors' strategies. Amazon uses its data to provide recommendations to its users on different products and services. With this approach, Amazon is able to persuade its consumers into buying and making additional sales. This approach works well for Amazon as it earns 35% of the revenue yearly with this technique. Additionally, Amazon collects consumer data for faster order tracking and better deliveries.     

Similarly, Amazon's virtual assistant, Alexa, can converse in different languages; uses speakers and a   camera to interact with the users. Amazon utilizes the audio commands from users to improve Alexa and deliver a better user experience. 

5. Data Science in Supply Chain Management

Predictive analytics and big data are driving innovation in the Supply chain domain. They offer greater visibility into the company operations, reduce costs and overheads, forecasting demands, predictive maintenance, product pricing, minimize supply chain interruptions, route optimization, fleet management , drive better performance, and more.     

Optimizing supply chain with big data analytics: UPS

UPS  is a renowned package delivery and supply chain management company. With thousands of packages being delivered every day, on average, a UPS driver makes about 100 deliveries each business day. On-time and safe package delivery are crucial to UPS's success. Hence, UPS offers an optimized navigation tool ''ORION'' (On-Road Integrated Optimization and Navigation), which uses highly advanced big data processing algorithms. This tool for UPS drivers provides route optimization concerning fuel, distance, and time. UPS utilizes supply chain data analysis in all aspects of its shipping process. Data about packages and deliveries are captured through radars and sensors. The deliveries and routes are optimized using big data systems. Overall, this approach has helped UPS save 1.6 million gallons of gasoline in transportation every year, significantly reducing delivery costs.    

6. Data Science in Meteorology

Weather prediction is an interesting  application of data science . Businesses like aviation, agriculture and farming, construction, consumer goods, sporting events, and many more are dependent on climatic conditions. The success of these businesses is closely tied to the weather, as decisions are made after considering the weather predictions from the meteorological department.   

Besides, weather forecasts are extremely helpful for individuals to manage their allergic conditions. One crucial application of weather forecasting is natural disaster prediction and risk management.  

Weather forecasts begin with a large amount of data collection related to the current environmental conditions (wind speed, temperature, humidity, clouds captured at a specific location and time) using sensors on IoT (Internet of Things) devices and satellite imagery. This gathered data is then analyzed using the understanding of atmospheric processes, and machine learning models are built to make predictions on upcoming weather conditions like rainfall or snow prediction. Although data science cannot help avoid natural calamities like floods, hurricanes, or forest fires. Tracking these natural phenomena well ahead of their arrival is beneficial. Such predictions allow governments sufficient time to take necessary steps and measures to ensure the safety of the population.  

IMD leveraged data science to achieve a record 1.2m evacuation before cyclone ''Fani''   

Most  d ata scientist’s responsibilities  rely on satellite images to make short-term forecasts, decide whether a forecast is correct, and validate models. Machine Learning is also used for pattern matching in this case. It can forecast future weather conditions if it recognizes a past pattern. When employing dependable equipment, sensor data is helpful to produce local forecasts about actual weather models. IMD used satellite pictures to study the low-pressure zones forming off the Odisha coast (India). In April 2019, thirteen days before cyclone ''Fani'' reached the area,  IMD  (India Meteorological Department) warned that a massive storm was underway, and the authorities began preparing for safety measures.  

It was one of the most powerful cyclones to strike India in the recent 20 years, and a record 1.2 million people were evacuated in less than 48 hours, thanks to the power of data science.   

7. Data Science in the Entertainment Industry

Due to the Pandemic, demand for OTT (Over-the-top) media platforms has grown significantly. People prefer watching movies and web series or listening to the music of their choice at leisure in the convenience of their homes. This sudden growth in demand has given rise to stiff competition. Every platform now uses data analytics in different capacities to provide better-personalized recommendations to its subscribers and improve user experience.   

How Netflix uses data science to personalize the content and improve recommendations  

Netflix  is an extremely popular internet television platform with streamable content offered in several languages and caters to various audiences. In 2006, when Netflix entered this media streaming market, they were interested in increasing the efficiency of their existing ''Cinematch'' platform by 10% and hence, offered a prize of $1 million to the winning team. This approach was successful as they found a solution developed by the BellKor team at the end of the competition that increased prediction accuracy by 10.06%. Over 200 work hours and an ensemble of 107 algorithms provided this result. These winning algorithms are now a part of the Netflix recommendation system.  

Netflix also employs Ranking Algorithms to generate personalized recommendations of movies and TV Shows appealing to its users.   

Spotify uses big data to deliver a rich user experience for online music streaming  

Personalized online music streaming is another area where data science is being used.  Spotify  is a well-known on-demand music service provider launched in 2008, which effectively leveraged big data to create personalized experiences for each user. It is a huge platform with more than 24 million subscribers and hosts a database of nearly 20million songs; they use the big data to offer a rich experience to its users. Spotify uses this big data and various algorithms to train machine learning models to provide personalized content. Spotify offers a "Discover Weekly" feature that generates a personalized playlist of fresh unheard songs matching the user's taste every week. Using the Spotify "Wrapped" feature, users get an overview of their most favorite or frequently listened songs during the entire year in December. Spotify also leverages the data to run targeted ads to grow its business. Thus, Spotify utilizes the user data, which is big data and some external data, to deliver a high-quality user experience.  

8. Data Science in Banking and Finance

Data science is extremely valuable in the Banking and  Finance industry . Several high priority aspects of Banking and Finance like credit risk modeling (possibility of repayment of a loan), fraud detection (detection of malicious or irregularities in transactional patterns using machine learning), identifying customer lifetime value (prediction of bank performance based on existing and potential customers), customer segmentation (customer profiling based on behavior and characteristics for personalization of offers and services). Finally, data science is also used in real-time predictive analytics (computational techniques to predict future events).    

How HDFC utilizes Big Data Analytics to increase revenues and enhance the banking experience    

One of the major private banks in India,  HDFC Bank , was an early adopter of AI. It started with Big Data analytics in 2004, intending to grow its revenue and understand its customers and markets better than its competitors. Back then, they were trendsetters by setting up an enterprise data warehouse in the bank to be able to track the differentiation to be given to customers based on their relationship value with HDFC Bank. Data science and analytics have been crucial in helping HDFC bank segregate its customers and offer customized personal or commercial banking services. The analytics engine and SaaS use have been assisting the HDFC bank in cross-selling relevant offers to its customers. Apart from the regular fraud prevention, it assists in keeping track of customer credit histories and has also been the reason for the speedy loan approvals offered by the bank.  

9. Data Science in Urban Planning and Smart Cities  

Data Science can help the dream of smart cities come true! Everything, from traffic flow to energy usage, can get optimized using data science techniques. You can use the data fetched from multiple sources to understand trends and plan urban living in a sorted manner.  

The significant data science case study is traffic management in Pune city. The city controls and modifies its traffic signals dynamically, tracking the traffic flow. Real-time data gets fetched from the signals through cameras or sensors installed. Based on this information, they do the traffic management. With this proactive approach, the traffic and congestion situation in the city gets managed, and the traffic flow becomes sorted. A similar case study is from Bhubaneswar, where the municipality has platforms for the people to give suggestions and actively participate in decision-making. The government goes through all the inputs provided before making any decisions, making rules or arranging things that their residents actually need.  

10. Data Science in Agricultural Yield Prediction   

Have you ever wondered how helpful it can be if you can predict your agricultural yield? That is exactly what data science is helping farmers with. They can get information about the number of crops they can produce in a given area based on different environmental factors and soil types. Using this information, the farmers can make informed decisions about their yield and benefit the buyers and themselves in multiple ways.  

Farmers across the globe and overseas use various data science techniques to understand multiple aspects of their farms and crops. A famous example of data science in the agricultural industry is the work done by Farmers Edge. It is a company in Canada that takes real-time images of farms across the globe and combines them with related data. The farmers use this data to make decisions relevant to their yield and improve their produce. Similarly, farmers in countries like Ireland use satellite-based information to ditch traditional methods and multiply their yield strategically.  

11. Data Science in the Transportation Industry   

Transportation keeps the world moving around. People and goods commute from one place to another for various purposes, and it is fair to say that the world will come to a standstill without efficient transportation. That is why it is crucial to keep the transportation industry in the most smoothly working pattern, and data science helps a lot in this. In the realm of technological progress, various devices such as traffic sensors, monitoring display systems, mobility management devices, and numerous others have emerged.  

Many cities have already adapted to the multi-modal transportation system. They use GPS trackers, geo-locations and CCTV cameras to monitor and manage their transportation system. Uber is the perfect case study to understand the use of data science in the transportation industry. They optimize their ride-sharing feature and track the delivery routes through data analysis. Their data science approach enabled them to serve more than 100 million users, making transportation easy and convenient. Moreover, they also use the data they fetch from users daily to offer cost-effective and quickly available rides.  

12. Data Science in the Environmental Industry    

Increasing pollution, global warming, climate changes and other poor environmental impacts have forced the world to pay attention to environmental industry. Multiple initiatives are being taken across the globe to preserve the environment and make the world a better place. Though the industry recognition and the efforts are in the initial stages, the impact is significant, and the growth is fast.  

The popular use of data science in the environmental industry is by NASA and other research organizations worldwide. NASA gets data related to the current climate conditions, and this data gets used to create remedial policies that can make a difference. Another way in which data science is actually helping researchers is they can predict natural disasters well before time and save or at least reduce the potential damage considerably. A similar case study is with the World Wildlife Fund. They use data science to track data related to deforestation and help reduce the illegal cutting of trees. Hence, it helps preserve the environment.  

Where to Find Full Data Science Case Studies?  

Data science is a highly evolving domain with many practical applications and a huge open community. Hence, the best way to keep updated with the latest trends in this domain is by reading case studies and technical articles. Usually, companies share their success stories of how data science helped them achieve their goals to showcase their potential and benefit the greater good. Such case studies are available online on the respective company websites and dedicated technology forums like Towards Data Science or Medium.  

Additionally, we can get some practical examples in recently published research papers and textbooks in data science.  

What Are the Skills Required for Data Scientists?  

Data scientists play an important role in the data science process as they are the ones who work on the data end to end. To be able to work on a data science case study, there are several skills required for data scientists like a good grasp of the fundamentals of data science, deep knowledge of statistics, excellent programming skills in Python or R, exposure to data manipulation and data analysis, ability to generate creative and compelling data visualizations, good knowledge of big data, machine learning and deep learning concepts for model building & deployment. Apart from these technical skills, data scientists also need to be good storytellers and should have an analytical mind with strong communication skills.    

Opt for the best business analyst training  elevating your expertise. Take the leap towards becoming a distinguished business analysis professional

Conclusion  

These were some interesting  data science case studies  across different industries. There are many more domains where data science has exciting applications, like in the Education domain, where data can be utilized to monitor student and instructor performance, develop an innovative curriculum that is in sync with the industry expectations, etc.   

Almost all the companies looking to leverage the power of big data begin with a swot analysis to narrow down the problems they intend to solve with data science. Further, they need to assess their competitors to develop relevant data science tools and strategies to address the challenging issue. This approach allows them to differentiate themselves from their competitors and offer something unique to their customers.  

With data science, the companies have become smarter and more data-driven to bring about tremendous growth. Moreover, data science has made these organizations more sustainable. Thus, the utility of data science in several sectors is clearly visible, a lot is left to be explored, and more is yet to come. Nonetheless, data science will continue to boost the performance of organizations in this age of big data.  

Frequently Asked Questions (FAQs)

A case study in data science requires a systematic and organized approach for solving the problem. Generally, four main steps are needed to tackle every data science case study: 

• Defining the problem statement and strategy to solve it  
• Gather and pre-process the data by making relevant assumptions  
• Select tool and appropriate algorithms to build machine learning /deep learning models 
• Make predictions, accept the solutions based on evaluation metrics, and improve the model if necessary. 

Getting data for a case study starts with a reasonable understanding of the problem. This gives us clarity about what we expect the dataset to include. Finding relevant data for a case study requires some effort. Although it is possible to collect relevant data using traditional techniques like surveys and questionnaires, we can also find good quality data sets online on different platforms like Kaggle, UCI Machine Learning repository, Azure open data sets, Government open datasets, Google Public Datasets, Data World and so on.  

Data science projects involve multiple steps to process the data and bring valuable insights. A data science project includes different steps - defining the problem statement, gathering relevant data required to solve the problem, data pre-processing, data exploration & data analysis, algorithm selection, model building, model prediction, model optimization, and communicating the results through dashboards and reports.  

Devashree Madhugiri

Devashree holds an M.Eng degree in Information Technology from Germany and a background in Data Science. She likes working with statistics and discovering hidden insights in varied datasets to create stunning dashboards. She enjoys sharing her knowledge in AI by writing technical articles on various technological platforms. She loves traveling, reading fiction, solving Sudoku puzzles, and participating in coding competitions in her leisure time.

Avail your free 1:1 mentorship session.

Something went wrong

Upcoming Data Science Batches & Dates

Case studies

Notes for contributors

Case studies are a core feature of the Real World Data Science platform. Our case studies are designed to show how data science is used to solve real-world problems in business, public policy and beyond.

A good case study will be a source of information, insight and inspiration for each of our target audiences:

• Practitioners will learn from their peers – whether by seeing new techniques applied to common problems, or familiar techniques adapted to unique challenges.
• Leaders will see how different data science teams work, the mix of skills and experience in play, and how the components of the data science process fit together.
• Students will enrich their understanding of how data science is applied, how data scientists operate, and what skills they need to hone to succeed in the workplace.

Case studies should follow the structure below. It is not necessary to use the section headings we have provided – creativity and variety are encouraged. However, the areas outlined under each section heading should be covered in all submissions.

• The problem/challenge Summarise the project and its relevance to your organisation’s needs, aims and ambitions.
• Goals Specify what exactly you sought to achieve with this project.
• Background An opportunity to explain more about your organisation, your team’s work leading up to this project, and to introduce audiences more generally to the type of problem/challenge you faced, particularly if it is a problem/challenge that may be experienced by organisations working in different sectors and industries.
• Approach Describe how you turned the organisational problem/challenge into a task that could be addressed by data science. Explain how you proposed to tackle the problem, including an introduction, explanation and (possibly) a demonstration of the method, model or algorithm used. (NB: If you have a particular interest and expertise in the method, model or algorithm employed, including the history and development of the approach, please consider writing an Explainer article for us.) Discuss the pros and cons, strengths and limitations of the approach.
• Implementation Walk audiences through the implementation process. Discuss any challenges you faced, the ethical questions you needed to ask and answer, and how you tested the approach to ensure that outcomes would be robust, unbiased, good quality, and aligned with the goals you set out to achieve.
• Impact How successful was the project? Did you achieve your goals? How has the project benefited your organisation? How has the project benefited your team? Does it inform or pave the way for future projects?
• Learnings What are your key takeaways from the project? Are there lessons that you can apply to future projects, or are there learnings for other data scientists working on similar problems/challenges?

Advice and recommendations

You do not need to divulge the detailed inner workings of your organisation. Audiences are mostly interested in understanding the general use case and the problem-solving process you went through, to see how they might apply the same approach within their own organisations.

Goals can be defined quite broadly. There’s no expectation that you set out your organisation’s short- or long-term targets. Instead, audiences need to know enough about what you want to do so they can understand what motivates your choice of approach.

Use toy examples and synthetic data to good effect. We understand that – whether for commercial, legal or ethical reasons – it can be difficult or impossible to share real data in your case studies, or to describe the actual outputs of your work. However, there are many ways to share learnings and insights without divulging sensitive information. This blog post from Lyft uses hypotheticals, mathematical notation and synthetic data to explain the company’s approach to causal forecasting without revealing actual KPIs or data.

People like to experiment, so encourage them to do so. Our platform allows you to embed code and to link that code to interactive coding environments like Google Colab . So if, for example, you want to explain a technique like bootstrapping , why not provide a code block so that audiences can run a bootstrapping simulation themselves.

Leverage links. You can’t be expected to explain or cover every detail in one case study, so feel free to point audiences to other sources of information that can enrich their understanding: blogs, videos, journal articles, conference papers, etc.

6 of my favorite case studies in Data Science!

Data scientists are numbers people. They have a deep understanding of statistics and algorithms, programming and hacking, and communication skills. Data science is about applying these three skill sets in a disciplined and systematic manner, with the goal of improving an aspect of the business. That’s the data science process . In order to stay abreast of industry trends, data scientists often turn to case studies. Reviewing these is a helpful way for both aspiring and working data scientists to challenge themselves and learn more about a particular field, a different way of thinking, or ways to better their own company based on similar experiences. If you’re not familiar with case studies , they’ve been described as “an intensive, systematic investigation of a single individual, group, community or some other unit in which the researcher examines in-depth data relating to several variables.” Data science is used by pretty much every industry out there. Insurance claims analysts can use data science to identify fraudulent behavior, e-commerce data scientists can build personalized experiences for their customers, music streaming companies can use it to create different genres of playlists—the possibilities are endless. Allow us to share a few of our favorite data science case studies with you so you can see first hand how companies across a variety of industries leveraged big data to drive productivity, profits, and more.

6 case studies in Data Science

• How Airbnb characterizes data science
• How data science is involved in decision-making at Airbnb
• How Airbnb has scaled its data science efforts across all aspects of the company

Airbnb says that “we’re at a point where our infrastructure is stable, our tools are sophisticated, and our warehouse is clean and reliable. We’re ready to take on exciting new problems.” 3. Spotify’s “This Is” Playlists: The Ultimate Song Analysis For 50 Mainstream Artists If you’re a music lover, you’ve probably used Spotify at least once. If you’re a regular user, you’ve likely taken note of their personalized playlists and been impressed at how well the songs catered to your music preferences. But have you ever thought about how Spotify categorizes their music? You can thank their data science teams for that. The goal of the “This Is” case study is to analyze the music of various Spotify artists, segment the styles, and categorize them into by loudness, danceability, energy, and more. To start, a data scientist looked at Spotify’s API, which collects and provides data from Spotify’s music catalog. Once the data researcher accessed the data from Spotify’s API, he:

• Processed the data to extract audio features for each artist
• Visualized the data using D3.js.
• Applied k-means clustering to separate the artists into different groups
• Analyzed each feature for all the artists

Want a sneak peek at the results? James Arthur and Post Malone are in the same cluster, Kendrick Lamar is the “fastest” artist, and Marshmello beat Martin Garrix in the energy category. 4. A Leading Online Travel Agency Increases Revenues by 16 Percent with Actionable Analytics One of the largest online travel agencies in the world generated the majority of its revenue through its website and directed most of its resources there, but its clients were still using offline channels such as faxes and phone calls to ask questions. The agency brought in WNS, a travel-focused business process management company, to help it determine how to rethink and redesign its roadmap to capture missed revenue opportunities. WNS determined that the agency lacked an adequate offline strategy, which resulted in a dip in revenue and market share. After a deep dive into customer segments, the performance of offline sales agents, ideal hours for sales agents, and more, WNS was able to help the agency increase offline revenue by 16 percent and increase conversion rates by 21 percent. 5. How Mint.com Grew from Zero to 1 Million Users Mint.com is a free personal finance management service that asks users to input their personal spending data to generate insights about where their money goes. When Noah Kagan joined Mint.com as its marketing director, his goal was to find 100,000 new members in just six months. He didn’t just meet that goal. He destroyed it, generating one million members. How did he do it? Kagan says his success was two-fold. This first part was having a product he believed in. The second he attributes to “reverse engineering marketing.” “The key focal point to this strategy is to work backward,” Kagan explained. “Instead of starting with an intimidating zero playing on your mind, start at the solution and map your plan back from there.” He went on: “Think of it as a road trip. You start with a set destination in mind and then plan your route there. You don’t get in your car and start driving without in the hope that you magically end up where you wanted to be.” 6. Netflix: Using Big Data to Drive Big Engagement One of the best ways to explain the benefits of data science to people who don’t quite grasp the industry is by using Netflix-focused examples. Yes, Netflix is the largest internet-television network in the world. But what most people don’t realize is that, at its core, Netflix is a customer-focused, data-driven business. Founded in 1997 as a mail-order DVD company, it now boasts more than 53 million members in approximately 50 countries. If you watch The Fast and The Furious on Friday night, Netflix will likely serve up a Mark Wahlberg movie among your personalized recommendations for Saturday night. This is due to data science. But did you know that the company also uses its data insights to inform the way it buys, licenses, and creates new content? House of Cards and Orange is the New Black are two examples of how the company leveraged big data to understand its subscribers and cater to their needs. The company’s most-watched shows are generated from recommendations, which in turn foster consumer engagement and loyalty. This is why the company is constantly working on its recommendation engines. The Netflix story is a perfect case study for those who require engaged audiences in order to survive. In summary, data scientists are companies’ secret weapons when it comes to understanding customer behavior and levering it to drive conversion, loyalty, and profits. These six data science case studies show you how a variety of organizations—from a nature conservation group to a finance company to a media company—leveraged their big data to not only survive but to beat out the competition.

Recent Blogs

Why Invest In Data?

Data Science

How big data and product analytics are impacting the fintech industry

How Even the Most World-Weary Investors are Leveraging the Power of Big Data to Make Trades

What you need to build and implement an enterprise big data strategy

Enterprise...

Big data challenges and how to overcome them

Big Data and blockchain are a perfect match. So what's keeping them apart?

Not that...

4 applications of big data in Supply Chain Management

How to help high schoolers understand big data

Data Science , Tech and Tools

The use of big data in manufacturing industry

Approximat...

The importance of big data and open source for the blockchain

Challenges of maintaining a traditional data warehouse

5 reasons why big data initiatives fail

5 data science books every beginner should read

Books , Data Science

How the evolution of data analytics impacts the digital marketing industry

Data analytics: How is it saving lives

Benefits and advantages of data cleansing techniques

How to use big data for business development

7 Best practices to help secure big data

others , Data Science

The Role of Big Data in Mobile App Development

Data matters: Just being a visionary is not enough for new entrepreneurs

“Without...

Why improved connectivity is boosted by big data

According...

How big data is battling child abuse

Technology...

How small businesses can harness the power of big data and data analytics

API testing tutorial: How does it work?

Big data in auditing and analytics: How is it helping?

Why customer data collection is important for effective marketing strategies?

Customer...

Subscribe to the Crayon Blog

Get the latest posts in your inbox!

Data Science Case Studies: Solved using Python

• February 19, 2021
• Machine Learning

Solving a Data Science case study means analyzing and solving a problem statement intensively. Solving case studies will help you show unique and amazing data science use cases in your portfolio. In this article, I’m going to introduce you to 3 data science case studies solved and explained using Python.

Data Science Case Studies

If you’ve learned data science by taking a course or certification program, you’re still not that close to finding a job easily. The most important point of your Data Science interview is to show how you can use your skills in real use cases. Below are 3 data science case studies that will help you understand how to analyze and solve a problem. All of the data science case studies mentioned below are solved and explained using Python.

Case Study 1:  Text Emotions Detection

If you are one of them who is having an interest in natural language processing then this use case is for you. The idea is to train a machine learning model to generate emojis based on an input text. Then this machine learning model can be used in training Artificial Intelligent Chatbots.

Use Case:   A human can express his emotions in any form, such as the face, gestures, speech and text. The detection of text emotions is a content-based classification problem. Detecting a person’s emotions is a difficult task, but detecting the emotions using text written by a person is even more difficult as a human can express his emotions in any form. 

Recognizing this type of emotion from a text written by a person plays an important role in applications such as chatbots, customer support forum, customer reviews etc. So you have to train a machine learning model that can identify the emotion of a text by presenting the most relevant emoji according to the input text.

Case Study 2:  Hotel Recommendation System

A hotel recommendation system typically works on collaborative filtering that makes recommendations based on ratings given by other customers in the same category as the user looking for a product.

Use Case:   We all plan trips and the first thing to do when planning a trip is finding a hotel. There are so many websites recommending the best hotel for our trip. A hotel recommendation system aims to predict which hotel a user is most likely to choose from among all hotels. So to build this type of system which will help the user to book the best hotel out of all the other hotels. We can do this using customer reviews.

For example, suppose you want to go on a business trip, so the hotel recommendation system should show you the hotels that other customers have rated best for business travel. It is therefore also our approach to build a recommendation system based on customer reviews and ratings. So use the ratings and reviews given by customers who belong to the same category as the user and build a hotel recommendation system.

Case Study 3:  Customer Personality Analysis

The analysis of customers is one of the most important roles that a data scientist has to do who is working at a product based company. So if you are someone who wants to join a product based company then this data science case study is best for you.

Use Case:   Customer Personality Analysis is a detailed analysis of a company’s ideal customers. It helps a business to better understand its customers and makes it easier for them to modify products according to the specific needs, behaviours and concerns of different types of customers.

You have to do an analysis which should help a business to modify its product based on its target customers from different types of customer segments. For example, instead of spending money to market a new product to every customer in the company’s database, a company can analyze which customer segment is most likely to buy the product and then market the product only on that particular segment.

So these three data science case studies are based on real-world problems, starting with the first; Text Emotions Detection, it is completely based on natural language processing and the machine learning model trained by you will be used in training an AI chatbot. The second use case; Hotel Recommendation System, is also based on NLP, but here you will understand how to generate recommendations using collaborative filtering. The last use case; customer personality analysis, is based on someone who wants to focus on the analysis part.

All these data science case studies are solved using Python, here are the resources where you will find these use cases solved and explained:

• Text Emotions Detection
• Hotel Recommendation System
• Customer Personality Analysis

I hope you liked this article on data science case studies solved and explained using the Python programming language. Feel free to ask your valuable questions in the comments section below.

Aman Kharwal

Data Strategist at Statso. My aim is to decode data science for the real world in the most simple words.

Recommended For You

Roadmap to Learn Cloud Platforms for Data Science

• May 14, 2024

Metro Operations Optimization using Python

• May 13, 2024

Who Needs to Learn LLMs?

• May 9, 2024

NLP Techniques Every Data Scientist Should Know

• May 7, 2024

One comment

[…] there is no need for any academic or professional qualifications, you should have projects based on practical use cases in your portfolio to get your first data science […]

Leave a Reply Cancel reply

Discover more from thecleverprogrammer.

Subscribe now to keep reading and get access to the full archive.

Type your email…

Continue reading

Cookie Policy

We use cookies to operate this website, improve usability, personalize your experience, and improve our marketing. Privacy Policy .

By clicking "Accept" or further use of this website, you agree to allow cookies.

• Data Science
• Data Analytics
• Machine Learning

Essential Statistics for Data Science: A Case Study using Python, Part I

Get to know some of the essential statistics you should be very familiar with when learning data science

Our last post dove straight into linear regression. In this post, we'll take a step back to cover essential statistics that every data scientist should know. To demonstrate these essentials, we'll look at a hypothetical case study involving an administrator tasked with improving school performance in Tennessee.

You should already know:

• Python fundamentals — learn on dataquest.io

Note, this tutorial is intended to serve solely as an educational tool and not as a scientific explanation of the causes of various school outcomes in Tennessee .

Article Resources

• Notebook and Data: Github
• Libraries: pandas, matplotlib, seaborn

Introduction

Meet Sally, a public school administrator. Some schools in her state of Tennessee are performing below average academically. Her superintendent, under pressure from frustrated parents and voters, approached Sally with the task of understanding why these schools are under-performing. Not an easy problem, to be sure.

To improve school performance, Sally needs to learn more about these schools and their students, just as a business needs to understand its own strengths and weaknesses and its customers.

Though Sally is eager to build an impressive explanatory model, she knows the importance of conducting preliminary research to prevent possible pitfalls or blind spots (e.g. cognitive bias'). Thus, she engages in a thorough exploratory analysis, which includes: a lit review, data collection, descriptive and inferential statistics, and data visualization.

Sally has strong opinions as to why some schools are under-performing, but opinions won't do, nor will a handful of facts; she needs rigorous statistical evidence.

Sally conducts a lit review, which involves reading a variety of credible sources to familiarize herself with the topic. Most importantly, Sally keeps an open mind and embraces a scientific world view to help her resist confirmation bias (seeking solely to confirm one's own world view).

In Sally's lit review, she finds multiple compelling explanations of school performance: curriculae , income , and parental involvement . These sources will help Sally select her model and data, and will guide her interpretation of the results.

Data Collection

The data we want isn't always available, but Sally lucks out and finds student performance data based on test scores ( school_rating ) for every public school in middle Tennessee. The data also includes various demographic, school faculty, and income variables (see readme for more information). Satisfied with this dataset, she writes a web-scraper to retrieve the data.

But data alone can't help Sally; she needs to convert the data into useful information.

Descriptive and Inferential Statistics

Sally opens her stats textbook and finds that there are two major types of statistics, descriptive and inferential.

Descriptive statistics identify patterns in the data, but they don't allow for making hypotheses about the data.

Within descriptive statistics, there are two measures used to describe the data: central tendency and deviation . Central tendency refers to the central position of the data (mean, median, mode) while the deviation describes how far spread out the data are from the mean. Deviation is most commonly measured with the standard deviation. A small standard deviation indicates the data are close to the mean, while a large standard deviation indicates that the data are more spread out from the mean.

Inferential statistics allow us to make hypotheses (or inferences ) about a sample that can be applied to the population. For Sally, this involves developing a hypothesis about her sample of middle Tennessee schools and applying it to her population of all schools in Tennessee.

For now, Sally puts aside inferential statistics and digs into descriptive statistics.

To begin learning about the sample, Sally uses pandas' describe method, as seen below. The column headers in bold text represent the variables Sally will be exploring. Each row header represents a descriptive statistic about the corresponding column.

Looking at the output above, Sally's variables can be put into two classes: measurements and indicators.

Measurements are variables that can be quantified. All data in the output above are measurements. Some of these measurements, such as state_percentile_16 , avg_score_16 and school_rating , are outcomes; these outcomes cannot be used to explain one another. For example, explaining school_rating as a result of state_percentile_16 (test scores) is circular logic. Therefore we need a second class of variables.

The second class, indicators, are used to explain our outcomes. Sally chooses indicators that describe the student body (for example, reduced_lunch ) or school administration ( stu_teach_ratio ) hoping they will explain school_rating .

Sally sees a pattern in one of the indicators, reduced_lunch . reduced_lunch is a variable measuring the average percentage of students per school enrolled in a federal program that provides lunches for students from lower-income households. In short, reduced_lunch is a good proxy for household income, which Sally remembers from her lit review was correlated with school performance.

Sally isolates reduced_lunch and groups the data by school_rating using pandas' groupby method and then uses describe on the re-shaped data (see below).

Below is a discussion of the metrics from the table above and what each result indicates about the relationship between school_rating and reduced_lunch :

count : the number of schools at each rating. Most of the schools in Sally's sample have a 4- or 5-star rating, but 25% of schools have a 1-star rating or below. This confirms that poor school performance isn't merely anecdotal, but a serious problem that deserves attention.

mean : the average percentage of students on reduced_lunch among all schools by each school_rating . As school performance increases, the average number of students on reduced lunch decreases. Schools with a 0-star rating have 83.6% of students on reduced lunch. And on the other end of the spectrum, 5-star schools on average have 21.6% of students on reduced lunch. We'll examine this pattern further. in the graphing section.

std : the standard deviation of the variable. Referring to the school_rating of 0, a standard deviation of 8.813498 indicates that 68.2% (refer to readme ) of all observations are within 8.81 percentage points on either side of the average, 83.6%. Note that the standard deviation increases as school_rating increases, indicating that reduced_lunch loses explanatory power as school performance improves. As with the mean, we'll explore this idea further in the graphing section.

min : the minimum value of the variable. This represents the school with the lowest percentage of students on reduced lunch at each school rating. For 0- and 1-star schools, the minimum percentage of students on reduced lunch is 53%. The minimum for 5-star schools is 2%. The minimum value tells a similar story as the mean, but looking at it from the low end of the range of observations.

25% : the bottom quartile; represents the lowest 25% of values for the variable, reduced_lunch . For 0-star schools, 25% of the observations are less than 79.5%. Sally sees the same trend in the bottom quartile as the above metrics: as school_rating increases the bottom 25% of reduced_lunch decreases.

50% : the second quartile; represents the lowest 50% of values. Looking at the trend in school_rating and reduced_lunch , the same relationship is present here.

75% : the top quartile; represents the lowest 75% of values. The trend continues.

max : the maximum value for that variable. You guessed it: the trend continues!

The descriptive statistics consistently reveal that schools with more students on reduced lunch under-perform when compared to their peers. Sally is on to something.

Sally decides to look at reduced_lunch from another angle using a correlation matrix with pandas' corr method. The values in the correlation matrix table will be between -1 and 1 (see below). A value of -1 indicates the strongest possible negative correlation, meaning as one variable decreases the other increases. And a value of 1 indicates the opposite. The result below, -0.815757, indicates strong negative correlation between reduced_lunch and school_rating . There's clearly a relationship between the two variables.

Sally continues to explore this relationship graphically.

Essential Graphs for Exploring Data

Box-and-whisker plot.

In her stats book, Sally sees a box-and-whisker plot . A box-and-whisker plot is helpful for visualizing the distribution of the data from the mean. Understanding the distribution allows Sally to understand how far spread out her data is from the mean; the larger the spread from the mean, the less robust reduced_lunch is at explaining school_rating .

See below for an explanation of the box-and-whisker plot.

Now that Sally knows how to read the box-and-whisker plot, she graphs reduced_lunch to see the distributions. See below.

In her box-and-whisker plots, Sally sees that the minimum and maximum reduced_lunch values tend to get closer to the mean as school_rating decreases; that is, as school_rating decreases so does the standard deviation in reduced_lunch .

What does this mean?

Starting with the top box-and-whisker plot, as school_rating decreases, reduced_lunch becomes a more powerful way to explain outcomes. This could be because as parents' incomes decrease they have fewer resources to devote to their children's education (such as, after-school programs, tutors, time spent on homework, computer camps, etc) than higher-income parents. Above a 3-star rating, more predictors are needed to explain school_rating due to an increasing spread in reduced_lunch .

Having used box-and-whisker plots to reaffirm her idea that household income and school performance are related, Sally seeks further validation.

Scatter Plot

To further examine the relationship between school_rating and reduced_lunch , Sally graphs the two variables on a scatter plot. See below.

In the scatter plot above, each dot represents a school. The placement of the dot represents that school's rating (Y-axis) and the percentage of its students on reduced lunch (x-axis).

The downward trend line shows the negative correlation between school_rating and reduced_lunch (as one increases, the other decreases). The slope of the trend line indicates how much school_rating decreases as reduced_lunch increases. A steeper slope would indicate that a small change in reduced_lunch has a big impact on school_rating while a more horizontal slope would indicate that the same small change in reduced_lunch has a smaller impact on school_rating .

Sally notices that the scatter plot further supports what she saw with the box-and-whisker plot: when reduced_lunch increases, school_rating decreases. The tighter spread of the data as school_rating declines indicates the increasing influence of reduced_lunch . Now she has a hypothesis.

Correlation Matrix

Sally is ready to test her hypothesis: a negative relationship exists between school_rating and reduced_lunch (to be covered in a follow up article). If the test is successful, she'll need to build a more robust model using additional variables. If the test fails, she'll need to re-visit her dataset to choose other variables that possibly explain school_rating . Either way, Sally could benefit from an efficient way of assessing relationships among her variables.

An efficient graph for assessing relationships is the correlation matrix, as seen below; its color-coded cells make it easier to interpret than the tabular correlation matrix above. Red cells indicate positive correlation; blue cells indicate negative correlation; white cells indicate no correlation. The darker the colors, the stronger the correlation (positive or negative) between those two variables.

With the correlation matrix in mind as a future starting point for finding additional variables, Sally moves on for now and prepares to test her hypothesis.

Sally was approached with a problem: why are some schools in middle Tennessee under-performing? To answer this question, she did the following:

• Conducted a lit review to educate herself on the topic.
• Gathered data from a reputable source to explore school ratings and characteristics of the student bodies and schools in middle Tennessee.
• The data indicated a robust relationship between school_rating and reduced_lunch .
• Explored the data visually.
• Though satisfied with her preliminary findings, Sally is keeping her mind open to other explanations.
• Developed a hypothesis: a negative relationship exists between school_rating and reduced_lunch .

In a follow up article, Sally will test her hypothesis. Should she find a satisfactory explanation for her sample of schools, she will attempt to apply her explanation to the population of schools in Tennessee.

Course Recommendations

Further learning:, applied data science with python — coursera, statistics and data science micromasters — edx, get updates in your inbox.

Join over 7,500 data science learners.

Recent articles:

The 6 best python courses for 2024 – ranked by software engineer, best course deals for black friday and cyber monday 2024, sigmoid function, dot product, 7 best artificial intelligence (ai) courses.

Top courses you can take today to begin your journey into the Artificial Intelligence field.

Meet the Authors

A graduate of Belmont University, Tim is a Nashville, TN-based software engineer and statistician at Perception Health, an industry leader in healthcare analytics, and co-founder of Sidekick, LLC, a data consulting company. Find him on  Twitter  and  GitHub .

John is a research analyst at Laffer Associates, a macroeconomic consulting firm based in Nashville, TN. He graduated from Belmont University. Find him on  GitHub  and  LinkedIn

Back to blog index

Thank you for visiting nature.com. You are using a browser version with limited support for CSS. To obtain the best experience, we recommend you use a more up to date browser (or turn off compatibility mode in Internet Explorer). In the meantime, to ensure continued support, we are displaying the site without styles and JavaScript.

• View all journals
• Explore content
• About the journal
• Publish with us
• Sign up for alerts
• Expert Recommendation
• Published: 21 April 2022

The case for data science in experimental chemistry: examples and recommendations

• Junko Yano   ORCID: orcid.org/0000-0001-6308-9071 1 ,
• Kelly J. Gaffney   ORCID: orcid.org/0000-0002-0525-6465 2 , 3 ,
• John Gregoire   ORCID: orcid.org/0000-0002-2863-5265 4 ,
• Linda Hung   ORCID: orcid.org/0000-0002-1578-6152 5 ,
• Abbas Ourmazd   ORCID: orcid.org/0000-0001-9946-3889 6 ,
• Joshua Schrier   ORCID: orcid.org/0000-0002-2071-1657 7 ,
• James A. Sethian   ORCID: orcid.org/0000-0002-7250-7789 8 , 9 &
• Francesca M. Toma   ORCID: orcid.org/0000-0003-2332-0798 10  

Nature Reviews Chemistry volume  6 ,  pages 357–370 ( 2022 ) Cite this article

4446 Accesses

34 Citations

32 Altmetric

Metrics details

• Physical chemistry

The physical sciences community is increasingly taking advantage of the possibilities offered by modern data science to solve problems in experimental chemistry and potentially to change the way we design, conduct and understand results from experiments. Successfully exploiting these opportunities involves considerable challenges. In this Expert Recommendation, we focus on experimental co-design and its importance to experimental chemistry. We provide examples of how data science is changing the way we conduct experiments, and we outline opportunities for further integration of data science and experimental chemistry to advance these fields. Our recommendations include establishing stronger links between chemists and data scientists; developing chemistry-specific data science methods; integrating algorithms, software and hardware to ‘co-design’ chemistry experiments from inception; and combining diverse and disparate data sources into a data network for chemistry research.

This is a preview of subscription content, access via your institution

Access options

Access Nature and 54 other Nature Portfolio journals

Get Nature+, our best-value online-access subscription

24,99 € / 30 days

cancel any time

Subscribe to this journal

Receive 12 digital issues and online access to articles

111,21 € per year

only 9,27 € per issue

Buy this article

• Purchase on Springer Link
• Instant access to full article PDF

Prices may be subject to local taxes which are calculated during checkout

Similar content being viewed by others

Making the collective knowledge of chemistry open and machine actionable

Anthropogenic biases in chemical reaction data hinder exploratory inorganic synthesis

Chemical reaction networks and opportunities for machine learning

Ourmazd, A. Science in the age of machine learning. Nat. Rev. Phys. 2 , 342–343 (2020).

Article   Google Scholar  

National Science Foundation. Framing the Role of Big Data and Modern Data Science in Chemistry. NSF https://www.nsf.gov/mps/che/workshops/data_chemistry_workshop_report_03262018.pdf (2018).

Mission Innovation (Energy Materials Innovation, 2018); http://mission-innovation.net/wp-content/uploads/2018/01/Mission-Innovation-IC6-Report-Materials-Acceleration-Platform-Jan-2018.pdf .

Butler, K. T., Davies, D. W., Cartwright, H., Isayev, O. & Walsh, A. Machine learning for molecular and materials science. Nature 559 , 547–555 (2018).

Article   CAS   PubMed   Google Scholar  

Morgan, D. & Jacobs, R. Opportunities and challenges for machine learning in materials science. Annu. Rev. Mater. Res. 50 , 71–103 (2020).

Article   CAS   Google Scholar  

Janet, J. P. & Kulik, H. J. Machine Learning In Chemistry (American Chemical Society, 2020).

Wang, A. Y.-T. et al. Machine learning for materials scientists: an introductory guide toward best practices. Chem. Mater. 32 , 4954–4965 (2020).

Dashti, A. et al. Retrieving functional pathways of biomolecules from single-particle snapshots. Nat. Commun. 11 , 4734 (2020).

Article   CAS   PubMed   PubMed Central   Google Scholar  

Selvaratnam, B. & Koodali, R. T. Machine learning in experimental materials chemistry. Catal. Today 371 , 77–84 (2021).

Shi, Y., Prieto, P. L., Zepel, T., Grunert, S. & Hein, J. E. Automated experimentation powers data science in chemistry. Acc. Chem. Res. 54 , 546–555 (2021).

Shen, Y. et al. Automation and computer-assisted planning for chemical synthesis. Nat. Rev. Meth. Prim. 1 , 23 (2021).

Nichols, P. L. Automated and enabling technologies for medicinal chemistry. Progr. Med. Chem. 60 , 191–272 (2021).

Stein, H. S. & Gregoire, J. M. Progress and prospects for accelerating materials science with automated and autonomous workflows. Chem. Sci. 10 , 9640–9649 (2019).

Flores-Leonar, M. M. et al. Materials acceleration platforms: on the way to autonomous experimentation. Curr. Opin. Green. Sustain. Chem. 25 , 100370 (2020).

Dashti, A. et al. Trajectories of the ribosome as a Brownian nanomachine. Proc. Natl Acad. Sci. USA 111 , 17492 (2014).

Hosseinizadeh, A. et al. Conformational landscape of a virus by single-particle X-ray scattering. Nat. Methods 14 , 877–881 (2017).

Ourmazd, A. Cryo-EM, XFELs and the structure conundrum in structural biology. Nat. Methods 16 , 941–944 (2019).

Fung, R. et al. Dynamics from noisy data with extreme timing uncertainty. Nature 532 , 471–475 (2016).

Coley, C. W., Eyke, N. S. & Jensen, K. F. Autonomous discovery in the chemical sciences. Part I: progress. Angew. Chem. Int. Ed. 59 , 22858–22893 (2020).

Coley, C. W., Eyke, N. S. & Jensen, K. F. Autonomous discovery in the chemical sciences. Part II: Outlook. Angew. Chem. Int. Ed. 59 , 23414–23436 (2020).

Stach, E. et al. Autonomous experimentation systems for materials development: a community perspective. Matter 4 , 2702–2726 (2021).

Cao, L., Russo, D. & Lapkin, A. A. Automated robotic platforms in design and development of formulations. AIChE J. 67 , e17248 (2021).

Oviedo, F. et al. Fast and interpretable classification of small X-ray diffraction datasets using data augmentation and deep neural networks. njp Comput. Mat. 5 , 60 (2019).

Google Scholar  

Epps, R. W. et al. Artificial chemist: an autonomous quantum dot synthesis bot. Adv. Mater. 32 , 2001626 (2020).

Volk, A. A., Epps, R. W. & Abolhasani, M. Accelerated development of colloidal nanomaterials enabled by modular microfluidic reactors: toward autonomous robotic experimentation. Adv. Mater. 33 , 2004495 (2021).

Abdel-Latif, K., Bateni, F., Crouse, S. & Abolhasani, M. Flow synthesis of metal halide perovskite quantum dots: from rapid parameter space mapping to AI-guided modular manufacturing. Matter 3 , 1053–1086 (2020).

Whitacre, J. F. et al. An autonomous electrochemical test stand for machine learning informed electrolyte optimization. J. Electrochem. Soc. 166 , A4181–A4187 (2019).

Dave, A. et al. Autonomous discovery of battery electrolytes with robotic experimentation and machine learning. Cell Rep. Phys. Sci. 1 , 100264 (2020).

Wimmer, E. et al. An autonomous self-optimizing flow machine for the synthesis of pyridine–oxazoline (PyOX) ligands. React. Chem. Eng. 4 , 1608–1615 (2019).

Cortés-Borda, D. et al. An autonomous self-optimizing flow reactor for the synthesis of natural product carpanone. J. Org. Chem. 83 , 14286–14299 (2018).

Article   PubMed   CAS   Google Scholar  

Jeraal, M. I., Sung, S. & Lapkin, A. A. A machine learning-enabled autonomous flow chemistry platform for process optimization of multiple reaction metrics. Chem. Meth. 1 , 71–77 (2021).

Christensen, M. et al. Data-science driven autonomous process optimization. Commun. Chem. 4 , 112 (2021).

Burger, B. et al. A mobile robotic chemist. Nature 583 , 237–241 (2020).

Shiri, P. et al. Automated solubility screening platform using computer vision. iScience 24 , 102176 (2021).

Waldron, C. et al. An autonomous microreactor platform for the rapid identification of kinetic models. React. Chem. Eng. 4 , 1623–1636 (2019).

Noack, M. M. et al. A kriging-based approach to autonomous experimentation with applications to X-ray scattering. Sci. Rep. 9 , 11809 (2019).

Article   PubMed   PubMed Central   CAS   Google Scholar  

Noack, M. M., Doerk, G. S., Li, R., Fukuto, M. & Yager, K. G. Advances in kriging-based autonomous X-ray scattering experiments. Sci. Rep. 10 , 1325 (2020).

Noack, M. M., Zwart, P. H. & Ushizima, D. M. et al. Gaussian processes for autonomous data acquisition at large-scale synchrotron and neutron facilities. Nat. Rev. Phys. 3 , 685–697 (2021).

Cho, S.-Y. et al. Finding hidden signals in chemical sensors using deep learning. Anal. Chem. 92 , 6529–6537 (2020).

Nega, P. W. et al. Using automated serendipity to discover how trace water promotes and inhibits lead halide perovskite crystal formation. Appl. Phys. Lett. 119 , 041903 (2021).

Kayser, Y. et al. Core-level nonlinear spectroscopy triggered by stochastic X-ray pulses. Nat. Commun. 10 , 4761 (2019).

Fuller, F. D. et al. Resonant X-ray emission spectroscopy from broadband stochastic pulses at an X-ray free electron laser. Commun. Chem. 4 , 84 (2021).

Fagnan, K. et al. Data and Models: A Framework for Advancing AI in Science (OSTI, 2019).

Domcke, W. & Yarkony, D. R. Role of conical intersections in molecular spectroscopy and photoinduced chemical dynamics. Annu. Rev. Phys. Chem. 63 , 325–352 (2012).

Hosseinizadeh, A. et al. Single-femtosecond atomic-resolution observation of a protein traversing a conical intersection. Nature 599 , 697–701 (2021).

Takens, F. in Dynamical Systems and Turbulence, Warwick 1980 (eds Rand, D. & Young, L.S.) 366–381 (Springer, 1981).

Packard, N. H., Crutchfield, J. P., Farmer, J. D. & Shaw, R. S. Geometry from a time series. Phys. Rev. Lett. 45 , 712–716 (1980).

Hosseinizadeh, A. et al. Few-fs resolution of a photoactive protein traversing a conical intersection. Nature 599 , 697–701 (2021).

Fung, R. et al. Achieving accurate estimates of fetal gestational age and personalised predictions of fetal growth based on data from an international prospective cohort study: a population-based machine learning study. Lancet Dig. Health 2 , e368–e375 (2020).

Jia, W. et al. in SC20: International Conference for High Performance Computing, Networking, Storage and Analysis 1–14 (IEEE, 2020); https://dl.acm.org/doi/abs/10.5555/3433701.3433707 .

Sun, S. et al. A data fusion approach to optimize compositional stability of halide perovskites. Matter 4 , 1305–1322 (2021).

Jia, X. et al. Anthropogenic biases in chemical reaction data hinder exploratory inorganic synthesis. Nature 573 , 251–255 (2019).

Krska, S. W., DiRocco, D. A., Dreher, S. D. & Shevlin, M. The evolution of chemical high-throughput experimentation to address challenging problems in pharmaceutical synthesis. Acc. Chem. Res. 50 , 2976–2985 (2017).

Dybowski, R. Interpretable machine learning as a tool for scientific discovery in chemistry. N. J. Chem. 44 , 20914–20920 (2020).

Guan, W. et al. Quantum machine learning in high energy physics. Mach. Learn. Sci. Technol. 2 , 011003 (2021).

Duros, V. et al. Intuition-enabled machine learning beats the competition when joint human-robot teams perform inorganic chemical experiments. J. Chem. Inf. Model. 59 , 2664–2671 (2019).

McNally, A., Prier, C. K. & MacMillan, D. W. C. Discovery of an α-amino C–H arylation reaction using the strategy of accelerated serendipity. Science 334 , 1114 (2011).

Buitrago Santanilla, A. et al. Nanomole-scale high-throughput chemistry for the synthesis of complex molecules. Science 347 , 49–53 (2015).

Lin, S. et al. Mapping the dark space of chemical reactions with extended nanomole synthesis and MALDI-TOF MS. Science 361 , eaar6236 (2018).

Selekman, J. A. et al. High-throughput automation in chemical process development. Annu. Rev. Chem. Biomol. 8 , 525–547 (2017).

Dragone, V., Sans, V., Henson, A. B., Granda, J. M. & Cronin, L. An autonomous organic reaction search engine for chemical reactivity. Nat. Commun. 8 , 15733 (2017).

Article   PubMed   PubMed Central   Google Scholar  

Sader, J. K. & Wulff, J. E. Reinvestigation of a robotically revealed reaction. Nature 570 , E54–E59 (2019).

Milo, A., Neel, A. J., Toste, F. D. & Sigman, M. S. Organic chemistry. A data-intensive approach to mechanistic elucidation applied to chiral anion catalysis. Science 347 , 737–743 (2015).

Article   PubMed Central   CAS   Google Scholar  

Melodie, C. et al. Data-science driven autonomous process optimization. Comm. Chem. 4 , 112 (2021).

Li, J. et al. AI applications through the whole life cycle of material discovery. Matter 3 , 393–432 (2020).

Kusne, A. G. et al. On-the-fly machine-learning for high-throughput experiments: search for rare-earth-free permanent magnets. Sci. Rep. 4 , 6367 (2014).

Kusne, A. G. et al. On-the-fly closed-loop materials discovery via Bayesian active learning. Nat. Commun. 11 , 5966 (2020).

Shi, F., Foster, J. G. & Evans, J. A. Weaving the fabric of science: dynamic network models of science’s unfolding structure. Soc. Netw. 43 , 73–85 (2015).

Bai, J. et al. From platform to knowledge graph: evolution of laboratory automation. J. Am. Chem. Soc. Au 2 , 292–309 (2022).

CAS   Google Scholar  

Gates-Rector, S. & Blanton, T. The Powder Diffraction File: a quality materials characterization database. Powder Diffr. 34 , 352–360 (2019).

Linstrom, P. J. & Mallard, W. G. (eds) NIST Chemistry WebBook, NIST Standard Reference Database Number 69 (National Institute of Standards and Technology, 2022).

Berman, H. M. et al. The Protein Data Bank. Nucleic Acids Res. 28 , 235–242 (2000).

Kuhn, S. & Schlörer, N. E. Facilitating quality control for spectra assignments of small organic molecules: nmrshiftdb2 — a free in-house NMR database with integrated LIMS for academic service laboratories. Magn. Reson. Chem. 53 , 582–589 (2015).

Hanson, R. et al. Development Of A Standard For Fair Data Management Of Spectroscopic Data (IUPAC, 2020).

Hanson, R. M. J. et al. FAIR enough? Spectrosc. Eur. World 33 , 25–31 (2021).

Kearnes, S. M. et al. The open reaction database. J. Am. Chem. Soc. 143 , 18820–18826 (2021).

Tremouilhac, P. et al. Chemotion ELN: an open source electronic lab notebook for chemists in academia. J. Cheminform. 9 , 54 (2017).

Mehr, S. H. M., Craven, M., Leonov Artem, I., Keenan, G. & Cronin, L. A universal system for digitization and automatic execution of the chemical synthesis literature. Science 370 , 101–108 (2020).

Vaucher, A. C. et al. Automated extraction of chemical synthesis actions from experimental procedures. Nat. Commun. 11 , 3601 (2020).

Pendleton, I. M. et al. Experiment Specification, Capture and Laboratory Automation Technology (ESCALATE): a software pipeline for automated chemical experimentation and data management. MRS Commun. 9 , 846–859 (2019).

Choudhury, R., Aykol, M., Gratzl, S., Montoya, J. & Hummelshøj, J. S. MaterialNet: a web-based graph explorer for materials science data. J. Opn Src. Softw. 5 , 2105 (2020).

Aykol, M. et al. Network analysis of synthesizable materials discovery. Nat. Commun. 10 , 2018 (2019).

Statt, M. R. et al. ESAMP: event-sourced architecture for materials provenance management and application to accelerated materials discovery. Preprint at ChemRxiv https://doi.org/10.26434/chemrxiv.14583258.v1 (2021).

Li, Z. et al. Robot-accelerated perovskite investigation and discovery. Chem. Mater. 32 , 5650–5663 (2020).

Ratner, D. et al. Office Of Basic Energy Sciences (BES) roundtable on producing and managing large scientific data with artificial intelligence and machine learning. US DOE OSTI https://doi.org/10.2172/1630823 (2019).

Kwon, H.-K., Gopal, C. B., Kirschner, J., Caicedo, S. & Storey, B. D. A user-centered approach to designing an experimental laboratory data platform. Preprint at arXiv https://arxiv.org/abs/2007.14443 (2020).

Mrdjenovich, D. et al. Propnet: a knowledge graph for materials science. Matter 2 , 464–480 (2020).

Sullivan, K. P., Brennan-Tonetta, P. & Marxen, L. J. Economic Impacts of the Research Collaboratory for Structural Bioinformatics (RCSB) Protein Data Bank (Rutgers Office of Research Analytics, 2017).

Jumper, J. et al. Highly accurate protein structure prediction with AlphaFold. Nature 596 , 583–589 (2021).

Baek, M. et al. Accurate prediction of protein structures and interactions using a three-track neural network. Science 373 , 871–876 (2021).

Alshahrani, M. et al. Neuro-symbolic representation learning on biological knowledge graphs. Bioinformatics 33 , 2723–2730 (2017).

Carbone, M. R., Yoo, S., Topsakal, M. & Lu, D. Classification of local chemical environments from X-ray absorption spectra using supervised machine learning. Phys. Rev. Mater. 3 , 033604 (2019).

Zheng, C., Chen, C., Chen, Y. & Ong, S. P. Random forest models for accurate identification of coordination environments from X-ray absorption near-edge structure. Patterns 1 , 100013 (2020).

Torrisi, S. B. et al. Random forest machine learning models for interpretable X-ray absorption near-edge structure spectrum-property relationships. npj Comput. Mater. 6 , 109 (2020).

Carbone, M. R., Topsakal, M., Lu, D. & Yoo, S. Machine-learning X-ray absorption spectra to quantitative accuracy. Phys. Rev. Lett. 124 , 156401 (2020).

Cibin, G. et al. An open access, integrated XAS data repository at diamond light source. Radiat. Phys. Chem. 175 , 108479 (2020).

Musil, F. et al. Physics-inspired structural representations for molecules and materials. Chem. Rev. 121 , 9759–9815 (2021).

Smidt, T. E. Euclidean symmetry and equivariance in machine learning. Trends Chem. 3 , 82–85 (2021).

Ropers, J., Mosca, M. M., Anosova, O., Kurlin, V. & Cooper, A. I. Fast predictions of lattice energies by continuous isometry invariants of crystal structures. Preprint at https://arxiv.org/abs/2108.07233 (2021).

Herr, J. E., Koh, K., Yao, K. & Parkhill, J. Compressing physics with an autoencoder: creating an atomic species representation to improve machine learning models in the chemical sciences. J. Chem. Phys. 151 , 084103 (2019).

Sharma, A. Laboratory glassware identification: supervised machine learning example for science students. J. Comput. Sci. Ed. 12 , 8–15 (2021).

Thrall, E. S., Lee, S. E., Schrier, J. & Zhao, Y. Machine learning for functional group identification in vibrational spectroscopy: a pedagogical lab for undergraduate chemistry students. J. Chem. Educ. 98 , 3269–3276 (2021).

Lafuente, D. et al. A gentle introduction to machine learning for chemists: an undergraduate workshop using python notebooks for visualization, data processing, analysis, modeling. J. Chem. Ed. 98 , 2892–2898 (2021).

Gressling, T. Data Science in Chemistry: Artificial Intelligence, Big Data, Chemometrics and Quantum Computing with Jupyter (Walter de Gruyter, 2020).

Kauwe, S. K., Graser, J., Murdock, R. & Sparks, T. D. Can machine learning find extraordinary materials? Comput. Mat. Sci. 174 , 109498 (2020).

Schwaller, P. et al. “Found in translation”: predicting outcomes of complex organic chemistry reactions using neural sequence-to-sequence models. Chem. Sci. 9 , 6091–6098 (2018).

Bergmann, U. et al. Using X-ray free-electron lasers for spectroscopy of molecular catalysts and metalloenzymes. Nat. Rev. Phys. 3 , 264–282 (2021).

Ayyer, K. et al. Low-signal limit of X-ray single particle diffractive imaging. Opt. Express 27 , 37816–37833 (2019).

Brewster, A. et al. Processing serial crystallographic data from XFELs or synchrotrons using the cctbx.xfel GUI. Comput. Crystallogr. Newsl. 10 , 22–39 (2019).

Young, I. D. et al. Structure of photosystem II and substrate binding at room temperature. Nature 540 , 453–457 (2016).

Ratner, D., Cryan, J. P., Lane, T. J., Li, S. & Stupakov, G. Pump–probe ghost imaging with SASE FELs. Phys. Rev. X 9 , 011045 (2019).

Download references

Acknowledgements

This article evolved from presentations and discussions at the workshop ‘At the Tipping Point: A Future of Fused Chemical and Data Science’ held in September 2020, sponsored by the Council on Chemical Sciences, Geosciences, and Biosciences of the US Department of Energy, Office of Science, Office of Basic Energy Sciences. The authors thank the members of the Council for their encouragement and assistance in developing this workshop. In addition, the authors are indebted to the agencies responsible for funding their individual research efforts, without which this work would not have been possible.

Author information

Authors and affiliations.

Molecular Biophysics and Integrated Bioimaging Division, Lawrence Berkeley National Laboratory, Berkeley, CA, USA

SLAC National Accelerator Laboratory, Menlo Park, CA, USA

Kelly J. Gaffney

PULSE Institute, SLAC National Accelerator Laboratory, Stanford University, Stanford, CA, USA

Division of Engineering and Applied Science, California Institute of Technology, Pasadena, CA, USA

John Gregoire

Accelerated Materials Design and Discovery, Toyota Research Institute, Los Altos, CA, USA

University of Wisconsin, Milwaukee, WI, USA

Abbas Ourmazd

Fordham University, Department of Chemistry, The Bronx, NY, USA

Joshua Schrier

Department of Mathematics, University of California, Berkeley, CA, USA

James A. Sethian

Center for Advanced Mathematics for Energy Research Applications (CAMERA), Lawrence Berkeley National Laboratory, Berkeley, CA, USA

Chemical Sciences Division, Lawrence Berkeley National Laboratory, Berkeley, CA, USA

Francesca M. Toma

You can also search for this author in PubMed   Google Scholar

Contributions

All authors contributed equally to all aspects of the article.

Corresponding authors

Correspondence to Junko Yano , Kelly J. Gaffney , John Gregoire , Linda Hung , Abbas Ourmazd , Joshua Schrier , James A. Sethian or Francesca M. Toma .

Ethics declarations

Competing interests.

The authors declare no competing interests.

Peer review

Peer review information.

Nature Reviews Chemistry thanks Martin Green, Venkatasubramanian Viswanathan and the other, anonymous, reviewer(s) for their contribution to the peer review of this work.

Additional information

Publisher’s note.

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Related links

Autoprotocol: https://autoprotocol.org/

Cambridge Structural Database: https://www.ccdc.cam.ac.uk/

CAMERA: https://camera.lbl.gov/

Chemotion Repository: https://www.chemotion-repository.net/welcome

FAIR principles: https://www.go-fair.org/fair-principles/

HardwareX: https://www.journals.elsevier.com/hardwarex

IBM RXN: https://rxn.res.ibm.com/

Inorganic Crystal Structure Database: https://www.psds.ac.uk/icsd

MaterialNet: https://maps.matr.io/

NMRShiftDB: https://nmrshiftdb.nmr.uni-koeln.de/

Open Reaction Database: http://open-reaction-database.org

Protein Data Bank: https://www.rcsb.org/

PuRe Data Resources: https://www.energy.gov/science/office-science-pure-data-resources

Reaxys: https://www.elsevier.com/solutions/reaxys

Rights and permissions

Reprints and permissions

About this article

Cite this article.

Yano, J., Gaffney, K.J., Gregoire, J. et al. The case for data science in experimental chemistry: examples and recommendations. Nat Rev Chem 6 , 357–370 (2022). https://doi.org/10.1038/s41570-022-00382-w

Download citation

Accepted : 17 March 2022

Published : 21 April 2022

Issue Date : May 2022

DOI : https://doi.org/10.1038/s41570-022-00382-w

Share this article

Anyone you share the following link with will be able to read this content:

Sorry, a shareable link is not currently available for this article.

Provided by the Springer Nature SharedIt content-sharing initiative

This article is cited by

Embracing data science in catalysis research.

• Manu Suvarna
• Javier Pérez-Ramírez

Nature Catalysis (2024)

COMPAS-2: a dataset of cata-condensed hetero-polycyclic aromatic systems

• Eduardo Mayo Yanes
• Sabyasachi Chakraborty
• Renana Gershoni-Poranne

Scientific Data (2024)

The rise of self-driving labs in chemical and materials sciences

• Milad Abolhasani
• Eugenia Kumacheva

Nature Synthesis (2023)

The Materials Provenance Store

• Michael J. Statt
• Brian A. Rohr
• John M. Gregoire

Scientific Data (2023)

Rapid planning and analysis of high-throughput experiment arrays for reaction discovery

• Babak Mahjour

Nature Communications (2023)

Quick links

• Explore articles by subject
• Guide to authors
• Editorial policies

Sign up for the Nature Briefing newsletter — what matters in science, free to your inbox daily.

Data Science Cases in Healthcare in 2024

Table of contents:.

Data science revolutionizes healthcare by providing insights and applications that transform patient care and operations. DATAFOREST applies data science to drive business success in healthcare while offering these capabilities outside the sector. 

Performance Optimization & Bottlenecks Elimination

performance boost

cost optimization

Daniel Garner

The team of DATAFOREST is very skilled and equipped with high knowledge.

Data science is increasingly important in healthcare as healthcare generates more and more data. Data scientists are needed to analyze this information to achieve improvements in patient outcomes and reduced costs, among other things. Healthcare delivery is transforming due to data science, from predicting disease outbreaks and developing personalized treatment plans.

This blog provides insights and applications of data science in healthcare. We will discuss the types of data science used in this industry, how it can be leveraged effectively to produce valuable results—and case studies on successful data science projects.

What is Data Science in the Healthcare Industry?

Data science uses advanced analytics, machine learning, and artificial intelligence to uncover previously hidden patterns within large amounts of data. Applying data science in healthcare and data science in medicine can use advanced analytics and machine learning algorithms to derive insights and make predictions that can improve patient outcomes. It includes predictive analytics and image analysis—which help identify patterns that would be impossible to detect with other methods. Health, medical, and biomedical data science are all branches of the larger field of data analytics. This data can include electronic health records, medical imaging, and other sources of healthcare-related information. Some examples of how data science is currently used in healthcare include predicting patient readmissions and identifying patients at risk for developing chronic diseases. Additionally, the practice has been proven to enhance the accuracy of medical diagnoses.

Overview of the Healthcare Industry

In recent years, according to research by Springer in the healthcare industry , Data Science has become increasingly important due to the vast amounts of data generated from patient records, medical images, and clinical trial results. Healthcare organizations can use data science in the healthcare industry to make sense of the vast amounts of data they collect and apply it to improve patient outcomes, optimize operations, and cut costs.

For example, predictive analytics can help healthcare providers identify patients at risk for certain conditions and intervene early—preventing the condition from progressing. Precision medicine tailors treatment plans to individual patients based on their unique genetic makeup and other factors.

DATAFOREST specializes in helping healthcare organizations implement solutions that harness the power of Data Science. Our team can develop and deploy data-driven strategies to improve patient outcomes, streamline operations, and drive business success.

Advantages of The Data Science in Healthcare

The global healthcare analytics market size is expected to reach USD 167.0 billion by 2030, expanding at a CAGR of 21.4% during the forecast period, according to a new report by Grand View Research Inc. This is because health data science, or health informatics, as it is called in some circles, has several benefits for doctors and patients. 

Here are 10 key benefits of data science for healthcare organizations:

• Improved patient outcomes: Data science can help healthcare providers develop more effective treatment plans by considering individual patient data.
• Predictive analytics: Data science can help healthcare providers identify patients at risk of developing certain conditions early on and prevent those conditions from becoming severe problems.
• Precision medicine: By using data science to tailor treatment plans, doctors can make better decisions about how best to treat individual patients.
• Enhanced research: Data science is an emerging field that uses large datasets to identify patterns and trends relevant to medical research. It can lead to the discovery of new treatments.
• Operational optimization: Healthcare organizations can use data science to optimize operations, reduce waste, and streamline processes—all of which improve patient care and increase profitability.
• Improved patient engagement: Personalized data analysis can help healthcare providers understand their patients better, improving patient outcomes.
• Real-time monitoring: Healthcare providers can use data science to monitor patient health in real-time, improving outcomes and the timing of interventions.
• Cost reduction: Healthcare organizations can use data science to identify areas to reduce costs. For example, by analyzing patient data, we might identify patients at risk for readmission and intervene early to prevent this costly scenario from happening again.
• Improved decision-making: Healthcare organizations can use data-driven decision-making to understand their patients better and improve outcomes while reducing costs. Improved data analysis can help healthcare organizations identify opportunities to improve their operations.
• Better resource allocation: Data analysis can help healthcare organizations make better decisions about how to spend money and provide high-quality care. With the proper data science tools, hospitals can allocate resources more effectively, improving patient care and increasing profitability.

How Data Science Can Improve Healthcare Systems

Data science significantly impacts the healthcare industry, helping organizations improve patient outcomes and drive innovation. Healthcare providers can use data science to make more effective decisions, identify areas for improvement and develop better treatment plans.

Data science can also help healthcare organizations stay up-to-date with their field's latest research and developments, leading to more effective treatments and interventions. This will ultimately improve patient care/outcomes by delivering more efficient services and personalized medicine options across multiple stages, from diagnostic tests to treatment recovery.

Healthcare companies can use data science to allocate resources more efficiently and effectively, reducing costs while improving profitability. As healthcare becomes less about treatment for illness or injury and more about prevention of disease (allocation of preventative care), the importance of using data science to understand patients better will grow.

Data Science Applications in Healthcare Industry: 9 Case Studies

Data science has become an essential tool in the healthcare industry, as technology makes it easier to collect and analyze large amounts of data. Data science has contributed to the rise in patient care, offering new avenues for diagnosis and treatment.

Predictive Analytics in Patient Diagnosis

Predictive analytics can help healthcare providers identify patients at risk for certain conditions, allowing them to intervene early and prevent the condition from progressing.

#1. Case Study: Machine Learning for Heart Disease Prediction

Predictive analytics is a fantastic tool for diagnosing illnesses, allowing doctors and healthcare providers to diagnose diseases early on and develop effective treatment plans.

With machine learning algorithms, predictive analytics can identify patterns that are invisible to the human eye and use them to predict a patient's health—including by identifying risk factors for developing diseases.

Researchers at Nottingham University have demonstrated how predictive analytics can help prevent heart disease. The study used patient data—including demographic, lifestyle, and clinical factors—to create a predictive model that more accurately identifies people at risk for heart disease than traditional methods.

This example demonstrates how data science—especially machine learning technology—can be used to develop personalized patient treatment plans and improve outcomes.

Need to optimize supply chain efficiency?

#2. case study: deep learning for diabetes risk prediction.

The National Library of Medicine discusses a survey that used machine learning approaches to predict diabetes risk . The study aimed to analyze how machine learning algorithms could identify diabetes mellitus at an early stage—a severe metabolic disorder that affects so many people worldwide.

The accuracy of the algorithms was evaluated using metrics such as sensitivity, specificity, and accuracy. The results showcased that the Support Vector Machine (SVM) algorithm had the highest accuracy of 96.6%, followed by the Random Forest (RF) algorithm with an accuracy of 96.4%. The K-Nearest Neighbor (KNN) algorithm had an accuracy of 94.6%.

Early detection of diabetes is critical for effective therapy, and machine learning approaches can help achieve this.

Improving Healthcare Operations with Data Science

Healthcare providers can use data science to improve operations and make processes more efficient, reducing costs. They do this by analyzing data on patient flow, resource allocation, and other factors — then using that information to optimize their operations to meet patients' needs better.

#3. Case Study: Predictive Analytics for Hospital Readmission Rates

Hospital readmissions can be costly and disruptive for both patients and healthcare providers. Predictive analytics can be used to identify patients who are at risk for readmission, allowing healthcare providers to intervene early and prevent readmissions from occurring. 

A study published in the journal Scientific Reports used machine learning to predict the hospital readmission risk from patients' claims data using machine learning , with a specific focus on chronic obstructive pulmonary disease (COPD). Researchers found that a machine learning model could accurately predict the hospital readmission risk for COPD patients, allowing earlier intervention and improved patient outcomes. A review of predictive models for hospital readmission risk found that machine-learning techniques are becoming increasingly popular and show promising results.

#4. Case Study: Data Analytics for Hospital Staff Scheduling

Optimizing hospital staff scheduling is crucial for improving patient outcomes and increasing efficiency. Data analytics can be used to analyze patient flow, staff availability, and workload—all of which feed into developing optimized schedules. 

Research by Harvard Business Review demonstrated the potential of data analytics in optimizing hospital staff scheduling . The study collected data on patient flow, staff availability, and workload and used various data analytics models to analyze the data.

Data analytics models developed by the hospital's staff scheduling department yielded more efficient work schedules, leading to a 30% decrease in patient waiting time and an increase of 25% in patient outcomes. Staff satisfaction increased as well—by 20%. In addition, 15% more patients could be seen daily, with 10 percent higher customer satisfaction ratings.

This study indicates that data analytics could improve hospital staff scheduling and improve patient care.

Enhancing Drug Discovery and Development

Data science is revolutionizing drug discovery and development by using machine learning algorithms to analyze large datasets of chemical compounds. This approach enables researchers to identify potential drug candidates more efficiently, reducing the time and cost required for drug development. However, there are challenges associated with using data science in healthcare, including ethical and security considerations, biases in data used to train ML algorithms, and the need for human involvement in developing and evaluating these technologies. 

#5. Case Study: Machine Learning for Accelerating Drug Development

The FDA's discussion papers on the use of AI and ML in drug development and manufacturing have been written to encourage discussion and debate on the benefits, challenges, and potential implications of applying data science to health-related issues. They aim to encourage collaboration and address these challenges to ensure data science's safe and effective use in healthcare. Overall, data science can improve patient outcomes and significantly accelerate drug development timelines.

#6. Case Study: Data Analytics for Improving Drug Efficacy

After identifying a promising drug candidate, the next step is to test its efficacy in clinical trials. However, many drugs that show promise during initial tests fail when put under rigorous conditions—such as those of actual use by patients—in later tests.

Data analytics can improve clinical trials by analyzing large patient data sets and identifying patterns that inform the design, execution, and evaluation of new treatments.

By analyzing patient data, a data scientist can determine which groups are most likely to benefit from a particular drug. Bringing together genetic mutations that cause disease in a single patient can drastically reduce the number of patients needed for drug trials, thereby reducing costs and speeding up timelines.

#7. Case Study: Optimizing Clinical Trial Design with Data Analytics

The article " The Role of Data Analytics in Improving Clinical Trials and Drug Discovery " by U.S. Food & Drug discusses how clinical trials and drug discovery can benefit from data analysis.

A database of real-world patient data, a synthetic control arm, and insights into research questions can be generated faster by analyzing databases of real-world patients.

Using machines equipped with advanced algorithms and artificial intelligence, companies can now gather data about a staggering number of patents—and turn that information into meaningful insights faster than ever before.

One of the challenges associated with traditional approaches to clinical trials is the need for more understanding of the underlying biology of diseases. However, by using synthetic control arms, clinical development, and drug discovery can be transformed. Synthetic control arms help overcome patient stratification challenges, reduce the time it takes to develop medical treatments, and improve clinical trial design and success rates. This approach can be beneficial for rare diseases where patient populations are smaller, and lifespan is short due to the disease's aggressive nature.

Personalized Medicine

Personalized medicine is a new approach to treating disease by considering an individual's unique genetic, environmental, and lifestyle factors. Data science can provide a personalized approach to medicine by analyzing large datasets of patient data. This approach can reduce healthcare costs and risks while improving treatment outcomes.

#8. Case Study: Big Data for Personalized Cancer Treatment

The article " Big Data in Basic and Translational Cancer Research ," published on PubMed, discusses how combining big data, bioinformatics, and artificial intelligence has led to notable advances in our fundamental understanding of cancer biology and translational advancements. The authors stress the need for collaboration among data scientists, clinicians, biologists, and policymakers to use big data to advance cancer treatment. 

The predictive model allowed the cancer center to personalize treatment for each patient, increasing the chances of success and reducing adverse events.

The new immunotherapy treatment appears more effective for patients whose disease is driven by the biomarkers identified in this predictive model.

This case study exemplifies the potential of big data in personalized cancer treatment. By leveraging large patient datasets and machine learning algorithms, data scientists can identify patterns within the data and develop predictive models to identify patients most likely to respond to a particular treatment.

Personalized cancer treatment can lead to improved patient outcomes and lower healthcare costs.

#9. Case Study: Machine Learning for Predicting Patient Response to Medication

The review article published in nature provides insights into the progress made by scientists in using machine learning to predict patients' responses to medications . While the potential of machine learning in predicting drug responses is promising, there are still challenges to overcome, including data quality and standardization issues and the need for large datasets to train algorithms. 

The article examines the challenges and recent advances in predicting a person's drug response using machine learning techniques. The author emphasizes how this can improve patient treatment outcomes by tailoring medications to specific individuals' genetic makeup.

Challenges and Limitations of Data Science in Healthcare

Using data science in healthcare projects has immense potential to transform the industry. However, several challenges and limitations must be addressed to realize health data science's benefits fully. 

Data Privacy and Security

Patient information is confidential and should be treated as such. Unauthorized access or disclosure of this data could lead to identity theft, financial loss, and damage to a healthcare provider's reputation. 

Healthcare providers must implement robust data privacy and security measures to protect patient data. Encryption can protect data in transit and at rest while limiting access to authorized personnel only. Multi-factor authentication is another important measure that an organization can implement.

Limited Availability of Data

Accurate and comprehensive data is essential for effective healthcare decision-making, but various challenges limit access to this data. These include silos where different parts of the system are separated; interoperability issues that make it hard for programs to communicate; and lack of standardization—where processes vary significantly between organizations or even within the same organization, depending on who's doing what. Healthcare providers and data science companies must work together to address these challenges to ensure that patient health records are reliable and up-to-date.

Technical Challenges

Providing patients with the best possible care is a top priority for healthcare providers. However, achieving this goal requires more than skilled staff and advanced equipment. It also requires effectively managing and sharing large amounts of data generated by electronic medical records (EMRs).

Unfortunately, many healthcare providers struggle with sharing data due to outdated technology infrastructure and legacy systems. These systems were not designed to handle the volume and complexity of data generated by modern healthcare practices, making it difficult for healthcare providers to access and share critical patient information.

Healthcare providers must invest in modern technology infrastructure and data management systems to overcome these challenges. This includes upgrading their existing systems, implementing new data management tools, and partnering with companies like DATAFOREST ; healthcare providers can gain the necessary skills and stack to implement advanced data management systems. 

Want to discover solutions for transparent and reliable operations?

Ethical considerations.

Finally, data science in healthcare raises ethical considerations. Healthcare companies and their patients must ensure that patient information is legal and transparent to those whose data it concerns.

Healthcare providers and data science companies must meet strict ethical standards to address the challenge of sharing patient information. Organizations must obtain informed consent before using their information to ensure that patients will trust them with their data. Organizations must also ensure they use the patient's data for legitimate purposes only and implement strict procedures to protect privacy by anonymizing it where possible.

To address these challenges, businesses should implement robust data privacy and security measures, improve data sharing and interoperability by partnering with relevant parties, and employ the services of qualified data science companies to help them adhere to strict ethical standards.

The healthcare industry can fully realize the potential of data science to transform healthcare delivery and improve patient outcomes by addressing these challenges.

Future of Data Science in Healthcare

Technological innovations and the emergence of new methods.

Advances in technology and techniques are opening up new avenues for data science in healthcare. For example, artificial intelligence (AI) algorithms and machine learning programs can now analyze large datasets to provide more sophisticated analysis than ever before.

Natural language processing (NLP) is increasing, making it possible to analyze unstructured data such as physician notes and patient narratives.

In addition, data sources such as wearable devices and remote patient monitoring technologies are becoming available. These new sources will provide real-time health information—enabling more personalized treatment regimens.

How Data Science Can Be Used to Further Clinical Practice

The future of data science in healthcare is to make it a part of everyday medical practice, using data-driven insights to improve patient outcomes.

Predictive models can identify patients at high risk of developing certain diseases or conditions—helping doctors make decisions about early intervention and treatment based on the patient's characteristics.

Data science can help make healthcare more efficient and less expensive by identifying patients at risk for hospital readmission and intervening to lower those risks.

Impact on Healthcare Outcomes

Data science can improve healthcare outcomes, enabling early intervention and treatment by identifying patients at high risk of developing certain conditions or diseases. This improves patient outcomes—and reduces costs. 

Data science can help personalize medical treatment by tailoring it to an individual's specific characteristics, improving efficacy, and reducing adverse events of a particular therapy.

Data science can improve healthcare delivery by identifying areas for improvement. With this knowledge, data scientists can optimize and streamline care delivery. This can lead to improved efficiency and reduced costs—essential goals that every hospital strives to achieve as they deal with rising operational expenses.

How Data Scientists Can Work with Healthcare Professionals

Healthcare data scientists and healthcare professionals must work together for effective patient care.

Healthcare professionals have the domain expertise to interpret data, and data scientists know how to work with large amounts of information.

Collaboration between data scientists and healthcare professionals leads to more effective use of data science in medicine, enabling personalized and effective treatment.

Summary of Key Points

• The healthcare industry is constantly evolving, facing new challenges such as changing regulations, technological advances, and shifting patient needs—but also great opportunities.
• Patient-centered care should be prioritized in the industry, as it involves putting patients at the center of all decision-making and tailoring their treatment to individual needs.
• We must embrace technology such as electronic health records and telemedicine to improve efficiency, accuracy, and patient outcomes.
• The healthcare industry must also address the rising demand for preventive and holistic approaches to wellness and issues related to access and affordability of care.
• The healthcare industry must continue to prioritize quality and safety, especially in the delivery of medications, infection control practices, and patient education.

Implications for Healthcare Industry

Healthcare's increasing use of data science has significant implications for the industry. By leveraging the power of data, healthcare providers and pharmaceutical companies can improve patient outcomes while reducing costs—and enhancing drug discovery.

Using data science to support the drug discovery and development process has the potential to significantly reduce timelines and costs, leading to faster market entry for innovative drugs. 

Personalized medicine—the practice of tailoring medical treatment to the individual characteristics of each patient—has enormous potential for transforming healthcare.

Identifying patients most likely to benefit from a particular treatment can improve patient outcomes, reduce healthcare costs and enhance the efficiency of drug development.

By applying data science to healthcare analytics, providers can identify improvement areas and optimize their workflows. This leads to better patient care while reducing costs—allowing providers more resources to which they might otherwise not have had access.

At DATAFOREST, we specialize in providing custom data-driven services for healthcare organizations. Data science can help you improve patient outcomes, streamline operations, and drive business success—and we can show you how. If you're interested in learning more about how we can help your healthcare organization leverage the full potential of data science, please get in touch with us to learn more about our services and applications. We'd be happy to talk with you about how we can address your unique data science problems in the healthcare industry.

What is data science, and how can data science be used in healthcare?

Data science is the practice of extracting insights and knowledge from data. In healthcare, data science involves using statistical and computational methods to analyze health data, such as electronic health records, medical imaging, and clinical trials. This information can be used to improve patient outcomes, optimize healthcare operations, and develop new treatments.

What are some examples of how to use data science in healthcare?

Data science has been used in healthcare to predict disease outbreaks, develop personalized treatment plans, and identify high-risk patients who require early intervention. For example, machine learning algorithms have been used to analyze medical images and identify early signs of cancer, leading to earlier detection and improved survival rates.

What are the challenges and limitations of healthcare data scientists?

Data scientists working with healthcare data often face data quality, privacy, and security challenges. Healthcare data is often complex, messy, and difficult to access. Additionally, strict regulations around the use and sharing of healthcare data can limit the types of analyses that can be performed.

What are some of the ethical issues that must be considered when using data science in healthcare?

Ethical considerations in healthcare data science include ensuring patient privacy, obtaining informed consent, and avoiding bias in data analysis. It is essential to use data responsibly and transparently and to prioritize patient welfare above all else.

What impact can data science have on the drug discovery and development process in healthcare?

Data science can be used to identify new drug targets, predict drug efficacy and toxicity, and optimize clinical trial design. By leveraging large-scale data analysis, data science can accelerate the drug development process and bring new treatments to patients faster.

How does data science affect healthcare operations and staffing?

Data science can help healthcare organizations optimize staffing levels, reduce wait times, and improve patient flow. By analyzing operational data, such as patient census and appointment schedules, data science can help healthcare organizations make data-driven decisions and improve overall efficiency.

How can healthcare professionals and data scientists work together to ensure the success of their projects?

Effective collaboration between healthcare professionals and data scientists requires clear communication, mutual respect, and a shared commitment to patient welfare. Healthcare professionals can provide domain expertise and context to data analysis, while data scientists can provide technical expertise and analytical tools. By working together, healthcare professionals and data scientists can develop clinically meaningful and data-driven solutions.

Aleksandr Sheremeta

Get More Value!

You will get from us best tailored content that will help your business grow.

Thanks for your submission!

latest posts

Data analytics: the future of business, data insights: the hidden truth of business, business intelligence: turning raw data into improved performance, media about us, when it comes to automation, choosing the right partner has never been more important, 15 most innovative database startups & companies, 10 best web development companies you should consider in 2022, try to trying.

Never give up

We love you to

People like this

Success stories

Web app for dropshippers.

hourly users

Shopify stores

Financial Intermediation Platform

model accuracy

timely development

E-commerce scraping

manual work reduced

pages processed daily

DevOps Experience

QPS performance

cost reduction

Supply chain dashboard

system integrations

More publications

Let data make value

We’d love to hear from you.

Share the project details – like scope, mockups, or business challenges. We will carefully check and get back to you with the next steps.

Stay a little longer
and explore what we have to offer!

Top 10 Project Management Case Studies with Examples 2024

1. nasa's mars exploration rover: innovative project management in space exploration., 2. apple's iphone development: delivering revolutionary products with precision., 3. tesla's gigafactory construction: exemplary project execution in renewable energy., 4. netflix's content expansion: agile management in the entertainment industry., 5. amazon's prime air drone delivery: pioneering logistics project management., 6. google's waymo self-driving cars: cutting-edge technology meets project efficiency., 7. mcdonald's digital transformation: adaptive project management in fast food., 8. ikea's sustainable store design: eco-friendly project implementation in retail., 9. unicef's vaccine distribution: humanitarian project management at scale., 10. spacex's starlink satellite network: revolutionizing global connectivity with project prowess., discover more stories.

Exploring variations in the implementation of a health system level policy intervention to improve maternal and child health outcomes in resource limited settings: A qualitative multiple case study from Uganda

• Find this author on Google Scholar
• Find this author on PubMed
• Search for this author on this site
• ORCID record for David Roger Walugembe
• For correspondence: [email protected]
• ORCID record for Katrina Plamondon
• Info/History
• Preview PDF

Background Despite growing literature, few studies have explored the implementation of policy interventions to reduce maternal and perinatal mortality in low- and middle-income countries (LMICs). Even fewer studies explicitly articulate the theoretical approaches used to understand contextual influences on policy implementation. This under-use of theory may account for the limited understanding of the variations in implementation processes and outcomes. We share findings from a study exploring how a health system-level policy intervention was implemented to improve maternal and child health outcomes in a resource limited LMIC. Methods Our qualitative multiple case study was informed by the Normalization Process Theory (NPT). It was conducted across eight districts and among ten health facilities in Uganda, with 48 purposively selected participants. These included health care workers located at each of the case sites, policy makers from the Ministry of Health, and from agencies and professional associations. Data were collected using semi-structured, in-depth interviews to understand uptake and use of Uganda’s maternal and perinatal death surveillance and response (MPDSR) policy and were inductively and deductively analyzed using NPT constructs and subconstructs. Results We identified six broad themes that may explain the observed variations in the implementation of the MPDSR policy. These include: 1) perception of the implementation of the policy, 2) leadership of the implementation process, 3) structural arrangements and coordination, 4) extent of management support and adequacy of resources, 5) variations in appraisal and reconfiguration efforts and 6) variations in barriers to implementation of the policy. Conclusion and recommendations The variations in sense making and relational efforts, especially perceptions of the implementation process and leadership capacity, had ripple effects across operational and appraisal efforts. Adopting theoretically informed approaches to assessing the implementation of policy interventions is crucial, especially within resource limited settings.

Competing Interest Statement

The authors have declared no competing interest.

Funding Statement

This study was undertaken with no funding.

Author Declarations

I confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.

The details of the IRB/oversight body that provided approval or exemption for the research described are given below:

Ethics approval for this study was sought from the Health Sciences Research Ethics Board (HSREB, IRB 00000940) Delegated Review of the University of Western Ontario. Additional ethical approval was sought from the School of Medicine Research and Ethics Committee, Makerere University College of Health Sciences (REC REF No. 2018-018), the Uganda National Council for Science and Technology (HS 2393) and the Ugandan Ministry of Health (ADM 130/313/05). Participation in the study was completely voluntary and written informed consent was sought at all times. Study participants were assured of privacy and confidentiality and approved the use of information for improving public health, clinical practices and policy implementation. The manuscript does not include details, images, or videos relating to individual participants.

I confirm that all necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived, and that any patient/participant/sample identifiers included were not known to anyone (e.g., hospital staff, patients or participants themselves) outside the research group so cannot be used to identify individuals.

I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).

I have followed all appropriate research reporting guidelines, such as any relevant EQUATOR Network research reporting checklist(s) and other pertinent material, if applicable.

Data Availability

The datasets generated and/or analysed during the current study are not publicly available because it was a qualitative study but are available from the corresponding author on reasonable request.

View the discussion thread.

Thank you for your interest in spreading the word about medRxiv.

NOTE: Your email address is requested solely to identify you as the sender of this article.

Citation Manager Formats

• EndNote (tagged)
• EndNote 8 (xml)
• RefWorks Tagged
• Ref Manager
• Tweet Widget
• Facebook Like
• Google Plus One
• Addiction Medicine (323)
• Allergy and Immunology (627)
• Anesthesia (163)
• Cardiovascular Medicine (2363)
• Dentistry and Oral Medicine (287)
• Dermatology (206)
• Emergency Medicine (378)
• Endocrinology (including Diabetes Mellitus and Metabolic Disease) (833)
• Epidemiology (11755)
• Forensic Medicine (10)
• Gastroenterology (701)
• Genetic and Genomic Medicine (3722)
• Geriatric Medicine (348)
• Health Economics (632)
• Health Informatics (2388)
• Health Policy (929)
• Health Systems and Quality Improvement (894)
• Hematology (340)
• HIV/AIDS (780)
• Infectious Diseases (except HIV/AIDS) (13298)
• Intensive Care and Critical Care Medicine (767)
• Medical Education (365)
• Medical Ethics (104)
• Nephrology (398)
• Neurology (3483)
• Nursing (197)
• Nutrition (522)
• Obstetrics and Gynecology (672)
• Occupational and Environmental Health (661)
• Oncology (1818)
• Ophthalmology (535)
• Orthopedics (218)
• Otolaryngology (286)
• Pain Medicine (232)
• Palliative Medicine (66)
• Pathology (445)
• Pediatrics (1030)
• Pharmacology and Therapeutics (426)
• Primary Care Research (418)
• Psychiatry and Clinical Psychology (3169)
• Public and Global Health (6128)
• Radiology and Imaging (1275)
• Rehabilitation Medicine and Physical Therapy (743)
• Respiratory Medicine (825)
• Rheumatology (379)
• Sexual and Reproductive Health (372)
• Sports Medicine (322)
• Surgery (400)
• Toxicology (50)
• Transplantation (172)
• Urology (145)