This capstone project applies machine learning techniques to predict annual medical insurance claim costs. Using a synthetic dataset, we explore linear regression, random forest regression and gradient boosting regression models to identify key cost drivers such as smoking status, BMI, and blood pressure.
The dataset used in this project contains synthetic health insurance claim data for individual patients. Each record represents a single insured person along with various demographic, health, lifestyle variables and their corresponding annual medical claim amount.
Column Name Description
-
Age: Age of the individual (in years)
-
Gender: Gender of the individual (male, female)
-
BMI (Body Mass Index): A measure of body fat
-
Bloodpressure Systolic blood pressure reading
-
Children: Number of Patients children
-
Smoker: Whether the person is a smoker (Yes, No)
-
Region: Geographic region (northeast, southeast, etc.)
-
Diabetic: Indicates if the person is diabetic (Yes, No)
-
Gender: Distribution is nearly equal between male and female patients.
-
Smoker: Roughly 20–25% of patients are smokers.
-
Region: Southeast has the most patients.
-
Diabetic: With 642 patients marked as diabetic (~48%), this indicates that almost half of the population in the dataset is living with diabetes. This suggest that diabetes is a major health factor in this dataset.
-
Patient Dependant_Children: Majority of patients have 0 to 2 children and few patients report have 4 or more children.
-
Age: Histogram generally shows uniform distribution. Boxplot shows no outliers.
-
BMI (Body Mass Index): Distribution is slightly right-skewed with a concentration between 25 and 35. Boxplot shows some outliers above BMI 45.
-
Bloodpressure: Appears normally distributed, centered around 90–95. Boxplot reveals multiple outliers on the higher end (possibly hypertension).
-
Claim (Insurance Claim Amount): Highly right-skewed distribution. Majority of claims are low, but long tail of high values. Boxplot shows many extreme outliers.
-
Smoking is the strongest predictor of higher claims across all models.
-
BMI and blood pressure are strong continuous cost drivers. Every unit increase in BMI correlates with thousands of dollars in added annual claim burden.
-
Gradient Boosting outperformed all other models (R² = 0.8484), suggesting that non-linear interactions between features are important to accurately predicting claims.
-
This dataset is good for prototyping risk-based pricing models for health insurance.
-
Future enhancements could include:
-
Time-series claim history
-
Medication use
-
Hospital visits or diagnoses
-
Ethical consideration: Predictive models in healthcare must be validated against bias and fairness, especially when used in pricing or coverage decisions that align with country-specific healthcare policies/laws and guildlines.
-
Pricing strategies should account for country-specific healthcare policies and subsidies (If any), as these were not explicitly detailed in the dataset.
