pip install classifier-toolkit
This is a new project.
This library is published in the PyPI directory. To install, users can run pip install 'classifier_toolkit' command.
This library automates binary classification tasks in the finance domain, specifically for default and fraud labeling. It includes several packages designed to address the main steps in any machine learning/data science task:
- EDA: which is accessible by EDA_Toolkit. This package provides the EDA and feature engineering functionality alongside with all the necessary visualizations.
- Feature Selection: To be implemented.
- Model fitting and hyperparameter tuning: To be implemented.
- Evaluation and reporting: To be implemented.
In the future, the package architectures will be included here. However, for now please consult the docstrings in the specific methods in the relevant modules.
Note: that this library does not contain data wrangling steps (although it contains feature engineering), it's an intermediate step between EDA and feature engineering where users should fix any data quality related issues. Therefore, conducting the EDA is crucial to mitigate any issues before moving onto the feature engineering and the subsequent steps.
-
EDA Toolkit: This module includes classes and methods for performing comprehensive exploratory data analysis. It provides automated warnings for data quality issues, univariate and bivariate analysis, and various data visualizations to help understand the dataset.
-
Univariate Analysis: This class focuses on the analysis of individual variables. It includes methods for calculating statistical measures, visualizing distributions, and assessing relationships between variables and a target through techniques like Cramer's V and Information Value. This helps in understanding the significance and distribution of each feature independently.
-
Bivariate Analysis: This class deals with the analysis of two variables to understand their relationship. It includes functionalities for generating correlation heatmaps, performing ANOVA tests between numerical and categorical variables, and computing pairwise Cramer's V for categorical features. This aids in identifying patterns and correlations between pairs of variables, which is crucial for feature selection and engineering.
-
Feature Engineering: This module assists in transforming features, handling missing values, encoding categorical variables, and more. It aims to enhance the dataset's quality for better model performance.
-
Visualizations: This module offers a wide range of plotting capabilities to visually analyze data distributions, relationships, and other crucial aspects of the dataset.
-
Automated Warnings: A utility to automatically check the dataset for common issues such as missing or duplicate values, outliers, and more, providing warnings to guide data cleaning efforts.
-
Feature Selection: This module provides various feature selection techniques:
- Embedded Methods: Includes ElasticNet for regularization-based feature selection.
- Wrapper Methods:
- Recursive Feature Elimination (RFE) with support for various ensemble methods (Random Forest, XGBoost, LightGBM, CatBoost).
- Sequential Feature Selection (forward, backward, floating, and bidirectional).
- Meta Selector: Combines multiple feature selection methods to provide a robust selection.
- Utility Functions: Includes scoring functions and plotting utilities for feature importance visualization.
The next planned improvements and additions to the library include:
- Adding model fitting and hyperparameter tuning functionalities.
- Developing comprehensive evaluation and reporting tools to assist with model assessment.
- Expanding documentation to include architecture diagrams and detailed usage examples.