Workflow Element Store

  1. Dealing with Outliers
  2. Handling Missing Data
  3. Dimensionality Reduction
  4. Data Transformations
  5. AutoEDA libraries
  6. Handling Noisy Data
  7. Handling Imbalanced Classes
  8. Feature Extraction from Images
  9. Handling Time-Series Data
  10. Data Partitioning - Train, Validation, & Test
  11. Binning / Discretization
  12. Textual Feature Extraction
  13. Auto-Preprocessing libraries
  14. Time-Based Features
  15. Feature Selection
  16. Domain-Specific Feature Engineering
  17. Handling Categorical Data
  18. Annotation
  19. Interaction Features
  20. Augmentation
  21. Data Scaling and Normalization
  22. Polynomial Features
  1. Regression Analysis
  2. Word Embeddings
  3. Regular Monitoring and Logging
  4. Transfer Learning
  5. Ensemble Techniques
  6. Performance Visualization
  7. Blackbox - Neural Network Models
  8. Model Comparison
  9. Recommendation Engine
  10. Hyperparameter Tuning
  11. Data Augmentation
  12. Cross-Validation
  13. Learning Rate Scheduling
  14. Batch Normalization
  15. Weight Initialization
  16. Regularization Techniques
  17. Forecasting Techniques
  18. GridSearchCV, RandomisedSearchCV, BayesianSearchCV
  19. Early Stopping
  20. Clustering
  21. Association Rules
  22. Binary Classification Techniques
  23. Network Analytics/ GeoSpatial Analytics
  24. Multiclass Classification Techniques
  25. AutoML
  26. Evaluation Metrics
  27. Natural Language Processing
  28. Cross-Validation
  29. External Validation
  30. Regularization
  31. Transfer Learning
  32. Batch Size Selection
  33. Model Interpretability
  34. Reinforcement Learning
  1. Databases
  2. Kafka Brokers
  3. Evidently.ai
  4. Github
  5. code repository
  6. Apache Airflow
  7. model registry
  8. Github Actions
  9. Datawarehouse
  10. Data Preprocessing pipeline models
ML Workflow Advanced - Architecture
  • Element belongs to model
  • Element not belongs to model

Data Sources

Streaming Data

Batch Data

Cloud Storage

Labeled Data

Feature Engineering Pipeline

Experimentation

ML Model

Repository

CI/CD component

Continuous integration/Continuous delivery

Continuous deployment

Artifact Store

Feature Store System

Orchestration Component

Artifact Store

CI/CD Component

Scheduler

Workflow orchestration component

Automation ML Workflow Pipeline

Monitoring Component

Model serving component

(Prediction on new batch or streaming data)