Workflow Element Store

  1. Auto-Preprocessing libraries
  2. Feature Extraction from Images
  3. Data Transformations
  4. Data Partitioning - Train, Validation, & Test
  5. Interaction Features
  6. Time-Based Features
  7. Handling Time-Series Data
  8. Feature Selection
  9. Augmentation
  10. Handling Missing Data
  11. Data Scaling and Normalization
  12. Textual Feature Extraction
  13. Polynomial Features
  14. Handling Categorical Data
  15. Handling Noisy Data
  16. Handling Imbalanced Classes
  17. AutoEDA libraries
  18. Dimensionality Reduction
  19. Annotation
  20. Domain-Specific Feature Engineering
  21. Binning / Discretization
  22. Dealing with Outliers
  1. External Validation
  2. Transfer Learning
  3. Regular Monitoring and Logging
  4. Natural Language Processing
  5. Forecasting Techniques
  6. Word Embeddings
  7. Learning Rate Scheduling
  8. AutoML
  9. Batch Normalization
  10. Blackbox - Neural Network Models
  11. Early Stopping
  12. Regression Analysis
  13. Regularization Techniques
  14. Performance Visualization
  15. Multiclass Classification Techniques
  16. Association Rules
  17. Cross-Validation
  18. Ensemble Techniques
  19. Batch Size Selection
  20. GridSearchCV, RandomisedSearchCV, BayesianSearchCV
  21. Recommendation Engine
  22. Hyperparameter Tuning
  23. Transfer Learning
  24. Model Comparison
  25. Binary Classification Techniques
  26. Weight Initialization
  27. Regularization
  28. Clustering
  29. Model Interpretability
  30. Evaluation Metrics
  31. Cross-Validation
  32. Data Augmentation
  33. Reinforcement Learning
  34. Network Analytics/ GeoSpatial Analytics
  1. Kafka Brokers
  2. model registry
  3. Datawarehouse
  4. code repository
  5. Github Actions
  6. Data Preprocessing pipeline models
  7. Apache Airflow
  8. Databases
  9. Github
  10. Evidently.ai
ML Workflow - Architecture
  • Element belongs to model
  • Element not belongs to model
Validate Export

Data Sources

Streaming Data

Batch Data

Cloud Storage

Labeled Data

Feature Engineering Pipeline

Experimentation

ML Model

Repository

CI/CD component

Continuous integration/Continuous delivery

Continuous deployment

Artifact Store

Feature Store System

Orchestration Component

Artifact Store

CI/CD Component

Scheduler

Workflow orchestration component

Automation ML Workflow Pipeline

Monitoring Component

Model serving component

(Prediction on new batch or streaming data)