DS-U3-MM Data Analytics Lifecycle

Introduction

• Key Stages
  • Discovery
  • Data Preparation
  • Model Planning
  • Model Building
  • Communicating Results
  • Operationalize

Data Collection

• Methods
  • Surveys and Questionnaires
  • Web Scraping
  • Sensor Data
  • Transactional Data
• Ensuring Data Quality

Data Cleaning

• Techniques
  • Removing Duplicates
  • Handling Missing Values
  • Correcting Inconsistencies
  • Filtering Outliers
• Challenges

Data Transformation

• Concept and Significance
• Techniques
  • Normalization
  • Encoding Categorical Variables
  • Aggregation

Exploratory Data Analysis (EDA)

• Importance
• Techniques
  • Descriptive Statistics
  • Data Visualization
  • Correlation Analysis

Data Integration

• Challenges
• Methods
  • ETL Tools
  • Data Warehousing
  • Standardizing Formats

Data Reduction

• Concept and Importance
• Techniques
  • Dimensionality Reduction
  • Sampling
  • Aggregation

Data Analysis

• Techniques
  • Descriptive Analysis
  • Predictive Analysis
  • Prescriptive Analysis
• Choosing Techniques

Data Interpretation

• Process and Significance
• Pitfalls

Data Visualization

• Principles
• Tools
  • Tableau
  • Power BI
  • Matplotlib/Seaborn