Skip to content

About

For Graduation Project AI

Resources

Stars

0 stars

Watchers

1 watching

Forks

Latest commit

 

History

280 Commits

Folders and files

NameName
Last commit message
Last commit date
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Current Learning Plan

📚 AI + Data Engineering Learning Roadmap

🎯 Objective

Build a strong foundation across:

  • Linear Algebra & Numerical Optimization
  • Machine Learning
  • Data Warehouse & BI Stack (SSIS, SSAS, SSRS, Power BI)
  • Agentic AI Systems

🧭 Learning Phases Overview

Phase Focus Area Duration
0 Prerequisites 2–3 weeks
1 Linear Algebra 3–4 weeks
2 Numerical Optimization 2–3 weeks
3 Machine Learning 4–6 weeks
4 Data Warehouse & BI Parallel
5 Integration Project 3–4 weeks
6 Agentic AI 2–4 weeks

⚙️ Phase 0 — Prerequisites

Topics

  • Python (NumPy, Pandas)
  • SQL Server
  • Basic Statistics

Deliverable

  • Clean dataset using SQL + Python
  • Simple Power BI dashboard

🧮 Phase 1 — Linear Algebra

Topics

  • Vectors & Matrices
  • Matrix Multiplication
  • Eigenvalues & Eigenvectors
  • Singular Value Decomposition (SVD)

Practical Work

  • Implement matrix operations using NumPy
  • Apply PCA on dataset

📉 Phase 2 — Numerical Optimization

Topics

  • Gradient Descent
  • Cost Functions
  • Convex vs Non-Convex Optimization
  • Regularization (L1, L2)

Practical Work

  • Implement Gradient Descent from scratch
  • Optimize regression model

🤖 Phase 3 — Machine Learning

Topics

Supervised Learning

  • Linear Regression
  • Logistic Regression
  • Decision Trees

Unsupervised Learning

  • K-Means Clustering

Evaluation

  • RMSE
  • Accuracy
  • Cross-validation

Tools

  • scikit-learn

Deliverable

End-to-end ML project:

  • Data cleaning
  • Feature engineering
  • Model training
  • Evaluation

🏗️ Phase 4 — Data Warehouse & BI Stack

1. Data Warehouse Modeling

  • Star Schema
  • Fact & Dimension Tables

2. SSIS (ETL)

  • Data extraction
  • Data cleaning
  • Data loading

3. SSAS (Analysis)

  • Cube design
  • Measures & KPIs
  • Tabular vs Multidimensional

4. SSRS (Reporting)

  • Paginated reports

5. Power BI

  • Dashboards
  • DAX
  • Row-Level Security (RLS)

🔁 Phase 5 — Integration Project

Project: Retail Intelligence System

Step 1 — Database Design

  • Star schema
  • FactSales + Dimensions (Customer, Product, Time)

Step 2 — ETL Pipeline

  • Use SSIS for data cleaning and loading

Step 3 — Cube Design

  • Build SSAS cube
  • Define KPIs (Revenue, Profit)

Step 4 — Machine Learning

  • Sales forecasting
  • Customer churn prediction

Step 5 — BI Dashboard

  • Executive dashboard using Power BI
  • Apply RLS

🤖 Phase 6 — Agentic AI

Topics

  • AI Agents
  • Tool usage (APIs, databases)
  • Memory systems
  • Multi-step reasoning

Tools

  • LangChain
  • AutoGen
  • Python

Project: AI Data Analyst Agent

Features

  • Query SQL database automatically
  • Generate insights
  • Build dashboards suggestions
  • Answer business questions

🚀 Final Outcome

By completing this roadmap, you will be able to:

✅ Design Data Warehouses
✅ Build ETL Pipelines
✅ Create Analytical Cubes
✅ Develop Machine Learning Models
✅ Build Professional BI Dashboards
✅ Create AI Agents for Data Analysis


🧠 Pro Tip

Focus on projects over theory. Each phase should produce something tangible.


📌 Suggested Weekly Schedule

  • Study: 2–3 hours/day
  • Practice: 2 hours/day
  • Project work: weekends

📂 Repository Structure

/project-root
│
├── data/
├── notebooks/
├── sql/
├── etl/
├── ssas/
├── reports/
├── powerbi/
├── ml/
└── agentic-ai/

📚 AI + Data Engineering Roadmap (Execution Plan)

📅 Start Date

01 August 2026

⏳ Estimated Duration

~20–24 Weeks


📊 Progress Tracking

✅ Completion Formula

Progress % = (Completed Tasks / Total Tasks) * 100

📌 How to Use

  • Mark tasks with [x] when done
  • GitHub will visually track progress in the checklist
  • You can also connect this to Power BI later for a visual dashboard

🧭 MASTER TASK LIST

⚙️ Phase 0 — Prerequisites (Week 1–2)

📅 01 Aug → 14 Aug

  • Install Python + environment
  • Learn NumPy basics
  • Learn Pandas basics
  • SQL basics (SELECT, JOIN, GROUP BY)
  • Load dataset into SQL Server
  • Clean dataset using SQL
  • Export to Power BI
  • Build simple dashboard

🧮 Phase 1 — Linear Algebra (Week 3–6)

📅 15 Aug → 11 Sep

  • Understand vectors
  • Matrix operations (add, multiply)
  • Matrix multiplication implementation (NumPy)
  • Learn eigenvalues & eigenvectors
  • Understand SVD concept
  • Apply PCA on dataset

📉 Phase 2 — Numerical Optimization (Week 7–9)

📅 12 Sep → 02 Oct

  • Understand cost functions
  • Learn Gradient Descent theory
  • Implement Gradient Descent (Python)
  • Learn learning rate tuning
  • Understand overfitting vs underfitting
  • Learn L1 / L2 Regularization

🤖 Phase 3 — Machine Learning (Week 10–15)

📅 03 Oct → 13 Nov

  • Linear Regression model
  • Logistic Regression model
  • Decision Trees
  • K-Means clustering
  • Model evaluation (RMSE, Accuracy)
  • Feature engineering
  • Build ML pipeline
  • Final ML mini-project

🏗️ Phase 4 — Data Warehouse & BI (Parallel Track)

📅 01 Aug → 30 Nov

Data Warehouse

  • Design Star Schema
  • Create Fact & Dimension tables

SSIS

  • Build ETL pipeline
  • Data cleaning flow
  • Schedule ETL job

SSAS

  • Create cube
  • Define measures & KPIs

SSRS

  • Build paginated report

Power BI

  • Data modeling
  • DAX measures
  • Dashboard design
  • Implement RLS

🔁 Phase 5 — Integration Project (Week 16–18)

📅 14 Nov → 04 Dec

Retail Intelligence System

  • Build full database schema
  • Implement ETL (SSIS)
  • Build SSAS cube
  • Train ML model (forecasting)
  • Build Power BI dashboard
  • Apply RLS
  • End-to-end testing

🤖 Phase 6 — Agentic AI (Week 19–22)

📅 05 Dec → 31 Dec

  • Learn AI agents concept
  • Setup LangChain / AutoGen
  • Build SQL query agent
  • Add memory system
  • Connect agent to dataset
  • Generate automated insights

🚀 FINAL CAPSTONE

📅 End of December 2026

Autonomous BI System

  • Agent monitors database
  • Detect anomalies
  • Trigger ML predictions
  • Update dashboards
  • Generate reports automatically

📅 Weekly Tracking Template

Week X
Planned:
Completed:
Blockers:
Notes:

📊 Optional: Advanced Tracking (Power BI)

You can export tasks into a table:

Task Status Phase Completion Date
Learn NumPy Done Phase 0 02 Aug

Then:

  • Build a Power BI dashboard
  • Track progress %
  • Visualize the timeline

🧠 Rules for Success

  • 🚫 No skipping phases
  • ✅ Build something every week
  • 🎯 Focus on integration, not isolated learning

📂 Project Structure

/project-root
│
├── data/
├── notebooks/
├── sql/
├── etl/
├── ssas/
├── reports/
├── powerbi/
├── ml/
└── agentic-ai/

🏁 Success Criteria

By the end, you will:

  • ✅ Build a Data Warehouse
  • ✅ Create ETL pipelines
  • ✅ Design analytical cubes
  • ✅ Train ML models
  • ✅ Build dashboards
  • ✅ Create AI agents

📎 License

This roadmap is for educational purposes.

About

For Graduation Project AI

Resources

Stars

0 stars

Watchers

1 watching

Forks

Releases

Packages

Used by

Contributors

Languages