AI, ML & DL
Why it matters
ש××שת ×××ש××× ×××× -- Artificial Intelligence, Machine Learning ×-Deep Learning -- ×× ×××”××” ××××¢× ×× ×××× ××× ××××× ××××Ø× ×. ××× ××××× ××Ŗ ××××” ××× ×××, ×§×©× ×קר×× ×××ר××, ××××× Job Descriptions, ×× ×××¢×Ŗ ×××× ××× ××Ŗ××× ××××× ××¢××.
×× ×××Ø× ×××× -- ×-Startup ×§×× ××¢× ×¢× ×§×××Ŗ ××× Google ×-Amazon -- ×שת×שת ×××× ×××××××Ŗ ×©× ×צ×××Ŗ ×¢× ×הפק×ר×× ×××. ×× ×× ××Ŗ× ×× ×××××× ×××××Ŗ ML Engineers, ××× × ××”××”××Ŗ ×©× ××Ŗ××× ××× ××× ××× × ××”××”××Ŗ ××× ××××Ŗ ××¢××× ××××××§: ×פשר ××× ××, ××× ×§×©×.
××¤× × ×©×¦××××× ×× ××”××××Ŗ ×××ר××××§××ר××Ŗ -- ×ש×× ××××× ××Ŗ ××Ŗ××× × ××××××: ×× ×× ×©××× ×¢×ש×, ××××¤× ×× ×××Ŗ ××Ŗ××××.
××× ×”×× ××× ×××××××, ×× ××× ×××ר "×× ×× × ×שת×ש×× ×-AI". תש××× ×××Ŗ× ×× ×××××§ ×× ×¢×ש×× -- ×-80% ×××קר×× ×× if-else ×¢× Marketing ×××.
Core ideas
××××” ××× ×ש××××Ŗ: AI > ML > DL
××××× × ×©××ש ×¢×××××× ××§×× × ××:
āāāāāāāāāāāāāāāāāāāāāāāāāāāāāāāāāāāāāāāāāāā
ā AI (Artificial Intelligence) ā
ā ×× ×ער××Ŗ ש×××× "×ש×××" ×× ×§×××Ŗ ××××××Ŗ ā
ā ā
ā āāāāāāāāāāāāāāāāāāāāāāāāāāāāāāāāāāāā ā
ā ā ML (Machine Learning) ā ā
ā ā ×××× ××××××××Ŗ ×××§×× ××××× ×§×©××××ā ā
ā ā ā ā
ā ā āāāāāāāāāāāāāāāāāāāāāāāāāāāāā ā ā
ā ā ā DL (Deep Learning) ā ā ā
ā ā ā רשת××Ŗ × ××ר×× ×× ×¢×××§××Ŗ ā ā ā
ā ā āāāāāāāāāāāāāāāāāāāāāāāāāāāāā ā ā
ā āāāāāāāāāāāāāāāāāāāāāāāāāāāāāāāāāāāā ā
āāāāāāāāāāāāāāāāāāāāāāāāāāāāāāāāāāāāāāāāāāā
- AI -- ×××ר××× ××× ×Ø×××. ×××× ×× ×ער×××Ŗ ××××”×”××Ŗ ××××× (Rule-based), ×¢×¦× ×××××, ××× ××ר ש"××Ŗ× ×× ×צ××Ø× ××××".
- ML -- ×Ŗ×Ŗ-×Ŗ××× ×©× AI. ×××§×× ×××Ŗ×× ××××× ××× ××Ŗ, ××ער××Ŗ ×××××Ŗ ×פ××”×× ××Ŗ×× Data.
- DL -- ×Ŗ×Ŗ-×Ŗ××× ×©× ML. ×שת×ש ×-Neural Networks ×¢× ×ר×× ×©××××Ŗ (layers) ××× ××××× ××צ×××× ××ר××××.
Narrow AI ××× General AI
×ש×× ××××× ×©×××¢× ×× ×× ×©×§××× ×××× ××× Narrow AI (××× × ××××××Ŗ××Ŗ צר×):
| ×”×× | ××”×ר | ×”××××” |
|---|---|---|
| Narrow AI (ANI) | ×ער××Ŗ ש×צ×××× ×Ŗ ××ש××× ×××Ŗ הפצ×פ××Ŗ -- ××××× ×Ŗ××× ××Ŗ, תר×××, ×××צ××Ŗ | ×§××× ×××× |
| General AI (AGI) | ×ער××Ŗ ש××××× ××××× ×××צע ×× ×ש××× ××× ×××§××××××Ŗ ××× ××× | ×¢×××× ×× ×§××× |
| Super AI (ASI) | ×ער××Ŗ שע××× ×¢× ×××××××Ŗ ××× ×ש×××Ŗ ××× ×Ŗ××× | ×××¢ ××××× × (××× ×Ŗ×××) |
ChatGPT, ××ר××Ŗ ש××× ×רש××, ××× ×¢×××× Narrow AI -- ××× ×צ×××× ××צ×רת ××§×”×, ××× ××× ×× ××× × ××××Ŗ××Ŗ ×©× ××¢×××, ××× ×××× ××××Ŗ ××§× ××Ŗ ××× ×××.
×ש××ש×× ×ר×××× ×¢×××× ×©××× "××Ŗ× ×Ŗ×××¢ AGI?" -- ×תש××× ×××××× ××× "×Ŗ××× ××Ŗ ×× ×©×××××". Ray Kurzweil ×××ר 2029, ××ר×× ×××ר×× "×××× ××£ פע×". ××£ ××× ××××Ŗ ×× ××××¢, ××× ×××× ×××××× ×תש××× ×©×××.
ש××שת ×”××× ××××××
| ×”×× | ×× ×§××Ø× | ××××× |
|---|---|---|
| Supervised Learning | ××××× ××§×× Data + Labels (תש××××Ŗ × ××× ××Ŗ) ××××× ×××××Ŗ | ××××× ×× ×Ŗ××× × ××× ××Ŗ×× ×× ××× |
| Unsupervised Learning | ××××× ××§×× Data ××× Labels ×××פש ××× ×× | ××××§×Ŗ ××§××××Ŗ ××§××צ××Ŗ (Clustering) |
| Reinforcement Learning | ××××× ××§×× Reward/Penalty ×¢× ×¤×¢××××Ŗ ××××× ××”×ר×××× | ר×××× ×©×××× ××××Ŗ, ××××ר××Ŗ× ×©×ש××§ ש××× |
Supervised Learning ××× ××”×× ×× ×¤×ׄ ×××תר ×תעש×××. ר×× ×××¢×××Ŗ ××¢×”×§×××Ŗ × ×פ×××Ŗ ×פ×: ××××× ×××ר××, ×”×××× ×Ŗ××× ××Ŗ, ××××× Spam. ×××¤×Ŗ× ××× ×©×ש ×× × Data ××Ŗ××× -- ××××ר, ××ש×× (×××Ø× ××× ×¦×××Ŗ ×©× ×× ×©×× ×× ×ער××Ŗ ××××××××Ŗ) ×”××× ×¢×××Ø× × ×× ×תש××× ×× ××× ×.
Unsupervised Learning ש××××©× ×ש××× ×× × Labels. ××××××: ×ש ×× × ×××××× ××§××××Ŗ, ××× ×× × ×Ø×צ×× ×××××Ŗ ×× ×ש ×§××צ××Ŗ ×××¢×××Ŗ ××× ××× -- ××× ×©×××Ø× × ×ר×ש ×× ××§××צ××Ŗ. ××××ר××Ŗ××× ××× K-Means ×-DBSCAN ×¢×ש×× ×××××§ ××Ŗ ××.
Reinforcement Learning ××× ××”×× ×"××× ××" ×××תר (×ר×× ×Ŗ×××ר×××Ŗ) ××× ×× ××× ×§×©× ×××ש×× ×פר××קש×. ××× ×צ××× ××ש××§×× ×ר××××××§×, ××× ××¢××× ××¢×”×§× -- ××× ×¤×××Ŗ × ×¤×ׄ ×× ××רש ×”××××Ŗ ×”××××צ×× ×××× ×ר×קצ×× ××Ŗ×ש××Ŗ.
××ש ×× Semi-Supervised ×-Self-Supervised
××¢××× ×××××Ŗ×, ××Ŗ××× Data ×¢××× ×ר×× ××”×£. ××× ×תפת×× ××ש××Ŗ ××× ×××:
- Semi-Supervised Learning -- ××××Ŗ ×§×× × ×©× Data ××Ŗ××× + ××××Ŗ ××××× ×©× Data ×× ××Ŗ×××. ××××× ×שת×ש ××©× ×××.
- Self-Supervised Learning -- ××××× ××צר "Labels" ×עצ×× ××Ŗ×× ×-Data. ×× GPT ×××: ××× × ××ש ××Ŗ ××××× ×××× ×××§×”×, ×"×תש××× ×× ××× ×" ××××Ŗ× ×¤×©×× ××××× ×©××××Ŗ ××× ××ר×.
Classic ML ××× Deep Learning
| Classic ML | Deep Learning | |
|---|---|---|
| ××××ר××Ŗ××× | Linear Regression, SVM, Random Forest, KNN | CNN, RNN, Transformer |
| Data × ×רש | ××××Ŗ-××פ×× ×©× ×××××××Ŗ | ××פ×× ×¢× ×××××× ×× |
| Feature Engineering | ××× × -- ×××× ××” ×××ר Features | ××××××× -- ×רשת ×××××Ŗ Features |
| ××××Ø× | CPU ×הפ××§ | ×ר×× × ×רש GPU / TPU |
| Interpretability | ×ר×× ×§× ×××”××ר | ×ר×× "×§××¤×”× ×©××ר×" |
| ××× ××××× | ×©× ×××Ŗ ×¢× ××§××Ŗ | שע××Ŗ ×¢× ×©×××¢××Ŗ |
| ×¢×××Ŗ | × ×××× ×××”××Ŗ | ××××× (××××Ø× + ×ש××) |
××Ŗ× ×××ר×× Classic ML?
- ×ש×ש ××¢× Data (××××Ŗ ×××××××Ŗ).
- ×שצר×× ××”×ר ×ר×ר ××× ××××× ××××× ×× ×©××××× (××××××: ××ש×ר ×שר××).
- ×ש-Tabular Data (××××××Ŗ) ××× ×”×× ×-Data ××¢××§×Ø× -- Classic ML ×¢×××× ×× ×¦× ×©× ××¢××Ŗ×× ×§×Ø××××Ŗ.
××Ŗ× ×××ר×× Deep Learning?
- ×ש×ש ×ר×× Data (××××Ŗ ××פ××+ ×××××××Ŗ).
- ×ש×-Data ××× ××-×××× × -- ×Ŗ××× ××Ŗ, ××§×”×, ×××××, ×××××.
- ×ש×-Feature Engineering ××× × ××× ××ר×× ××× ×× ×©××××××××Ŗ ×× ×××× ×.
- ×ש×××צ××¢×× ×ש×××× ××תר ×-Interpretability.
××××ר××Ŗ×× Classic ML ×ר××××× -- ××× ×××ר
| ××××ר××Ŗ× | ×”×× | ש×××ש × ×¤×ׄ |
|---|---|---|
| Linear Regression | Supervised (Regression) | ××××× ×××ר××, ×××ר××Ŗ, ××פר×××Ø× |
| Logistic Regression | Supervised (Classification) | Spam detection, ××××× Churn |
| Decision Tree | Supervised | ×”××××, ××”×ר ××××××Ŗ |
| Random Forest | Supervised (Ensemble) | ×××¢× ×× ××¢×× -- "××ר×רת ×××××" |
| SVM | Supervised | ×”×××× ××§×”×××, ×Ŗ××× ××Ŗ ×§×× ××Ŗ |
| K-Means | Unsupervised (Clustering) | ×”××× ×צ×××Ŗ ××§××××Ŗ |
| XGBoost / LightGBM | Supervised (Ensemble) | ×× ×¦××× ×Ŗ×ר××××Ŗ Kaggle |
XGBoost ××× ××× ×קרש ×צף ×©× ××××× ×Ø×× ××קפר×× ×-Titanic: ××× ×× ×©×× × ×צ×× ×××××Ŗ ×× ×-Kaggle, ××× ××× ×× ×¤×תר ×××.
×ר××××§××ר××Ŗ DL ×ר×××××Ŗ -- ××× ×××ר
| ×ר××××§×××Ø× | ש×××ש ×¢××§×Ø× | ×××××××Ŗ |
|---|---|---|
| CNN (Convolutional Neural Network) | Computer Vision | ××××× ×Ŗ××× ××Ŗ, ר×× ××××× ××× |
| RNN / LSTM | ×”×ר××Ŗ ××× ×××Ŗ, ××§×”× | ××××× ×× ×××Ŗ, תר××× (××¤× × Transformers) |
| Transformer | NLP, ××¢×ש×× ×× Vision | GPT, BERT, ViT |
| GAN (Generative Adversarial Network) | ×צ×רת ×Ŗ××× | Deepfakes, ×צ×רת ×Ŗ××× ××Ŗ |
| Diffusion Models | ×צ×רת ×Ŗ××× | Stable Diffusion, DALL-E |
| Autoencoder / VAE | ××××”×, Anomaly Detection | ××××× ×ר××××Ŗ, Denoising |
×××¤× ×× ×××©× ×ש×שת ×תעש×××
- Classic ML: ××××× ××× ×××Ŗ ×× ×§××××Ŗ, ××××× Churn ×©× ××§××××Ŗ, ×ער×××Ŗ ××××¦× ×¤×©××××Ŗ, × ××Ŗ×× ×”×××× ××.
- Deep Learning -- Computer Vision: ××××× ×¤× ××, ×××× ×××Ŗ ××××× ×××××Ŗ, ××××§×Ŗ ×××××Ŗ ××פע×××.
- Deep Learning -- NLP: ChatGPT, תר××× ×××××××, ×”×××× ××§×”×××, Chatbots.
- Deep Learning -- Audio: ××××× ××××ר (Speech-to-Text), ×צ×רת ×××××§×, ××××× ×Ø×ש××Ŗ ××§××.
- Reinforcement Learning: ×ש××§×× (AlphaGo), ר××××××§×, ××פ×××××צ×× ×©× ×©×Ø×©×Ø×Ŗ ×הפק×.
The ML Workflow -- ×-Data ××××× ××××× ×פר××קש×
×× × ××ר××× ×××פ××”××Ŗ ×©× ×¤×Ø×××§× ML ××§×¦× ×קצ×:
×××רת ×××¢×× ××¢×”×§××Ŗ
ā
ā¼
×××”××£ Data āāāāāāāāāāā¶ × ××§×× ××¢×××× Data
ā
ā¼
Feature Engineering
(×××רת/×צ×רת Features)
ā
ā¼
×××רת ×××× + ×××××
ā
ā¼
×ער×× (Evaluation)
āāā Accuracy, Precision, Recall
āāā Cross-validation
ā
××× ×הפ××§?
/ \
×× ××
ā ā
ā¼ ā¼
×××Ø× ×ש×× Deploy ×-Production
×§××× (ר××: production.md)
×פ××¢×, 80% ××××× ×©× Data Scientist ×××× ×¢× × ××§×× Data. ××Ŗ ×-20% ×× ×תר×× ××× ××××× ×¢× ×× ×”××Ŗ ×××”××ר ×-PM ××× ×¦×Ø×× ×¢×× Data × ×§×.
Common confusions
×ר×× ×× ×©×× ×©×××¢×× "AI" ×××ש××× ×שר ×¢× ChatGPT ×× ×¢× ×Ø××××××. ×פ××¢×, AI ×××× ×××× ×¢×¦×× ×©× ××× ×××××××Ŗ -- ×××××ר××Ŗ× ×¤×©×× ×©××××× Spam ×-Email, ××Ø× ×ער××Ŗ ×××צ××Ŗ ×-Netflix, ××¢× ×××××× ×× ×Ø×××××× ××× GPT ×-Diffusion Models.
Deep Learning ××× ×”×× ××× ×©× Machine Learning, ×× ×©× ××ר ××××Ŗ× ××ר. ×ש ×ר×× ××××ר××Ŗ×× ML ש×× ×× Deep Learning (××× Decision Trees ×-SVM), ××× ×¢×××× ×Ø×××× ×××× ××××.
Data צר×× ×××××Ŗ ×××××Ŗ× ×-×××צ×. ×××××× ×××××××Ŗ ×¢× Labels ש××××× ×× ××× ×××× ×ר××¢. Quality > Quantity.
Overfitting ×§××Ø× ×ש××××× "ש×× ×" ××Ŗ ×-Training Data ×××§×× ××××× ××Ŗ ××פ××”×× ×××××Ŗ×××. ×× ××× ×Ŗ×××× ×©××©× × ×Ŗ×©××××Ŗ ××××× × ××× ×× ×××× ××Ŗ ××××ר -- ×ר××¢ ש×ש××× ××©×Ŗ× × ×§×¦×Ŗ, ××× × ×ש×. ×פתר××: Regularization, Cross-validation, ×××תר Data ×××××.
Tiny example
××××× × ×©××Ŗ× ××× ×× ×ער××Ŗ ש×××× ××× Review ×©× ××צר ××× ××××× ×× ×©××××:
=== "××שת Classic ML"
```python
from sklearn.feature_extraction.text import TfidfVectorizer
from sklearn.linear_model import LogisticRegression
# ש×× 1: ×פ×××Ŗ ××§×”× ××הפר×× (Feature Engineering ××× ×)
vectorizer = TfidfVectorizer(max_features=1000)
X_train = vectorizer.fit_transform(reviews_text)
# ש×× 2: ××××× ××××
model = LogisticRegression()
model.fit(X_train, labels) # labels = [positive, negative, ...]
# ש×× 3: ×××××
new_review = vectorizer.transform(["×××צר ××¢×××, ××××ׄ ××××!"])
print(model.predict(new_review)) # -> "positive"
```
=== "××שת Deep Learning"
```python
from transformers import pipeline
# ××××× ××ר ××× Features ×עצ×× ××Ŗ×× ×××××× × ×××××××Ŗ
classifier = pipeline("sentiment-analysis")
result = classifier("×××צר ××¢×××, ××××ׄ ××××!")
print(result) # -> [{'label': 'POSITIVE', 'score': 0.98}]
```
ש××× ×× ×××××
×-Classic ML -- ×× ×× × ××××ר×× ××× ××פ×× ××§×”× ××הפר×× (TfidfVectorizer).
×-Deep Learning -- ××××× ××ר ×¢×©× ××Ŗ ×× ×עצ×× ××××× ×-Training ×¢× Data ×¢× ×§.
××××× × ×הפת: ××××× ×××ר ××ר×
=== "Classic ML -- Linear Regression"
```python
from sklearn.linear_model import LinearRegression
import numpy as np
# Features: ש×× (×"ר), ×הפר ××ר××, ×§×××, ×ר××§ ××ר××
X_train = np.array([
[80, 3, 2, 5], # ×××Ø× 1
[120, 4, 5, 3], # ×××Ø× 2
[60, 2, 1, 10], # ×××Ø× 3
# ... ×¢×× ×××××××Ŗ
])
y_train = np.array([1_500_000, 2_800_000, 900_000])
model = LinearRegression()
model.fit(X_train, y_train)
# ××××× ×××ר ××××Ø× ××ש×
new_apartment = np.array([[100, 3, 4, 4]])
print(f"×××ר ×ש×ער: {model.predict(new_apartment)[0]:,.0f} ש\"×")
```
=== "Deep Learning -- Neural Network"
```python
import torch
import torch.nn as nn
class PricePredictor(nn.Module):
def __init__(self):
super().__init__()
self.network = nn.Sequential(
nn.Linear(4, 64),
nn.ReLU(),
nn.Linear(64, 32),
nn.ReLU(),
nn.Linear(32, 1)
)
def forward(self, x):
return self.network(x)
# ×××ר××Ŗ -- Classic ML ×××Ø× ××× ×¢×××£!
# DL ××××× ×××, ××× ××× ×× × ×Ø××...
```
×××××× ××××Ø× ××ר××Ŗ ××שר××, ×פ××× ××××× ××× ××Ŗ×§×× ××¢××× ×× ×צ××× ×××××Ŗ ש××××ר ×קפ×ׄ ×-30% ×× ××ש×× ×××ש×× ××ר×× ×¢× ×Ŗ××× ××Ŗ ××ש×. ××× ××ר×× × ×©×ר×× ×××ר "××× ××××× ×¦×× ×× ×ש××Ŗ".
š¤ļø ××××¤× ××Ŗ×××××
××”××× ××××× ××××ׄ ××פה ××¢× ××× × ×עש××Ŗ:
ש×× 1: ××”××” ××Ŗ××× (2-3 ש×××¢××Ŗ)
- ×”××××”×××§× ××”××”××Ŗ -- Mean, Median, Standard Deviation, Distributions
- ×××××Ø× ××× ×ר××Ŗ -- Vectors, Matrices, Dot Product (×× ×¦×Ø×× ×××××Ŗ ××Ŗ××××§××, צר×× ××××× ××Ŗ ×רע×××)
- Calculus ××”××”× -- Derivatives, Gradient (×ש××× ××××× ××× ×××× ××××)
- ×ש×× ××××ׄ: ××§×רה 3Blue1Brown ×-YouTube (××× ××, ××××××× ×××¢×××)
ש×× 2: Python + Data Basics (3-4 ש×××¢××Ŗ)
- Python ××”××”× -- loops, functions, classes
- NumPy -- ×¢×××× ×¢× ×ער×××
- Pandas -- ×¢×××× ×¢× ××××××Ŗ Data
- Matplotlib / Seaborn -- ××××××××צ××
- ×ש×× ××××ׄ: Kaggle Learn (××× ××, ××× ×ר××§××××)
ש×× 3: Machine Learning ×§×××”× (4-6 ש×××¢××Ŗ)
- ×§×רה Andrew Ng -- Machine Learning ×-Coursera
- תר××× ×-Kaggle: ×××Ŗ××× ×¢× Titanic ×-House Prices
- הפר×××Ŗ Scikit-learn -- ××××× ××Ø× ××××§××× ×צ×× ×××¢××× ×©××
ש×× 4: Deep Learning (4-8 ש×××¢××Ŗ)
- ×§×רה fast.ai (××× ××, Top-Down approach -- ×ר×צ×× ×§×× ××××× ×ר×ש××)
- PyTorch basics -- Tensors, Autograd, nn.Module
- ××× ××Ŗ פר×××§× ××× ×-0: Image Classifier ×× Text Classifier
ש×× 5: ××Ŗ××××Ŗ (×××Ŗ×× ××××××)
- NLP -- Hugging Face Transformers, Course ×©× Hugging Face
- Computer Vision -- ×§×רה CS231n ×©× Stanford (××× ×× ×-YouTube)
- MLOps -- MLflow, Docker, ×-Production
××פ ×××: ×× ×¦×Ø×× ×עש××Ŗ ××× ××¤× × ×©××Ŗ××××× ××× ××Ŗ
××××©× ××× ×פק×××××Ŗ ××× "learn by doing". ×××Ø× ×©×× 2, ××ר ×פשר ×××Ŗ××× ××שתתף ××Ŗ×ר××××Ŗ Kaggle ×××× ××Ŗ פר×××§××× ×§×× ××. ×××Ŗ××××§× ×Ŗ××× ×” ×××ר××.
××× × ××¢×××§× ×©× AI/ML ××רשת ××”××” ×××§ ×××Ŗ××××§× ×××××¢× ×××ש×. ×§×רה×× ××××××Ø× ××× ×ר××Ŗ, ××”×Ŗ×ר××Ŗ, ××××××Ŗ ×××× × ×× ××פת×.
××Ŗ××× ××Ŗ ×××××××× ×©×× ×-TAU:
- ×××× ×××××× ××ש××××Ŗ (0368-3235)
- ××”××××Ŗ ×××××× ××¢×××§× (0368-3080)
- ××”×Ŗ×ר××Ŗ ××”××××”×××§× ×××-×××× (0368-2002)
- ×××××Ø× ××× ×ר××Ŗ 1× (0366-1119)
š¼ ש××××Ŗ ×ר×××× ×¢××××
×× ××××× ××× AI, ML ×-DL?
AI ××× ×××ר××× ×ר××× ×××תר -- ×× ×ער××Ŗ ש×××× ××Ŗ× ××××Ŗ ××× ××××× ×××Ŗ. ML ××× ×Ŗ×Ŗ-×Ŗ××× ×©× AI ש×× ×ער×××Ŗ ××××××Ŗ ×-Data ×××§×× ×××××× ××××ר×× ×ר×ש. DL ××× ×Ŗ×Ŗ-×Ŗ××× ×©× ML ש×שת×ש ×רשת××Ŗ × ××ר×× ×× ×¢× ×©××××Ŗ ר×××Ŗ. ××××”: AI ā ML ā DL.
×× ××××× ××× Supervised ×-Unsupervised Learning?
×-Supervised Learning ××××× ××§×× Data ×¢× Labels (תש××××Ŗ × ××× ××Ŗ) ××××× ×××××Ŗ Labels ×¢××ר Data ××ש. ×-Unsupervised Learning ××× Labels -- ××××× ××פש ××× ×× ××פ××”×× ×-Data ×עצ×× (××× Clustering). ×××××: Supervised = ××××× Spam (×ש Label: spam/not spam). Unsupervised = ××××§×Ŗ ××§××××Ŗ ××§××צ××Ŗ (××× Labels ××××ר×× ×ר×ש).
××Ŗ× ×Ŗ×××Ø× Classic ML ×¢× ×¤× × Deep Learning?
×ש×ש ××¢× Data (××××Ŗ-××פ×× ×©× ×××××××Ŗ), ×שצר×× Interpretability (××”×ר ××× ××××× ××××× ×× ×©×××××), ×ש×-Data ××× Tabular (××××××Ŗ), ××ש×ש ××××××Ŗ ××××Ø× ×× ×Ŗ×§×¦××. Classic ML ×× ×××ר ××תר ×××× ××-Deploy.
×× ×× Overfitting ×××× ××× ×¢×× ×××Ŗ×?
Overfitting ×§××Ø× ×ש××××× "ש×× ×" ××Ŗ ×-Training Data ××× ×צ××× ×-Generalize ×-Data ××ש. ×”××פ×××: ××צ××¢×× ××¢×××× ×¢× Training, ××צ××¢×× ×ר××¢×× ×¢× Test. פתר×× ××Ŗ: Regularization (L1/L2), Dropout (×-DL), Cross-validation, ×××××Ŗ ×-Training Data, Early Stopping, ×פ×ש×× ×××××.
××”×××Ø× ×× ×× Bias-Variance Tradeoff
Bias ××× ×©×××× ×©× ×ר××Ŗ ×× ××××× ×¤×©×× ××× (Underfitting) -- ××× "×פהפה" ×פ××”×× ×-Data. Variance ××× ×©×××× ×©× ×ר××Ŗ ×× ××××× ××ר×× ××× (Overfitting) -- ××× ×Ø××ש ×רעש ×-Data. ×-Tradeoff: ×××× ×¤×©×× = High Bias, Low Variance. ×××× ××ר×× = Low Bias, High Variance. ××××Ø× ××× ××צ×× ××Ŗ × ×§×××Ŗ ××××××.
×× ×× Transfer Learning ×××× ××× ×ש××?
Transfer Learning ××× ×©×××ש ××××× ×©××ר ×××× ×¢× ×ש××× ×××Ŗ (×××Ø× ××× ×¢× Data ×¢× ×§) ×××”××” ××ש××× ××ש×. ×××§×× ×××× ×××× ××פה, ×××§××× ×××× Pre-trained ××¢×ש×× Fine-tuning ×¢× ×-Data ש×× ×. ×× ×××”× ×××, Data, ×××”×£. ×××××××Ŗ: BERT ×××¢×××Ŗ NLP, ResNet ×××¢×××Ŗ Computer Vision, GPT ×-Foundation Model.
×× ××××× ××× Precision ×-Recall?
Precision = ××Ŗ×× ×× ×× ×©××××× ××× ×-Positive, ××× ××××Ŗ Positive? Recall = ××Ŗ×× ×× ×-Positives ×××××Ŗ×××, ××× ××××× ×צ×? ×××××: ×× ××××× ×××× Spam -- Precision ×××× = ××¢× False Positives (×××××× ××××××××× ×©×”××× × ×-Spam). Recall ×××× = ××¢× False Negatives (Spam ש×× ××××). ×ר×× ×ש Tradeoff ××× ×××, ×-F1 Score ××× ××××צע ××ר××× × ×©× ×©× ×××.
×× ×× Feature Engineering ×××× ××× ×ש××?
Feature Engineering ××× ×Ŗ×××× ××צ×ר×, ××××ר×, ×××××Ø× ×©× ××©×Ŗ× ×× (Features) ××-Data ×××××× ×פ×ר×× ×©××××× ×××× ××××× ××× ×. ×××××: ××Ŗ×× ×Ŗ×ר×× ×פשר ××צ×ר Features ××× ××× ×ש×××¢, ×××ש, ××× ×× ××. ×-Classic ML ×× ×§×Ø××× ×××× ×. ×-Deep Learning ×רשת ×××××Ŗ Features ××××¤× ×××××××, ××× Feature Engineering ××× ×¢×××× ×××× ×שפר ××צ××¢××.
Links to other notes
- ×פת תפק×××× (Roles Map) -- ×× ×¢××× ×¢× AI/ML ×פ××¢×?
- פר×××§×©× (Production) -- ××× ×××× ML ××××¢ ××שת×ש×× ××××Ŗ×××?
- רשת××Ŗ × ××ר×× ×× (Neural Networks) -- צ×××× ×¢×××§× ××Ŗ×× DL