Recap · Why · Practical AI · Add AI to an app · Lab
Today
Short theory. Then you build.
01 · RECAP
Fast refresher
The words from 101 and 102, one slide each.
02 · WHY
AI is not optional
Where it is used, and what jobs now ask for.
03 · PRACTICAL AI
Agents, tools, API calls
Agents, tools, and the five parts you need to add AI to an app.
04 · LAB
Six steps, three apps
From one API call to a small agent, then your own apps.
Recap · What AI is
Machines imitating things humans do
Language, recognition, judgment — performed without anyone writing an explicit rule for each case.
Recap · AI ⊃ ML ⊃ DL
AI contains ML. ML contains deep learning.
ARTIFICIAL INTELLIGENCE
MACHINE LEARNING
The machine fits its own rules from examples.
Example: a spam filter trained on a million labelled emails.
DEEP LEARNING
LLMs live here
One way to build AI. Today, the most common one.
ALSO AI, WITH NO LEARNING AT ALL
Rule-based systems
An engineer writes if / then rules: “if cell temperature > 45 °C, stop charging.”
Search
Route finding in a maps app: try the possible paths, keep the shortest one.
Expert systems
MYCIN (1970s): about 600 rules from doctors, used to suggest antibiotics.
Hand-written game players
Deep Blue beat Kasparov in 1997 with fast search and hand-built scoring rules.
AI contains machine learning. But you can have AI without machine learning.
Recap · Who writes the rules
The difference is who writes the rules
SOFTWARE YOU HAVE WRITTEN
A human writes every rule
You decide each case in advance, by hand — if subject contains "lottery". You maintain that list forever, and it fails on the case you did not foresee.
MACHINE LEARNING
Nobody writes the rules
Show it a million labelled emails and the rule is fitted from the examples. It fails on the case that looks unlike anything it was shown.
Now try to hand-write the rules for “is there a cat in this photo?” The moment you cannot, you have found the reason this field exists.
Recap · What AI is not
Good imitation. Not a brain. Not AGI.
TURING TEST · 1950
Can a judge tell?
A judge chats by text with a hidden human and a hidden machine. Today's chatbots often fool people in short chats.
NOT A BRAIN
Pattern-fitting at scale
It imitates human-like answers. Impressive imitation is still imitation.
NOT AGI
Not built yet
AGI = matches people at nearly every mental task. Even the best models today are narrow AI.
Fooling a judge in a short chat shows good imitation. It does not show understanding.
Recap · Why now · 1
The maths was always there
These methods existed for decades. Backpropagation, the method that trains today’s models, is from 1986.
Recap · Why now · 2
What changed is scale
INPUT 1
Data
THEN · 199860,000 digit images
NOW · 2024~15 trillion words
The internet became a training set. Bars not to scale: the real gap is far bigger.
INPUT 2
Compute
THEN · CPUa few cores
NOW · GPUthousands of MACs
A GPU is a parallel MAC farm. Training runs use thousands of GPUs at once.
INPUT 3
One architecture
THEN · LENET~60 thousand weights
NOW · TRANSFORMERhundreds of billions
The transformer (2017) keeps improving as you make it bigger, for text, images, audio and code.
Same maths+scale=today’s AI
Recap · Everything is numbers
Computers only work with numbers
A computer can only do arithmetic. So text, images and sound must first become numbers.
TEXT
Hi!
→
7210533
Each character has an ID number: H = 72, i = 105, ! = 33.
IMAGE
→
210 65 47232 154 44244 211 9458 111 176…
A grid of pixels. Each pixel = red, green, blue, each from 0 to 255.
SOUND
→
0.540.75−0.46−0.750.460.75…
The ADC samples the mic voltage: 44,100 numbers every second.
SENSOR
→
0.31
A temperature sensor gives a voltage: 0.31 V means 31 °C.
So a model takes numbers in, does maths, and gives numbers out.
Recap · What a model is
A model is a file of learned numbers
A large file of numbers — the weights. The computer uses these numbers to make the prediction.
Nobody typed in its behaviour. It was trained: the numbers were changed again and again on data until the output was right.
Next: what these numbers are and what they do.
ON DISK
llama-3.2-3b.gguf
2.3 GB
llamamodel family (made by Meta)3.2version3b3 billion learned numbers.gguffile type, like .mp3 or .pdf
That is the whole model. One file. You can copy it like any other file.
Recap · Weights and parameters
A weight is one learned number
y = w·x + b
Weight w
The multiplier. How strongly an input counts.
Bias b
The offset. Shifts the result up or down.
Parameters
All the learned numbers: weights + biases. In normal talk, “parameters” ≈ “weights”.
Recap · Parameter counts
What “7B” and “70B” actually mean
M = million, B = billion. 7B = seven billion learned numbers in the file.
110MBERT-base (Google, 2018)
1.5BGPT-2 (OpenAI, 2019)
8BLlama 3.1 8B — runs on a laptop
70BLlama 3.1 70B — needs a workstation
405BLlama 3.1 405B — needs a server
1T+Largest open models (Kimi, DeepSeek, Qwen)
More parameters
Usually more capable: better at long instructions and rare facts.
…but slower and costlier
More numbers to store and multiply for every word.
Closed models (GPT, Claude, Gemini): sizes not published. Outside guesses: a few hundred billion to a few trillion.
Recap · Scale · published sizes and outside guesses, Oct 2026
How big are the big ones?
PUBLISHED BY THE MAKER · open-weight models
Llama 3.1 405B · Meta
405B
Kimi K2 · Moonshot
1T · 32B
DeepSeek V4-Pro
1.6T · 49B
Qwen3.8 flagship · Alibaba
2.4T · 95B
Kimi K3 · Moonshot
2.8T · 104B
GUESSED BY OUTSIDERS · closed models · companies do not publish sizes
Claude 3.5 Sonnet · Anthropic
Microsoft research paper, Dec 2024
≈175B est.
GPT-4o · OpenAI
Microsoft research paper, Dec 2024
≈200B est.
GPT-4 · OpenAI
leaks, 2023 (SemiAnalysis, G. Hotz)
≈1.8T est.
Gemini 3 Pro · Google
one analyst, Nov 2025 (LifeArchitect)
≈3T est.
totalactive per wordestimate — not confirmed by the companyNo public guess yet for GPT-6, Claude 5.5 or Gemini 4.
Recap · Families & tiers · Oct 2026
One family, several size points
CLAUDE TIER
CHARACTER
USE IT WHEN
Haiku
Smallest, fastest, cheapest
Many simple jobs, quick answers
Sonnet
Balanced everyday model
Most daily tasks and most of this course
Opus
Large, strong reasoning
Hard problems where a wrong answer costs a lot
Fable
Top tier, above Opus, most costly
Long, difficult jobs that run for hours
Same idea elsewhere: OpenAI has GPT-6 Luna, Sol and Astra; Google has Gemini Flash and Gemini 4 Argon. Picking a tier is a cost-versus-capability trade, like choosing a component grade.
Recap · Memory
How much memory a model needs
memory ≈ parameters × bytes per parameter
FP16 = 2 B · 4-bit ≈ 0.5 B
SIZEFP164-BITRUNS ON (4-BIT)
1B2 GB
~1 GB
A phone
7B14 GB
~4–5 GB
A normal laptop
70B140 GB
~40 GB
A workstation
405B810 GB
~230 GB
A multi-GPU server
Fewer bits per number = quantization, the same idea as in your ADC.
Recap · Cost · Oct 2026
Why it is cheap, and what it really costs
YOU RENT A SLICE
One reply uses the GPUs for milliseconds to a few seconds.
THEY SHARE IT
The same GPUs serve a very large number of users at once.
ECE VIEW
Time-division multiplexing on one trunk line.
ONE CHAT MESSAGE · SONNET 5.5
in 1,000 tok × $2/1M = $0.002 out 500 tok × $10/1M = $0.005
$0.007 ≈ 67 paise
Rate used: $1 = ₹95. A token is a piece of a word.
App plans (ChatGPT Plus, Claude Pro): about $20 a month, flat fee for the same models.
Output costs more than input. Free tiers exist — we use one in the lab.
Recap · What happens when you type
What happens when you type into ChatGPT
01 · YOU
You type a question
What is a MOSFET?
→
02 · INTERNET
The text goes to a server
Your phone sends it to the company’s data centre.
→
03 · DATA CENTRE
A model runs on GPUs
Large computers read your text and start the reply.
→
04 · BACK TO YOU
The reply comes word by word
A MOSFET is a voltage-controlled
Your phone does not think. It only sends your text and shows the reply. The work happens on a model far away.
Recap · Shells
Chat apps are shells around a model
When you talk to ChatGPT you are talking to a model. ChatGPT is the app wrapped around it. The model is the brain.
Recap · What is in front of you
What is actually in front of you
YOU SEE
The shell
chatgpt.com, claude.ai, the Gemini app — text box, history, login, buttons.
→
SENDS
A request
Your text, plus the conversation so far, over the internet.
→
DOES THE WORK
The model
A file of learned numbers, running on someone else’s GPUs.
The model dropdown at the top of the chat window? That is you swapping the brain inside the shell.
Recap · Shell and model
The app is a shell. The model does not remember.
SHELL · chatgpt.com
text box · history · login
MODEL
the brain
GPT · Claude · Gemini
Each send re-sends the whole chat:
send 1
m1
send 2
m1r1m2
send 3
m1r1m2r2m3
YOU PAY PER TOKEN · IN AND OUT
Sonnet 5.5: $2 in, $10 out per 1M tokens
One chat message ≈ 67 paise
Recap · Three ways in
Three ways to reach a model
A · THE COMPANY’S APP
Open the website or app
chatgpt.com claude.ai gemini.google.com
Easiest. You use it today.
B · AN API
Call it from your own code
Your program sends text to the company’s server and gets the reply back. You pay per use.
Today’s lab uses this door.
C · RUN IT LOCALLY
Download the weights
The model file runs on your own laptop. No internet needed.
Only possible with open-weight models.
Door C only works if the maker gives you the file. That is what “open” and “closed” mean.
Recap · Openness and access
Who gives you the file?
CLOSED
You rent access
GPT · Claude · Gemini
doors A · B
OPEN WEIGHT
You get the numbers
Llama · Qwen · DeepSeek
doors A · B · C
OPEN SOURCE
You get the recipe too
weights + data + code · rare
doors A · B · C
Door C only works with open weights. The lab uses door B, so closed models are fine.
Recap · The main makers · Oct 2026
Who makes which model, and where you use it
COMPANY
MODEL FAMILY
OPEN?
WHERE YOU USE IT
OpenAI
GPT-6 (Luna, Sol, Astra)
Closed
ChatGPT
Anthropic
Claude Haiku, Sonnet, Opus 5.5 · Fable 5.1
Closed
claude.ai, Claude app
Google
Gemini 4 Argon, Gemini Flash · Gemma 4 is open
Closed
Gemini app
Meta
Muse Spark · Llama, Muse Glimmer
Mixed
Meta AI, WhatsApp, Instagram
xAI
Grok 4.7
Closed
grok.com, X
DeepSeek
DeepSeek V4 (Pro, Flash)
Open weight
DeepSeek app
Alibaba
Qwen3.8
Open weight
Qwen app
Mistral
Mistral Medium 3.5, Mistral Large
Open weight
Le Chat
Moonshot
Kimi K3
Open weight
kimi.com
Version numbers change every few months. Learn the pattern: maker → family → open or closed → app.
Recap · More doors · Oct 2026
Apps where you pick the model yourself
Perplexity
Search with sources. Paid plans let you pick GPT, Claude or Gemini.
OpenRouter
One account, hundreds of models from many makers. Has a chat page.
T3 Chat
A fast chat app with a long model list.
Poe
Chat with many models and bots in one app.
GitHub Copilot
Coding help in your editor. Model picker: Claude, GPT, Gemini, Grok and more.
Cursor
A code editor built around AI. You choose the model.
LM Studio · LOCAL
A chat app on your own laptop. You pick an open-weight file and it runs offline. Door C.
Same models, different shells. The shell is a choice. So is the model.
Recap · Hallucination
A model will invent a datasheet value and sound completely sure
Today you only need to see it happen. Why it happens comes in a later lecture — and it is not a bug that someone forgot to fix.
THE RULECheck every number, part number and citation against the datasheet or a real source.
Why · AI is not optional
AI is not optional
Almost every task you do can be made faster or better with AI. It has become a built-in part of how work gets done.
Why · Where AI already sits
AI is already inside everyday work
Writing & email
Drafts, rewrites, summaries of long threads.
Coding
Writes, explains and debugs code, including firmware.
Search
Answers with sources instead of ten blue links.
Design
Diagrams, slides and images from a description.
Data analysis
Cleans a CSV of lab readings and plots it.
Circuit & chip design
PCB auto-routing, layout and verification help in EDA tools.
Documentation
Reads a 400-page datasheet and finds the register you need.
Meetings
Transcribes, then lists the decisions and action items.
Study
Explains a topic at your level, then quizzes you on it.
Why · Beyond ECE
It is in every field, and in your day
01
Medicine
Reads X-rays and eye scans to flag disease early.
02
Agriculture
A phone photo of a leaf identifies the crop disease.
03
Finance
Flags a fraud card payment in milliseconds.
04
Maps
Predicts traffic and your arrival time.
05
Phone cameras
Night mode and portrait blur are computed by a network.
06
Translation
Live captions and translation between dozens of languages.
You probably used AI today before this class started.
Why · Jobs
Jobs already ask for it
CORE ECE
VLSI and EDA
Chip-design job posts now list Python, scripting and AI tools next to Cadence and Synopsys skills. The EDA tools themselves ship AI features.
CORE ECE
Embedded and firmware
Teams use coding agents to write drivers, tests and docs. You are expected to check what the agent wrote.
IT AND SERVICES
TCS, Infosys, Wipro …
They train freshers and staff in generative AI and say these skills are hard to find.
EVERY ROLE
The interview question
“How do you use AI in your work?” A clear answer with one real example puts you ahead.
Knowing the AI words is not the skill. Using AI to get work done is.
Why · You can't skip it
You can’t skip AI
AI is the new internet: a personal-computer moment. ECE already depends on computers and the internet. It will depend on AI the same way.
1980s
Personal computer
Circuit simulation and CAD moved onto your desk.
1990s – 2000s
Internet
Datasheets, forums and open-source tools a search away.
NOW
AI
A tool that reads, writes, codes and designs with you.
So: how do you actually use it?
3.0 · Practical AI
Practical AI
Knowing the words is not enough. You need to do things with it.