What is AI?

Nested circles: Artificial Intelligence contains Machine Learning, which contains Deep Learning, then Generative AI, then Large Language Models, then ChatGPT

What are Large Language Models?

💬

LLMs are basically your ChatGPT. The thing you talk to every day. ChatGPT is a large language model.

🧠

These models require training to understand how to connect words and sentences and say the right thing!

How do we model Language?

“The two men appeared out of nowhere. The narrow path stretched ahead. The same stars twinkled above. Two men walked silently. The two guards stood watch. Men appeared from shadows. Out of the darkness they came. Nowhere seemed safe anymore.”

🤔 How would we model this piece of text such that a computer can understand it consistently and generate similar language?

One way is…..

“The two men appeared out of nowhere. The narrow path stretched ahead. The same stars twinkled above. Two men walked silently. The two guards stood watch. Men appeared from shadows. Out of the darkness they came. Nowhere seemed safe anymore.”

Generated text…..

Our generator wrote:

first-order Markov language model – Bigram

What we just did is called Markov chaining. Because each next word depends only on the one word before it, it's a Bigram model.

🐍

By the end of this course you would have built your own text generation engine (1st order Markov chaining) using Python.

Introduction to Transformers

The first Language models were created using Markov Chaining methods. LLMs today do not use this anymore.. Now they have created this new model called transformers. Transformers have a much more advanced way of modeling language and understanding context

It can understand similarity of words by taking into account neighboring words

“Car” is similar to “vehicle”

💡 At it’s core it is smart word statistics. When scaled up with enough data and computing power, can produce such sophisticated language understanding and generation

Modern AI models and their companies

Anthropic OpenAI DeepSeek
  • OpenAIGPT-6 Astra, GPT-5.6 (Sol, Terra, Luna)
  • AnthropicClaude Fable 5.1, Opus 5, Sonnet 5, Haiku 4.5
  • GoogleGemini 3.1 Pro, Gemini 3.8 Flash, Gemini 3 Deep Think
  • MetaMuse Spark 1.3, Muse Glimmer, Llama 4
  • xAI (X)Grok 4.6, Grok 4.5
  • MicrosoftCopilot, MAI-Thinking-1, MAI-Code-1-Flash
  • DeepSeekDeepSeek V4 Pro, DeepSeek V4 Flash
  • AlibabaQwen3.8-Max, Qwen3.8-Flash
  • BaiduERNIE 5.1, ERNIE 5.0

As of September 2026. New models come out every few weeks!

Hallucinations

ChatGPT solving 5.9 = x + 5.11 and wrongly answering x = -0.21 (the right answer is 0.79)