The MD Academy
AI & Memory: From Synapse to System
How your CV stacks up
Upload your CV to see how well it fits this job role
?%
All courses
COURSE 8
AI & Memory: From Synapse to System
Neurologists, neurosurgeons, and clinically-minded physicians who want to truly understand how AI works
The math and neuroscience behind modern AI, built for clinicians. From vectors and gradients to the biological and artificial neuron, neural networks, attention, and large language models — then memory itself: how brains and machines store, recall, and forget, and what that means for clinical AI. Rigorous but accessible; no prior machine-learning background required.
Key Features:
- 10 lessons
- Lifetime access
- Certificate of completion
Course Curriculum
-
Why Memory Is the Frontier: Human Memory, Machine Memory, and the Bridge Between
Free preview - 25 min
Learning Objectives:
- Frame why memory — not reasoning — is the limiting frontier for current AI.
- Map the human memory taxonomy onto its computational counterparts.
- See the arc of the course: from synapse and matrix to clinical AI systems.
Key Takeaway: Memory is the frontier on both sides of the bridge. In the brain and in the machine, a memory is a distributed pattern held in the strengths between units — not a place. The clinical taxonomy you already use — working, episodic, semantic, procedural — maps cleanly onto a model's context window, retrieval store, weights, and learned skills. Understand both, and you can judge whether a clinical AI is safe to remember with.
-
The Math You Actually Need: Vectors, Matrices, the Dot Product, and Gradients
25 min
Learning Objectives:
- Read a vector as a pattern, and a matrix as the connections that transform it.
- Use the dot product as a measure of similarity between two patterns.
- Explain a gradient as the direction that reduces error — the seed of all learning.
Key Takeaway: Four ideas, and you have the whole toolkit. A vector is a pattern written as numbers. A matrix is the sheet of connections that turns one pattern into another — and the weights are the memory. The dot product scores how similar two patterns are, which is what attention and search both run on. And the gradient is the direction that reduces error, stepped over and over until the network learns. Pattern, transformation, similarity, tuning — keep those four words, and every diagram from here on is readable.
-
The Neuron — Biological & Artificial: The Perceptron, the Firing Decision, and Hebbian Learning
25 min
Learning Objectives:
- Map the parts of a perceptron onto the parts of a neuron you already know.
- Explain the firing decision as a weighted sum passed through an activation function.
- State Hebb's rule and see it as the biological cousin of the gradient step.
Key Takeaway: The artificial neuron is your neuron, abstracted: dendrites become inputs, synaptic strengths become weights, the soma's summation becomes Σ, and the axon's threshold becomes an activation function. The decision to fire is a weighted sum passed through that nonlinearity — and the nonlinearity is what makes depth worth anything. Learning, on both sides, is the adjustment of weights: Hebb's rule in tissue, the gradient step in silicon — the same instinct, strengthen what works, pointed two ways.
Reasons to use Rodeo
Start with a chat, not a search bar
Grad scheme, placement, apprenticeship? Not sure what you want yet — that's fine. Your agent talks it through with you and turns "I have no idea" into a shortlist.
It searches the market for you
Every day your agent scans the market matching roles against what actually matters to you, not just keywords on a CV.
Only hits
No noise. No "maybe this fits." Just roles with a clear explanation of why they're right — and where to focus when applying.
-
Neural Networks from Scratch: Layers, the Forward Pass, Loss, and Backpropagation
25 min
Learning Objectives:
- Describe a layer as a matrix multiply followed by an activation, and a network as stacked layers.
- Explain the forward pass and the loss — how a network turns inputs into a prediction and scores it.
- Walk through backpropagation and the training loop as the gradient step from Lesson 2, done at scale.
Key Takeaway: A neural network is layers stacked together, and each layer is just a matrix multiply with an activation on top. The forward pass sends a pattern through those layers to a prediction. The loss scores how wrong that prediction is, in one number. Backpropagation sends the error backward so every weight learns its share of the blame, and the gradient step nudges each weight a little way downhill. Forward, loss, backward, step — repeat that loop, and a random network becomes one that has learned. It is the gradient from Lesson 2 and the neuron from Lesson 3, finally working in concert.
-
From MLPs to Attention: Embeddings, Self-Attention, and the Transformer
20 min
Learning Objectives:
- Say why a plain MLP struggles with language, and what embeddings fix.
- Explain self-attention as a dot-product similarity that decides where to look.
- Describe the transformer as stacked attention, trained to predict the next token.
Key Takeaway: Three ideas, and you can read any model in the news. A plain MLP can't handle a sentence, so we turn words into embeddings — vectors that sit close when their meanings are close. Self-attention then lets each word ask the others 'which of you matters to me?', and the answer is the dot product from Lesson 2, softened into a spotlight that blends in the relevant words. Stack that attention into layers, train the stack to predict the next word, and you have a transformer. Meaning, focus, prediction — and underneath it all, the same similarity score we built three lessons ago.
-
Memory as Computation: Hopfield Networks, Associative Memory, and Energy Landscapes
25 min
Learning Objectives:
- Explain associative memory — recall by content, not by address.
- Read a Hopfield network as an energy landscape, where memories are low-energy attractor states.
- Describe pattern completion, and why capacity limits cause interference between similar memories.
Key Takeaway: Memory, computed, is this. The brain recalls by content, not by address — give it a fragment and it rebuilds the whole. A Hopfield network does the same with one rule: store memories as valleys in an energy landscape, then let a noisy cue roll downhill into the nearest one. That descent is pattern completion, the mechanism behind cued recall and the smell that brings back an afternoon. And when you store too many memories, or memories too alike, their valleys merge — which is interference, the same word, the same phenomenon, in the patient and in the machine.
-
The Hippocampus & Complementary Learning Systems: Fast vs. Slow Learning, Replay, and Consolidation
Get help with your application
Your very own career expert that helps elevate your application to the next level.
18 min
Learning Objectives:
- State complementary learning systems theory: a fast hippocampus, a slow neocortex, and why both are needed.
- Describe systems consolidation as replay — the hippocampus training the cortex, largely during sleep.
- Distinguish pattern separation in the dentate gyrus from pattern completion in CA3, and see why one network fails.
Key Takeaway: Memory is split on purpose. The hippocampus is the fast learner — one-shot, sparse, separated — catching each episode as it happens. The neocortex is the slow learner — incremental, overlapping — distilling structure across a lifetime. Between them runs replay: the hippocampus rehearsing experiences, much of it in sleep, to slowly train the cortex, which is systems consolidation. The dentate gyrus separates so storage doesn't interfere; CA3 completes so a fragment can recover the whole. And the reason for all of it is the failure on that last slide — one network can't both learn fast and remember. Two systems can. The machines are still catching up.
-
Continual Learning & Catastrophic Forgetting: Why Networks Forget, and How Replay and EWC Help
20 min
Learning Objectives:
- Explain catastrophic forgetting as overwriting — and why it follows from where memory is stored.
- Describe experience replay and connect it to hippocampal replay and sleep from Lesson 7.
- State the idea behind elastic weight consolidation — protect the weights that matter most.
Key Takeaway: A network forgets catastrophically because its memory lives in shared weights, and training on something new moves the very weights that held the old. Two cures answer it. Experience replay interleaves old examples with new — the same trick the hippocampus runs during sleep. Elastic weight consolidation measures which weights matter and anchors them, the way a consolidated synapse resists change. Stay plastic enough to learn, stable enough to remember — that balance is the whole game, in silicon and in cortex alike.
-
LLM Memory Architectures: Context Windows, Retrieval, and Agent Memory
16 min
Learning Objectives:
- Read the context window as working memory — powerful, limited, and wiped between sessions.
- Explain the trained weights as semantic long-term memory, and retrieval as an episodic lookup store.
- Name the memory tiers a capable agent needs, and the failure mode of each.
Key Takeaway: A language model's memory is three stores, and you already know all three. The context window is working memory — fast, limited, and wiped between sessions, like the phone number you hold just long enough to dial. The trained weights are semantic long-term memory — vast, durable, and frozen after training. And retrieval is the episodic store, fetching specific facts by dot-product similarity and dropping them into the window. An agent needs all three at once. And each fails its own way: context forgets, weights go stale, and the wrong retrieval becomes confabulation — fluent, confident, and wrong. Knowing which store an answer came from is how you know how far
“It took my CV and asked me questions relevant to understanding what kind of jobs to suggest for me. Suggestions were almost perfect. Jobs were exactly what I’ve been looking for.”
Jessica, London
Skills
Location