Graphics in 5 Minutes
Graphics in 5 Minutes
  • 30
  • 679 755
Reinforcement Learning: ChatGPT and RLHF
Reinforcement Learning from human feedback, and how it's used to help train large language models like ChatGPT.
Part 3 of RL from scratch series.
ua-cam.com/video/vXtfdGphr3c/v-deo.html
0:00 - intro
0:06 - large language models
0:35 - learning to tell jokes
1:13 - fine tuning with better data
1:26 - positive and negative examples
2:03 - reinforcement learning for LLMs
3:00 - labeling fewer examples
3:56 - reward networks
5:08 - summing it up
5:23 - variants
5:57 - chatGPT, Bard, Claude, Llama
6:09 - finally, a good joke!
Переглядів: 7 009

Відео

Reinforcement Learning: AlphaGo
Переглядів 8 тис.8 місяців тому
How AlphaGo works, based on Reinforcement Learning. Part 2 of RL from scratch series. ua-cam.com/video/vXtfdGphr3c/v-deo.html 0:00 - intro 0:06 - how to play Go 0:21 - introducing alphaGo 0:46 - analyzing expert games 2:17 - training an expert policy 2:47 - value functions 4:05 - search trees 5:42 - reinforcement learning 6:17 - alphaGo's value function 7:47 - alphaZero
Reinforcement Learning from scratch
Переглядів 29 тис.8 місяців тому
How does Reinforcement Learning work? A short cartoon that intuitively explains this amazing machine learning approach, and how it was used in AlphaGo and ChatGPT. Part 1 of 3. 0:00 - intro 0:13 - pong 0:28 - the policy 0:51 - policy as neural network 1:32 - supervised learning 2:51 - reinforcement learning using policy gradient 4:24 - minimizing error using gradient descent 4:45 - probabilisti...
Particle Systems and Physics Simulation: Part 2
Переглядів 1,7 тис.Рік тому
Equivalent to a 50 minute university lecture on particle systems. Part 2 of 2. Part 1: ua-cam.com/video/sYBU9GY_g1k/v-deo.html 0:00 - intro 0:17 - Euler step size 1:38 - trajectory visualization 3:22 - springs 4:22 - particle system algorithm 5:06 - stiff springs and instability 5:46 - Symplectic Euler 6:16 - pinball Graphics in 5 minutes is a series of cartoon-style videos that teach computer ...
Particle Systems and Physics Simulation
Переглядів 2,2 тис.Рік тому
Equivalent to a 50 minute university lecture on particle systems. Part 1 of 2. Part 2: ua-cam.com/video/geB2Ms_Mq04/v-deo.html 0:00 - intro 0:08 - smoke 1:10 - physics 1:30 - approximating the area under the curve 2:25 - Euler integration 3:24 - Particle System 3:50 - bouncing balls 4:15 - collisions 4:47 - restitution and friction Graphics in 5 minutes is a series of cartoon-style videos that ...
Ray Tracing in 5 minutes
Переглядів 7 тис.Рік тому
Equivalent to a 50 minute university lecture on Ray Tracing. Part 1 of 3. Part 2: ua-cam.com/video/mTOllvinv-U/v-deo.html 0:00 - intro 1:27 - tracing from the eye 1:48 - single bounce tracing 3:03 - reflection 3:21 - refraction 4:17 - ray tracer on the back of a business card Graphics in 5 minutes is a series of cartoon-style videos that teach computer graphics in 10x less time. You can take th...
Ray Tracing in 5 minutes: Part 2 -- implementing a basic ray tracer
Переглядів 3,7 тис.Рік тому
Equivalent to a 50 minute university lecture on Ray Tracing. Part 2 of 3. Part 3: ua-cam.com/video/58n6nHBwisU/v-deo.html 0:00 - intro 0:09 - rays 0:19 - TraceRay function 1:38 - shading 2:11 - shadow attenuation 2:55 - soft shadows 3:34 - colored shadows 4:16 - transparent shadows Graphics in 5 minutes is a series of cartoon-style videos that teach computer graphics in 10x less time. You can t...
Ray Tracing in 5 minutes: Part 3 -- recursive ray tracing
Переглядів 3,1 тис.Рік тому
Equivalent to a 50 minute university lecture on Ray Tracing. Part 3 of 3. Part 1: ua-cam.com/video/H5TB2l7zq6s/v-deo.html 0:00 - intro 0:09 - distance attenuation 0:49 - ambient reflection 0:56 - emission 1:02 - Blinn-Phong illumination Model 1:19 - TraceImage function 2:08 - reflection rays 3:15 - refraction rays 4:37 - total internal reflection 5:44 - stepping through a ray tracer Graphics in...
Rotation by shearing
Переглядів 1,8 тис.Рік тому
This is an addendum to the Affine Transformations video ua-cam.com/video/AheaTd_l5Is/v-deo.html
Text to Image in 5 minutes: Parti, Dall-E 2, Imagen
Переглядів 12 тис.Рік тому
The key ideas and intuition for how these AI image generation systems work. Part 2: ua-cam.com/video/lyodbLwb2lY/v-deo.html Text Image Generation Playlist: ua-cam.com/play/PLWfDJ5nla8UoG2mvvHs_OS0asAKC5HJeu.html
Text to Image: Part 2 -- how image diffusion works in 5 minutes
Переглядів 9 тис.Рік тому
Part 1: ua-cam.com/video/GYyP7Ova8KA/v-deo.html How image diffusion works Text Image Generation Playlist: ua-cam.com/play/PLWfDJ5nla8UoG2mvvHs_OS0asAKC5HJeu.html
Large Language Models: Part 2
Переглядів 113 тис.Рік тому
How do language models like GPT and Palm work? Part 1: ua-cam.com/video/lnA9DMvHtfI/v-deo.html See next: text-to-image (Parti, Imagen, Dall-E): ua-cam.com/video/GYyP7Ova8KA/v-deo.html 0:00 - intro 0:14 - next word prediction 0:20 - word embeddings 1:01 - transformers 3:11 - generating text 4:13 - stacking attention layers 4:47 - training data 5:21 - GPT-3 examples
Large Language Models from scratch
Переглядів 330 тис.Рік тому
How do language models like chatGPT and Palm work? A short cartoon that explains transformers and the tech behind LLMs. Part 2: ua-cam.com/video/YDiSFS-yHwk/v-deo.html 0:05 - autocomplete 0:44 - search query completion 1:03 - language modeling with probabilities 1:59 - time series and graphs 2:34 - text generation 3:43 - conditional probabilities 3:52 - trigrams 4:49 - universal function approx...
Subdivision surfaces in 5 minutes
Переглядів 4,9 тис.Рік тому
Equivalent to a 50 minute university lecture on subdivision curves and surfaces. 0:00 - intro 0:23 - subdivision curves 2:42 - limit curves = B-spline 3:29 - repeating control points 3:58 - subdivision surfaces 4:12 - Loop Subdivision Graphics in 5 minutes is a series of cartoon-style videos that teach computer graphics in 10x less time. You can take the equivalent of a University level compute...
Fourier Transform in 5 minutes: The Case of the Splotched Van Gogh, Part 3
Переглядів 4,8 тис.Рік тому
Equivalent to a 50 minute university lecture on Fourier Transforms. Part 3 of 3. 0:00 - intro 0:20 - sampling a sinusoid 0:37 - aliases and frequencies 1:30 - avoiding aliasing and the Nyquist rate 3:05 - 2D image frequencies 3:32 - 2D image Fourier Transform 5:56 - low-pass filtering and anti-aliasing 6:37 - sinc filter 6:40 - resizing with a low-pass filter Graphics in 5 minutes is a series o...
How to Create a Cartoon Lecture
Переглядів 1,4 тис.Рік тому
How to Create a Cartoon Lecture
Interpolation in 5 minutes
Переглядів 11 тис.Рік тому
Interpolation in 5 minutes
Splines in 5 minutes: Part 3 -- B-splines and 2D
Переглядів 22 тис.Рік тому
Splines in 5 minutes: Part 3 B-splines and 2D
Splines in 5 Minutes: Part 2 -- Catmull-Rom and Natural Cubic Splines
Переглядів 14 тис.Рік тому
Splines in 5 Minutes: Part 2 Catmull-Rom and Natural Cubic Splines
Splines in 5 minutes: Part 1 -- cubic curves
Переглядів 15 тис.Рік тому
Splines in 5 minutes: Part 1 cubic curves
Diffuse reflection in 5 minutes
Переглядів 4,2 тис.Рік тому
Diffuse reflection in 5 minutes
Specular reflection in 5 minutes
Переглядів 3,9 тис.Рік тому
Specular reflection in 5 minutes
Perspective projection in 5 minutes: Part 2 -- the math!
Переглядів 6 тис.Рік тому
Perspective projection in 5 minutes: Part 2 the math!
Perspective projection in 5 minutes
Переглядів 18 тис.Рік тому
Perspective projection in 5 minutes
Image filtering in 5 minutes: The Case of the Splotched Van Gogh, Part 2
Переглядів 3,8 тис.Рік тому
Image filtering in 5 minutes: The Case of the Splotched Van Gogh, Part 2
Images in 5 minutes: The Case of the Splotched Van Gogh, Part 1
Переглядів 3,5 тис.Рік тому
Images in 5 minutes: The Case of the Splotched Van Gogh, Part 1
Meshes in 5 minutes: creating a surface of revolution
Переглядів 2,4 тис.Рік тому
Meshes in 5 minutes: creating a surface of revolution
Affine transformations in 5 minutes
Переглядів 29 тис.Рік тому
Affine transformations in 5 minutes
Hierarchical modeling in 5 minutes
Переглядів 7 тис.Рік тому
Hierarchical modeling in 5 minutes
Meshes in 5 minutes
Переглядів 3 тис.Рік тому
Meshes in 5 minutes

КОМЕНТАРІ

  • @MikeSaintAntoine
    @MikeSaintAntoine 3 години тому

    Anyone else watching this because of the KAN paper that just came out? lol Great video! 👍

  • @user-cm5es5kk7j
    @user-cm5es5kk7j 22 години тому

    help me a lot, can't wait to see more

  • @pokemonkaipokemon
    @pokemonkaipokemon 3 дні тому

    can u make a video about Piecewise Affine Transformation . i made some diy book scanner .i have some curved pages while i scann . this issue is something that can be solved with a programm called abbyfinereader and the command straighten text line . but i am trying to correct it with python.

  • @stayhappy-forever
    @stayhappy-forever 4 дні тому

    come back :(

  • @sreenivasulupala2374
    @sreenivasulupala2374 6 днів тому

    Excellent explanation. Thank you.

  • @argh44z
    @argh44z 7 днів тому

    these videos are gold!

  • @bugra7097
    @bugra7097 8 днів тому

    hats off.

  • @bugra7097
    @bugra7097 8 днів тому

    grateful

  • @bugra7097
    @bugra7097 8 днів тому

    you are the best. I watched many vids but that is the only one makes sense.

  • @jbrownson
    @jbrownson 8 днів тому

    excellent explanation, thanks

  • @precastdetailing
    @precastdetailing 8 днів тому

    very good mate.

  • @bardiashahrestani3291
    @bardiashahrestani3291 9 днів тому

    hear me out. it'll be "Interpolation in 2.5 minutes" if you put the playback speed on 2x

  • @omarel-ghezawi6466
    @omarel-ghezawi6466 10 днів тому

    Excellent in every respect. I read the remaining comments agreeing with most of them and ticking the like thumbs to save me repeating what they have said. Thanks a lot.

  • @solotron7390
    @solotron7390 12 днів тому

    Finally! Someone who knows how explain complexity with simplicity.

  • @mohajeramir
    @mohajeramir 18 днів тому

    Excellent

  • @junglemandude
    @junglemandude 19 днів тому

    Thanks, what a video, in 8 minutes I have learnet so much, and very well explained with graphics indeed.

  • @Eis461
    @Eis461 20 днів тому

    Beneficial

  • @cloudysh
    @cloudysh 24 дні тому

    This was so surprisingly great :3

  • @metaljacket8102
    @metaljacket8102 24 дні тому

    This is really awsome! It's the best video that explains DRL in such an easy to understand way!

  • @bombur9007
    @bombur9007 25 днів тому

    how many layers should such network have

  • @Flaaroni
    @Flaaroni 28 днів тому

    The third interpretation for mirror reflection is so funny out of context

  • @melissapereira6957
    @melissapereira6957 29 днів тому

    I totally love the way you explained this :)

  • @tolkunovart
    @tolkunovart Місяць тому

    I've watched a bunch of different videos about Ray Tracing and Path Tracing and they all say that the rays fly out of the camera and reflect off the surface, the difference is that in Path Tracing many rays will reflect in random directions, while in Ray Tracing a single ray will reflect and fly directly to the light source. This raised a lot of questions in my mind, how do reflections, shadows, transparent materials, etc. work in Ray Tracing, but no one in their videos even thinks about it, they just reflect a ray once and that's it. I finally found this video that explained literally everything and answered all my questions, it's literally a diamond for me, thank you

  • @tuulymusic3856
    @tuulymusic3856 Місяць тому

    Please come back, your videos are great!

  • @creamycreations7881
    @creamycreations7881 Місяць тому

    Just fuc**ng amazing video hats offf

  • @mineq4967
    @mineq4967 Місяць тому

    but by what number do you change the weights like you never told us

  • @darthvader4899
    @darthvader4899 Місяць тому

    this is video is super underrated. In fact the whole channel is underrated.

  • @labCmais135
    @labCmais135 Місяць тому

    Wow, just saw this 😂, its excellent, thank you

  • @Sm_Colly
    @Sm_Colly Місяць тому

    Soothing voice to learn about transformers and warm room is perfect for recipe for my sleep.🛌

  • @sumitpawar000
    @sumitpawar000 Місяць тому

    Wow .. what an explanation sir ❤ Thank you 🙏

  • @UzunKamis
    @UzunKamis Місяць тому

    Part 1 -- Cubic Curves ua-cam.com/video/YMl25iCCRew/v-deo.html Part 2 -- Catmull-Rom and Natural Cubic Splines ua-cam.com/video/DLsqkWV6Cag/v-deo.html Part 3 -- B-Splines and 2D ua-cam.com/video/JwN43QAlF50/v-deo.html

  • @UzunKamis
    @UzunKamis Місяць тому

    Part 1 -- Cubic Curves ua-cam.com/video/YMl25iCCRew/v-deo.html Part 2 -- Catmull-Rom and Natural Cubic Splines ua-cam.com/video/DLsqkWV6Cag/v-deo.html Part 3 -- B-Splines and 2D ua-cam.com/video/JwN43QAlF50/v-deo.html

  • @UzunKamis
    @UzunKamis Місяць тому

    Thank you very much for this very explanatory video. It is the first time we are studying this with my project students. We would like to make some comments about what we get from the explanations. Please correct us if we are wrong. For NCS, we use f''[x_{k+1}]=g''[x_{k+1}] condition in the middle points together with f''[x_{1}]==0 and g''[x_{n}]==0 at the end points. While, for CRS, we use f'[x_{k+1}]=g'[x_{k+1}]=(g[x_{k+2}]-f[x_{k}])/(x_{k+2}-x_{k}) together with some derivative constraints (such as f'[x_{1}]=0 and g'[x_{n}]=-1) at the end points.

  • @solveigberling1662
    @solveigberling1662 Місяць тому

    That was dope

  • @tushargupta1999
    @tushargupta1999 Місяць тому

    This video is amazing. You explained everything in such a simple manner. I am feeling really motivated to learn more about reinforcement learning and neural networks after watching this.

  • @garvjoshi1111
    @garvjoshi1111 Місяць тому

    🔥🔥🔥 probably for the first time I'm using this emoji for education related things

  • @themax2go
    @themax2go Місяць тому

    agi: 1. ai develops understanding of win-loss conditions and sets policy params (inputs & actions) accordingly. 2. ai creates (= designs & builds) training env(s). 3. ai iterates, avals & adjusts policy parameters accordingly 4. done (or validation run(s) w/ human(s))

  • @user-hf5og1bt8j
    @user-hf5og1bt8j 2 місяці тому

    amazing video! thank you!

  • @PranavAshok
    @PranavAshok 2 місяці тому

    You are really gifted at this! Thank you so much!

  • @_sudipidus_
    @_sudipidus_ 2 місяці тому

    This is so good I’m inspired to go back and learn Fourier and Taylor series

  • @jeffhall4214
    @jeffhall4214 2 місяці тому

    What if the spline is in 3D space and now there's a Z component as well? How do we account for that?

    • @g5min
      @g5min 2 місяці тому

      see part 3...

    • @jeffhall4214
      @jeffhall4214 2 місяці тому

      Thank you sir. @@g5min

  • @memesalldayjack3267
    @memesalldayjack3267 2 місяці тому

    oh man, this tutorial is so well explained and compact, i already feel like i could come up with a rough code to do those subdivisions, tho the 3d part having multiple neighbors i haven't grasped yet, i think I'll look into that quad algorithm

  • @breakdancerQ
    @breakdancerQ 2 місяці тому

    Too frikin awesome

  • @ravikiranramachandra1000
    @ravikiranramachandra1000 2 місяці тому

    Explanation is really good😊

  • @vigajad7677
    @vigajad7677 2 місяці тому

    ...man. I've been trying to learn this (and some other stuff when I gave up on this particular topic :')) for computer graphics exam for past 3 days and didn't get the intuitions for the affine operations at all. Until now. Wow. Thank you A LOT.

  • @hansu7474
    @hansu7474 2 місяці тому

    Great video!

  • @hansu7474
    @hansu7474 3 місяці тому

    Great video mate!

  • @monkeyrobotsinc.9875
    @monkeyrobotsinc.9875 3 місяці тому

    huhMAUjinus not homo-genius. but cool.

  • @monkeyrobotsinc.9875
    @monkeyrobotsinc.9875 3 місяці тому

    nice. but turn up your volume and use sound compression thanks.

  • @federicosalvetti7703
    @federicosalvetti7703 3 місяці тому

    My man you are great, I am implementing this in code as an exercise and I am understanding so much better!