Main content

## Jacobian

# Jacobian prerequisite knowledge

## Video transcript

- Hello, everyone. In
these next few videos, I'm going to be talking
about something called, the Jacobian, and more specifically,
it's the Jacobian matrix, or sometimes the associated determinant, and here, I just want to talk about some of the background
knowledge that I'm assuming, because to understand the Jacobian, you do have to have a little bit of a background in linear
algebra, and in particular, I want to make sure that
everyone here understands how to think about matrices
as transformations of space, When I say transformations, here, let me just get
kind of a matrix on here. I'll call it two one
and negative three one. You'll see why I'm coloring
it like this in just a moment. When I say, how to think about this as a transformation of space, I mean, you can multiply a matrix by some kind of two-dimensional vector, some kind of two-dimensional x y, and this is going to give us
a new two-dimensional vector. This is going to bring us
to, let's see in this case, it'll be, I'll write kind of two
one negative three one, where what it gives us is two x plus negative three times y, and then, one x plus one times y. Right? This is a new
two-dimensional vector somewhere else in space, and even if you know how to compute it, there's still room for a
deeper geometric understanding of what it actually means
to take a vector x y to the vector two x plus negative three y and one x plus one y. There's also still a deeper understanding in what we mean when we call
this a linear transformation, a linear transformation. What I'm going to do is just show you what this particular
transformation looks like on the left here, where every single point on this blue grid, I'm
going to tell the computer, "Hey, if that point was x
y, I want you to take it to two x plus negative
three y, one x plus one y. Here's what it looks like. Let me just kind of play it out here. All of the points in space move, and you end up in some final state here. There are a couple
important things to note. First of all, all of the grid lines remain parallel and evenly spaced, and they're still lines. They didn't get curved in some way, and that's very, very special. That is the geometric
way that you can think about this term, this idea
of a linear transformation. I kind of like to think about
it that lines stay lines, and in particular the grid lines here, the ones that started off as kind of vertical and horizontal, they still remain parallel, and they still remain evenly spaced. The other thing to notice here is I have these two vectors highlighted: the green vector and the red vector. These are the ones that started off, if we kind of back things up, these are the ones that started off as the basis vectors, right? Let me kind of make a
little bit more room here. The green vector is one zero, one in the x-direction,
zero in the y-direction, and then that red vertical vector here, is zero one, zero one. If we notice where they land, under this transformation, when the matrix is multiplied by every single vector in space, the place where the green vector lands, the one that started off as one zero, has coordinates two one, and that corresponds very
directly with the fact that the first column of
our matrix is two one. Then, similarly, over
here, the second vector, the one that started off as zero one, ends up at the coordinates
negative three one, and that's what corresponds with the fact that the next column
is negative three one. It's actually relatively simple to see why that's going to be true. Here, I'll go ahead and
multiply this matrix that we had that was ... See now it's kind of easy to remember what the matrix is, right? I can just kind of read it off here as two one negative three one, but just to see why it's
actually taking the basis vectors to the columns like this, when you do the
multiplication by one zero, notice how it's going to take us to, so it's two times one, that'll be two, and then, negative three times zero, so that'll just be zero, and over here, it's one times one, so that's one, and then, one times zero, so again we're adding zero. The only terms that actually matter because of the zero down here, was everything in that first column. Similarly, if we take that same matrix, two one negative three one, and we multiply it by zero one over here, by the second basis vector, what you're going to get, is two times zero, so zero, plus that element in that second column, and then, one times zero, so another zero, plus one times one, plus that one. Again, it's kind of like
that zero knocks out all of the terms in other columns. Then, like I said, geometrically, the meaning of a linear transformation is that grid lines remain
parallel and evenly spaced. When you start to think
about it a little bit, if you can know where
the screen vector lands and where the spread vector lands, that's going to lock into place where the entire grid has to go. Let me show you what I mean
and how this corresponds with, maybe, a different
definition that you've heard for what linear transformation means. If we have some kind of function L, and it's going to take in a
vector and spit out a vector, it's said to be linear if
it satisfies the property that when you take a
constant times a vector, what it produces is
that same constant times whatever would have
happened if you applied that transformation to the
vector, not scaled, right, so here you're applying
that transformation to a scaled vector, and evidently, that's the same as scaling the
transformation of the vector. Similarly, second property of linearity is that if you add two vectors, it doesn't really matter if you add them before or after the transformation. If you take the sum of the vectors then apply the transformation, that's the same as first
applying the transformation to each one separately, and then adding up the results. One of the most important consequences of this formal definition of linearity, is that it means if you take your function and apply it to some vector x y, I can split up that vector as x times the first basis vector, x times one zero plus y, let's see y, times that
second basis vector, zero one, and because of these two
properties of linearity, if I can split it up like this, it doesn't matter if I
do the scaling and adding before the transformation, or if I do that scaling and adding after the transformation, and say that it's x times
whatever the transformed version of one zero is, and I'll show you
geometrically what this means in just a moment, but
I kind of want to get all the algebra on the screen, plus y times the transformed version of zero one, zero one. To be concrete, let's actually put in a value for x and y here, and try to think about that
specific vector geometrically. Maybe I'll put in something
like vector two one. If we look over on the grid, we're going to be focusing
on the point that's over here at two one, and this particular point. I'm going to play the transformation, and I want you to follow this
point to see where it lands, and it's going to end up over here. Okay, so, in terms of the old grid, right, the original one that we started with, it's now at the point one three. This is where we've ended up, but importantly, I want you
to notice how it's still two times that green vector
plus one times that red vector. It's satisfying that
property that it's still x times whatever the transformed version of that first basis vector is, plus y times the transformed version of that second basis vector. That's all just a little overview, and the upshot, the main thing I want you
to remember from all of this is when you have some kind of matrix, you can think of it as a
transformation of space that keeps grid lines
parallel and evenly spaced. That's a very special
kind of transformation. That is a very restrictive
property to have on a function from 2-D
points to other 2-D points. The convenient way to encode that, is that the landing spot
for that first basis vector, the one that started off
one unit to the right, is represented with the
first column of the matrix, and the landing spot for
the second basis vector, the one that was pointing one unit up, is encoded with that second column. If this feels totally unfamiliar, or you want to learn more about this, it's something that I've made
other videos on in the past, but in terms of understanding
the Jacobian matrix, where we're going with this, and kind of getting a
geometric feel for it, that short overview that I gave should be enough to get us going. With that, I will see you next video.