#linear-algebra
2 messages · Page 12 of 1
then think about what the map looks like
everything is fixed
so its the identity
the identity looks the same in every basis
as does any scaling map
what do you mean exactly by "fixed under the map." Kinda stuck on that part
f(x)=x
ohh i think i see what you mean
It may help to think in matrix terms if that version is less helpful. Scalar multiples of the identity are the only matrices which commute with all others
So if you conjugate a scalar multiple of the identity with some change of basis you'll get the same guy back
and if some matrix is conjugated to itself by every invertible matrix
then it commutes with every invertible matrix
But really try to understand the geometric picture the others are giving. If a map acts the same way on everyone it should have the same matrix representation in any basis
uh define conjugate?
PAP^{-1}
is what you get when you conjugate A by P
Its a natural action of the set of invertible nxn matrices on M_{nxn}
when the eigenvalues of a matrix are all 1, it seems like the matrix would always just be the identity.
if it has a basis of eigenvectors
Imagine a rotation about some axis in R^3
okay
The only vectors that get scaled at all are on the axis, and they are preserved, so the only eigenvalue is 1
But it's not the identity
thats just the only real eigenvalue tho.
Well, as a map R^3 -> R^3 you wouldn't think of it as having complex eigenvalues. The matrix is allowed to act on C^3 and then you can say well there are other eigenvalues.
But also there should be a complex example as well
So we want the char poly to be (t-1)^n so just give me any upper triangular matrix whose diagonal entries are all 1
Actually I dunno why I had to think of the char poly but polynomials are how I process all of linear algebra lmao
But yeah the only eigenvalue is 1 but it's not the identity
c o m p l e x i f i c a t i o n
For some reason I always try to make linear algebra problems into topology problems
Wait how?
let A be a torus shaped matrix....
Through continuity of functions like the determinant and the nth eigenvalue function
Weird
I mean I guess for certain problems it sorta is the correct way but also... idk somehow unless it screams itself as a topology problem that's not my instinct
When I learned the analytic proof of Cayley-Hamilton I was so upset lmao
I once tried to show that an open set of n dimensional vector space contains n linearly independent vectors using the fact that open sets are codimension 0 submanifolds and an n manifold cant be contained in a manifold of lower dimension
Or something like that
wait so im thinking about diagonalizing nxn triangular matrices with 1's on the diagonal, and it seems like the dimension of the eigenspace here would not be equal to n... 
Yeah, "1 is the only eigenvalue" doesn't mean n-dim eigenspace
It just means there are no other eigenvalues
There are two types of multiplicity for eigenvalues
Algebraic multiplicity and geometric multiplicity
i got that
algebraic = geometric for diagonalizabilityu
geometric <= algebraic always
Yup, so if 1 has geometric multiplicity n then trivially you're the diagonal, since ker(A-I) = k^n => A-I = 0
So the example I gave was one where 1 has algebraic multiplicity n, meaning no other eigenvalues could exist, but you're not the identity, so the geometric multiplicity has to be smaller
oh...
i think ive reached a better understanding than before. thank y'all for the help!
Multiplying these matrices togather should give one matrix that scales by 2 in x and y, rotates 45 deg, and translates 2 in the x direction and -2 in the y, right?
I tried applying that transformation to the square on the on the left, but it seems that the y value is off because it wasn't moved down, right?
reverse the multiplication order
i multiplied them in matlab. if i type matrixScale * matrixRotation * matrixTranslate * columnVector in matlab does it know that it needs to do the multiplication from left to right?
but couldn't changing the order change the resulting vector? are you always supposed to transformations in that order? sry i'm a little confused
i know i'm supposed to apply them in this order. sry i don't think i was clear enough
if i apply them in that order is the resulting square i got correct?
i'm just having trouble seeing why y value is not changed
like when i try to imagine the transformation in my head i see the square moving down, but i'm incorrect?
rotation and scaling commute, where you do the translation does matter
(assuming you rotate and scale around the same point)
what i'm saying is that you're applying the transformations in the wrong order
and i'm telling you the order in which you need to apply them to get what you want
ah i gotcha. thanks for the help
eigenspace is just the span of eigenvectors yea?
each eigenspace is the span of all the eigenvectors of eigenvalue n
n to denote an eigenvalue 
(or just the set of all of those, span is unnecessary)
I blanked out sry :P λ, n, whatever
all the same
so if i have to parametrize the eigenspace of a matrix A given the eigenvalue lamda = 2
i just remember i have to find the char polynomial and after that im stuck
you want to what?
find a basis for the eigenspace of A corresponding to the eigenvalue 2?
that eigenspace is just ker(A - 2I)
damnit, forgot that, was going about finding the characteristic polynomial, thanks man
charpoly will give you the rest of the eigenvalues
you don't really care about that here
one can arrive at a basis from a parameterization and vice versa
anyone know how i can show that A is diagonalizable?
depends on what A is 
Find the eigenbasis
eigenbasis is basically the eigenvectors from all the eigenvalues correct?
i just wanna refresh to find eigenvalues is it (A-(lambda)I)?
ok imma do that now
wait order doesn't matter?
det(M) = (-1)^n det(-M)
So Det(lambda I -A) = 0 iff Det(A-lambda I)= 0
yes
Because of what ann said
For consistencies sake we pick lambda I -A
But both are correct
Det(A-lambda I)= 0
so use that to find the eigenvalues first?
and then find the eigenvectors after and that'll give me my basis?
Yep
Assuming that it does in fact have a basis of eigenvectors
If you have 2 distinct eigenvalues your good though
yeah i got 2 and -1
now i do (A-2I)x=0 for the eigenvector for the first one correct?
do i gotta get the rref form of the matrix after i subtract?
Just write the vector as (a, b)^t
And see what the matrix does to it
Why would you need to get the rref form?
Ok
So
[-6 -6] (a). (-6a -6b) (0)
[3 3] (b) = (3a + 3b)= (0)
Solve for a and b
It's pretty easy
@slim pebble
Yes is (-1,1) correct?
Now just gotta find the eigenvector for the other eigenvalue and that’ll make my P?
Yep
Then you change the basis to be in terms of those eigenvectors
Which makes your transformation look like a diagonal matrix
so in order to prove that A is diagonalizable you just gotta find the D matrix?
For instance
the D matrix is just the matrix of eigenvalues
it is unique up to permutation of the eigenvalues
ie you can list the eigenvalues in whatever order you like
but there are no similar diagonal matrices that arent composed of those eigenvalues
ah ok i get what you're saying
you can show this is true by noticing that the roots of the characteristic polynomial are invariant under change of basis
Since $det(PAP^{-1} - \lambda I)= det(PAP^{-1}- P \lambda I P^{-1})=det(P(A-\lambda I )P^{-1})=$ $det(P)det(A-\lambda I )det(P^{-1})= det(A-\lambda I )$
Liquid:
where does 1 get sent? where does t get sent? where does t^2 get sent?
thats all the data that the matrix keeps track of
first off what is p(1)?
@slim pebble
p(1)?
you just plug 1 to the equation right?
do i plug it in the 3p(t)+tp(t)+t^2p(t) ?
wait how you get that?
its a constant polynomial
sorry i missed class when she was going over this
so T is a transformation which takes a polynomial p(t) to 3p(t)+tp(t)+t^2p(t)
so... p(t) is the 2-t-t^2?
no
oh it is
in problem a
but its just a polynomial in terms of t of degree <= 2
because the p(t) the highest degree is 2 right?
Liquid:
the space of real polynomials of degree <= 2
so what would t be?
yeah sure
yep
now write it in term of the basis
T(1) = 3(1) -1(t) +1 (t^2) +0(t^3) + 0 (t^4)
R^n -> R^m means a mxn matrix
no
the polynomial itself has degree 3; how can a polynomial of degree 3 have a root of multiplicity 4?
How did you get that?
^
And that is not true either, since two roots of multiplicity 3 give a total multiplicity of 6
And as Ann pointed out, the polynomial has degree 3
So the multiplicities must add up to 3

if you multiply a matrix with a contraction of a (rank4) tensor, how do you call that?
,rotate
correct me if i'm wrong, but couldn't you just use the standard basis matrices for R^(2x2)
woopy:
Compile Error! Click the
reaction for details. (You may edit your message)
like that would be e_1,1
That would work
@sand oak
A1 has the top left
A2 - A1 has the top right
A3 - A1 has the bottom right
none of them have the bottom left
You can span it with A1, A2, A3
Notably
A4 = A3 + A2 - A1
A5 = A4 - A1 = A3 + A2 - 2A1
They don't add anything to the span
literally none of these are orthogonal to each other... am i missing something?
these = what
there actually is one answer option in which the two vectors being added are orthogonal
d
@rare barn you could also have known it because in none of the other examples you have a vector in Span{u}
the set containing that vector alone would be a basis
ok i see what you're saying. thanks
does anyone know of a good youtube video or something that can help me with this?
i tried solving it by doing this:
3b1b has a linear algebra series
so basically the first column of the matrix corresponds to the first basis element in the source space
and the second column corresponds to the second basis element
so it looks correct
your doing rows instead of columns
yep
nice thanks a bunch 👌🏼
Quick question: Is it a Cross Product or a Dot Product that equals to |A||B| sin (theta)?
cross
Ok! Thanks
np
if you ever forget it again, you can figure that one out pretty directly if you understand the geometric meaning of both sine and ×
because A×B has magnitude of the area of the parallelogram spanned by A and B. If you see A as being the base, then the height is |B|sinθ
note also that A×B ≠ |A||B|sin(θ)
the lefthand side is a vector, the right is merely its magnitude
@warm sluice
what is this process called? is it a linear map or something?
i'm just trying to find out what i can search for on youtube to learn more about this.
or maybe someone can walk me through it?
the linear map is the thing described here, the matrix is a representation of it
as for how to do it, I recommend just watching the 3blue1brown series on linalg, it’ll teach you that and much more
episode 3 should explain your thing, but I recommend starting at the top
he explains it much better than I could, and imo I could explain it pretty well
its a linear transformation. map/transformation can kinda be used interchangeably i think. Usually a linear map is a mapping from one vector space to another, while a transformation maps a vector space onto the same vector space.
To say that e1 maps to -3e2 is to say $$T\left( \begin{pmatrix}1 \ 0 \end{pmatrix} \right) = \begin{pmatrix} 0 \ -3 \end{pmatrix}$$
and to say e2 maps to e1 - 2e2 is to say $$T\left(\begin{pmatrix}0 \ 1 \end{pmatrix}\right) = \begin{pmatrix}1 \ -2 \end{pmatrix}$$
kxrider:
so the matrix transformation needs to satisfy those two things
The only one that does that is $$\begin{pmatrix} 0 & 1 \ -3 & -2 \end{pmatrix}$$
kxrider:
alright seems to make sense
how the hell am i supposed to figure this out
simply solve a linear equation
set up the general form for the equation of a line
insert the values you have
solve for teh unknown
done
I assume you take classes that are supposed to teach you this
and that you take notes
this class is online, i've been teaching myself all the material :/
anyway, we’ll ignore that #prealg-and-algebra is prolly the better channel for this cause whatever, it’s linear :P
so, first of all, do you know the equation of a line
y = (something with x)
y=mx+b, i think?
ye
okay yeah
so, that’s the general form
now, you know the slope
do you know what the slope is?
apart from the bit where it clearly says -1/2
1/2 i forgot what was in the screenshot ack
that it’s m is the bit that matters :P
so now you have the equation y = -1/2 x + b
now, you do know one pair (x,y) which satisfies this equation
plug them in
yeah i was given that. but. it isnt the y intercept, which is what i believe b is supposed to be?
no, that would just be a special case
just plug in the values
well, the y intercept would be b
you have to find that now
you can’t plug in b, it’s the unknown
i think i only have to write the equation
but you do know what m*1 + b is
yes, for that you need to find b
so, what is m*1 + b (where m is -1/2, as already discussed)
wouldnt it just be -1/2 + B?
yes, but what does that equal?
i have no idea, to be honest with you lmao
at x = 1, what is the y-value of the line?
0?
what, no, that’s not what I meant
at the position where x is 1
you know what, sorry, but I give up. I can’t teach basic algebra
sweet. i'm sorry, this is just really hard for me, lol.
(I mean, I could. but I’d have to start at the beginning. with these things, starting somewhere in the middle is painful)
no its fine. im just going to cheat for this part lmao.
…that’s not fine
do you have any intention of ever taking any math classes ever again?
or ever using math in any way, shape or form
if so, you must understand this
these things are the foundation of everything to come
and you’ll struggle way more
... @hexed swift?
i don't have to take another math class.
i could learn this if I had more time, and I plan to come back and learn it, however today is the last day I have to finish work.
you will almost certainly have to take more math after this
well, i'll just grab a tutor next semester.
grab a tutor for this stuff, not for whatever you’re working on then
i have no time left, todays the last day of my semester
this is the only thing i've really not been able to figure out, is writing out the equation itself without the y-intercept given. the entire rest of this unit has been fine
you got a pair (x=1, y=3). plug that into the equation, then solve for b
right
For what it's worth this kinda thing should be in #prealg-and-algebra
yea we mentioned it but I decided to ignore it because i don’t like changing channels :P
I'd rather you change channels in the future
But you can continue on here if you've been discussing for a while
but then I have to unmute the channel
little confused with what to do here....
not sure how to find the distance just from the magnitudes, dont i need the original vectors
they form an orthogonal basis, so you know a lot about them
in particular you can rather easily compute projections
also remember the pythagorean theorem, I think you might need it
yea but dont i need the vector itself to find the orthogonal proj
wait, isit b?
nvm i got it
3u2-2u4
root181
really basic question, if P is a projection matrix and v,w vectors, is <v,Pw> <= <v,w>?
seems reasonable 
actually jk I don't think that's right
seems right to me but i havent written anything down for it
oh actually

(2, 1)
(-2, -1)
v = (1,-1)^T
w = (0,1)^T
let v and w be orthogonal
then
and P be any projection to a subspace that doesn't include v and w
yup
huh
oh well, time to prove this lemma in a different way I guess
whats the lemma, out of curiosity
i see~
the term happens to look like v^TPw
well, <v,Pw>
I don't really do math, I'm in stat/ML
being a mathematician sounds fun though
trying to find if this matrix has an eigenbasis. so basically my logic is to try to see if it has any eigenvalues because if not then there can't be an eigenbasis. if it does then i need to find the eigenvectors that make up a basis for R^3. is any of this correct or am i completely wrong?
YA IT DOES SEEM FUN
well
since its in R^3
it definitely has at least one eigenvalue
cuz its characteristic polynomial has odd degree
and odd degree polynomials cross the x axis at least once
but ya
thats the correct way to go
^^
is there any generalization of vector matrix multiplication to other operations?
I'm looking for some sort of formalization for $A\widehat{v}$ where $A : Mat$ and $\widehat{v} : \text{Vec of} \mathbb{R} \rightarrow \mathbb{R}$
Tyler (Aearnus):
Do you know what matrix multiplication is?
except it's not multiplication it's application
yes ofc
On mobile will explain what I want better in a sec
Are you asking for something along the lines of linear transformations? Because if that's the case, then there's quite a bit of generalizing we can do from there.
I want to be able to express the following:
For some vector $\widehat{v} = \begin{bmatrix} v_1 \ v_2 \ \vdots \ v_n \end{bmatrix}$, some matrix $A = \left[A_1 \hdots A_n \right]$, and some associative and noncommutative operation $\cdot$, I want to be able to express $A_1 \cdot v_1 + \hdots + A_n \cdot v_n$
is there an unamiguous way to do this without defining it myself? or is my best bet going to be explaining that in my writing
Tyler (Aearnus):
(edited to more accurately reflect what i'm doing)
Assuming $ A_{i}, 1 \leq i \leq n $ are all column vectors of $A$, it almost sounds like you're asking for a generalization of $A \vec v$ as some sort of span.
TiredPatzer:
At least, that's the way it reads at the moment. Just trying to help clarify things
I'm not considering the span of A or anything like that
Also, to be clear, I mention the span because when we have some matrix, $A$ multipying $\vec v$, we can express this multiplication as the span $v_{1} A_{1} + \dots + v_{n} A_{n} $
TiredPatzer:
ahh yeah I see what you meant. in that case yeah, I want a generalization of the span
though the elements of v are not necessarily constants
so it's the span of A if you're looking at a non-real (non-numeric?) space
Well, generally speaking, it's more like the span of the range of $A$, where $A$ is the matrix representation of some linear transformation, $T$
TiredPatzer:
i'm not 100% sure we're on the same page here
I suppose that's better worded as the span of the range of $T$, then. Sorry if that's a little vague - I'm being a bit non-rigorous.
TiredPatzer:
That's alright. I don't think I'm being clear myself. But I do think I know what you're referring to - in general, the elements of v don't have to be numeric. They just have to be the elements of some field (and therefore satisfy all of the requirements to be defined as such).
i'm in the middle of typing my thoughts up, but I want to do this because I'm modelling soft body physics using a vector of "nodes" and a matrix of distances
and i realized that calculating new positions/velocities for each of the nodes will be as easy as doing this sort of generalized sum across the columns of C
and I wanted a way to write that out correctly
Ok, I see. So, you're definitely describing some very specific things here. Firstly, your matrix C is symmetric with a main diagonal of 0s. What it also sounds like, to me, is these "nodes" are elements of this vector space.
yeah
I think the problem here is that the matrix and the node vectors are fundamentally in different vector spaces
so what I actually need to do is bring them into the same vector space, then it's possible that I could literally just do vector and matrix multiplication
without having to do fancy things with summing columns with supplied operators or w/e
Essentially yes - that's where you'll have to pick up on some stuff about linear transformations.
Because you can define matrices that function as linear transformations from one vector space to another
and said matrices (not the C one you mentioned), would be composed of some basis of the vector space that you want to bring the element you're acting on to
let me write up a little bit more and see if I can get further with this
I definitely need to formalize what a node is before I move any further
Sounds good!
thanks!
Yeah, that's a good start - right now the idea of the nodes is a little vague.
No problem!
this is what I have currently
i'm at the edge of my intuition, I have to break out the memo pad haha
@coral sage
Sounds a bit like you want to look into FEA analysis
I see what you're up to. I can look at what I know
I appreciate it!
it's nothing that serious, I couldn't shake this idea of using a matrix of connections & i needed to write it down
You're going to want to include the idea that each connection wants to retain its shape
also, I know for a fact using euler integration on $\pi$ and $\delta$ is going to make a really shitty simulation, but until I have an actual process for modifying $\alpha$ I won't mess with that
Tyler (Aearnus):
Euler integration?
I figure you can model each connection with a second order DE. If any connection deflects too far, it stays that way
was considering that
but i currently have a C in differential equations so that'd probably be a lil bit over my head
though it's worth a shot
Just not positive how the distribution of forces should be carried out
writing it out
you need to turn the matrix C into an "offset matrix"
which encodes what position each constraint ideally would want its respective node to move to
(that's the best way i've managed to formulate that idea and I've been sitting on it for 10 minutes now)
currently trying to work out a numerical example on paper, will send it when I figure it out
Sorry for the crappy handwriting
But this is what I'm looking at
Are these nodes in 2D or 3D?
Gotcha
node 0 is at position $0+i$, node 1 is at position $0.5+i$
Tyler (Aearnus):
sorry it was hard to read
Why (0 + i, 0, 0, 1)?
Arbitrary choice, just allowed me to calculate it all out easily
Position is 0+i, velocity is 0, acceleration is 0, mass is 1
Gotcha
Let T be a linear operator on a finite-dimensional real inner product space V. T is self-adjoint if and only if there exists an orthonormal basis for V consisting of eigenvectors of T.
My book goes on to say that this is used extensively in many areas of mathematics and statistics. Can someone elaborate on this more? Does this theorem have a name?
Its kinda a corollary of Schurs theorem, so maybe people refer to that instead?
spectral theorem, i think
that does sound like the spectral theorem, yea
The spectral theorem in the book is just a bunch of things that follows from normality or self-adjunct
So yeah that makes sense
Simple quick question for my understanding:
Do the vectors v1 = (1, 0, 1) and v2 = (0, 1, 0) span the whole R3?
Do I need the v3 = (0, 0, 1) or is it already in v1?
no, the span of (1, 0, 1) and (0, 1, 0) is not all of R^3, and no, (0, 0, 1) is not in their span
What third vector do I need then in order to span all of R^3?
Any other to v1 and v2 linearly independent vector I guess
Thank you a lot for your help, I really appreciate it 😃
So if I should compute a coordinate vector directly, how should I do that? I know how to compute a coordinate vector, but I don't understand the question for the same exercise where it says "Check by computing directly" or something similar. Any advice here? 😃
can u post an example of what ur talking about?
Sure just a second
This is what it says. I understand the a, b and c part of the exercise. The d part is a little weird for me
what does section 4.6 tell you to do?
The (12) equation?
yea
According to my linear algebra textbook, the second property of a sub space of R^n is that If x and y are in U, then x+y is also in U
Would that then mean that any subspace of R^n must have infinitely many vectors in it?
Ok
What if that’s not the case tho?
Assume there are vectors other than the zero vector
if we're talking of an R-vector space then sure
a 0D space is the zero vector. A 1D space is a line in R^n
the set of point that lie on a line are in the subspace
Because in tandem with the third property, it seems like every vector in R^n can be reached
And I thought subspaces were supposed to be a subset of R^n
Proper subset
well usually we are talking about proper subspaces.
span{(1,0,0)^T} is a proper subspace of R^3
Hmm
Does a subspace in R^3 represent what I intuitively think it does?
Aka, a region of space?
pretty much. For a subset of R^3 to be a subspace, it should either look like a point, a line, a plane, or a cuboid
thats just because when you take a point on a line, and add it to another point on a line, you get another point on the line, and similarly for the others
uh
a subspace of R3 cannot be a cuboid @slow scroll @flint flicker
the 3D subspace is just all of R3
and also, the subspace must always pass through the origin
I got (-2, 3, 0) + t(-1, 2, -1) for a
For b i got the determinant = 0 so R was at the meeting
For c I got x y z = 2 -5 -5
Which doesn't plug back in to (-2, 3, 0) + t(-1, 2, -1)
t = -4 works for x and y
but i got t = -5 for z
Is how I got (2 -5 -5)
Nvm I guess right answer is (2 -5 4) I did my matrix multiplication wrong
Ignore ^
how do steady state vectors in Markov chains relate to eigenvctors
• Howard Anton and Chris Rorres, Elementary Linear Algebra, 11th edition (2014), Wiley.
• Jim Hefferon, Linear Algebra, 3rd edition (2017).
• Friedberg, Insel, Spence, Linear Algebra, Prentice Hall (emphasis on theory).
• David C. Lay et al., Linear Algebra and its Applications, Pearson (emphasis on calculations).
• Steven Leon, Linear Algebra with Applications, Prentice Hall (emphasis on theory).
Out of all of these textbooks, which is most worth studying from?
ive never heard of any of those, but I've self studied about a semester worth so far from "Linear Algebra Done Wrong"
im given these 4 vertices, trying to find angle where diagonals intersect
i thought id use dot product but i dont see how dot product works here considering u is from (0,0) to (5,3) so its not tail to tail with v vector (2,3) to (3,0)
if you project u onto v, you will get the angle supplementary to theta
err i mean, if you use dot product u.v = |u||v|cos(pi - theta)
well whatever u work in a;sldfkjasf
im not sure whether the answer refers to vector u as the whole line (from 0 0 to 5 3) or if its from the intersection point to 5 3
doesn't matter, the angle is the same
huh i wouldve thought the angle supplementary to theta was the angle from the dot product, but your answer is saying otherwise 
well shit
if anyone else has an explanation itd help me
or ill go tmrw ask someone hopefully i hve time
Explain why each of the following is not an inner product on a given vector space:
im pretty sure none of these are positive definite, am i right?
the first two are definitely not positive definite
what polynomial gives you that the third is not?
any constant, i'm p sure
oh yea, thats tru.
ah, @half ice, I figured out how to construct that matrix from the other day
Does an eigenvector have to be a column vector?
Here the 0 which the matrix * the eigenvector is is assumed to be a column vector itself [0, 0, 0] vertically, but could 0 not be seen as a row vector, [0, 0, 0] horizontally?~~ And if 0 was taken as a row vector, wouldn't the eigenvector have to be a row vector as it would have to have n x 1 dimensions, so the the product matrix ([0, 0, 0] horizontally) could have m x 1 dimensions~~ Actually nevermind you couldn't multiply a 3 x 3 matrix with a 1 * n matrix, and that's what a row vector would have to be (not n * 1 dimensions)
Actually, I'm confused again. Your eigenvector has to be column vector if it's to the right of the matrix A, but if it's to the left then it can be a row vector since the dimensions would work. So why can't the eigenvector be to the left of the matrix when multiplying, which would mean the eigenvector would have to be a row vector rather than a column vector?
@wintry steppe
Still need it?
@half ice It? If by it you mean some help, yep
Or clarification rather than help per se
The eigenvectors are the null space of A - Iλ
They aren't usually just a column or row of the matrix
They are vectors that the transformation does not rotate
@half ice "They aren't usually just a column or row of the matrix" - which matrix are you talking about here? I mean the eigenvectors themselves are column vectors, like the one in the image I posted
"The eigenvectors are the null space of A - Iλ" - I don't understand what this means and at this point I'm too afraid to ask.
Nullspace → The null space of a matrix A are the vectors that A maps to 0. That is, Av = 0
In the example above, you're looking for the vectors that your bottom matrix maps to zero
ok I get that
This forces an equation:
4v1 - 2v2 - 2v3 = 0
makes sense
You can solve that for any one, so do this:
2v1 - v2 = v3
This gives you the general form of the nullspace. All of the vectors that are mapped to zero look like this:
[ v1 ]
[ v2 ]
[2v1 - v2]
For any v1, v2 you want
I get the solving part, the part I don't understand is you're mapping your matrix A to zero, with the understanding of zero being
[0]
[0]
[0]
Rather than [0, 0, 0]
Which you could do if your eigenvector preceded the matrix A (was on the left)
and was a row vector rather than column
Remember that, in order to multiply two matricies, the number of rows of the first must equal the number of columns of the second
For a matrix A
Av is a vertical vector
vA is a horizontal vector
Just to make sure that matrix multiplication thing is met
Do you mean that the product of the multiuplication is a vertical vector or horizontal vector?
Both v, and the product Av
It sounds like you;'re agreeing with me then
I always have this in my head when multiplying matricies. Let B be a column vector, it's clear why a product is then a column vector
Yeah I get that. My question is just would it be valid to have your eigenvector in the equation as vA=lambdax rather than Av=lambdax, so your eigenvector is a row and not column
vector
Also, another question, how do I find two orthonormal eigenvectors for a given eigenvalue if I've already found? https://math.stackexchange.com/questions/1383725/what-is-the-difference-between-orthogonal-and-orthonormal-in-terms-of-vectors-an seems to imply orthonormality is orthogonal+normalised, so should I just find two orthogonal vectors and then normalise them?
Sure! But it looks kinda dumb. We avoid row vectors whenever possible
You should get the same vector as a row with that process
Why avoid row vectors?
They're just not used in favor of column vectors
ok
Column vectors use space better, that much is clear
Is my method for finding two orthonormal eigenvectors the right idea?
If λ is of multiplicity 2, then the eigenvectors associated to it will describe a plane. It's possible to find an orthonormal basis to this
This is called the Graham-Schmidt process I believe
How do I know if lambda is of multiplicity 2?
How many eigenvectors it generates or how many rows reduce to zero when finding the eigenvectors
I think it only generates one eigenvector
Since I only found one when solving to find the eigenvector.
The example above has 2
The matrix I'm using is the one I posted ages ago
All of the vectors that are mapped to zero look like this:
[ v1 ]
[ v2 ]
[2v1 - v2]
This can be seperated like so:
[1] [0]
v1[0] + v2[1]
[2] [-1]
That's the one from Khan
Can't read it. Maybe try a snipping tool?
It's a symmetric matrix and has two eigenvalues, but I don't know if that helps in finding the miultiplicity of the specific eigenvalues
E2 = E3, that's an eigenvalue of multiplicity 2
Just to check, an eigenvector can't be populated with all zeroes can it?
nvm question answered https://math.stackexchange.com/questions/990016/can-the-zero-vector-be-an-eigenvector-for-a-matrix
perhaps they were given different definitions?

@oblique crag
Then do you know your definitions of one-to-one and onto?
@half ice i honestly have no idea 😅
I had same thought
Looked at it and was like that is the definition...?
Maybe examples?
@oblique crag a common definition for one-to-one is the following:
for any two v,u in the domain (which is R^n here), if T(v)=T(u), then v=u
which is a different setup than (a) but is equivalent.
as for onto, the usual definition is what's on there in (b)

ya got that but, wtf is this stupid book askin me to do LOL
should i just rewrite what they said 😂
can you find somewhere in the same chapter, these definitions? @oblique crag
I have an ebook and bad signal@rn but can try to load it
ok
If A is a zero matrix and b-> ≠0, then the normal equations for Ax-> =b-> have no solutions.
is this true?
(-> denotes vector)
Yeah, you can show that very easily
Or you can view your matrices as functions, in which case the zero matrix is the function which maps every point to 0
From which what you want to show immediately follows
There's some way to write:
[ 0.1 0.1] = [a 0] [cosθ -sinθ]
[-0.1 0.1] [0 b] [sinθ cosθ]
is that the matrix product?
Yus
is that the same as PCP^-1 ?
oh ok... also, when do you know to use the determinant or not for the (A-Lambda I)
Eigenvalues/Eigenvectors satisfy:
λv = Av
It follows that the eigenvalues satisfy
det|A - λI| = 0
That form is useful for finding λ
oh so the det λ is for the eigenvalues?
Yus, it's a form that makes them easy to find
Need to find a Basis of this vector space . I dunno how I transform this Matrix into line gradually form. Pls help
i don't see the vector space... what does the L mean?
it says I need to find the basis of this under vector space
are you translating this from another language
You can also speak funny German
this is true
original
Ich hab versucht , das Gleichungssystem mit gauß zu lösen. Da bekomm ich nach einer Umformung eine nuller Zeile
was ist L(…)?
so stehts im skript
denk das ist einfach nur die bezeichnung für den Unterrraun
m
I will ask university linz 😃
so, what system of equations did you try to solve? really all you have to do is find out a subset of those vectors which is linearly independent
(which will be either one or two of them, since you’re in a 2D space)
Could someone instruct me in this problem?
Let E denote n-by-n unit matrix, v be a n-by-1 vector, v' its transpose
is it true that det(E - v*v') = 1 - v'*v ?
@swift plinth you misunderstood the question, I think. you have four vectors, these define some subspace of ℝ², either a line or a plane. you now need to figure out what that subspace is, then write down a basis
you don’t need to solve any equations
just figure out which vectors are redundant
(that is, among those four vectors, some can be written as linear combinations of the others, kick them out until you’re down to the smallest possible)
ahhh now I got it !!! thanks Sascha!
I checked some random vectors and it seems to check out, don't know how to proceed with the determinant though
it's very easy to see this by using an eigenvalue argument
I noticed it has 1 as eigenvalue though, I definitely missed something
consider $vv^T$ as a linear operator on $K^n$. clearly, its rank is $1$ (since its image is the span of ${v}$), so it has $0$ as an eigenvalue with multiplicity $n-1$. its last eigenvalue is $v^Tv$, with $v$ as its corresponding eigenvector
Ann:
so then, $vv^T - E$ has exactly those eigenvalues but shifted down by 1. so they're $-1$ with multiplicity $n-1$ and $v^Tv-1$ with multiplicity 1
Ann:
and then $E - vv^T$ has exactly those eigenvalues but with the sign flipped
Ann:
so $\det(E - vv^T) = 1^{n-1} (1 - v^Tv)^1 = 1 - v^Tv$
Ann:
Thanks for the help. Is it inconvenient to directly manipulate the determinant in this case?
it would be incredibly inconvenient to try and do entry-manipulation
I tried to take the last term out of the determinant but it didn't word out. Thanks Ann.
o hek there is one linear algebra section
So, I'm stuck on 2 questions on my HW. I don't want the answers, but just the thought process behind it.
The first one asks
2.) Let V be the degree n or less polynomial over the reals. Show the linear transformation derivative is not diagonalizable by finding its eigenvalues and eigenvectors
Hmm
If you differentiate a polynomial with degree n, you get a polynomial with degree n-1
I have idea but idk if I'm right. I can't write to see if u make sense
So I know that the derivative knocks down the power by one, n-1
Yeahhh
And then I'm stuck from herr
Sorry irrelevant
^
That much I can figure out
So wouldn't that mean u couldn't diagonalize that shit?
Right
So make derivative transformation matrix, then show it has missing value
Then maybe do induction and show some shit
Like, base case, then inductive hypothesis, but idk. I'm just throwing shit out
I probably can pull off the induction part, but how would I do the derivative transformation matrix?
Hmm.. Idk. I'm thinking something with operators, but idk. Have u done operators in the class?
Maybe some. Sort of matrix multiplication to get the polynomial down 1 degree?
??
Hint : derivative of ax^n is nax^(n-1)
@wintry steppe try first degree polynomial first, maybe it will be easier to find the matrix further
The derivative of ax^1 is just a
I mean start with a_0 + a_1 x
Oh xD
Guess your problem mainly is finding the matrix then
Look in notes
Hmm maybe starting with 2nd order would make it more obvious
Was it talked about at all?
Some basic facts
T:P^n -> P^n
Basis vector - (1,x,x^2,...,x^n)
T(p)= p' = A•p
Take a general polynomial p, differentiate ita and solve for A ig
hECK yEA
Nice
I'll show it to you on Monday when I get the solutions
AAAAAH okayy
@wintry steppe @wintry steppe Can I ask a few questions on how to study linear algebra if you don't mind?
😂 I'm not a great person to ask about studying, but I can try
After Psycho is done with their questions of course
I study math in a horrible college
I got only two students in my class
And our teacher is plain horrible.
@elfin schooner I'm the wrong person on how to ask for studying linear algebra ROFL
damn two students
xd
eh but I still am not satisfied you know
I mean, being at such a small uni is gonna be hard period. No other students to work with
I've been studying alone, and most of the time, I have no idea if I'm doing it right or wrong
Less options for classes
I badly need a good mentor
less students = more time with teachers
Well how about reading the textbook linearly 
Like, it's gonna be hard. Ur best bet is a prof
Maybe a grad student if u have them
My batch is the first
Small classes usually means easier to ask questions
^
My teachers don't care usually
Or getting lost either
O
I've asked several questions, but they don't answer them
Wtf
Well, idk how to help then. Maybe find one who does
"I'll tell you tomorrow" they say, and the tomorrow never comes
@wintry steppe From where?
Like, linear, or any subject u do, a PhD can answer u
Did you want me to ask my other question
sure
Hmm I can relate the pain of not having a proper mentor
@wintry steppe you ask first, we talk later
How many math profs have u asked ur question to? Every single one? Like, a PhD in math can answer ur questions.
Best yeah, ask ur question yo
3.) Let v1, v2 be subspaces of a vector space V. Prove V= V1(+)V2 iff V=v1+v2 and v1 (intersection) v2 = {0}. Let T: V -> V be linear such that T^2=I. Prove V=V (+) Vt where Vt = { v is in V | Tv=v} and V = {v is in V | Tv = -v}
The formatting is a bit messed up since I am typing on my phone. I can also send the screenshot of the problem if needed

I mean I remember solving that problem
It was kinda satisfying
Lets hit V1(+)V2 implies V1+V2 and V1 cap V2={0} first
Okay
Since a direct sum HAS to be a sum, the first conclusion is satisfied
Comes from the definition
Yes, that's the easy part
Now let v belong to V1 cap V2
Since v belongs to V1, v can be expressed as linear combination of basis of V1
Let v=(sum) a_i • x_i a_i are elements of field and x_i are basis of V1
Since v belongs to V2, v can be expressed as linear combination of basis of v2
Let v=(sum) b_i • y_i where blah blah blah
Before I continue, I wanna know what your definition of a direct sum is
Let me check my notes on that
Okay
I'm meeting with prof rn. Sorry I cannot help, but wolf seems like a linear slayer anyways
😂 😂
So u donut me me
byee
Let V be a vector space and {v1, v2,..., vn} be a subspace of V. We say V is the direct sum of the vi's written (you direct sum the vi's from 1 to k). If v is in V, then there are vi in v1 such that V= v1+...+vk
Ummmm...I may have written a bit too much of my notes haha
I just now got that XD
I can present a good intuition for direct sum if ya wish
Note that I figured this out by myself so it might be wrong...idk
🤔 I mean, I will also work with my classmates on this last HW assignment tbh.
He does allow for that
I'm going to do this tonight, then do all of my remaining HW tomorrow.
But ty for the help!
Anytime
But
fammm
I'd really like it if you were to listen to my intuition to the definition of a direct sum
Okay
And share some opinion you might have
Here's a nice lil example
Let V=R2
You know that the subspaces of R2 are
-R2
-Straight lines passing the origin
-{0} duh
R2 and {0} won't help much in direct sums, so lets skip that
Let's just say the subspaces V1 and V2 are straight lines passing through the origin
such that V1=/=V2
Okay
Now the definition of direct sum says that If v is in V, then there are vi in v1 such that V= v1+...+vk
Yes
Now, you can like intuitively see that if you choose a point in line V1, and a point in line V2, you get another point in the plane
That vector law of addition
,w plot y=2x, y=3x
let 2x and 3x be the subspaces...for now
Okay
Now, you can like intuitively see that if you choose a point in line V1, and a point in line V2, you get another point in the plane
Does this make sense now?
The sum of subspaces spans the space
An easy case would be to take the subspaces x=0 and y=0 i guess
i have a much more easy approach for your direct sum thing tho
I'm all ears for wanting to learn the material.
so yeah take a vector v in V1 cap V2
V1 cap V2 is a subspace of V, so -v also belongs to V1 cap V2 (so it belongs to V2)
mmhmm
now we can write the zero vector in two different ways
0 = 0+0 = v + (-v)
0 belonging to V1 and V2, v belonging to V1, -v belonging to V2
OH
Just one more day of lin alg after today. I can get through it!
(i literally took my class notes, couldn't remember it on the top of my head)
gaaa
That's really neat fam
Meanwhile, my teacher skipped sums because why not?
heck 
Thanks for the proof!

OK I looked back at this and I'm not sure how to find orthonormal vectors here. Wolfram's eigenvectors for the a-b eigenvalue aren't orthogonal
v1 and v2 give a dot product of 1
Nvm got it, found another orthogonal eigenvector using the x1+x2+x3=0 condition
hi, how would I go about finding a basis for the orthogonal complement of W, which is the set of all vectors [x,y,x+y]?
Would I be correct in saying that If W is a subspace of Rn and y is in Rn then projwy is always the closest vector in W to Y
or would it not always be the closest such as the case with 0 vector
ProjW(Y) is the projection of a vector Y onto W.
Meaning it will always be the closest
Even if its the zero vector
as its a shadow
The length is different but its basically the same
Closest?
Closest vector in W to y
No. A projection doesn't take a subspace, it takes a vector
Right but in the book that I am reading
it says the following
So what Iam trying to get at
is this always the case
if W is a subspace of Rn and y is in Rn
is projwy always the closest vector in W to y
Or would there be vectors that break this logic
No, the projection operation takes two vectors and returns one.
This passage is stating that there always exists a specific vector in a subspace with those properties
read from y^
y-hat is unique in W, because of its protection properties
I'm not sure what it means by "closest"
Hmm. I suppose that is the distance for when y - y^ is minimum
by looking at the characteristic polynomial of the operator.
are you asking about geometric or algebraic? @robust swallow
Suppose $(t-1)(t+2)^2 (t-3)^4 = 0$ is the characteristic polynomial for a particular operator. Then the eigenvalues are $1, -2, 3$. 1 has multiplicity 1, -2 has multiplicity 2, 3 has multiplicity 4. This is algebraic multiplicty.
kxrider:
Suppose $\lambda$ is an eigenvalue for an operator $A$. Then $\dim(\text{Ker}(A - \lambda I) )$ is the geometric multiplicity of $\lambda$.
kxrider:
lets say you compute the kernel of A - lambda I and you get (1,0,0)a + (0,1,0)b for all scalars a, b as the kernel.
If you found the kernel using rref(A-lambda I), the vectors should form a basis for the kernel of A - lambda I.
So just count the number of vectors (1, 0, 0) and (0, 1, 0) thats two vectors, so the geometric multiplicity is 2.
👀
on part b, I said that $x$ can be written as a linear combination of the basis vectors. In other words, $$ (x, v_k) = \sum_{j=1}^n \alpha_j (v_j, v_k) = 0 $$. Not too sure what to do next tho xd
kxrider:
how did you do (a)?
when v = x, (x,x) = 0 which is true if and only if x=0.
hmm i have an idea
Alright got it. I said $$ x = \sum_{k=1}^n \alpha_k v_k.$$
Therefore, $$(x,x) = \left(x, \sum_{k=1}^n \alpha_k v_k \right) \ = \sum_{k=1}^n \bar{\alpha_k} (x, v_k).$$
$(x, v_k) = 0 \forall k$ which means the sum is zero, and $(x,x) = 0$.
kxrider:
well gotta be precise about things ya know
wait does your definition of inner product space involve it being over C
My book defines it for both. The problem here didn't specify but i assumed complex.
oh yea, took me too long to see, but if $(x, v_k) = (y, v_k) $ for all $k$, then
$(x-y, v_k) = 0$ for all k. Therefore $x-y=0 , \implies x=y$.
kxrider:
@robust swallow If you have an eigenvector, $\lambda$ for an operator, $A$, then the eigenspace is $\text{Ker}(A - \lambda I)$. Basically, its a space of eigenvectors.
kxrider:
it's the same as between a basis and a space...
@slow scroll λ is an eigenvalue, not an eigenvector
@robust swallow an eigenbasis is a basis for an eigenspace, evidently
an eigenvector is a (nonzero) element of the eigenspace
is there a problem you're doing rn?
@robust swallow
Vagorge:
OOF i called an eigenvalue an eigenvector 🤦 🤦
okay
so in that case it means there is a basis for all of K^n consisting of eigenvectors of A
of which there are thus n
well
n LI ones
so A is diagonalizable, and there is no discrepancy between alg and geo mults for any eigenvalue
algebraic multiplicity of lambda_1 is presumably the multiplicity of (lambda-lambda_1) in the characteristic polynomial
is the geometric multiplicity dim(Ker(M - lambda_1 I))?
indeed
and then M is diagonalizable if and only if algebraic multiplicity = geometric multiplicity for all eigenvalues?
yup
cool, nice coincidence that this was here when I looked
at school we have to horribly blackbox diagonalisation so I've been trying to understand it properly, think this is the last piece in the puzzle
all they do for it is like
M = U^-1 D U, where D is a diagonal matrix consisting of the eigenvalues of M, and U consists of some corresponding eigenvectors
and then M^n = U^-1 D^n U
just wondering Jean Valjean, are you french?
nope I'm british
rip
cause i recently found out about a french prof (on Youtube) explaining those concepts freaking well

is it in french?
it is
I'm not bad at understanding spoken french I guess so that would be cool to see
https://www.youtube.com/watch?v=jJmXnpjmk_Y&list=PLE8WtfrsTAin8EGRBTDZWpa_6RVO3o2Ab there's 3 videos, you could skip to the last one if you want ^_^ enjoy
Définition et exemples de ces notions d'éléments propres d'un endomorphisme linéaire. Histoire de bien savoir de quoi on parle avant d'attaquer les calculs ;-)


