#linear-algebra
2 messages · Page 239 of 1
According to my prof’s lecture videos, g(\alpha) = \beta(f) so I tried it out for arbitrary maps I denoted as \alpha, \beta, f, g, and the compositions don’t match up? Can someone please help clarify this for me?
The usual field structure on reals+the fact that every real uniquely corresponds to a complex number with 0 imaginary part should be used here.
ok thanks
If the zero vector spans a zero space which is 0 dimensional, can we somehow relate it to the field over which the vector space was defined?
The problem I'm trying to solve is to show that intersection of spans of orthonormal basis of R^3 is a point.
What I did is show that it's span(0), can I say that span(0) is just some point?
I see. Thanks. I'll think some more and see if I can figure something else out.
That phrasing to me seems off as the span of any orthonormal basis is R^3 so the intersection of any set of spans of orthonormal bases is R^3... So i assume its a convoluted way to say orthonormal bases are linearly independent, which is then part of the definition of basis anyway
I'm confused lol
I misphrased that. Imagine u,v,w are orthonormal basis. Then S is span of u and v, T is span of w, find intersection of S and T.
if x is in S cap T, then x = au + bv = cw for some scalars a, b, c. use linear independence to continue
This is what I did and got that a = b = c = 0, but I don't know how to interpret that.
I don't understand. Is the zero vector a point?
you have just shown that if x is in the intersection of S and T, then x must be the zero vector
It's the 0 vector
In coordinate spaces it's the origin, yes
Thanks
That makes sense
I thought the answer would be span(0) but that's just 0 anyway
Thank you all.
why is (AB)^T = B^T A^T?
they are the same thing, well, span(0) and {0}
work out some matrix multiplication and the answer pops out, unless you're asking for like "a deeper reason"
How does the inclusion of complex numbers and the function to satisfy being a differential equation change the methods for finding whether it’s closed under addition
what is the condition of a matrix to have real eigenvalues
a common condition (but NOT necessary) is that a matrix is symmetric, or more generally Hermitian
that it has real eigenvalues
What complex numbers?
C^2(I) is the space of all twice differentible functions on I
I think he's asking whether we can consider such a space as a complex vector space or not. And what does it change wrt viewing it as a real vector space.
I’m wondering if there’s any difference in how we deal with proving subspaces as opposed to real
Nope
No difference rly for any field
Same requirement regardless of the scalar field V is built on
Ok thanks
I still don’t understand this stuff especially well but I’ve got enough that I can bs the assignment due tonight lol (got a meeting with the prof later in the week where I can try for the understanding part)
I cannot see why it would be a zero matrix
Notice that the anti-symmetric matrix $A$ induces an anti-symmetric bilinear map on $V$ given by:
$$
\Omega : V \times V \rightarrow \mathbb{K}
$$
Given by $\Omega(u,v) = u^{t} A v$, where we identify a 1 × 1 matrix with a scalar in the underlying field $\mathbb{K}$.
\
\
But notice that for every anti-symmetric bilinear form $\Omega$ on a field $\mathbb{K}$ with $\text{char}(\mathbb{K}) \neq 2$ we have that $\forall b \in V$
$$
\Omega(b,b) = - \Omega(b,b) \implies 2 \Omega(b,b) = 0
$$
And since $\text{char}(\mathbb{K}) \neq 2$, we have that $\Omega(b,b) = 0$ and via de identification, we have that $b^{t} A b \in \mathcal{O}_{1 ×1}$ is the zero matrix.
Your language is abstract to me. I’m a freshman
MisterSystem
Are you familiar with bilinear maps?
No. Just year1 student
Ok, then we will have to compute things explicitly lol
Notice the following
Since $A = - A^{t}$, we have that $\forall b \in V$ a vector in a finite dimensional vector space (over the reals if you feel more comfortable) we have that:
$$
b^{t} A b = b^{t}(-A)^{t}b = - b^{t} A^{t} b = -(b^{t}Ab)^{t}
$$
But since $b^{t} A b \in \mathcal{O}{1 \times 1}$ is a $1 \times 1$ matrix, it is trivially symmetric, i.e $(b^{t} A b)^{t} = b^{t} A b$.
So
$$
b^{t} A b = - b^{t} A b \implies 2 b^{t} A b = 0 \implies b^{t} A b = 0
$$
So $b^{t} A b \in \mathcal{O}{1 \times 1}$ is the zero matrix ; $\square$
MisterSystem
@glad acorn Is this easier to grasp?
This is basically the same argument btw
I just didn't mention anything about fields other than the reals
Yeah so why don’t you just answer me in this simple language
Because the argument is more general
Thx anyway
@winter harbor Are you familiar w/ matrices?
No, I am not
I have no idea how to prove this type of question. Do I need to show that all 3 cases would arrive the same conclusion?
That AB-BA is anti-symmetric
should be able to directly substitute
along with the definitions of symmetric and antisymmetric, another handy property is that, for any two matrices C and D, (CD)^T = D^T C^T
so take [A,B]^T and see what happens
Case 1: AB are all symmetric case2:AB are all anti-symmetric Case3: one of them is symmetric and another is anti-symmetric
I see 3cases here
I'm very desperate...
Is there an expansion for the transpose (AB-BA)?
i gave you one for the product. for the sum, the transpose of a sum is the sum of the transposes
(AB-BA)T=BTAT-ATBT
mhm
now consider all the cases
there's 4 btw
both sym, both antisym, one sym and one antisym, and backwards
Very frustrated.
I’m unsure how to solve this can anyone help me?
9b: Having trouble thinking about how to express this. Doing row reduction along the first column, new a_i1 would be equal to old a_i1-l_i1*a_11, right?
CreamyBoy
that makes sense if I were expressing this in a computer function, but how do I express this for a linear algebra question?
sorry if this is really easy but does anyone know why this system has no basis and a dimension of 0?
i thought you just augment all the equations as rows in a matrix and then see the the dependance relations
looks good
can you post the whole thing
u and v are just vectors
yeah idk wtf is going on lmao
let me check the answer in the back
2 root 966
dont know what they could possibly mean though
-norm(u) * v, then take the norm of that vector?
my professor lol
oh wait lmao that makes sense
im just doing the problems he assigned bc we have an exam tomorrow
check dimensions
norm(u) is a constant scalar, so whatever, then times v, now a vector, which you can take norm of
$$|(-|u|)v|$$
TTerra
i see it now, thanks
is the 0 vector considered to be orthonormal
it wouldnt be since it doesnt have any length
0 vector is orthogonal to all vectors, but isnt orthonormal since the norm isnt 1
what i figured, thank you
d
confused on what this question means by "z is closed" does that mean z=0?
yup it was i figured it out nevermind
can somebody point me a direction to read about how to do this? elimination by multiplying matrices? this is the first time my book brought it up and I can't find any information about it. googling just has resources on row reduction/manipulation.
it isn't covered by this chapter it seems and I'm suddenly getting questions like this which I don't know how to approach in the slightest...
guys does det(B^n) equivalent to (det(B))^n
does det(AB) = det(A) det(B) ?
what you should do now is remember what the matrix representation of a system of equations really means
and also how to read the rank of a RREF'd matrix
both of which are things which should not be foreign to you
BA=AB where A B are two square matrices
Does A exist if and only if B has an inverse?
Is this the only exceptional case?
no
that's some overcomplication if i ever saw any...
what are you trying to do rn?
there exist non-invertible matrices B which commute with something
Ok
in fact, for any matrix B there exists a different matrix that commutes with B
(that every matrix commutes with itself ought to be somewhat obvious)
I don’t get it
so what you're saying is, to you these matrices are nothing more but grids of numbers with arcane, ritualistic rules on how to handle them.
Can I construct a matrix C-C^t, that the inverse of this matrix exists?
C is an n size square matrix larger than 2
do you mean you want to construct a matrix C such that C - C^t is invertible?
Yes
and what do you think?
Seems it’s impossible
and what makes you say that?
Diagonal entries all become zero
so what?
for even n, can't you always construct a matrix that swaps the rows and shifts the sign of a few of them?
you can have a matrix be invertible despite a zero diagonal.
that's just the easiest example that came to mind, an antidiagonal mat
well, C - C^T antidiagonal
i think we might run into trouble if n is odd.
but phymathdoublemajor didn't specify if we needed an example for every value of n or if just one is enough.
oh, sorry, were we not done with the previous question from your linear algebra homework
but if you insist: you can just take 2B if B isn't 0, and anything you want if B is 0.
Yeah?

I’m not getting itt
of course you aren't getting it! you will never get anything if you view matrices from such a standpoint!
Then elaborate more naaa
do you know how to translate between systems of equations and matrices?
if you do, then you should know that every row corresponds to an equation an every column to an unknown - except the last column, which holds the right-hand sides of your equations.
if you don't know even this basic fact then how can you expect to do anything with systems of equations via matrices?
did your teacher explain nothing to you?
Like position?
it's the number of linearly independent cols
Well yes she barely taught anything
the rank of a matrix can be defined in many different but equivalent ways. in your case, it's the number of pivots in the (R)REF of your matrix
seems ok...
Ok thank you
a janky way is to simply multiply both sides by (I-T)
yeah thats what i'm doing rn actually
and show that both sides yield the identity mat
just playing around
that's not janky at all lol
just got I = 1 
i mean, one can associate it to some system x = x_0 + Tx and let y = x - x_0 and y = Tx (like a flow diagram with a loop)
does not seem alright
and then you get the recursive relationship that directly produces the series
instead of starting already with the series
but yeah, if you multiply (I-T) from the left and from the right and show you get I both ways, you're done
it isn't because the zero product property isn't true for matrices
What’s the difference between a vector space and a field?
vector space is kind of like 2 sets merged together and a field is just 1 set
w/ vector spaces you have your set of vectors and your scalar field, and the 2 operations + and *, whereas the field itself would just be.. the field with + and * b/w things in the field
What does “vector field over itself” mean?
what happened in the 3rd line of the equality
@strange delta dot product properties. (x2 + 3x3) * (y1) + (2x1) * (y2)
and then y_1 x_2 + y_1 3x_3 + 2x_1 y_2
Probably the fact any scalar field K is a K-vector space
hello, i would like to ask how to solve this? i already found the intersection of the lines, and then what do i do next?
3 noncollinear points define a plane
it partially depends on how you want to represent the plane equation too, but I'd just pick one point on either line to be my other 2 points
then make a formula that looks like those lines, but with two parameters like, A+sB+tC
find the normal direction of the plane first
ah i see, thank you
In every linear algebra resource I can find, we compute eigenvalues/eigenvectors for an operator by first converting it to a matrix, and then getting the characteristic equation by taking the determinant of eigenvalue * identity - matrix. Usually, we then compute the determinant with cofactor, which is horribly inefficient, we’re running in O(n!) time. Is there a better way? Or I’ll start with, is there another way to compute the characteristic equation/eigenvalues without the determinant? I’m looking for any way to speed up computing eigenvalues/eigenvectors of matrices by hand, particularly for 3x3 and 4x4 matrices, but I’d be happy to hear about higher dimensions as well. Further, if anyone has any resources they recommend to consult to learn more about efficient ways to compute eigenvalues/eigenvectors by hand I’d love to hear it.
That's a nice question
Indeed there are way more efficient algorithms to compute the determinant
In fact
The most basic one I can think right of the bat
Would be Gaussian Elimination
You can use gaussian elimination to compute determinants and it is about O(n^3) irrc
Gaussian elimination is very nice for just a matrix of numbers. But unfortunately for the symbolic determinant with the eigenvalues it gets much crazier much quicker with all the multiplication and division by expressions involving lambda, and it seems I can get the answer quicker by just writing down the answer for a 3x3 determinant that I have memorized.
And yes, you can indeed define eigenvalues and eigenvalues without making any mention of the determinant at all. Axler "Linear Algebra done Right" famously does this.
But like, you define things intrinsically
Axler does indeed, I love his book, but he doesn’t provide much in the way of computations sadly
Yeah
That's what I was about to say
He defines things intrinsically
So they are theoretically very nice
But computationally unfeasible
I really like the approach he takes to determinants and trace, but the problem left behind is, what other systematic way can we have to compute the eigenvalues?
all the examples he provides are extremely nice, but it just won’t work for a general case
I think in nice cases like hermitian/symmetric or normal operators.
And working over C
We can find eigenvalues by looking at a system of polynomial equations
Namely
Technically with this method, we only need to 0 out n(n-1)/2 entries, and then multiply together n components, but the problem is these entries get really crazy easily, and for a human like me with poor working memory that slows my processing and computing down, maybe I just need to practice or something
At least if you know something about matrix beforehand
Like
true
We have that
$$
\det(A) = \prod\limits_{i=1} \lambda_{i}
$$
and
$$
\text{tr}(A) = \sum\limits_{i=1}^{n} \lambda_{i}
$$
Where $A \mathcal{M}{n}(\mathbb{C})$ is a normal operator and $\lambda{1}, \cdots, \lambda_{n}$ are its eigenvalues.
MisterSystem
In some easy cases we can prolly compute explicitly calculate the determinant and the trace of A
And we can put this information into a system of equations
yeah for 3x3 that can be done in under a minute
And with some maybe other information we can completely specify all the eigenvalues of A by solving this system of polynomial equations on lambda_1, ..., lambda_n
This works nicely for 2×2, but computing 2 × 2 determinants is already so simple that it is kind of boring
Maybe with some more information we can track the 3×3 case too
2x2 already got the answer memorized in closed form for both eigenvalues lol

it takes a nice form in terms of the determinant and trace
Anyways, I think I should know a bit more of these computational aspects.
iirc it’s (trace +- sqrt(trace^2 - 4 determinant) )/2
and this could further be simplified by bringing in the 2 and viewing trace/2 as the mean of the eigenvalues, and just leave the determinant
I wish we could use that formula to get 2 of the eigenvalues for any matrix and then just guess the rest lol
would make life so much easier
update: since trace and determinant are easy to compute, I just need to memorize the coefficient on the linear term in 3 dimensions to compute that and I’ll have the characteristic equation quickly
Tim O'Brien
I wonder if $Tr(kA)=kTr(A)$
Tim O'Brien
Makes sense right?
it is
why dont you try proving it
Yeah I should do that
Does Trace even have applications?
It seems really useless at least to me
it's equal to the sum of the singular values
you also use it in the definition of the inner product of two matrices
and in multilinear algebra, it's generalized to "contractions"
Interesting
Also on a side note
My teach was talking about invertible linear transformatoins
And he said the mapping has to be one-to-one (which makes sense)
and I also asked him if it had to be onto with the range is equal to the codomain
but he said not all onto mappings have [set of range] = [set of codomain]
Trace is also used in char polynomial
That goes against surjectivity no?
That's wrong yeah, unless I'm smooth braining
Surj is that the image is the output space identically
range = image bruh
am I wrong?
idk what the usual terminology is
Psuedo invertible 
i avoid "range"
why? I
Bruh Penrose... I forget all of that
Or whatever the other term for pseudoinversess are
yeah, moore penrose pseudo inverse
Ye that bitch
Functions are cool
I can't wait to learn about non-linear transofmrations
That shit must be mind-beindgin
bending*
You've already learned a bunch of R to R non linear functions
I think that some people take the codomain as the "range" because we don't really care about the rest of the y-axis when we're doing functions in high school
it's kinda like giving visual intuition to matrix multiplication for high schoolers
it's great to get an idea of what's going on, but it can be overwhelming
Yeah ik HS you kinda get the idea of functions map from domain to range, but in reality... no
😌
for this set of vectors is it linear dependent or independent? I'm not sure since theres a dot product which is just a number
im gonna assume that's meant to be a comma.
anyone know how to do that last part?
i have the matrix to change from B to C
i think im overthinking it lol
would these notes be an error then?
they put the c vectors on the left and b vectors on the right side of matrix
then call it B to C
Nope cause P(B->C) is made of the b vectors written in C
so it takes vectors in B and gives vectors in C (in being wrt that basis)
ooo
is that a contradiction with this?
im 
it looks like in the first picture its c written in terms of b and thats B-->C where as in the bottom pic i just sent its b written in terms of c and thats B --> C
ah ok
in the question i linked, its asking for the B-coordinate vector for -1+2t
it doesnt specify that it starts at C?
you can easily write -1+2t wrt C
since C is the canonical basis
so you need to "translate" a vector in C to a vector in B

😅
oh i think i see waht ur saying
so i found B-->C, i just transpose that matrix and multiply it by the [-1, 2, 0] ?
$-1+2t=[-1,2,0]_C$
Mosh
No, you invert the matrix
OH
INVERT NOT TRANSPOSE
thats what i messed up
thanks for the help though i appreciate it a lot
Hi :3
This is the prompt for a homework assignment
if I remember correctly an operator is a linear map of the form
$T: \mathbb{R}^n\rightarrow \mathbb{R}^n$
Tim O'Brien
yes, linear operators act on the vector space itself
$T:V\to V$
Mosh
I haven't learned about vector spaces yet, but looking forward to it :3
it's asking which equation is true
when it says they both diagonalize to the same matrix is that the same as being similar to the diagonal matrix?
yes
Okay so if we call this matrix X there exists invertible matrices P,Q such that PAP^-1 = X and QBQ^-1 = X?
is that what the question is asking
the question is to show that, knowing the above information, show that A and B are similar
so you have PAP^-1 = QBQ^-1
how can you get RAR^-1 = B for some invertible matrix R?
I don't understand the generalized form in step k
and this part too in the following slide
how do you show/prove (AB)^T = B^T A^T ?
you can express the matrix multiplication element by element using sums
just manipulate those sums
@little scarab i remember you asking the same question but 2 days ago in this very channel. you even got a response, but evidently you decided to ignore it, not even asking for clarification.
large oof
yes, apologies; I think I didn't see the response until much later and it wouldn't make sense to reply to it now
well in any case, the response was repeated by edd just now
proving (AB)^T = B^T A^T really is naught but a matter of writing out the relevant matrix multiplications
i think i see what ed's referring to but not how to translate it into actual maths. i guess it's better to read over my textbook and see if i can't try to develop the idea myself first before asking for another hint
if you know the definition of matrix product and transpose it really is not hard to write out
For P to be non singular the det(P) must be non zero but how do I prove that it is greater than 0
you don't need to
even if det(P) is negative, det(P'P) will be (det(P))^2 and hence positive
Oh wow okay lol that helps a lot thank you so much
If I had to give a reason for det(P'P) = det(P)^2 ,, would the following be sufficient : P is a non singular matrix meaning P is a square matrix therefore det(P) = det(P') ?
det(P) = det(P') has nothing to do with P being nonsingular
we're talking about square matrices all throughout anyway
Thanks 👍
is there a term to describe the identity matrix but where the diagonal of 1s goes from bottom left to top right?
row exchange matrix?
would it be considered the transposed identity matrix? would that make sense since, afaik, the identity matrix is equal to the transpose of itself?
oh, i should add
it's column exchange if the mat goes on the right
so permutation mat is better
@midnight trout
I think it goes by the specific name 'Exchange matrix' and is denoted by a J
yes this is why I was asking because I found it interesting that it changes from row to column depending on where you put it
that sounds correct but I have no idea
exchange matrix or permutation matrix sound like completely reasonable names
I spent 3 hours today trying to understand what 'elimination matrix' is because my book doesn't call them what every other source calls them 'elementary matrix'
exchange mat is more specific
lol
well it is probably better to think of it as a permutation matrix unless you have some specific reason not to
i think elementary matrices need not have all 1s as their nonzero elements
also nice, you're a mod again
when you google 'elimination matrix' all you get is tutorials on how to do row reduction
and you're back to honorable :x
haha I left the server for a few months I guess to focus on other things
yes the row of an elementary matrix is 1s. then one element is a non zero
which is so simple but my book had to be special and unique
your book sounds more correct
since you don't want the elements to be all 1s when you do elementary operations
the whole second half of the chapter was about constructing elementary matrices
constructing and combining them, just they called them something different
the name doesn't really matter as long as you understand what they do, anyway
but yeah
exchange or permutation mat
the name matters insofar as I can google it lol
the worst part about getting stuck on something like that is that it makes me sleepy. so I had a second wind starting at like 10 pm. now it's 2 am
ah, think I got it! thanks guys :)
can somebody explain how the x ~ y implies [x] = [y]
i underlined what im referring too in red
like, why is it that if two elements are equivalent, then they belong to the same equivalence class
Heya, quick question the Pauli matrices; so I have been trying to derive the Pauli matrices, and have found some information relating to how they behave as Spinors (which I don't fully understand either, as objects, other than the fact that they require two rotations to reach the same place again), and something relating to quaternion rotation? How does one derive these from these bits of information?
just to confirm, if I have a square matrix which has a left inverse then it must also have the right inverse (and vice versa), and thus is invertible, right?
sounds right off the top of my head
something like
we consider square mat A with right inverse B, so that AB = I
and then the left inverse C, so that CA = I
take the latter and multiply both sides by B, getting CAB = B
we can associate so that C(AB) = B, and AB = I, so C(I) = B
I have a question
so
a complex 2D vector is a 4D object right?
like you need to be able to visualize 4 dimensions in order to visualize a vector space over C^2 right?
got it, thanks
wait wdym by "from some viewpoints"? can you elaborate?
your terminology is a little off
with the "vector space over C^2" thing to be specific
C^2 has dimension 4 as a real vector space, but 2 as a complex vector space
no
"complex vector space" is short for "vector space over C"
C^2 is the vector space
oh right i forgot
Hey guys, I don't know how to get the following matrix from this equation
k1 and k2 and n are 3x1 vectors
I is a 3x3 identity matrix
are n and k vectors of real numbers?
yes
aight
one thing is that the dot product of vectors of reals can be written as x^T y
and since the vectors are of reals, the order doesn't matter
i.e. x^T y = y^T x
so we can write k_1 dot n as n^T k_1
you'll agree that n^T k_1 is a scalar, and so we can move it to the right
I know it has something with this
we get that k_2 = k_1 - 2 n (n^T k_1)
that's literally the same as i wrote, yes
now, the product of matrices is associative
so just associate from the left instead of from the right
i understand up to thois point
k_2 = k_1 - 2 n (n^T k_1) -> k_2 = k_1 - 2 (n n^T) k_1
factor out the k_1, and you get the identity you wrote
OMG IT GET IT
thanks so much
wow, that was so easy!
thats really beautful actually
thanks 😄
aight coo
the geometric interpretation is nice as well
orthogonal projection onto the orthogonal complement of the normal
... kinda, except for that factor of 2
thanks! Out of curiosity, what would happen if k1,k2, or n were not real numbers? Wouldn't the proof be the same?
just wouldn't the matrix be complex?
there would be some extra complex conjugates here and there
you can't just swap the order of the dot product
the dot product in C^n is x^H y, where H is the Hermitian transpose or complex conjugate transpose
you transpose the vector and complex conj all the entries
i'm also an engjneer
must've learned it at some point near the end of undergrad or early masters
Wouldn't defining a vector space over a ring be the exact same as defining it over a field?
a module over a ring is more general
I've heard of "modules" are they just vector spaces over a ring?
Aesthetically the definition looks the same, a module over a commutative ring would be just an abelian groups (M,+) endowed with a monoid action (R,*) of the multiplicative monoid of a commutative ring. Which satisfy distributivity properties a*(u+v) = a*u + a* v and (a+b)*u = a*u + b* u.
The definition is very similar
We just change ring to Field
And monoid action to group action
And we get vector spaces
is an abelian group a group where the binary operation of the group is commutative?
I know next to nothing about abstract algebra 😅
and I've never heard of a "monoid action"
Yup
That's correct
Have you heard about group actions before?
monoid actions are like, group actions except monoids
I think so
It's the same thing basically
is a monoid action more general?
yes
I just tried to like, make the definition of a module over a ring as compact as possible, because I am lazy and don't want to write down like 10 axioms.
So it seems really abstract, but it is not.
lol it's okay
So like, aesthetically the definition looks the same
But when we are working with rings
Say commutative rings
We lose a lot of properties
For instance, not every module has a basis.
Those that do are called free modules.
oh wow
Yeah
damn this is all super interesting, what's a good "intro to abstract algebra" book that talks about modules?
Dummit and Foote talks a bit about them
is that a good book for people like me who don't know much? or is it too dense?
Nope
In fact
I think most people find Dummit and Foote a bit slow
At least the ones I have talked here in this server
There's also Artin
Which is like
Really good
It's my favorite abstract algebra book
"nope" as in it's not dense?
ah I see
Yeah
lol I'll also check that out then
thanks!
Np
I'm pretty sure they mean -2(row1) + row2 by "add -2 times row 1 to row 2"
it's just the basic row operations
there is nothing to explain, just do what you're told.
Got it thanks
Yes my friend got it now it’s hers not mine
we have linear transformations in linear algebra right? so are "non-linear transformations" just vector functions?
perhaps
well not every vector function I guess but they can be represented using vector functions but never using matricies
if we have $PAP^{-1}= QBQ^{-1}$
can we do $Q^{-1}PAP^{-1}Q = Q^{-1}QBQ^{-1}Q = B$?
clement
there was a note talking about how a and b can have different eigenvalues but am i supposed to use that somewhere?
yea
but can i take my R = Q^-1P? I read somewhere that matrix multiplication is not commutative so we would have R^-1 = QP^-1, but here we had written Q^-1PAP^-1Q = B
hello quick question, it asked me is R^2 a vector space
R is all real number but whats the two
R x R
and that means...?
all couples (a,b) where a and b are real numbers
R^-1 = P^-1Q
dont we distribute the ^-1 inside? Since R = Q^-1P then R^-1 = QP^-1
and maintain order of the multiplication
no you swap order
oh im having trouble understanding as to why that is
Nvm I think I can see
$RR^{-1} = Q^{-1}PP^{-1}Q = Q^{-1}IQ = I*I = I?$
clement
for this are we supposed to solve for det(M - lambdaI) = 0 to show its diagonalizable over C by showing distinct eigenvector
solving using quadratic formulae?
Yeah, the characteristic polynomial is:
$$
\lambda^{2} + (-2 \cos \theta)\lambda + 1
$$
MisterSystem
And to show it is diagonalizable we must show this polynomial has distinct roots
yo can someone help me with this, "Give an example of a 3x4 matrix A and a vector x when Ax is not defined. Explain."
let x = (1)
If I have an injective linear map from R^n -> R^m with m >= n, why is it true that there is a suitable choice of basis s.t the matrix is (1_n | 0)?
those are meant to be blocks one on top of the other but I can't format it properly in disc
I know by rank nullity that injectivity means rank = n
so I have n linearly independent rows/cols
so is the idea to choose those as my basis?
Let T be your map. Let {e_i} be the standard basis on R^n. Then {T(e_i)} is a linearly independent set in R^m. If you extend it to a basis of R^m, that basis works.
@thin hazel
If A^2 = I, is A = I?
No
@marble lance perfect, im really rusty on my linear algebra so ill have a think about this. Thank you!
@marble lance why
the pauli matrices are a good example
I mean I as in the Identity matrix
So could you give me a full example
Oh I see, thank you
if matrices AB = I, then AB = BA right?
correct
false
uhm
Since y is missing, how do I go about this
I'm assuming I cant just assume y is a static 0
y would be any real right?
yea
if your matrices are square
pick A=[1,0] and B=[1,0]^T, then AB=I but BA is not
could I say that this is equal to 4x -z + y -y = 0
not true, I just gave an example
meaning to say that the change in y doesnt affect x or z
I thought I is always square?
otherwise its false but not necessarily nonsense
I is always square, but A or B may not be.
ah right
if A and B are square, then yes, AB = I implies BA = I = AB
left-inverses of square matrices are right-inverses
(this follows from linear injections being surjections)
to make a geometrical picture you can think of taking something in 2D space, putting it into 3D space, then projecting it back into 2D space, and you've done nothing
but if you take something in 3D space and project it into 2D, then you've lost information and so putting it back into 3D space you no longer have the identity
rref is when each row has a leading one, and the entries above and below each leading one are zero
Row echelon form has each row starts with a number, and has zeros as entries underneath
It has be 2
the second row is filled out correctly.
Rest r wrong?
wait why is 3 not ref?
Yes that too
The leading coefficient (also called the pivot) of a nonzero row is always strictly to the right of the leading coefficient of the row above it.
It’s neither
that one (#3) is neither, yes
yea it would be rref if a_14 = 0 though
Ohh
Yes
You are wrong for #1
Convert that to an augmented matrix and put it into rref
and see what the solution is
I got no solution
Youa re wrong for #2
What’s its
Well put it into rref
and you will see what the right answer is
You are correct for #3 gj
That should make sense, two planes that intersect intersect at a line
and there are infinite points on that line that could be a possible solution
you are wrong for #4
Infinity ?
Unique?
and you are correct for #5
that's what you said it's wrong\
No sotluton
yes
no bro
Wait
you are just guessing at this point trying to get the right answer
It’s unique
No
Why not
if you are talking about this one
I don’t get it
Yes this
I think one sec
wait wait
my bad x_3 is a free variable
x_4= -1
but yeah still infinity
can anyone give me an example of how linear algebra is used in machine learning?
PCA is legit just LA
hmm i can see that, but lets say i have a dataset with house sale prices, location and size in square feet, and i want to predict future house prices. I can see why probability and statistics is used but why is linear algebra used? Is is just because python handles data through matrices?
multivar probability rely on LA as basis
often times like regression you can derive stuff like max likelihood estimation as a nice linear alg expression
data tends to have a structure that is well captured via linear subspaces
this is related to pca, as someone mentioned above
l9w dimensionality structure
also tge multivar calc you need for optimization inevitably relies 9n vectors
pardon the typos o still have one eye closed
n9 w9rries
if i have a set of 4-tuples, if i show it is a basis for R^4, does that also show that its a basis for R^3?
no
you could take a set of 3 linearly independent 4-tuples, which would be a basis for a subspace of R^4 with dimension 3
the question i have to answer gives me four 4-tuples, asks me to show that its a basis for R^3... so I would just take 3 of them, make sure they're linearly independent and that they generate a subspace that spans R^3?
they span a subspace of R^4 that is isomorphic to R^3. they do not span R^3 because they are 4-tuples, and consequently not in R^3, since R^3’s vectors are 3-tuples.
exactly as c squared says
yeah that makes sense
The set of ordered 4-tuples {(0, 2, 1, 0), (1, −1, 0, 0), (1, 2, 0, −1), (1, 0, 0, 1)}
presumably forms a basis for R 3 . Show that it is a basis indeed. Then,
starting with this basis use the Gram-Schmidt procedure to constructan orthonormal basis for R 4 . Verify that the resulting vectors are or-
thonormal.
thats the question ive been given
yeah, should be R^4, otherwise it doesn't make sense
okay cool im not going crazy then
its been confusing me for a few hours now 🙃
ty for the help 🙂
it's basically a "show the vectors are lin indep and then do gram schmidt"
yeah thats what i thought but i didnt realise it was a typo and have been trying to work out wtf it means cause it didnt make any sense to me 😂
emailed my teacher like 48 hours ago about it but he hasnt responded still 🙃
but yeah ty
when it's not diagonalizable
"defective matrix"
these are matrices with repeated eigenvalues, but they don't have the same number of lin indep eigenvectors as the number of the repeated eigvals
yeah
so you look for the eigenvalues, find the eigenvectors, and check whether the eigenvectors are all linearly independent
and if they are, then you can diagonalize the mat using those vectors
can someone please explain to me how are these vectors linearly independent in the subspace W. Because from my understanding, the rank of the matrix is lower than the no of unknowns which would give us infinitely many solutions for a,b,c,d. Making the vectors dependent? Unless im missing something?
in this setting, you would've been better served to put the vectors as columns of the matrix, not rows
since you want to generate stuff in R^4, not R^3
but in any case, you found the matrix has 3 pivots
this means rank 3, 3 lin indep rows
so the rows are independent from each other
So what would be the condition for dependency here? Or in other words to get infinitely many solutions?😅
infinitely many solutions for what
there is no system of equations here
you aren't solving anything
you were only asked about the dimension of a subspace spanned by a set of vectors
no equation, and no solutions involved
okay okay i think i get why i was having this problem in my head, was thinking about these vectors as a set of equations.
anyhow thank you!
if you have have a transformation S∘T represented by matrices and want to find the matrix representing the transformation, is the algebra ST or TS?
S∘T means do T then S
and wrt. matrices, ST(v) = S(T(v))
so it's the same i think
right, so it's just ST?
Can someone explain to me the visualization behind Tensors ? Like, what's the use of these objects in physics ? and why we need to generalize the number of indices to any arbitrary number to work it out in continuum mechanics for example.
like for example, why matrices are not enough ?
technically you can turn them into matrices that represent the same operation
just some elements might have to appear several times
and if a system Ax=b has one unique solution, what does that say about the solutions of Ax=0
for example, in general if you want to map an array of size m x n x o into another of size q x r x s, you would need a map of some sort that is of size (m x n x o) x (q x r x s)
but you can matricize this
it says that x = 0 but what has that to do with Tensors ?
it says only x = 0 yields Ax = 0
anyway, you can turn it into a matrix
maybe of size mno x qrs, for example
and this can be done in several ways
in general you just save yourself the pain by using einstein notation
since the actual implementation of the map isn't unique
and you might wanna retain some intuition
so it has at least one solution?
for example some map that takes a scalar field in 3D and maps it into another scalar field in 3D
probably only one?
you'd need a tensor with 6D to represent this "natively"
but you can just as easily turn the 3D stuff into 1D by "unrolling"
this is completely unrelated to what i said. you were the one that said Ax = b has a single solution, so i told you what that implies regarding Ax = 0
think of the dimension of the null space
As long as you can turn them into matrices, why would you work with them after all ? like why dont you work with matrices only if they are more useful than Tensors in physics ? I just want to know what's the purpose of Tensors in general
it's just a multilinear transformation
how you represent it doesn't matter
you don't need matrices either
but does what i said follow?
you only care about the underlying transformation and its properties
and anyway, using physics definitions, matrices and vectors are also tensors
For example. scalar product represents the tendency of 2 vectors to align with each others. Now this is like a visualization of scalar product apart from the pure mathematical axioms etc... Can you do the same with Tensors ?
Most often, i see ppl saying Tensors only matter because of how they transform
why is that?
that's a property of vectors
scalar products, i mean
okok
because what you said doesn't make sense
unless you make a vector space where the vectors are tensors
oh got it
vectors in a more abstract sense
tensors are one possible representation of a multilinear transformation
so vectors are more general right?
okay btw excuse my dumb ass lol
i think you need to go review again what vectors and vector spaces are
and also linear transformations
okay thanks for that recommendations
but can you please explain the relationship between vectors and Tensors ? which is more general ?
they are different things
generally speaking they are not related
vectors can be tensors though, and tensors can also be vectors
depending on whether they act as linear transformations or members of a vector space
the question doesn't make sense
so can I just check again...
I believe: if a system Ax=0 has a solution x0, and a system Ax=b has a solution x1, then that system also has a solution x0+x1
so if Ax=b only has one unique solution, does Ax=0 have one solution or none? i imagine it still has the trivial solution (x = 0)?
only the trivial one (x=0), yes
Dawdle of Doubt. lmao i was in class when i asked those questions and i only looked at half the answers. will check what you said now
i need help
could anyone help me with these?
try the #multivariable-calculus channel
can anyone tell me the importance of finding the greatest eigenvalue of Matrix A would be important? Like for example using the power iterator method. What applications does it have for data science, machine learning etc?
are you familiar with the gradient descent algorithm?
if you use a fixed step size that depends on the largest eigenvalue of the matrix A = M^TM in a system Mx = b, the gradient descent algorithm is guaranteed to converge
the singular values are related to how well behaved a system is
also you can make iterative algorithms that can find the several eigenvalues and eigenvectors by repeating that method and then projecting on the complement of the eigenvectors you have found
Page Rank is also a nice algorithm where knowing the largest eigenvalue of your matrix gives you nice information.
a bit side note (not related to matrix power) but PCA takes the largest eigenvalue & corresponding eigenvector of the covariance matrix to be the first PC
I have a few general questions about linear algebra and its importance to mathematics. I keep seeing linear algebra pop up in various places as a central topic to study regardless of one's particular interests. Example: University of Arizona Ph.D. in Applied Math --- recommended background reading for incoming Ph.D. Students. "(i) Linear algebra. You can never know too much linear algebra! [snip text] If you only review one thing this summer, it should be linear algebra. This will help you with all three core courses. " https://appliedmath.arizona.edu/background-reading What makes linear algebra so important? Why does it crop up in so many places? Is linear algebra an active field of research?
when you compute stuff on a computer, you have to make discrete calculations
numerical computations tend to involve vectors of samples of a function or random process
and then operations over these vectors are represented as linear operators
yes, it is an active field (i pretty much only do linear algebra, both pure and numerical)
stuff like approximating differential equations, machine learning, optimization, etc, all realy on this stuff
you make discrete approximations, provide error bounds, etc
what i do is pretty much also linalg
signal processing and machine learning
figure out the matrix A of T in that basis and then compute det(A - tI)
I being the 4x4 identity matrix
that's how all matrices are defined
yeah, the columns of A will be the representations of T's action on the basis elements
some action on the basis vectors
you can also make use of linearity here
two things are happening to the polys, and then they are added
for example, $T(1) = 1 = 1\cdot 1 + 0 \cdot x + 0 \cdot x^2 + 0 \cdot x^3$, so the first column is $$\begin{pmatrix}1 \ 0 \ 0 \ 0 \end{pmatrix}$$
TTerra
so you could say the matrix M does 2 things, and you could represent that as M = A + B
Yeetus
yeah the filling in is different
Yeetus
that's more like it
Remember that the minimal polynomial divides the characteristic polynomial and has the same irreducible factors as the characteristic polynomial.
np
Well, an endomorphism is diagonalizable iff the minimal polynomial has no repeated roots.
Working over C, ofc.
Yup
Can anyone here go to calculus and tell me if this kinda makes sense
Yup.
This is easy to see if you think about the Jordan normal form.
Hi, I think I’m putting this in the correct section of the server, can anybody provide hints on how to find the matrix of a linear map given only the kernel of the linear map please
the kernel isn't sufficient
if M has kernel K, 2M will also have kernel K, for a start
right, so you just have to find one such matrix
To start this question then, I found a specific form for all vectors within the kernel, and then I think I can proceed to find a basis for the kernel, but I’m unsure how that is going to help with respect to finding one such matrix
i'd help but i gtg sorry
consider just the simplest possible projection of the space onto that hyperplane?
ok i have a little more time than i thought
so
take the basis for the kernel
extend it to the whole vector space
then it's just the matrix of the map that maps basis vectors in the kernel to themselves and those not in the kernel to their closest analogue in terms of the kernel basis vectors?
is that coherent? sorry gtg
you say that you found a specific form for all vectors within the kernel. do you mind sharing?
Sure, gimme 10 mins and I’ll post that
Nearly home just gotta get my soln so far
actually
dont waste your time on that
so
lets just "organize" the information you have
we know that
2a - 1b - 0c + 1d = 0
0a + 1b + 1c + 1d = 0
2a - 2b - 1c + 0d = 0
0a + 0b + 0c + 0d = 0
hint : this looks eerily similar to a matrix multiplied by a column vector (a, b, c, d)...
Yeah so far so good, that’s how I ended up eventually obtaining a general form for my vectors in the kernel
well, im suggesting that you did not need to do that
yea. you just use the equations given to you to form the matrix. it should be
2 -1 0 1
0 1 1 1
2 -2 -1 0
0 0 0 0
I can’t believe I actually asked that question 😂you putting that has made it so obvious it’s unreal
lol
Thank you for the help 😁
Hello, I'm asked to check if the following is a vector space. Could I get a hint on how to start this question? I was thinking I could try to write it as a span and then it would be a vector space? But I'm not sure. I got about as far as this: ```
{(x1, x2, (1-2x1-5x2)/9 | x1, x2 for all real numbers}
Then I try to rewrite this as a span but I don't know how to :(
Help appreciated!
Think about what it means for something to be a vector space. What must be satisfied to have a vector space?
all vector spaces have the zero vector in it....
it must have closure under addition and under multiplication right?
Correct, think about all the axioms surrounding vector spaces and how you can show if they are or aren’t satisfied
oh wait it not be a vector space then? Because I could multiply by two for (1,1,2/3) that is inside the set, and get (2,2,4/3) which isnt inside the set? So it isn't closed under multiplication? Is that right?
ohhh also the 0 vector yea. because 0,0,0 doesn't satisfy this
so it isnt a vector space, and i overcomplicated this
thanks
what are E0 and E1
okay. and just to make sure, its f : V --> V, with f^2 = f
i would look at the map
v |--> ( (f(v) - v) / 2, (f(v) + v) / 2)
from V into E0 + E1 (where + in this line is meant to be a direct sum)
you're going to need to show that (f(v) - v)/2 is in E0 and (f(v) + v)/2 is in E1
then show that this map is indeed an isomorphism
which part(s) are you unsure about
cool
anybody knowledgable on Power method and the inverse power method? For biggest and smallest eigenvalues of A
what about it?
so my book says this, i wanted to make the inverse power method in python and an easy way of doing it was just modifying my original power method but converting the matrix A to the inverse first and then run the same algorithm. However in the picture below it says that is not a good idea and they want me to use lu factorization, why ?
because it is typically frowned upon computing the inverse to solve a system. i do not know how you solve a system in python but most languages has a \ -solve (originally from matlab) maybe you need to solve using a solve function? or use lu explicitly
yes there is a solve function but idk how to substitute it
idk if this is readable to you but as you can see i set A to the inverse of A in the start, i want to use solve instead but im not sure how
it would be readable tomorrow morning, now I am just about to goto sleep. probably somebody else knows
i assume just switch dot(A,x) to linalg.solve(A,x)
and remove where you define A to be A inverse
On second glance, I’m not so sure we can do this, those equations are defining the vectors within the kernel(ie (a b c d) transposed such that those equations hold), and since vectors of the kernel are within the domain of the linear map, how does this provide us with information about the matrix for the linear map?
Dont those equations just give us information defining the vectors within the kernel and nothing about the linear map itself
That is, they define the vectors such that $f(v)=0$
mchambo02
the kernel of f (the linear transformation represented by the matrix we found) is precisely U
I understand that I think, but don’t the equations therefore define merely what values a, b, c&d can take whilst being contained within the kernel, and therefore what vectors are contained within U? I’m just struggling to see in hindsight how we can use those to obtain the matrix for the map when they’re only defining vectors within U, right?
the equations determine the vectors (a, b, c, d) such that f(a, b, c, d) = (0, 0, 0, 0)
Ok yeah I’m with you
like, idk what else... um. im not sure what the issue is you're trying to bring up
the matrix we get wont be unique in the slightest (if thats what the concern is)
Oh wait I get it now I think, instead of trying to find the form of vectors within the kernel, we can use those equations defining vectors within the kernel to obtain the matrix quite trivially. I think I was getting confused because I thought we could only use those equations to find vectors within the kernel, when in fact if we consider general f( a b c d)^T=0 we can also use those equations. It’s hard to explain what I wasn’t getting but it makes sense again now
Thank you again 😅
yep, no worries
So could the matrix we get be multiplied by any lambda(excluding 0) and still be correct?
yes
you could also permute any of the rows of the matrix it would be correct
just not the columns
which is is super effing enlightening because row reduction preserves the kernel and thats the first time ive ever really seen that. like i thought i understood why, but holy
thats so explicit
Perfect, thank you 😁
Does the rank of a matrix representing the linear transformation = rank of the transformation ? This makes sense in my head but just Want to check
yes
Ok thank you
the isomorphism given by the choice of basis on the codomain of your transformation takes the transformation's image to the column space of its matrix representation, and since it's an isomorphism, it preserves dimensions
🥗
Linear Salad
Let T : W -> W be linear, where W is an n-dimensional complex vector space. Suppose that T has k distinct nonzero eigenvalues. I want to show that ker T^n = ker T^(n - k). Clearly ker T^(n - k) is a subset of ker T^n. The other direction is giving me a hard time: If T^n v = 0, then T^k(T^(n - k) v) = 0. Assume w := T^(n - k) v /= 0. Then the T-cyclic subspace <w> has some dimension less than k. I'm not sure how to continue here, but it feels like I'm going in the right direction.
Notice that we can do this by induction
Notice the following
If $T \in \text{End}(W)$ has $k$ distinct eigenvalues, then let $\lambda_{i} \in \mathbb{C}$ be its $i$-th eigenvalue and $v_{i} \in V_{\lambda_{i}}$ be any eigenvector in the eigenspace $V_{\lambda_{i}$ corresponding to the $i$-th eigenvalue.
\
\
Let $V = \text{span}{v_{1})} \oplus \cdots \oplus \text{span}{v_{k}}$
\
\
Notice that $V$ if we suppose $k < n$. And suppose that the result holds for $k < n$, this implies that $T^{k}$ restricted to $V$ has $k$ distinct eigenvalues. So by hypothesis, $\text{ker} , T^{k} = \text{ker} , T^{k-k} = \text{ker} ,\text{id} = {0}$.
\
\
So if we prove $T^{n-k} (v) \in V$, we see that $T^{n-k}(v) = 0$ follows.
I see how V is equal to that direct sum with T^(k-1). But why T^(k-1)? I don't follow the rest.
MisterSystem
Compile Error! Click the
reaction for more information.
(You may edit your message to recompile.)
Oh, you're right.
Yeah, the nice thing is that
We artificially produced a subspace of dimension k
Where T^k has k distinct eigenvalues
And we can apply some induction argument here
I think you can carry out the details
But why T^(k-1)?
Oh, yeah I didn't mean that
If $T \in \text{End}(W)$ has $k$ distinct eigenvalues, then let $\lambda_{i} \in \mathbb{C}$ be its $i$-th eigenvalue and $v_{i} \in V_{\lambda_{i}}$ be any eigenvector in the eigenspace $V_{\lambda_{i}$ corresponding to the $i$-th eigenvalue.
\
\
Let $V = \text{span}{v_{1}} \oplus \cdots \oplus \text{span}{v_{k}}$
\
\
Notice that $V$ if we suppose $k < n$. And suppose that the result holds for $k < n$, this implies that $T^{k}$ restricted to $V$ has $k$ distinct eigenvalues. So by hypothesis, $\text{ker} , T^{k} = \text{ker} , T^{k-k} = \text{ker} ,\text{id} = {0}$.
\
\
So if we prove $T^{n-k} (v) \in V$, we see that $T^{n-k}(v) = 0$ follows.
I really meant span(v_i) and so on
Because notice that