#linear-algebra
2 messages · Page 226 of 1
ah, someone did some cleanup on isle 3
Could someone please help me to find some applications of vector spaces?
ℝ^n is pretty handy for everything.
beyond that, function spaces are very very important to harmonic/fourier analysis and therefore modern physics
a lot of computing science takes place in vector spaces over a finite field (or modules over a ring Z/nZ), but CS people are unlikely to use that sort of terminology
and of course, linearity is a very very very useful property for a function to have
most of numerical analysis is trying to linearly approximate things
or at least polynomial approximate it
and linear maps are just vector space isomorphisms, so you can think of linearity as just a statement about vector space relations
etcetc
those are just some of the common examples
tysm
how to learn about Vector Spaces and Subspaces ?
i cant understand these topics , can someone recommend me some resource to study?
Just a quick sanitiy check, given some matrix $A$ and some vector $x$ with $\sigma_{min,A}$ being the lowest nonzero singular value the following it true? given finit dimension and real etc
$$\sigma_{min, A} ||x|| \leq ||Ax|| ,\forall x$$
Dusto
Yes, assuming you are considering 0 as a singular value too
And I think you need to assume A is square
Right, I misremembered
alright just checked numerically and this inequality doesn't seem to hold up at least in l2
what does work out is the following
$$||x|| \leq \sigma_{max, A} ||Ax||$$
Dusto
that's a weird one lol
it shouldn't work if A is a singular vec and the singular val is less than 1
the inequality you wrote before was true, but this one isn't
you can make a counter example as A = [0.9, 0; 0, 0.9], x = [1;0]
I've derived the inequality you gave before, it definitely works
yeah, they mixed something up
Btw the inequality
$$\abs{\abs{Ax}}\leq \sigma_{\max}\abs{\abs{x}}$$
Does work as well
ShiN
yep, same rayleigh
If complex no is a vector space, then why cant we define multiplication and division of two vectors like complex nos
division of vectors isnt a thing
and multiplying 2 vectors is not a thing defined in the vector space, it's defined in the inner product
I see
C is just special
(it's a field and any field happens to be a vector space over itself)
but of course, not all vector spaces are fields
those other operations you mentioned just happen to look similar in this special case
but for vector spaces, you only need a handful of properties for + and * (with a scalar)
anything else is extra
I know Gram-Schmidt, but I always fail to use it in the exams cus the task is weird.
Find orthogonalbasis {yi} of P3 with <p,q> scalar, so that yi has degree i
The other task to proof its actually an scalar product was easy. But now I dont get what they want me to do exactly.
Am I even supposed to use gram schmidt here somehow?
my exam is in 9 hours
In ML they often say XOR gate is not linear. Are they just ignoring the field {0, 1}? 
they do the operations over the reals, so yes
@faint dune
Note that φ is not y (discord doesn't have support for the φ character sadly, φ is the closest we get)
It seems like it just wants any orthogonal basis where every degree poly is used. Except, that's every basis
what does this question even mean? confused about the 2nd part after the comma
if you reflect the vector x in the line y = x you get Qx
it's asking you to find the matrix representing the linear transformation that is reflection in the line y = x
probably
the wording is a little strange
What do you mean "create" haha
Make?
The image spans a plane. It just kinda already exists
Yes
Yeah you could do that cross product trick
You have two vectors that are on the plane already, they are the columns
Yaya it works. Feel free to ask if you have any others!
If the output is a 2D space, then the output is a 2D space. You don't need rank-nullity to say that haha
@half ice I thought about it at night and my idea was to just write down v1=1 as degree 0 startvector
And then I determine v2 si that the scalarproduct is 0.
And the same for v3 but scalar with both is zero. Mybe for v3 I can also just take any vector and hope its not collinear and use gram schmidt 🦢
it asks you for the degree of each one to be increasing tho
so yeah, the procedure you said is correct, but it's a bit annoying
Applied linear algebra vs optimization for my math elective as a stats/ML emphasis major 
that's a tough choice, but i would argue that optimization anyways includes a fair bit of linalg
@wintry steppe .
what is this notation
divided difference, but there is functions in brackets?
applied to gf ?
like gf(x2)- gf(x1) / (x2-x1) but just a guess
check your notes toge
normally i would agree, but they did say ML
they'll probably pick up some linalg along the way
but the optimization stuff is super important in ML
especially if you want to come up with new stuff
it's all optimization
you don't even have to do it with linalg
Yeah there's definitely linear algebra in ML but I think you'd pick it up just as well on a course in neural networks or something
Most of the linear algebra required is not very advanced
in this question, is n supposed to be the dimension of V with the fi linearly independent?
because otherwise i dont think its true
(tag plz)
suppose V is R^3 and f maps e1 to 0, and e2 and e3 to 1. If g maps e1 and e2 to 0 and e3 to 1, then clearly the kernel of f is in g, but g isnt a multiple of f
@marble lance
am i missing something in this example?
f(e2-e3) = 0 but g(e2-e3) = -1
So I don't agree the kernel of f is in the kernel of g
It's okay, it took me a second, haha
My first instict was that the kernel of f was just {(x,0,0)} and of g was {(x,y,0)}
yes thats what i thought too
Oops
Not learning linear algebra, but matrix algebra as part of a high school course. My question is regarding using matrices to represent linear transformations. Why is it that when deriving a matrix to represent a linear transformation, we apply the transformation to unit vectors i and j and the images of i and j become our transformation matrix?
each column of the matrix represents the action of the transformation on each of the vectors in the ordered basis
so yes
Let's say our transformation is T and we want to transform the vector (x, y). Now (x, y) = x i + y j. And by the properties of a linear transformation this means T(x, y) = x T(i) + y T(j) and this we can write as [ T(i) T(j)] [x, y].
So it only matters how you transform the basis vectors, since this then determines how all other vectors are transformed
[T(i) T(j)] is the matrix whose first column is T(i) and whose second column is T(j). And [x, y] is the vector we are transforming as a column
@random axle
I get it now, thanks!
👍
This from an old exam, I tried to take the eigenvalues and find the eigenvectors
For 1
But got a single span
So means its not linear
So confused

'it's not linear'?
Linear independent
what is not linearly independent?
1,2,0,1 are the eigenvalues since its a upper triangle
Eigenvalue 1 only has 1 span but there are 2 off them
the whole point of the question is you only get 1 eigenvector for 1
except for one value of x, for which you get 2, and so A is diagonalisable for that x
you need to choose the right x which gives you two eigenvectors for the eigenvalue 1
so that you have 4 linearly independent eigenvectors
which gives u diagonalizable
So your saying solve for eigenvalue 1 and find x which gives 2 eigenvectors
ye, find x such that there are 2 linearly independent eigenvectors with eigenvalue 1
or equivalent find x such that
$\mathrm{null}\begin{pmatrix} 0 & 3 & 10 & x \ 0 & 1 & 4 & 3 \ 0 & 0 & -1 & 4 \ 0 & 0 & 0 & 0\end{pmatrix} = 2$
nuclearpotat
yup nice
Does anyone have good resources for understanding the proof of spectral theorem?
the proof of what fact precisely ?
Any normal operator m on a vector space v is diagonal with respect to an orthonormal basis for v
I think I should said spectral theorem
are you looking for a proof or for intuition on the theorem? you should be able to find a proof in any half-decent linear algebra book, maybe even on wikipedia
I think it would help specifying a step you can't understand
My book isn't a linear algebra book so it glosses over the proof as an aside
I think I'll look at the Wikipedia page for now then
first you should understand why a symmetric matrix is diagonalizable
(aka gauss decomposition of quadratic forms)
and then you just need to check the eigenspaces are orthogonal using the symmetry
that's just calculation
and then you can easily deduce the spectral theorem
Hi, can anyone help me understand this proof? Why is <w1, vj> is equal to <u, vj>?
is it because w1 is orthogonal to u ?
what does "orthogonal project of u on W" mean?
think of extending the orthogonal basis of W to one of V
Is there a convenient way to visualize (in lower dimensions) sets of the form
$${v\in \mathbb R^n: \langle v,x_0\rangle = \alpha}$$
For some fixed $\alpha,x_0$?
With the standard dot product
ShiN
Ofc when alpha=0 it's just the originally complement and it's trivial
idk, all vectors of the same length and making the same angle w.r.t x0?
aren't these hyperplanes?
this is of the form ax1 + bx2 + cx3 + ... + d = 0
you can build it backwards from the def of a plane
A hyperplane can be affine right?
say you know a point p0 is on a plane with normal x0. any vector w = u - p0 is on the plane if <u - p0, x0> = 0
then <u, x0> = <p0, x0>, where <p0,x0 > = alpha
and if alpha is nonzero, it's affine indeed
So if you have some vector $p_0$ that satisfies the condition, then this is just
$p_0+{x_0}^{\perp}$?
ShiN
no
u - p0 = {x0}_orthocomp
Sorry I misread
Yeayea I read it wrong
I'm trying to understand geometrically why this forms a plane tho
Or a hyperplane
set p_0 = 0 and try it out in 2D
a hyperplane in 2D is a line
then try changing p_0 to something else and see what happens
i constructed the set from the definition of a plane up there, too
I think this construction works too tho, since for every orthogonal vector $u$ satisfies
$$<u+p_0,x_0>=<u,x_0>+<p_0,x_0>=\alpha$$
ShiN
It's just easier for mr to understand affine subspaces like this
hmm in the previous one though, the alpha was directly related to the distance from the origin
here you have 2 constants
You choose some arbitrary vector for this tho
arbitrary yes, but anyhow projected onto x0
This works since for every 2 vectors in our set you have p_0-q_0 is orthogonal to x_0
So they're in the same coset
So they generate the same affine subspace w.r.t the orthogonal complement
it'll work, i'm just saying the interpretation of alpha is lost
Ah
Well I guess
If you take a normalised vector it might be a better interpretation
i should've said that, yes
i meant to have x0 be the normal of the hyperplane, with unit norm
Ah ok
Hi there, I'm trying to prove the following statement : "All hyperplanes of Mn(R) (the vector space of n by n matrices with coefficients in R) contain an inversible matrix". The approach I came up with kind of differs with the answer provided, which was a little bit more involved.
Let H be a hyperplane of Mn(R), thus there exists a linear functional f such that H = Ker(f) . All linear functions over Mn(R) are of the form Tr(A.) with A a matrix different from 0. To prove the result, it suffices to show that there exists i in [1,n] such that E_i,i is in H (i.e. f(E_i,i) = 0). (E_i,i is an element of the canonical basis) if such an E_i,i exists then we're done. If not then we consider E = E_i,i - f(E_i,i)/n * I_n (I_n being the identity matrix) . We have f(E) = 0 and E invertible.
(i = 1 for example, if for all i in [1,n] f(E_i,i) != 0)
Is my reasoning correct ?
hi
I'm trying to write a program to convert a triplet of 3D points into Euler XYZ angle representation
I found this website that seemingly does this directly but I don't understand what it's doing so it's hard to write my code based off of its output when I hardly even understand what it's doing
If anyone can help me to understand the workflow I need to go through in order to convert a set of three points in 3D space into Euler angles, it would mean a lot to me
This is that website btw
It says that it normalizes all inputs to quaternions
tbh I don't have a solid grasp on what that means. It just converts a triplet of 3d points to a quaternion? Then it just converts that to Euler angles?
The scipy python library has an as_euler() function that I can allegedly pass quaternions into as input and it'd return em as Euler angles
But I don't know how to convert a triplet of points to a quaternion — all my googling led me to quite high-level technical discussion
I'm a quick learner but all the results I found about this came with the assumption that I already know my shit with linear algebra, which I don't.
I understand simple 3x3 matrix manipulation
Dot products and cross products
I'm a little iffy on what normalization is. I don't even know if I need normalization for the programming task at hand
Any insight into this would be mind-bogglingly relieving
Any idea what's the answer to the b part of this question?
@tight stag quaternions are generally the standard for computing 3D rotations, so i'd recommend familiarizing yourself with how they are used to that end. There are a lot of good resources on them and they can be helpful for converting between representations
speaking of quaternions, i was wondering if anyone knows of any terminology to describe "planes spanned by a scalar and a vector" vs "planes spanned by two vectors"?
wdym a plane spanned by a scalar and a vector
spans are defined for sets of vectors
the set of all quaternions of the form a+bu for some pure quaternion (vector) u
how do you define the sum of a scalar and a vector?
what is your preferred notation for quaternions?
ah i see the issue. for whatever reason the real component is also called scalar
that's pretty confusing
I'll read more into them and get back to you here. But, just to clarify, are you suggesting that it may be necessary to convert from a triplet of points to a quaternion, to then convert the quaternion into a set of Euler angles?
i would prefer denoting the quaternion as some 4d vector
then there is no confusion
that's actually my bad Edd. i have a bad habit of referring to the real part as such
with that out of the way, there is no difference
the "scalar" is also a vector, e.g. some multiple of (1,0,0,0)
but, there is a difference! Span{1, u} forms a subalgebra isomorphic to the complex numbers, while Span{u, v} does not
this is very application-specific because quaternions have additional structure
from the point of view of spans and vectors with no additional structure, they're the same
so you'd have to ask someone that works more with this stuff :x sorry
maybe not necessary, but it might be easier, and quaternions are helpful to know because they are so ubiquitous for 3D rotations
How do i even go about this? translation: "determine the matrix that represents, in the canonical basis of R3, the projection onto the plan pi defined by the equation x+2y+3x=0 in parallel to the line D defined by the equation x/3=y/2=z
Maybe i'm missing something but I don't see why Ei,i being in H suffices, since Ei,i itself is not invertible. Also not exactly sure I see why E satisfies f(E)=0, wouldn't it be
$$f(E)=f(E_{i,i}) - \frac{f(E_{i,i})}{n}f(I_n)= f(E_{i,i})(1 - \frac{tr(A)}{n})$$
?
ShiN
Oh my god yes damn that was stupid of me 
thank you mate :""/ I'll see if I cam rework this method
np
can anyone help me with this?
In matrices is ABCD = (AB)(CD)??
matrix multiplication is associative, so yes
but A((BC)D), A(B(CD)), ((AB)C)D, etc. also work
theyre all the same
ok ty
I know this is a tall order... but would someone be willing to proofread my homework? it's taken me like 4+ hours to type it up and don't have the energy to proofread
you're doxxing yourself
think about the rank of A
Rank of A will be n
actually i think that part isnt needed
for linear transf9rmations, if the arg is 0, the result is 0
I think he is trying to say that for every linear transformation T, T(0) = 0
this is an n-1 dimensional plane going through the origin. The basis will need n-1 vectors to span it and they will all be perpendicular to (1,1,1,1....1). I will leave it up to you to come up with these vectors
Hey I have question on singular value decomposition
So I found the eigenvectors of V and normalized it
but the problem is it already does not have rational entries
I am not sure if I have made a mistake or if I am missing a step but how can I find a matrix with rational entries only??
you can't just do an eigenvalue decomposition and expect the entries to be rational
the question asks me to find matrices with rational entries so I am assuming it should be somehow possible for this case. I am not really sure how though
i'm honestly not sure how this is done, but not with the regular method for sure
im given this matrix and the questions says that i have to change the elements in the lower triangle area to make it symmetric. does this mean that i should add or subtract another matrix from this one?
can you show the original question?
Change the elements found in the matrix's lower triangle area so that it can become:
i) symmetric
ii) hermitian
iii) upper triangular
i just want to know if im supposed to subtract or add some other matrix from the original one given in the question
if it doesn't say how... i'd honestly just replace the elements
i think you're supposed to show the transpose distributes over the sum
literally just change any number individually how i like?
doesnt sound very right, i thought id have to do matrix operations to get to those answers
without any other context... i would say so, since they ask you to only change the elements in the lower triangular part
you can do it with matrices if you want, but you're anyway adding and subtracting lower traingular mats
What I did is wrong?
thx
it's incomplete
i'd look at the elements of aA + bB, and those of (aA + bB)^t, and finally those of aA^t + bB^t
wdym look at the elements?
is it possible to find the magnitude of a 1x2 matrix?
afaik in order to find the magnitude of a square matrix you need to find its determinant, but i dont think there is a way to find the determinant of a 1x2 matrix
Sorry I missed your message. Yeah apparently in the hint given, we have since third eigenvalue is 0, then it belongs to Null(A^T A) = Span{v_3} and first eigenvalue = Null(A^T A - 9*Identity matrix) = Span{v_1, v_2} where v_1, v_2 are eigenvectors for 9 and v_3 is eigenvector for 0. So the suggestion was to find a basis {w_1, v_2} of first eigenvalue such that w_1 has rational entries and is linear combination of v_1 and v_2 and then apply gram schmidt on {w_1, v_2} and normalize it.
Quite hard to understand what my prof is saying tbh...
definitely not regular way yeah
***The following vectors are given:
|f1>= ξ|e1 > +|e2>
|f2>= |e1 > +ξ|e2> +|e3>,
|f3>= |e2> +ξ|e3>
Where |e1>, |e2> and |e3> are orthonormal and ξ is a real number. For which values of ξ are |f1>, |f2> and |f3> linearly independent? For which values are they linearly dependent?***
Can someone help me out this this? I am wondering if I need to do this:
c1|f1> + c2|f12> + c3|f3> = 0
is this what i have to do? the problem is that i will end up with four scalars c1,c2,c3 and ξ
is that fine anyways?
I am trying to figure out a 3-D geometry problem, and I am not sure if I can even describe it correctly... I think it might be some kind of projection problem?
If I have a point (P1) and and a plane (K), how do I figure out if another point (P2) is within the boundary formed by the point and the boundaries of K (see picture below sorry for ms paint).
yep, projection and change of basis
you can make a local coordinate system on the plane and do a change of basis from the global 3D to the local 2D
once in the local 2D coords, you can easily measure distances
e.g. if you have a local orthonormal basis, it's as simple as projecting the point onto it and seeing if the absolute value of the projection is <= some quantity
Okay I am kind of following you up to here. What is that "some quantity" part? Presumably it changes in 3-D space
no, it depends only on the size of your square K there
say you want it to be W x L "units"
you can arbitrarily make a local coord system with 0 in the middle of that square or rectange
then you need the projections to be |<point, local_x>| <= W/2
and similarly for L
Just so I understand here.
You are saying projecting the point onto the plane, not "onto the local othonormal basis", is that correct?
there is no difference between those 2
And then I am comparing distances as defined in the local coordinate system?
yeah, that works
the only thing that changes is at what point you subtract the reference origin
so i would do it like this
trace a ray from p1 to p2
find the intersection of that ray with an infinite plane that includes K
and then using a reference origin for K and an orthonormal basis, find out if it is within the boundaries
ahh that is a bit easier to visualize
that last step requires a change of basis from the 3D world where the rays and the plane live to a cleverly chosen 2D basis
an orthonormal basis makes this simple
someone on twitter asked something interesting
take $\mathbb{F} = \C$ or an arbitrary field if you're feeling special
a sham, a rock, a canal, panama
find four 4 by 4 matrices $A, B, C, D$ over this field such that the matrix $X = aA + bB + cC + dD$ has rank 2 for every $(a,b,c,d) \neq (0,0,0,0)$
a sham, a rock, a canal, panama
i do not know why they think this exists, you can probably do dimension counting or something
I guess to put my thoughts on paper, we have $68 = 4^2 * 4 + 4$ variables and equations saying that all the 3 by 3 and 4 by 4 minors vanish, that at least one of the 2 by 2 minors does not vanish, and that at least one of the a,b,c,d does not vanish
a sham, a rock, a canal, panama
there are a total of $\binom{4}{3}^2 \cdot \binom{4}{4}^2 = 16$ minors, so we're intersecting 16 hypersurfaces and then taking an open subset cut out by the two equations $abcd \neq 0$ and $\prod_{m \in 2\times 2\text{ minors of } X} m \neq 0$
so i think this line of thinking shows that there must be a solution, probably (for F algebraically closed so dimension stuff works out)
but I don't actually know how to find one, and if anyone could help that would be great
hm no this doesn't actually work to show there are solutions does it
because the open equations could just completely cut out the equations saying the minors vanish
a sham, a rock, a canal, panama
but that probably isn't the case
anyways if anyone has thoughts about how you can find solutions please ping me
or thoughts on why solutions exist
@hayden_wlog @SC_Griffith I think this is asking for four 2x4 matrices (A,B,C,D), where aA+bB+cC+dD=[v//w], v, w in F^4, and (v=tw for some t OR w=0) iff (a=b=c=d=0). Is that correct? If so, I have some bad news for you...
Solutions won't exist in the algebraically closed case
Well, maybe. As the op points out, this assumes some restriction on the form of A, B, C, D
Hey guys need some help checking this... I think I did it right? But I got slight different numbers for the solutions. I know the end result is the same because there are no solutions but... not sure if I messed up somewhere ?
My lighting is terrible hopefully thats better
yes there's no solution if you get 0=not 0
also there are RREF calculators online, which is quicker than asking someone here to do it for you
@nocturne jewel I guess where I'm confused is more so if its okay to get different values for the solutions.. like if I did rref on this system again and got completely different numbers again
each matrix has a unique RREF iirc, so check your working or look for an RREF calc w/ steps
I did but the rref calculators I found dont take AUG matrixes
they only show the rref of the matrix alone and thats exactly the same as what I have
System of linear equations calculator - solve system of linear equations step-by-step, Gaussian elimination, Cramer's rule, inverse matrix method, analysis for compatibility
Oh sweet thank you
Hmm wait I have a slight confusion
I thought every pivot row had to have 0
i mean column
shouldn't it be [ 1 2 0 1 ] for the top row
I mean you're just solving the system, so you can stop once you know there's no solutions
Ah okay , so you can ignore the "standard rref" if you see its no solution
you stop solving once it's solved lol
if you get to x=2 for example... you wouldnt do anything else cause you've arrived at where you wanted to be, the answer
Well im confused cause my teacher never said that but kahn academy said for it to be proper rref every pivot column should have nothing but 0's and 1's
yes that's true
BUT the question isn't get the RREF of a matrix, it's to solve the augmented matrix
So its another case of ignore this now because we dont care
Then wouldn't it just be REF
Not really, it's just pointless work to get the exact RREF
So its a gray area between REF and proper RREF because we dont care and just want an answer
ill be honest I forget the exact difference but there is one
I just go w/ Gauss-Jordan until I don't need to anymore
Thank you for the help. Trust me ik that the rules get confusing and contradictory in higher mathematics. Sometimes you have to write a super rigorous exact answer or you get an F. Then other times its like.... eh... we know this so we can assume x,y,z lmao
pretty much REF is just getting the bottom of the pivots knocked out, RREF is getting both top and bottoms knocked out ( as much as you can, google the exact difference lol)
huh
Yeah that seems right. I'm not sure again why it really matters other than making it easier?

If gives you x1 = the number doesn't it
Again I just run w/ GJ then stop when I'm done
There's probably some fringe problems that require exact rref, but thats later
like you will divide it to make in 1 and all that
I'm sorry but I am not understanding your English, no offense
yeah no clue what you're saying either
nvm i was talking about the REF thing but nvm
Ah well thanks for trying to help lmao
like in the spots above and below the pivots you can just subtract off
yes that's gauss-jordan
yeah like this part
you could go further
and clear up all the numbers above i guess even if this is considered row reduced
oh yeah
In case you guys are curious. The main difference is that it is easy to read the null space off the RREF, but it takes more work for the REF.
I guess cause the upper and lower triangulars look nice its just pleasing to the eye , and slightly reduces the computation
Well... more computation during rref, but afterwards the system looks nicer
lmao
Would anyone be able to link to me a video that explains linear transformations? I feel I need more information when it comes to calculating them
not sure what exactly you are looking for but there is this playlist https://www.youtube.com/watch?v=rHLEWRxRGiM&list=PLZHQObOWTQDPD3MizzM2xVFitgF8hE_ab
What do 3d linear transformations look like?
Help fund future projects: https://www.patreon.com/3blue1brown
An equally valuable form of support is to simply share some of the videos.
Home page: https://www.3blue1brown.com/
Full series: http://3b1b.co/eola
Future series like this are funded by the community, through Patreon, where supporters ge...
I have seen them. They are really good to understand what is happening. But it doesnt really go into solving the problems from what i remember. I am looking to solve problems like this.
apply linearity of T
tbh not that far kinda doing this on my own but would it not be something like this
$T[au+bv]=aT[u]+bT[v]$ for u v in the space and a b in the field
Mosh
yes, that's called linearity like I said already...
though dont post full solutions...
oh
i meant linear transformation. isn't that what this is doing? Is that called a linear transformation right?
oh it says it in the title
only invertible linear transformations are changes of basis
a non-invertible linear map doesn't take a basis to a basis so it can't be a change of basis

in Sylvester rank inequality , when we have two matrices like A and B of order $m \times n$ and $ n \times m$ repectively then $rank A+rank B - ? \leq rank(AB) \leq min {rank A, rank B}$ what is ? here is it m or n?
honey99
n
so common term?
sylvester's ineq says that if A is m by n and B is n by k then rk(AB) >= rk(A) + rk(B) - n
${(x,0,0)|x\in\mathbb{R}}$ is a subspace of $\mathbb{R}^3$ right?
jswatj
yea it’s a subspace. it’s the x-axis
Could someone explain what shearing is please? First time I've seen that term.
exactly what the images show
"bending space" along one direction
a shear is applied to transform the blue grid into the green one
which "bends" the shapes as well
ok, i see thankx
So it seems like a rotation, but the points that are on the x-axis stay fixed (if you are shearing in the x-axis direction)?
not a rotation, lengths aren't preserved
Oh i see
what do you call a baby eigensheep?
a lamb, duh
is that eigen stuff hard? it's a topic that crops up later in my chapter. I've noticed a lot of exam questions based on it
eigenstuff is not hard in and of itself but it can be tricky to understand if you don't have a good grasp of the more basic stuff that comes before it.
How do we know what b equals in the case of yTb = 1
I just dont understand the right-hand side verfies that yTb = 1 statement
couldn't b = [1, 1, -1], [1, 0, 0], etdc
it's the same vector in Ax=b
ohh i guess it is saying if we are given b from the start?
oh yeah i see
it is from the x1 -x2 = 1 , x2 -x3 = 1, x1-x3 =1
[1,1,1]?
riht
of course you're given b
right*
you're given the system of m equations off the bat
yeah i see that now although not exactly sure what this question was getting at or showing
just says it is under the topic
If det(U) > 1, can we prove that det(2*I-U^n) will become negative for big enough n? Or is this false. Any help would be appreciated
U is a real nxn matrix here
Is the n in U's exponent and its dimension the same n, or is U fixed?
I'm assuming the latter
Consider the case where the size of U is even, and all the eigenvalues of U are negative, then if n is even the eigenvalues of 2I-U^n might be negative, but for odd n the eigenvalues will all be positive, so det(2I-U^n) will be positive for all odd n in this case
Supposing U has all real eigenvalues in this case
I know what i did wrong
i think
nvm
im confused
how would i turn a single vector into a line?
jswatj
mhm
and what kind of line do you want
parallel to this?
passing through some specific point?
what's the original question
so
oh damn
you found the null space to be of dim 1, yeah?
yeah
so it has a basis containing 1 vector
Yeah i did that
and got a unique solution
sorry
not uniqe solution
only one basic vector*
mhm
but you agree that any scaled version of that vector is still in the null space yeah?
aight
how do you know that
Yeah
A line
mhm
simple enough. a line can be parametrically described given a point on it and a direction that the line is parallel to
the line contains zero, since if we set c = 0, then c x = 0
so a line of the form p + c x, with p = 0, is simply c x
a line parallel to the vector x and passing through the origin
this is what you'd expect, since the null space is a subspace and needs to contain the origin
right
Solve 4 equations with 3 unknowns
Can someone critique my proof writing skills + correctness?
wouldn't it just be that $p=tv$ where $v$ is the vector we have?
jswatj
since we can use the origin as p_0
ur using a different notation from the one i picked, but i guess so
i used p as p_0 and c x as t v
Oh sorry
lambda 1,2,3 adds up to 0
so i dont think its as simple as solving 4 equations with 3 unknowns
where do you get that the lambdas add up to 0?
Why would they need to add to 0?
is the im(A) a vector space?
yes
Yes
where A is a matrix
you can write A x as a linear combination of the columns of A, so it is the subspace spanned by the columns of A
why do you say the lambdas add up to 0?
Need some help with the proof of spectral theorem
I'm trying to understand how PMP = lambda P
that doesn't look right
Where M is a normal operator on V dim 1, lambda is and eigenvalue of M and P is the projector onto the egienspace
i mean the lambdas couldn't be 0s
all right. at any rate, you'd really just try to solve the system
you have a 4 x 3 matrix, so you'll end up having to parameterize something
how do i do that?
IM a bit confused by this
I understood this at the time, but looking back I don't quite understand
If A has a pivot point in every row, doesn't that mean any augmented matrix is always consistent?
wht do you mean?
OHHH
I think I get what you mean
ya
Tim O'Brien
lol
draw out some cases
ugh im bad at latex i should figure out how to do this
one sec
could you draw on paper ?
pitabread
third column is b
what do you think of this
does the augmented column have a pivot?
and is it consistent? (considering col 3 is b)
There is not a pivot in every row
of A
sorry for lat ereply
reply
of A, but does the matrix [A b] have a pivot?
No it doesnt
you don't see/consider the 3rd row as a pivot?
Oh I mean it's a pivot it's just not row reduced echelon form
I guess I don't get what pivot means then
i mean the text is just talking about pivots when it talks about pivots
right
what is a pivot exactly?
Like whatws the definition
Just a term in a matrix with 0's below it?
informally it's the first non-zero entry in a row
i think it has to be unique too (column wise)

if its unique in a column that means row reduced echelon form
not sure about my last statement
I think first non zero entry in a row is good
yea
So let me try to understaned the theorem once more
this is inconsistent
correct
Despite having pivot points in each row
correct
so if Ax=b has a solution for every b, A has a pivot point in all rows
and if you find some example of a consistent one, there you have your two cases for [A b]
Ok wait so
it's not always inconsistent
when the pivot in the augmented column it is always inconsistent
in your example it would be consistent
(probably)
For Ax=b to be consistent, there has to be a pivot point in every row of A. But the fact that
[A b] has a pivot point in every row doesn't guarantee consistency.
Is this right?
hm it's not strong enough, your text is good in this
and also it's important to note it's talking about mxn
non square matrices
ugh
it's close
the reason i say it's not strong enough is that that's only one condition for consistency
Yeah I get that
actually
hm
it says a b c d are equivalent...
in which case you'd be right full stop
but then you'd have to be able to prove a <-> b <-> c <-> d
not looking for 100% proving everything at the moment
lol
Just want to understand
yea i get that
I think I do
Yeah ikr
i always hear, "you can never know enough linear algebra"
let me look
no not artin
But yeah I want to be fluent in Matrix Algebra to start Group Theory
but thanks for the chat I think I understand it?
Like 50% sure
"you can never know enough linear algebra" only applies to useful linear algebra, i.e., not matrix reduction stuff :^)
Unfounded claim
Hi guyes
I have somehow good linear algebra back ground and i want to put it in practice via solving problems
So please some one introduce me to a good source for it (it is better to be a website or something)
:)
yea let the computers deal with matrices
Check out "Linear Algebra and its Applications" by David C. Lay
It has some cool problems
at least to a math n00b like me
all row swapping elementary matrices are symmetric right
idk if this is where this goes
I’m learning about tensors and I see this
All of them have the transformations on the left-hand side of the tensor, except the (1,1) tensors which have one transformation on the left and one on the right
then this rule is given
and the issue here is that for the (0,1) and (0,2) tensors in the top chart, the forward transforms are on the left instead of the right like this rule suggests
so my question is, how do you know whether to apply transforms to the left or right side of a tensor given its type?
If I have a (1,2) tensor, for example, I know it’s got two forward transforms and one backwards transform when I change coordinates, but how do I know where to put them?
I’m still looking for an answer btw
***You are given the linear system:
kx-y=1
4x-ky=n
For which values of k and n does the system have a single solution (x,y)? For which does it have infinite solutions? For which is it impossible to solve?***
As you can see I haven't done any attempts on finding the values for infinite solutions as I'm rather unsure. Is my method correct for the rest?
in terms of infinite solutions, try graphing something with a single solution, and then try to imagine what an infinite solution answer between two lines would imply
Which two lines?
i'm just putting in two equations here to highlight what it means graphically for a system of 2 equations to share a unique solution:
(you can verify that (1,2) is indeed the solution to the system)
Mhm
it's also useful to think about the relationship the lines would need to have to have no solution
(no point of intersection)
Parallel
I don't remember if there is a way to express parallel vectors through an equation though
you can look at the dot product of the normalized vectors
if it is 1 or -1, they're parallel
can someone help me with my question
Can I get advice on how to solve this question? No answer needed.
i'm not super familiar with that, lorem, sorry
what channel should I ask in?
wait what actually is linear algebra?
is it just a more graphic interpretation of concepts?
check the pins. namington has a good explanation.
this channel is the right one, lorem, but people that might know are not around at the moment
And they are orthogonal when it's 0 right?
mhm
Umm.... for this problem
Aren't they all true????
I mean d is definitely true.....
a,b,c can be true???
Am I missing something obvious?
<@&286206848099549185> ?
why is a true?
rather
can you explain your answer to each of them?
i'll just give an example
{(1, 0), (0, 1)} is a spanning set for R^2 which does not contain a basis of the subspace spanned by {(1, 1)}
a is false I think
because i mean if you said (1,0) (1,1) is the set for R^2 but h happens to be a line in the direction (1,0)?
?
i don't know what you mean
a basis of span{(1, 1)} has to consist of a single vector which is a multiple of (1, 1), and neither of the vectors in {(1, 0), (0, 1)} are of that form
Yeah this counter example seems right
it is right 
Yep
okay yeah then i see that
Yeah if the question went like "some spanning set" for option a then it will be true @little crater
well
perhaps the wording in a is unclear (hell, in a, b, and c really)
experience tells me it means "for all" but it can definitely be interpreted as "there exists" regarding spanning sets
Yep
can someone explain the last part with "I − P projects onto the....."
like i wasn't sure how to know what space (I-P) was projecting onto
add information if you want to explain I think I might just need to sit on it and look over this post https://math.stackexchange.com/questions/2507116/i-p-projection-matrix?rq=1
Well $P$ is the orthogonal projection onto $R(A)$, the range of $A$.
IlIIllIIIlllIIIIllll
So $I - P$ is the orthogonal projection onto $R(A)^\perp = N(A^*)$
IlIIllIIIlllIIIIllll
I guess $N(A^*)$ is what Strang calls the left null space
IlIIllIIIlllIIIIllll
The general fact is if $P$ is the orthogonal projection onto a subspace $W$, then $I - P$ is the orthogonal projection onto $W^\perp$.
IlIIllIIIlllIIIIllll
Yes $C(A) = R(A)$
IlIIllIIIlllIIIIllll
oh
range is defined for any function, so I was applying it to the function $A \colon \mathbb{R}^n \to \mathbb{R}^m$
IlIIllIIIlllIIIIllll
is that big p or little p?
$P$ is capital P I think.
IlIIllIIIlllIIIIllll
so when you make these projection matrix they are always square?
Yes a projection maps a vector space $V$ to itself. So it is (represented by) a square matrix.
IlIIllIIIlllIIIIllll
well it says can... so it technically is still true....
which message specifically are you replying to
^this message later may clarify things
you should take the former interpretation for this problem
it's poorly worded
hmm...
i mean im pretty sure they can all be true in the correct circumstances....
a is false when you interpret it as:
for all f.d. vector spaces V, and all subspaces H of V, *every* spanning set of V can be reduced to a basis of H.
it is true, however, when you interpret it as:
for all f.d. vector spaces V, and all subspaces H of V, *some* spanning set of V can be reduced to a basis of H.
the problem is that the exercise uses the article "a" to mean every when it is also correct to interpret it as "some." the wording is unclear. nevertheless, you should pick a to be the false one, since the others are true no matter the interpretation of "a"
if they wanted to explicitly say that some spanning set could be reduced to a basis of H then they probably would have said that explicitly ("there is a spanning set of V such that...")
of course, a is true in some circumstances. what if V = {0}? but you need to interpret the problem as quantifying over all vector spaces
and i gave an example to show that there's a vector space + subspace + basis for which it fails
i've typed too much
Can an orthogonal column matrix have A'.A= D, where D is a diagonal matrix? Or is it always normalized to an identity matrix?
no need to normalize it
easy example, take A = 2*I, where I is any identity matrix
A'.A = 4*I
And how would this relation hold if A' is replaced by (A')*
I'm trying to prove something and I have never taken linear algebra before so sorry if these questions sound repetitive or dumb 😅
it would be faster if you say what you're working on
you can conjugate the matrix i used as an example and nothing changes 😛
Could you please take a look at this and let me know if it's correct or even comprehensive at all?
Ah okay
you didn't prove it
Ah crap
i would suggest looking at the elements of A^H A
(H as in complex conjugate transpose or hermitian transpose)
sure but that doesn't matter here
wait
no
we still don't need it, but it's also not true
That's for hermitian matrices
you can make up any matrix you like out of real or complex numbers, and then take the hermitian transponse or whatever you wanna call it
Ah I think yeah understood not for the conjugate transpose
my hint is to write the matrix in terms of its columns for the first case, and in terms of its rows for the second
and recall that the dot product for vectors in C^n is v^H v
It would be I right? Since the column elements are orthogonal?
And that would follow that rows are orthogonal as well?
what
you're mixing everything up
the two things are completely separate
and it also wouldn't be I
for the same reason i gave you earlier
you can have orthogonal vectors that don't have unit norm
they're even telling you it's diagonal, not an identity
Okay....I think I lack major understanding of this subject sorry 😞
yep, i would recommend reviewing first
matrix multiplication, representing matrices with column and row vectors, dot products, orthogonality
that sort of stuff
Okay thank you so much for your help though 😄
Hello, so, I’m supposed to solve these linear systems, yet I can’t figure out why number 36, for which complete and coefficient matrices SEEM to have different ranks, still has solutions.
are you sure you calculated those ranks correctly?
That's the first thing I'm unsure about in fact
yeah well arithmetic mistakes happen to the best of us
#36 is an overdetermined system. if you disregard the third equation and solve the system formed by the other two you will get a unique solution, and said solution happens to also satisfy the third equation and so is a solution for the whole system
The thing is, the full matrix (so the matrix that includes the second member) has a non-zero determinant.
So, 3 is its rank.
If I remove the last equation, that would make the rank 2.
Unless I can calculate ranks for non-square matrices, but that is pseudomath.
According to the Rouché-Capelli theorem, if the rank for both matrices isn't the same, the system has no solutions.
lmao what
rank is defined for any matrix, square or not. it's not pseudomath
are you sure of that?
Maybe I'm mistranslating ranks. I'm studying them on an Italian textbook.
,w determinant [[1,2,2],[2,1,3],[4,5,7]]
2 of the first row + 1 of the 2nd = row 3?
It depends XD. Do you understand the concept of Gaussian elimination?
i was just talking about the example Ann has
looks like you really only have in that case 2 linearly independent vectors and the other 1 is just a combination of the others
This is a complete matrix. The first two columns are the coefficients, the last column is the second member.
It summarises exercise 36 here.
By the way, both my math books absolutely ignored square matrices when explaining how to determine them.
No wonder I am left like this.
yeah like for every unknown variable you should have at least 1 equation
which is i guess where the whole square matrix things come into play
like for x,y,z you would want 3 equations
but in 36
you have 3 equations and only after 2 unknowns so you only needed the 2 equations i believe
Yeah, that's a good rule of thumb
👍
Are you familiar with projections of vectors onto sub spaces?
if you wanted to ping me out of the blue, you could've at least pinged me directly instead of replying to an irrelevant message.
Oops
you shouldn't ping people out of the blue anyway.
if you have a question, post it here.
Okay...
So so we have like a vector [2,1] would we always with regards to projections and subspaces say that the sub space would be like [ {2,1}, {0,0}]?
actually i think i might need to sit on it to word it better
it's a linearly dependent set, not "2 independent vectors and 1 other one"
isn't that the same thing?
2 indepent vectors with the 3rd being dependent on the other 2
yeah
isn't that what i said?
i mean i guess that is the correct term to call that

how do you choose which one the 3rd is?
yeah i mean you don't do you
It's just a naming convention. Dependent set of vectors <=> at least one is linearly dependent on the others.
Yeah i was pointing out that we just call it a dependent set
you can reduce the set to an indep set by removing one of the vectors of course
So im trying to work out that whole cross product thing and so say if you have 3 vectors U, V, A which are in r^3 how do I relate the find the the part where vectors U, V share the same left null space
Like basically A is that vector you get when you do the cross product of U, V
but I was trying to work off the idea
V transpose A = 0 , and U tranpose A = 0
but how do i find the intercept of said left null space <@&286206848099549185>
graphically it looks like it is the interception of the 2 planes from the resulting left nulls space of each vector
a system of equations can be though of as a matrix by just taking the coefficients and sticking them in a matrix then multiplying by the column matrix of variables
oh so i need another system dont i
oh i was about to ask my own question
oh
what is was gonna ask is just when thinking about a matrix as a representation of system of equations, then what is the column space
well I believe it is thought of as the span of the vectors in that matrix
bc i understand that it's just the span of the columns, but what's the point of treating all the x components of a system as a single vector
basically what is even reachable given the vectors
i should probably start typing messages as one big thing rather than a few small ones
yeah that sure
basically looking at it is just the span of the columns
i believe
basically what all those 3 vectors could possibly reach
in this case
columnspace is R^3 since theyre all linearly independent i know that
well in our example they are not actually linearly independent
hard to show but from the image
they all sit on a plane
so they really only span a plane in R^3
but basically the column space is just what all possibly places through linear combinatons of adding the vectors together that you can possibly reach
well and scaling and substracting
they have the 3d calculator
this might also help https://www.youtube.com/watch?v=k7RM-ot2NWY&list=PLZHQObOWTQDPD3MizzM2xVFitgF8hE_ab&index=2
The fundamental concepts of span, linear combinations, linear dependence, and bases.
Help fund future projects: https://www.patreon.com/3blue1brown
An equally valuable form of support is to simply share some of the videos.
Home page: https://www.3blue1brown.com/
Full series: http://3b1b.co/eola
Future series like this are funded by the commun...
yeah i havent gotten to his colspace video yet so im just gonna stick it out till then
merci
there is also this
MIT 18.06 Linear Algebra, Spring 2005
Instructor: Gilbert Strang
View the complete course: http://ocw.mit.edu/18-06S05
YouTube Playlist: https://www.youtube.com/playlist?list=PLE7DDD91010BC51F8
- Column Space and Nullspace
License: Creative Commons BY-NC-SA
More information at https://ocw.mit.edu/terms
More courses at https://ocw.mit.edu
exactly why im asking
.
oh what are you studying it on your own
yessir
k = an + b
g^an exists in U because it's just (g^n)^a, closedness
then g^-an exists in U, inverses
g^(k mod n) = g^k * g^-an, so by closedness it's in U
wait this is #linear-algebra ?
Ok I got it thank you! Also sorry for wrong channel, will delete in 5 min.
Uh... I think this is true... but when i tried to write it out with the definition of similarity it didn't work out am I doing something wrong???
I tried expressing P as some change of coordinate matrix
but I am getting confused with the D
This is not true, every invertible matrix is the change of basis matrix for some bases (In fact, it's can be the change of basis from some basis into the standard basis in F^n, can you see why?), but not every invertible matrix is diagonalisable
is this correct?
<@&286206848099549185>
rank is the dimension of the image of A and the image of A is the span of its columns
so the image is a subspace of R^7
oh shit
the null space is going to be a subspace of R^4 because of the dimensions of the matrix
and you can use rank nullity to figure out the dimension
the row space should be the span of the rows, which has the same dimension as the span of the columns of A, but is a subspace of R^4
so im(A) is a subspace of R^m and null(A) is a subspace of R^n?
for an m by n matrix yea
