Lalitha A R

Maximising variance in dimensionality reduction (PCA) and chettinad paneer gravy

Okay, image you are a spy and you are looking to find more information about your target. But you have far too many files at hand and need to scope it down so you can actually find the person.

You have clue

XX = The person breathes oxygen

YY = The person likes chapati with chettinad paneer

ZZ = The person knows how to make chettinad dishes and salna

Now, can you tell anything unique about the person to track down based on XX? Nope. It’S same for every human in the list.1 But then YY and ZZ tells you something:

  1. Either they have lived in tamilnadu / knows tamil or atleast have travelled
  2. But when you add they also know how to cook, you can pretty much say most likely someone who lived in tamilnadu and mother tongue being tamil

They both point in the same direction and lets you deduce: Tamil person.

So instead of keeping all the clues (which was our problem to begin with), you do

PC1≈0.707Y+0.707Z\text{PC}_1 \approx 0.707Y + 0.707Z

Basically, when we are working with too much data and you want to tone it down so you get information2, you see which directs are useful and throw others away.