IQ Measurement Puzzle - Statistics Problem


Source: 40 Puzzles and Problems in Probability and Mathematical Statistics (Interesting book by Wolfgang Schwarz)

Inspiration: This problem demonstrates clearly the shortcomings of out grading system through exams

Problem:
Peter has an IQ of 90 whereas the IQ of Paula is 110. However, due to unsystematic biological or psychological day-to-day variation that is unrelated to the IQ per se, any single measurement of either IQ is distorted by an independent additive measurement error that has a zero-mean normal distribution with some variance. For example, if Paula’s IQ were measured repeatedly, the outcomes would be normally distributed with a mean of 110 (her “true” IQ) and some standard deviation. Suppose that either Peter or Paula is selected at random (p = 0.5), and his/her IQ is measured. You do not know who was selected, but you are told that the result of this first measurement is 105. Now the same person —whose identity is unknown to you — is measured a second time.

a) What is your prediction for the outcome of this second measurement if standard deviation = 3?
b) Answer the same question if standard deviation = 20?

Update (Sep 15, 2012):
Minor change in the question as suggested by Akshay Soni

Update (5th Feb 2013):
Solution posted by Akshay Soni (IITB Mech Senior Undergraduate) , AB and Nikhil Simha R (Amazon India SDE, CSE IITB 2012 Alumnus) in comments! Rephrased and improved formatting of the solution and posted by me in comments!










Comments

  1. Akshay6:37 PM, September 15, 2012

    Calculating the probability that peter was selected given the measurement,
    P(Pe|measurement=m)=P(m|Pe)*P(Pe)/total probab
    P(Pe|measurement=m)= N1(m)/N1(m)+N2(m)
    Let the above quantity be U
    where, N1~(m1,sigma^2) & N2~(m2,sigma^2)
    Second measurement given the first = m1*U + m2*(1-U)
    Substituting values:
    new measurement=
    (110+ 90*exp(-100/sigma^2))/(1+exp(-100/sigma^2)

    Now with given variance, i.e. sigma^2=3, sigma^2=20,
    new measurement ~ 110 which is close to Paula's

    ReplyDelete
  2. AB1:14 PM, September 16, 2012

    I tried an extremely crude method for solving this.
    I'll do the case for std. deviation 20:-
    Since probability function for any particular point in a normal distribution is zero, I assumed a range between 104.99 and 105.01 for calculating the probability based on mean and std. deviation.
    Corresponding to Paula, the probability of IQ between 104.99 and 105.01 is 0.00039 while for Peter it is 0.0003. Now applying Bayes rule, the probability of the score belonging to Paula is 0.5652 while for Peter it is 0.4348, hence the expected value of next IQ test will be 101.302.

    ReplyDelete
    Replies
    1. Pratik Poddar12:06 AM, February 05, 2013

      Correct solution. Our answer do not match exactly because of rounding error. Range does not matter. We could have used pdf only. There was no need of cdf. The area "dx" would have cancelled in both numerator and denominator if you would have solved it using variables and then taken "dx" to zero. Nevertheless, correct solution. Thanks

      Delete
  3. nikhil4:11 PM, October 19, 2012

    p(p=peter|x=105)
    =(p(x=105|p=peter)*p(p=peter))/(p(x=105|p=peter)*p(p=peter)+p(x=105|p=paula)*p(p=paula))
    (bayes rule)
    = p(x=105|p=peter)/p(x=105|p=peter)+p(x=105|p=paula)
    ( because p(p=peter)=p(p=paula)=1/2 )

    prediction=p(p=peter|x=105)*90+p(p=paula|x=105)*110
    p(p=paula|x=105)=mu(110,dev)(105)/(mu(110,dev)(105)+mu(90,dev)(105)) // mu(mean,deviation) is gaussian deviation prediction
    now lets try putting dev=20 or dev=3;

    when x=3 we see almost that 105 has its contribution almost all from paula and none from peter for your prediction. Hence approximately 110. (you are very sure it is paula who scored 105)

    but at standard deviation 20 you begin to see that there is significant contribution from peter to predict the next value. ( you are not really sure who is the one who scored 105)

    I don't know if this is what you had in mind. But looks like with one exam(high std. dev.) you cannot really determine who the score belonged to specially even if it is closer to paula's mean.
    So I think you never can really estimate mean scores of students with just one(very less number of) exam.

    ReplyDelete
  4. AB4:34 PM, November 05, 2012

    What's the correct answer

    ReplyDelete
  5. Pratik Poddar12:04 AM, February 05, 2013

    Rephrasing the solution posted by Nikhil Simha. Thanks a ton

    Say first measurement is x
    P(Peter|x=105)=P(x=105|Peter)*P(Peter)/(P(x=105|Peter)*P(Peter)+P(x=105|Paula)*P(Paula))

    Since P(Peter)=P(Paula) = 1/2

    P(Peter|x=105)=P(x=105|Peter)/(P(x=105|Peter)+P(x=105|Paula))

    Prediction for second measurement = P(Peter|x=105)*90+P(Paula|x=105)*110

    P(Paula|x=105)=mu(110,dev)(105)/(mu(110,dev)(105)+mu(90,dev)(105))
    // mu(mean,deviation) is gaussian deviation prediction
    Putting dev=20 or dev=3;

    P(Paula|x=105) with dev=3 is 0.033/(0.033+0.000) ~ 1
    P(Paula|x=105) with dev=20 is 0.019/(0.019+0.015) = 0.559

    Prediction with dev=3 is 110
    Prediction with dev=20 is 90*(1-0.559)+110*(0.559) = 90+20*0.559 = 101.18

    Discussion:
    "When x=3 we see almost that 105 has its contribution almost all from Paula and none from Peter for your prediction. Hence approximately 110. (you are very sure it is Paula who scored 105)

    but at standard deviation 20 you begin to see that there is significant contribution from Peter to predict the next value. ( you are not really sure who is the one who scored 105)"

    ReplyDelete

Post a Comment

Popular posts from this blog

Fraction Brainteaser

Source: Sent to me by Gaurav Sinha Problem: Siddhant writes a Maths test and correctly answers 5 out of 6 Arithmetic questions and 20 out of 28 Geometry questions.  In total, Siddhant scores 25 out of 34.  Vaibhav writes another Maths test and correctly answers 20 out of 25 Arithmetic questions and 6 out of 9 Geometry questions. in total, Vaibhav scores 26 out of 34. Note that a) Vaibhav scores more than Siddhant b) Siddhant score better than Vaibhav in both individual topics -  5/6 > 20/25 and 20/28 > 6/9 How is it possible? 
Read more

Buying Dimsums

Source: Alok Goyal (Stellaris VP, Ex-Helion VC) puzzle blog Problem: A fast food restaurant sells dimsums in boxes of 7 and 3. What’s the greatest number of dimsums a person cannot buy. Generalize it for p and q where p and q are relatively prime. I loved the puzzle. Hope you enjoy it too.
Read more

Consecutive Heads

Let's say A keep tossing a fair coin, until he get 2 consecutive heads, define X to be the number of tosses for this process; B keep tossing another fair coin, until he get 3 consecutive heads, define Y to be the number of the tosses for this process. 1) Calculate P{X>Y} 2) What's the expected value of X 3) What's the expected value of Y This is probably the hardest puzzle I have ever put on my blog. Hence, I will post its solution in the post directly rather than on comment. Solution: 1) (Solved by me finally after 13 months :)) Make a state diagram. Let the state be (a,b) where a is the number of consecutive heads streak "A" is on currently and b is the number of consecutive heads streak "B" is on currently. So, (0,3) (1,3) are final accepted states and (2,0) (2,1) (2,2) (2,3) are failure states. If you get tails, your contribution to the state reaches to "0" f(State) = P(X>Y | "State" configuration initially)
Read more