Clarifying Apple Stock Question

#12
by rccogar - opened

Hi - Just wanted to ask a clarifying question (keeping it a bit vague to avoid any risk of further contaminating others' validation results).

Task ID: 08cae58d-4084-4616-b6dd-dd6534e4825b

Question: "According to Google Finance, when was the first year the Apple stock went above $50 (without adjusting for stock split)?"

Annotator Steps: '''

  1. typed in 'Google finance apple' on browser
  2. clicked first link
  3. clicked 'max' to display entire history of apple stock
  4. hovered mouse around the area that line crosses over $50
  5. noted the date'''

This was confusing - "why is my agent getting such a different result?"
The reason is that, like most finance websites, Google Finance adjusts for stock splits by default.
So the provided response is the first year Apple's stock went above $50 (adjusting for stock splits).
The date Apple's stock first crossed $50 (without adjusting for stock splits) is > 10 years earlier.

So I think the question should be updated to remove the word "without".

Happy to elaborate further if helpful.

Thanks,

C

Tagging @gregmialz on this one :)

The question is simply wrong.
The original annotator wanted to state "backward adjusted price" > $50, but them mistakenly described it like "unadjusted price" > $50, which was achieved in the second year the stock hit the market.

But this is a common problem for fact-seeking benchmarks where annotators may not be true professionals of the field related to their questions.

Besides the only way to fix the problem is the alter the question from "unadjusted price" to "backward adjusted price" as google finance only provide the later one.
Moreover, I have zero idea why one should according to google finance as stock prices must be all the same everywhere.

Your need to confirm your account before you can post a new comment.

Sign up or log in to comment