View Single Post
Old 01-24-2021, 12:45 PM   #46
arpad_m


 
arpad_m's Avatar
 
Drives: 2018 Camaro 2SS A8
Join Date: Jul 2017
Location: East Tennessee
Posts: 11,714
Quote:
Originally Posted by ember1205 View Post
But there is no appreciable amount of data. By their own admission, their sample size is miniscule - "329,000 vehicles in our 2020 surveys, detailing 2000 to 2020 models." If we were to assume even breakdown by model year, that's 16,500 cars from each model year.

Let's assume that the complete list of manufacturers is: Chevy, Cadillac, GMC, Buick, Ford, Lincoln, Dodge (inclusive of RAM), Fiat, Subaru, Honda, Acura, Toyota, Lexus, Infinity, Nissan, Land Rover, Jaguar, Mercedes, BMW, VW, Jeep, Audi, Volvo, Hyundai, Kia, Mazda, Chrysler, and Mini. That's 28 of what are arguably the most common and well-known brands on the roads. If we again assume equal division among all manufacturers, that's less than 600 cars from each manufacturer, for each model year. Split that among the various models within a brand and you end up with what? MAYBE 100 of any one specific model but not accounting for differing trim levels? That number effectively represents the ANNUAL sales numbers per dealership on most models!

CR is not a comprehensive review, and owners that respond are more likely to respond because they want to complain as opposed to wanting to praise.

Viewed in another light, 329,000 surveys sent out for 2020 represents .1% of the US population. That's one tenth of one percent.

Could there be useful information to be had at the hands of CR? Sure. But, you have to take their information with a grain of salt by knowing that you are not being shown data that represents a true sample size of any specific car out there.
Absolutely. I didn't mean I was convinced about the veracity of their conclusions, quite the opposite in fact, but that the method in itself looks fundamentally sound. There must be other factors that throw it off, such as the insufficient or completely absent weighting that I mentioned, or the less than significant sample size that you have brought up, a very good point indeed.
__________________
2018 Camaro 2SS — G7E MX0 NPP F55 IO6
735 rwhp | 665 rwtq

Magnuson TVS 2300 80mm pulley | Kooks 1 7/8" LT headers | JRE smooth idle terminator cam | LT4 FS & injectors | TSP forged pistons & rods
JMS PowerMAX | DSX flex fuel kit | Roto-Fab CAI | Soler 95mm LT5 TB | 1LE wheels | 1LE brakes | BMR rear cradle lockout | JRE custom tune

1100 - 1/30/18 | 2000 - 1/31/18
3000 - 2/06/18 TPW 2/26/18
3400 - 2/19/18 | 3800 - 2/26/18
4300 - 2/27/18 | 4B00 - 3/01/18
4200 - 3/05/18 | 4800 - 3/14/18
5000 - 3/16/18 | 6000 - 3/19/18
arpad_m is offline   Reply With Quote