Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

One of my degrees is in statistics, and the others are in computer engineering, finance, and computer science. As such I not only took a ton of math, but studied and worked in the contexts you describe where stats is relevant.

The problem with statistics education is that it is generally heavily watered down, particularly the classes at the university level for business, psychology, and other majors that need the knowledge but aren't math or engineering majors. People heavily misunderstand the usage, difficulty, and nuances of stats education if they are only exposed on this level. It's better than nothing, but leads to serious issues that remind me a bit of the novice arrogant programmer vs. the grizzled veteran smart senior programmer. Generally, most people I see with limited stats education come out of it thinking mean, median, normal distributions, and at best linear regression are the whole of stats.

Another problem that also related to the parent with regard to stats vs. calculus is that calculus is actually a pre-requisite for most useful statistics work. It is true there are plenty of topics in stats you can cover without knowing calculus, but you are at a severe disadvantage and won't really understand the "why" and just be regurgitating the memorized method. I feel a lot of statistics is a combination of the "why" and "how" because so much of it is applying math at a more discretionary and opinionated level, like is done in science. Really learning stats requires a lot of math, from advanced algebra to diff eq possibly to matrices to calculus. To do good work in stats, you need a lot of tools to draw from, otherwise you're stuck with tools that often don't work (common example is people who only are familiar with normal distributions and nothing else).

Yet another problem with stats is that you can really make up whatever you want when you conduct statistical applications such as an analysis. The rule is that as long as you provide justification and proof for what you are doing - i.e. how and why, it is acceptable along with some text to explain. This is why good statisticians do things like describe and reveal their sampling methods, explain what did and did not work, and why they selected various tools. Obviously most dubious work can be quickly disputed and identified by someone who knows what they are doing, but the reality is that so many people never follow-up, fact check, or even read anything but the conclusion.

Stats is in so many ways about showing the process and justifying your answers than the quantitative answers. This is similar to financial forecasts as well for example which also use a lot of applied math, and people just believe what they read even though the evidence to disprove the report is right there. The science comparison applies here too. Just like with research studies, a lot of people don't check, verify, and re-run the results so people just believe what they read or rubber stamp it. I recall I had a very mean professor that once gave a final exam question that actually could not be solved at all using the methods we learned because the types of analysis and models we were asked to try to apply were invalid for the data. The simplest version of this familiar to many people is trying to create a best fit linear equation to non-linear data - simply draw it on paper against a data plot and you'll see it makes no sense.

If there's one important thing I learned in stats, it's to be skeptical and prove things with evidence. Nearly every time I watch the news, read an article, etc., I go nuts because they are making huge conclusions without giving you a way to understand who, what, where, why, and how about the study. The presidential elections in the US are an obvious example I see a lot with things like "Survey Monkey" passed off as scientific data in some contexts. Even represented as a casual, unscientific process, such things can be dangerous because people still accept statistics at face-value usually.

In summary, yes, people should learn statistics but it requires a lot of hard work to develop the tools and analytical skills to do it right. Like calculus, it can require many courses which can equate to years of study. Like anything, the skills involved also tend to get better with time and increased knowledge. At least an extra course or two beyond what is taught now would go a long way, but people really need to emphasize more than stats as repeating some processes of functions, formulas, proofs, and such, and more as a way of thinking and set of tools. Stats should teach you to be very paranoid and skeptical, and verify what you see in the world around you as best you can before you believe it. Once you do that, like the parent says, you will see so much clearer what is true, false, dubious, could be better, etc. in the world around you.



For students who aren't going to learn calculus, I wonder if a better introduction to prob and stats (and perhaps math in general) would be through simulation and visualization rather than learning formulas by rote.

I had the opposite problem, which was that I learned stats as a bunch of proofs with practically no applications. I only use fairly basic stats today, but I often test my conclusions by running some sort of monte carlo analysis. I graph everything.

It sounds like a lot of what you're recommending could be described as teaching general quantitative scientific methodology.


>practically no applications

This is the general problem with math education in general. Just equations. Solving equations is relatively easy. Coming up with them is where the real challenge and innovation is.


Solving equations is NOT easy.


Where I went to school there was an undergrad stats sequence for engineers, which was mathematically more intense than the general stats sequence. But it still didn't use much, if any, calculus. And I think in general I'm on board with most here that believe that for most people who aren't going to be engineers, a year of stats is more valuable than a year of calculus.


Oh I agree with that notion, it's just hard to get a lot out of stats without a large volume of it and a lot of other types of math as tools. Some are pre-requisites, while others are simply useful for applying in conjunction/situationally.

I still feel like calculus is one of the more valuable types of math. It really does teach you a lot, but like anything, it requires a good teacher. I find it all ties together for me in the end, like when doing graphics programming and games, I use a lot of trig, geometry, algebra, and calculus even, and stats some (and even more for business-type stuff).




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: