r/AskStatistics • • 12h ago

Did everything "right", became a statistical analyst, got laid off. Is it worth it to stay on track or pivot completely, given the obviously foreboding circumstances we all face.

15 Upvotes

Hi all!

Thanks for reading.

I'm at a serious career crossroads and would really appreciate some honest perspective about what I might be able to do next.

As a bit of background, I got a B.S. in Mathematics and an M.S. in Statistics/Decision Theory and graduated in 2023. Got hired as a stats analyst at a reputable think tank at the beginning of 2024, where I worked with some amazing statisticians and economists on work in Medicaid studies and the likes. That is... until the axe fell. As a largely government-funded institution, devastating cuts to healthcare, socioeconomic research, DEI, etc., left a huge chunk of us either laid off immediately or facing the prospect of another year or so before ultimately joining the unfortunate many, myself included. Many who got laid off were considered prestigious researchers in their areas with 20+ years of experience.

Now I find myself in a brutal job market - limited opportunities, intense competition, and the imposing doom of AI in statistical analysis and data science. For example, I was recently a serious contender for an entry level analysis position requiring 2 years of experience but was pushed out by someone with 12+ years of experience. It's rough. So rough that I'm wondering if staying in this field is even feasible anymore.

I'm willing to pivot from research to pretty much anything within the field. I'll really miss contributing to meaningful work but let's face it, I have a family to feed, so to speak. That said, I'm also willing to put in the work to pivot further into, say IT infrastructure or something like that if the money is there and the certification process is not crazy. Heck, I'm even considering starting a house painting business.

I'd really appreciate some honest perspectives:

  • For those currently working in statistics or data science, how are you feeling about the job market and long-term prospectives?
  • Has anyone here successfully pivoted from stats to something different? How was the transition?
  • If you were in my position, would you continue pursuing statistics, invest in new technical skills, or seriously consider a different path altogether?

I'm not expecting anyone to make this decision for me. I'm just trying to seek inspiration as to where to direct my energy after months of shooting resumes into essentially a void. Thanks!!!


r/AskStatistics • • 15h ago

What to do with many categorial variables in regression?

6 Upvotes

Hi, I'm trying to do a regression analysis to find relationships between 16 nominal/ ordinal variables + 11 continuous variables and only 1 continuous dependent variable in SPSS.

I searched online and found out that I have to create dummies for each categorial variable. But, I have 16. I don't think it's efficient! I believe it will create many errors.

So, what to do? is there a way that SPSS can do that by itself in the background?

Or maybe a different regression approach? I found that there is something called General Linear Model, it separates the nominal variables from the continuous ones before doing the analysis.


r/AskStatistics • • 8h ago

Harmonising logically dependent covariates before regression: iterative covariate-space approach or joint model of y and x?

2 Upvotes

I am building a regression model for a response y using several covariates that describe the same physical reality, namely the built environment. The covariates come from different sources, and they should be consistent with each other:

  • If there is a road, there should be impervious surface.
  • If there is impervious surface but no road, the road map may be incomplete (the road data come from OpenStreetMap, whose completeness varies).
  • If there is a building height, there should be impervious surface.

And so on for the other covariates.

In practice the sources are imperfect, so these relationships are often violated. A regression model such as a random forest or gradient boosting will handle this implicitly, through the predicted probability of y given the covariates. I wonder whether a more explicit, iterative process would work better. I see two options:

  1. Covariate space only: harmonise the covariates among themselves before the regression. For example, iteratively update each layer given the others until they are mutually consistent.
  2. Joint model of y and x: model the response and the covariates together, so that each constrains the other.

Some of the rules are firm (a building height implies impervious surface). Others are only probable (impervious surface without a road may be a car park, not a missing road).

If each option were formalised as a single, well-defined statistical procedure, which procedure would be the most appropriate for Option 1 and which for Option 2, given that the rules are a mix of firm and probable ones?


r/AskStatistics • • 18h ago

Struggling with determining significance: How to analyze number of occurrences per group member per day per treatment?

6 Upvotes

Say I'm attempting to determine significance of temperature on the sprout timing of a species of grass. I have 2 groups of 30 pots held at either temp A or temp B. My results are in the form of the number of sprouts that emerged in each pot on each day of the experiment, as well as the temperature at which they were grown. What kind of analysis is best for determining whether there is a significant difference between the timing of the two temperature groups? I'm very grateful for any suggestions.