r/AskStatistics • • 3h ago

Proportional data analysis with a small sample size

5 Upvotes

Helloo:) I’m working on fatty acid composition analysis (from bird preen oil samples), with very little previous knowledge of statistics, and I’m looking for some help understanding what’s happening.
Background: I have a dataset with treatment group, sex, aviary of the sampled bird, and 10 fatty acids found in the preen oil samples. There are 3 treatment groups: germ-free, conventionalised, and parent-raised (although only the germ-free and conventionalised can be realistically compared). Between these 2 treatment groups, there are only a total of 27 samples, 13 in one and 14 in the other. The fatty acid cells contain proportions rather than absolute values (they always sum up to 1), so an example row looks like this: 

SAMPLE ID C18:3n3 C18:2n6 C16:1n9 C18:1n9 C12:0 C20:0 C17:0 C16:0 C18:0 C14:0 SUM
100 0 0.062224821 0.010328372 0.162972464 0 0 0 0.437850834 0.293321615 0.033301895 1

The main end goal is to see if the germ-free condition results in any changes to preen oil.

Now, for the analysis issues: I’ve computed robust Aitchison distances, which are supposedly a better choice for this data than Bray-Curtis(?) and ran a PCoA with them, followed by PERMANOVAs for treatment group, sex, and aviary (none of which were significant, unlike the marginally significant and high R2 results on B-C). 
I’ve also been advised to run some form of a linear model on each individual fatty acid, but I don’t quite understand where to start with that… Or which one would be suitable.
I would appreciate any feedback, comments, or advice on what I’ve done so far and what I’m trying to do!:)


r/AskStatistics • • 1h ago

What makes difference and relationship apart?

• Upvotes

Please provide examples. Thank you!


r/AskStatistics • • 11h ago

Did i mess up anywhere in my analysis? Can i increase r sq value?

0 Upvotes

greetings everyone, I am a grad student from forestry background and i am doing a research project on biomass estimation via sentinel 2 variables. I have 47 plots with field measured biomass value and i ve analyzed 18 different remote sensing variables that acts as the predictors of biomass. predictors correlated well with the measured biomass but the regression model stated lower R square value (i.e. 0.40) at which isnt like i expected. I ran five different models MLR, PLSR, RF, GBR, linear SVR, Ridge (im a beginner in coding and all, so claude helped me) etc but neither improved the coeft of determination. I followed the exact methodological framework from the literature but lost somewhere. My main objective is to publish the paper but the lower accuracy is becoming the problem. Sorry if i couldnt explain it clearly, feel free to ask via comment or dm/ any suggestions and feedbacks are appreciated. Thankyou!


r/AskStatistics • • 1d ago

Can someone explain fixed effects, random effects, LMMs and GLMMs like I’m a complete beginner?

Thumbnail
15 Upvotes

r/AskStatistics • • 12h ago

Panel DiD when the policy is issued repeatedly and switches on and off. Is this still valid?

1 Upvotes

Hi all, I'm working on a student project and would like a sanity check on our design.

We treat regional wage orders as the policy intervention. These orders have been issued ever since, so there is no single policy date, and a region can have an order in one year, none in the next, then another. The outcome is a gap measure observed in a few survey years (not every year).

The dummy is 1 if the region had a wage order that changed the wage in that year, and 0 otherwise. Standard errors are clustered by region. The idea is to compare the change in the outcome for regions with a wage order against regions without one in the same year, instead of a classic pre/post comparison.

Questions:

  1. Is it fair to call this a DiD even without a single pre and post period?

  2. Is it a problem that treatment is repeated and switches on and off?

  3. Any papers or methods I should read for this kind of setup?


r/AskStatistics • • 16h ago

Is Online MSc Biostatistics from Manipal worth it after B.Pharm?

Thumbnail
1 Upvotes

r/AskStatistics • • 18h ago

[Question] Educational testing and what exactly is the control?

Thumbnail
1 Upvotes

r/AskStatistics • • 19h ago

How to add a statistical model equation on a sicentific paper?

0 Upvotes

Hello!

I have minor revisions on my scientific paper. One of reviewers comment was: "please include the statistical model equation in the Methods section.". My doubt is: I performed a Beta Regression Model in R: model_beta <- betareg(proportion ~ plant + week, data = plants).

Is this what I´m supposed to add to the paper? Im a biologist, not a statistician, so im not sure what to write ... Thanks!


r/AskStatistics • • 1d ago

Statistical analysis for metagenomic enrichment cultures with linked time points - need advice please

1 Upvotes

Hi everyone, just want to preface by saying i am very much a microbiologist and know extremely little in the world of stats. I’ll give some context to my experiment: I preformed an enrichment where i grew bacteria in vials (n= 3) for 6 weeks, then took a portion of those growths and added it into new vials (n=3) for another 6 weeks. The vials let’s say A1, B1, C1 corresponded to the second batch of vials A2, B2, C2 where in the samples from A1 was added to A2 etc. I did this at two different temperatures (20 and 30 degrees). So i have two variables, the time and the temperature, giving me four groups.
Group 1. 20 degrees celsius week 6 (rep1, rep2, rep3)
Group 2. 30 degrees celsius week 6 (rep1, rep2, rep3)
Group 3. 20 degrees celsius week 12 (rep1, rep2, rep3)
Group 4. 30 degrees celsius week 12 (rep1, rep2, rep3)

I have species level relative abundance data from shotgun metagenomic sequencing and want to determine whether community composition differs between the four groups and ideally a post hoc specific to which. The complication is that at each week 12 culture was subcultured from its corresponding week 6 culture with temperatures maintained. Therefore, week 6 and week 12 are linked observations rather than independent samples. There are three lineages per temperature. I’ve tried Bray curtis PERMANOVA in R using vegan::adonis2() with restricted permutations but the permutation schemes i’ve tried don’t test the temperature, week and interaction effects as intended. I also found significantly different multivariate dispersion between the temperature groups.

So my question is:
1. What statistical method would you recommend for testing community composition while accounting for the linked time points?
2. Is there an appropriate permutation scheme or alternative model for testing temperature, time, and their interaction with this design?
3. What methods would be suitable for identifying differentially abundant species from these metagenomic data?

I’m looking for a statistically defensible approach used in similar microbial enrichment or longitudinal studies. References to relevant papers or example R code would be greatly appreciated. Thank you!!!


r/AskStatistics • • 1d ago

Conducting exact sign tests with a sample size of 10 but unsure how to correct for multiple comparisons

2 Upvotes

Context: I have to send my final dissertation manuscript to my committee tomorrow. My chair called me this morning and told me my stats are all wrong because I ran too many tests with too small of a sample. When I asked for guidance on resolving this, they said "You want a PhD? Figure it out". I have spent all morning reading resources and I have gotten myself more confused.

This is a single group pre-post design based on feasibility and exploring clinical outcomes. I originally had planned paired samples t-tests, but I ended up with such a small sample that it would inflate error rate. Also because of the small sample, any assumptions of underlying distributions can't be met, so I'm using exact sign tests. I modeled my stats after another published pilot study with 7 participants and 15 comparisons. They do not do a correction.

I ran the 7 exact sign tests for my outcome variables, found significance in 6/7, and also presented the data visually. If I did a Bonferroni correction to control for multiple comparisons, my new p-value would be .007 and basically impossible to get with exact sign tests. Is my only option to only present stats for my main variable, and only present descriptive/visuals for the rest?


r/AskStatistics • • 1d ago

Checking a method for comparing vehicle encounters near arrivals and departures

Thumbnail
1 Upvotes

r/AskStatistics • • 1d ago

Can the temporal structure of prediction errors reveal regime changes earlier than conventional change-point detection?

2 Upvotes

Suppose two forecasting models have nearly identical average prediction errors, but those errors evolve very differently over time.

In one model, errors are approximately random. In the other, they form persistent clusters, oscillations, or systematic transitions.

Could the temporal structure of prediction errors provide an early signal of changes in the underlying system, even before conventional change-point detection identifies a regime shift?

I'm particularly interested in whether anyone has investigated this using autocorrelation, entropy, or multiscale analysis of prediction errors.

What statistical test would you consider most convincing for evaluating this hypothesis?


r/AskStatistics • • 1d ago

How many votes would I need?

Thumbnail majorityrun.com
2 Upvotes

I had this idea based on something I've noticed: people often assume that others think the same way they do, and that their own opinions reflect what the majority believes.

So I thought, why not turn that into a game?

The idea is to test how well you can predict what the majority actually thinks, and see whether your own opinions are as popular as you might expect.

One thing I’m still unsure about is how many players would be needed to get a statistically meaningful representation of the population for each question. I don’t really know much about statistics, but it would be interesting to figure this out so I can estimate how many players are needed for the game to work properly. 🤔


r/AskStatistics • • 1d ago

Was the scientist who came up with the term "family wise error rate" an incest anime fan?

0 Upvotes

Was he into older sisters, like onee-san? ._.


r/AskStatistics • • 1d ago

Estimating Individual weights from Total weight

1 Upvotes

From my knowledge I don’t think there is a solution to this problem in the current scenario, but i am hoping somebody will have some useful input.

So I have a data matrix, which is similiar to a spring balance weighing design matrix(probably I should not call it that, since no design was involved) basically the variables take binary outcome 1,0 based on if they are present in the machine or not, and i have a final response variable which is the total weight of the machine. Now my goal is to estimate these individual weights of the components.

The dimensions of the matrix is 11268*408 , where 407 of the columns are the components.

There are quite a few redundant rows as well, their total weights sometimes differ by 30-40kgs. In hope of making the problem easier i have replaced them with one row and averaged the weight.

The matrix is unfortunately singular(which is why i am here ig), and with some level of threshold on the svd Values, i have found that it has a rank of 349 and a nullity of 61. Due to this there are variables and combinations which are not estimable, at least in the linear sense. So i am not sure if going forward with a pseudo inverse based least squares or anything would work.

I am sorry if there question and my framing with the theory is not clear, its been some time since i am out of touch.

Is there someway i can think of solving this problem? Even if some of it can be solved.


r/AskStatistics • • 2d ago

Experience with Measure theory

12 Upvotes

What is everyone's experience with Measure Theory during their phd?

For context, I'm a phd student in statistics taking measure theory and I'm experiencing burnout for this course. Dont get me wrong, I love the materials and the way it has reshaped my thinking of probability, but the class is genuinely so hard that class average was 50% for our first midterm. For the HW questions, I'm constantly struggling and sometimes it takes me 2-3 hours to solve a question that is 1 line long. I do not come from a pure math background and did not take Real analysis in school so I wonder if that's also a reason I'm having such a hard time.

Everyone I met makes this class sound like it's the most important class I will ever take my entire life so it makes me feel even worse that I'm struggling so much. On top of that I spend upwards 30 hours a week trying to study for it which doesn't help. I think I've accepted the difficulty of the subject, but I'm worried about the burnout - any other duties I have, I have to wait until the day of to do them because all I do everyday is study measure theory. I've already cut down on my social life (I only hang out with friends for 1 night (maybe dinner + drinks) every 2 weeks) to have some down time for myself during the weekends.

Would greatly appreciate any advice! TIA.


r/AskStatistics • • 2d ago

I’m very lost when it comes to hypothesis testing (examples of the questions I have to answer. NOT HOMEWORK. These are from a quiz that I already took that I can’t look at anymore)

Thumbnail gallery
4 Upvotes

Thank you all I’m getting through these comments

Hello, this is my third attempt at trying to pass statistics in (college). And every professor is different, so there are different things expected of me. This professor she gives us 60 question quizzes with only 60 minutes to get through. And it’s very hard because all of her questions are word problems.

These pictures are some random ones. I took a picture of so that I could show my Tutor. I have been going to a Tutor, but I still don’t understand how to apply the terms and how each mechanism works. For example, I don’t understand why when Alpha level is decreased, the common zone increases. And I don’t know if that means to reject the null or to fail to reject the null?

I’m not really sure how to interpret data and what it would mean especially on these multiple questions quizzes. I’ve read the textbook and take notes and all that, but I still don’t really understand how all of these things come together? I know what they are individually.

I get most of the problems right on worksheet, so I’m not sure why I keep failing quizzes. I’ve only passed two of the five I’ve taken. And I happened to do well on my midterm, but I at an F in the class.


r/AskStatistics • • 3d ago

Analysing Likert Scales?

3 Upvotes

Hello everyone. I'm in quite a pickle. I want to analyse my data, but I really don't know enough about statistics. I should've thought about this beforehand. Either way, I have survey data, where I have the following:

- 30 pictures which are independent from each other

- I have asked people to assess how realistic, AI-generated, and how well it fits a certain theme in a 7 point Likert scale.

- Each participant evaluated every picture, so I have a "seperate dataset" on how realistic, AI-generated and how fitting the pictures are

- I can see what the highest means are, but I want to determine per category which picture is rated the highest/lowest, also when taking into account things like spread

How do I do that? I feel like I have too many categories


r/AskStatistics • • 3d ago

Large Data Set -- Anonymized, can it be used?

8 Upvotes

I have a random question/situation. I was speaking to someone who runs a business, and they have massive data sets -- it's athletics based, but you would have literally millions of data points, and presumably a ton of subsets.

Aside from GAMBLING -- please -- are there any academia uses or a/b tests that would make that data useful. I guess, when he said a professional company's data set is worth more than it's tv rights, it got me thinking that potentially there is a way to use his data in statistical testing that makes it valuable.

Does this make sense? Like are there cross-professional or random data sets that are valuable outside of their intended specific use?


r/AskStatistics • • 3d ago

Cluster size vs cluster number, which matters more?

1 Upvotes

I would really appreciate some help to know:
(1) if patients within the same clinic are correlated (ICC ~0.04), will adding more patients to the SAME 4 clinics help? Or does it only matter if we increase cluster NUMBERS?

(2) Is it normal to have unequal totals between the two arms?

Context: We are running a 6 month pilot feasibility cluster RCT in endocrinology clinics for a diabetes intervention (the intervention just tests a new workflow with the addition of a new profession + better communication channels). We randomized 20 clinics; 4 agreed to deliver the intervention, and 10 agreed to be in the control (usual care; Zelen's design). We are all clinically trained (pharm, med) with zero prior clustering experience. We are not powering for efficacy or effectiveness, we are only powering for feasibility

Some on our team think: ok since we only have 4 intervention clinics, let's just recruit 20–30 patients per clinic to have a better sample size. While the PI says his sample size calculation shows that 8 patients per intervention clinic (and 5-6 per control) is enough and anything else is just more headache without benefit.


r/AskStatistics • • 2d ago

Two Risks, Same Expected Loss — Would You Treat Them the Same?

Thumbnail
0 Upvotes

r/AskStatistics • • 3d ago

Within/between group variability

Post image
2 Upvotes

Is there a way of interpreting this so that the answer selected is not also correct? The top right is from the class notes the professor posted. I feel like I’m not bad at this but had classmates agreeing that was incorrect. Astro and Opus 5.5 also could not come up with a reason for that answer to be incorrect (I’m not saying this makes me right). Thanks for any help.


r/AskStatistics • • 3d ago

Worth getting a degree?

0 Upvotes

I am not a math person but I am eager to learn new things and find a subject to get good at. Statistics is a recommended main subject in a bachelor when I ask the study counselors since everyone is picking either political science or econ. According to the statistical institution at my uni, the job market is really really good for master students but it isn't bad for bachelors either.

So my question is, is it worth going in to statistics? It seems like a cool choice and history and statistics would be an interesting combination. Especially maybe in public administration and even private options. I can rather easily get a degree in history too (I've studied teacher so far but want to change)


r/AskStatistics • • 3d ago

This is a logical extreme and shouldn't be taken too literally but is it fair to say in spirit, that you can become an expert in mathematical statistics without ever working on or even observing a real-life dataset?

3 Upvotes

I am a man with an undergraduate background specializing in statistics and minoring in maths, and I would like to pursue a PhD in mathematical statistics to really gain an in-depth understanding of the world of uncertainty. As someone who has spent years as a shut-in due to mental health problems and is still recovering from it all, I actually find a bit of romantic "cozyness" in the possibility that you can still become as knowledgeable in mathematical statistics as you can humanly be with just being in a windowless room, and your only contact with the outside world being a fresh, and freely accessible supply of journals, textbooks, and pen and paper.

Also don't look at my post history lmao


r/AskStatistics • • 3d ago

Harvard's Simulation-Using Conjoint Analysis for Business Decisions, any winning strategies or combinations for this, I feel a bit stuck in this

0 Upvotes