Behold: PRQL. I only know it exists not if the errors are good, my SQL needs are simple, but perhaps for some complex data wrangling it could be nicer idk
- 0 Posts
- 6 Comments
PartiallyApplied@lemmy.worldto People Twitter@sh.itjust.works•It's best not to dwell on it4·26 days agoPerhaps the textbook example is the Simpson’s Paradox.
This article goes through a couple cases where naively and statically conclusions are supported, but when you correctly separate the data, those conclusions reverse themselves.
Another relevant issue is Aggregation Bias. This article has an example where conclusions about a population hold inversely with individuals of that population.
And the last one I can think of is MAUP, which deals with the fact that statistics are very sensitive in whatever process is used to divvy up a space. This is commonly referenced in spatial statistics but has more broad implications I believe.
This is not to say that you can never generalize, and indeed, often a big goal of statistics is to answer questions about populations using only information from a subset of individuals in that population.
All Models Are Wrong, Some are Useful
- George Box
The argument I was making is that the NYT will authoritatively make conclusions without taking into account the individual, looking only at the population level, and not only is that oftentimes dubious, sometimes it’s actively detrimental. They don’t seem to me to prove their due diligence in mitigating the risk that comes with such dubious assumptions, hence the cynic in me left that Hozier quote.
PartiallyApplied@lemmy.worldto People Twitter@sh.itjust.works•It's best not to dwell on it1·26 days ago“Wet sidewalks cause rain”
Pretty much. I never really thought about the causal link being entirely reversed, moreso that the chain of reasoning being broken or mediated by some factor they missed, which yes definitely happens, but now I can definitely think of instances where it’s totally flipped.
Very interesting read, thanks for sharing!
PartiallyApplied@lemmy.worldto People Twitter@sh.itjust.works•It's best not to dwell on it5·26 days agoI feel this hard with the New York Times.
99% of the time, I feel like it covers subjects adequately. It might be a bit further right than me, but for a general US source, I feel it’s rather representative.
Then they write a story about something happening to low income US people, and it’s just social and logical salad. They report, it appears as though they analytically look at data, instead of talking to people. Statisticians will tell you, and this is subtle: conclusions made at one level of detail cannot be generalized to another level of detail. Looking at data without talking with people is fallacious for social issues. The NYT needs to understand this, but meanwhile they are horrifically insensitive bordering on destructive at times.
“The jackboot only jumps down on people standing up”
- Hozier, “Jackboot Jump”
Then I read the next story and I take it as credible without much critical thought or evidence. Bias is strange.
PartiallyApplied@lemmy.worldto Not The Onion@lemmy.world•Dodge Chargers Now Have Pop-Up Ads at Every Stoplight... Just What Nobody Asked ForEnglish5·28 days agoI think many people don’t like it conceptually because the advertising for Brave is:
Built in Privacy + Crypto + Ad Blocking
Firefox + uBlock Origin suffices well enough for most people. It’s stable, suits the purpose, and separates them from a company entangled with crypto.
Everyone is just trying to do their best to balance convenience with the social impacts of their actions. People make change because they care, either altruistically or personally, but it always comes with some sort of personal cost. Putting your neck out there and trying to make a change is more important than any specific browser choice
deleted by creator
You probably already know this, but for those who don’t, git can globally ignore patterns. It’s the first thing I set up after logging in. Honestly wish git just shipped this way out of the box (maybe match .DS_Store by name and some magic bytes?) with a way to disable it. Just for the sake of easier onboarding
deleted by creator