r/dataanalysis • • Jun 12 '24

Announcing DataAnalysisCareers

66 Upvotes

Hello community!

Today we are announcing a new career-focused space to help better serve our community and encouraging you to join:

/r/DataAnalysisCareers

The new subreddit is a place to post, share, and ask about all data analysis career topics. While /r/DataAnalysis will remain to post about data analysis itself — the praxis — whether resources, challenges, humour, statistics, projects and so on.


Previous Approach

In February of 2023 this community's moderators introduced a rule limiting career-entry posts to a megathread stickied at the top of home page, as a result of community feedback. In our opinion, his has had a positive impact on the discussion and quality of the posts, and the sustained growth of subscribers in that timeframe leads us to believe many of you agree.

We’ve also listened to feedback from community members whose primary focus is career-entry and have observed that the megathread approach has left a need unmet for that segment of the community. Those megathreads have generally not received much attention beyond people posting questions, which might receive one or two responses at best. Long-running megathreads require constant participation, re-visiting the same thread over-and-over, which the design and nature of Reddit, especially on mobile, generally discourages.

Moreover, about 50% of the posts submitted to the subreddit are asking career-entry questions. This has required extensive manual sorting by moderators in order to prevent the focus of this community from being smothered by career entry questions. So while there is still a strong interest on Reddit for those interested in pursuing data analysis skills and careers, their needs are not adequately addressed and this community's mod resources are spread thin.


New Approach

So we’re going to change tactics! First, by creating a proper home for all career questions in /r/DataAnalysisCareers (no more megathread ghetto!) Second, within r/DataAnalysis, the rules will be updated to direct all career-centred posts and questions to the new subreddit. This applies not just to the "how do I get into data analysis" type questions, but also career-focused questions from those already in data analysis careers.

  • How do I become a data analysis?
  • What certifications should I take?
  • What is a good course, degree, or bootcamp?
  • How can someone with a degree in X transition into data analysis?
  • How can I improve my resume?
  • What can I do to prepare for an interview?
  • Should I accept job offer A or B?

We are still sorting out the exact boundaries — there will always be an edge case we did not anticipate! But there will still be some overlap in these twin communities.


We hope many of our more knowledgeable & experienced community members will subscribe and offer their advice and perhaps benefit from it themselves.

If anyone has any thoughts or suggestions, please drop a comment below!


r/dataanalysis • • 22h ago

FAERS is a masterclass in why you model the data-generating process before the data

11 Upvotes

If you want a dataset that punishes naive counting, the FDA's adverse-event database (FAERS, public via OpenFDA) is perfect. Twenty-plus million reports, and almost every property a data scientist relies on is absent or adversarial:

No denominator. Reports are suspicions filed voluntarily. There is no exposed-population count, so no incidence rate can ever be computed — any "rate" derived from it is fabricated.

Duplicates by design. The same case can be submitted by the patient, a pharmacist, and the manufacturer, plus follow-up versions of each. Deduplication and restricting to primary-suspect reports is the first pipeline step, not an optional cleaning nicety.

The collection process reacts to publicity. For semaglutide, reports by year received run: 40 through 2017, 1,142 in 2018, 3,515 in 2020, 6,302 in 2022, 9,483 in 2023, 14,287 in 2024, 19,977 in 2025. That curve tracks adoption and media attention. Treating it as a risk curve is the classic error.

Coding artifacts dominate naive rankings. MedDRA Preferred Terms include administrative entries — "Off Label Use" alone accounts for 7,316 semaglutide reports. Rank raw terms and your top "adverse events" are paperwork.

Missingness is informative and huge. Outcome and age fields are blank in a large share of reports; blank means unknown, not none.

The standard tool that survives all this is disproportionality analysis — ROR/PRR against the full database, with the Evans criteria (PRR ≥ 2, chi-square ≥ 4, ≥ 3 cases) as a screening rule. In an October 2026 snapshot, semaglutide's impaired gastric emptying posts ROR 117.2 (95% CI 112.7–121.9), and 96.9 when restricted to 2023–2026 — a signal that persists after you control for the publicity era. That persistence check is the whole game: a statistic that survives interrogating the generating process.

What other public datasets do people here use to teach "the count is not the phenomenon"?


r/dataanalysis • • 20h ago

A practical learning order for beginners, with a realistic timeline

1 Upvotes

I get asked fairly often how to start in data analysis with no experience, so here is the order I would follow if I had to begin again, plus a timeline that is honest about how long this takes.

Start with spreadsheets, not Python. Excel or Google Sheets will still be part of the job even if you later use other tools. Learn how to clean a messy export, write formulas, build a PivotTable, and make a simple chart that answers one question. If you cannot turn a raw file into a clear summary, the rest of the stack will not help much. This is a few weeks of work if you practice on real files, not just tidy tutorial datasets.

Add a little statistics next, but keep it practical. You want medians as well as averages, a basic sense of distributions, and a habit of asking whether two things that move together are actually causing each other. This is not about becoming a statistician. It is about not presenting a clean number that is quietly wrong.

Then learn SQL. In a lot of companies, this is how data actually gets pulled. I would learn it in this order: SELECT and FROM, WHERE, ORDER BY, aggregates with GROUP BY, then INNER and LEFT JOINs. Practice until you can explain what a join keeps and what it drops. Also watch for joins that duplicate rows and inflate totals. That mistake is easy to miss.

After SQL, pick one visualization tool and stay with it long enough to get decent. Power BI, Tableau, or even well-built Excel dashboards are all fine. The skill is not the software brand. It is showing a finding so a non-technical person can use it.

Python can come after that. I would focus on pandas and basic plots first. Machine learning can wait. Plenty of junior work is Excel, SQL, and a clear explanation, not a model.

The part that matters for applications is a small portfolio. Three to five projects is enough if they are finished. Use public data, pick a question a real team might ask, write down your steps, and be honest about the limits of the data. A short write-up of one good project beats a list of unfinished notebooks.

On timing: if you can give this 8 to 10 hours a week, six to twelve months is a realistic window for junior or internship-level work. Less time per week stretches that out. A two-month crash plan usually produces shallow projects. The better test is not "how many tools have I opened," but "can I take a messy question and come back with a clear, careful answer?"


r/dataanalysis • • 3d ago

Why?

Post image
7 Upvotes

r/dataanalysis • • 3d ago

Project Feedback Cloudflare's analytics dashboard wasn't keeping up with my site metrics. So I built an atlas for my 30 day site traffic.

0 Upvotes

r/dataanalysis • • 4d ago

Project Feedback I built a free .pbix viewer that opens your file locally. Nothing is uploaded

Thumbnail
powerbireader.app
10 Upvotes

Select a .pbix file and it runs entirely in your browser. The file is never sent to a server, all information is kept locally.

Features:

- Lists tables, columns and relationships

- Export tables to CSV/XLSX

- Shows all DAX measures with their expressions

- No install and no account

Feedback and suggestions are very welcome!


r/dataanalysis • • 3d ago

Wrote down 150 forecasts with a % over 3 months. My 90% calls hit 71% of the time

0 Upvotes

started this after reading superforecasting. every week i wrote 10-15 small predictions with a %, stuff like the weather, if a package shows up on time, sports, btc closing higher, work deadlines.

results after 3 months:

-50-60% calls: hit about 57%, fine

-70-80% : hit 66%, a bit overconfident

-90%+: hit 71%, very overconfident lol

-worst topic by far was prices. my btc calls were basically a coin flip with extra confidence

anyone else track this? what actually helped you get better calibrated


r/dataanalysis • • 5d ago

Advice about interacting with Claude for complex projects?

24 Upvotes

I'm struggling at work, and I need advice. I'm an analyst, but my question is not super specific to analytics, so I understand if I need to move my post.

The main problem is that I've had multiple coworkers send me long, Claude-generated documents about our data models and tasks, and I am having a hard time understanding them.

I work at a decently large company, and I've been shuffled around on a few different projects. This means I have to learn all about the underlying data models, metrics definitions, etc. each time I move. I am a big "learn by doing" person. In my previous jobs, I'd be assigned a couple of ad hoc requests, and that would help me build my understanding of the data and how it's used.

At this job, someone (peer or, the main culprit , my own manager) will send me a zip folder with a mix of md, sql, py, all generated by Claude, and say "this should have what you need." I'm expected feed everything into Claude, validate the output, and then have a report or updated data model ready to go in less than a week. Most of the instructions I receive were written by a robot, for a robot. Standard, shared documentation is missing in a lot of places, and the context lives in someone's head and then gets put into a prompt for Claude.

I'm having a major comprehension problem paired with a speed problem. I'm expected to move quickly and defend all my numbers, but I feel I can only do one or the other. My boss insists I must be prompting Claude incorrectly if I am getting confused or slowed down.

Does anyone have advice about how I can use Claude (as it is required by my company) but not totally melt my brain? I feel so lost right now.


r/dataanalysis • • 4d ago

How do you deal with this

2 Upvotes

Hi,

I have been doing data analysis for quite some time now, and notice a common theme of issue I have had when working across departments in my company, as the dataset may vary the knowledge required to understand is always different, hence getting the time to sit down and study them, is near impossible.

In some cases, values in columns don't make sense, objectives aren't properly defined, or important information is scattered across questionnaires, documents, emails and conversations with the people who collected the data.

And of course, the people who have that knowledge aren't always available when you need clarification.

I want to understand how other people deal with this, particularly those working across multiple projects or departments in a company or organisation.

I have been trying to tackle this issue by using a plugin (currently still in the work, but getting good result so far), to assist me . With it, I am able to simultaneously connect the spreadsheet I'm analysing to a shared project space containing uploaded contextual documents or files that contains information and knowledge related to the spreadsheet, so I can find information without having to search through everything manually again. So when going through the dataset, I can click on a variable and it searches the documents and find information on it that are presented in those saved documents.

But nonetheless, I'm interested in how you approach these problems, especially those working in different industries or with larger datasets.

Would love to hear about your experiences.


r/dataanalysis • • 5d ago

Project Feedback Can anyone help me with project execution ? how do i approach it ? Created a Guide but didn't worked out well

0 Upvotes

Hii everyone,

I was a digital marketer executive in an agency, after i quit my job i started learning tech stack for data analysis i am finished with learning and currently on project i started my project last week its a cart abandonment analysis from GA4 dataset on big query whole plan is to analyze using creating a funnel than using python perform statistical tests ( hypothesis testing and ab testing ) and present my findings through power bi.

ideation part was done now i actually had to do project so i asked claude to create a guide for me to follow, a project guide and another solution guide to it.

But the guide's language was tuff it gave me ques and was done with i didn't knew what to do or how to do to it fast forward to today i have improvised and created 4th version of that guide with improved language better guidance but there is always something missing a vague question important information being left out for my sake i created an excel with imp fields out of 108 columns.

Today after writing a 50 line query to create a session table i was confused like why am i doing this i couldn't ans why i need this table it doesn't look like the funnel i thought it would be, mind you i have created funnels before in sheets for campaign analysis from top of the funnel metrics to the bottom of funnel from cpm cpc ad spend to order initiated order completed and all the steps in between so i asked chatgpt about the funnel part of my project ( which i thought i was working toward bcz of all the steps in between ) how is it related and it couldn't ans probably or give me reason which makes sense i wanted an industry level project and it told me that we will prove that shoppers are dropping and at what stage like wtf we already know shoppers are dropping and told me to analyze by device and demographics which still falls under EDA what realistic problem finding is that and what realistic solution can i provide ?

I am facing too much time reading that guide and going back and forth with GPT/claude to understand things and actual process because of the confusion caused by guide and even the solution fields don't match, can anyone help me with execution how do i execute and create portfolio projects i tried looking up DA projects of people on GitHub but didn't find anything useful i don't know how to even represent a project.

I need a framework on how to create a project i am not copying from anywhere just need guidance, looking for advice on how should i approach project creation even ready to pay ( although i don't have much money tbh but still )

I am seconding guessing that i should just create project with ai ideation would be mine and i can just understand the code and project ( practise SQL and pandas daily and DAX few times a week ) that way i will have coding syntax in mind and create projects more and faster which will get me interviews real learning is on the job anyways i have forecasting, data cleaning and time series projects in mind as well i am short on savings money as well


r/dataanalysis • • 5d ago

Data Question Refunds in monthly revenue reports: order month or refund month?

1 Upvotes

I build sales reports for e-commerce brands and this keeps coming up. A customer orders in October and gets refunded in November. Shopify puts the refund in November, and accounting usually wants it there too. But if you're judging how October's campaign or product did, it makes more sense to pull the refund back to October, otherwise October looks better than it was and November looks worse.

How do you handle it? One view, two views (by refund date and by order date), or something else?


r/dataanalysis • • 6d ago

Career Advice Question for Experienced Data analyst

9 Upvotes

Howdy people!!

I have been a data analyst for about half a year now and has experienced few issues when it comes to handling and processing data for reporting; some due to departments giving dataset that aren't clear, some due to report requirements or objectives not being definitive and some may be due to unavailability of higher ups who have key knowledge of the data, as of course they are busy people, and so the report you will write is highly dependent on the source data.

Aside this as I grow in my data analytics career what problem could one also face, or even better what problem or experience have you faced or is common in your own area of work or environment as a data analyst.


r/dataanalysis • • 6d ago

Please fill it (crying emoji 1000 times)

3 Upvotes

Would really appreciate a few seconds of your time to explore our dashboards and share your feedback through a short questionnaire. Your responses will help us understand how people interpret and trust AI-based fraud predictions.
Questionnaire: https://forms.gle/eCAHLwVgc3W795dk6

Your participation would mean a lot to our research. Thank you for your time and support!

Please fill it (crying emoji 1000 times)


r/dataanalysis • • 7d ago

Data Tools How did you learn Excel?

19 Upvotes

I am mainly self taught after finding an interest in it from a college project so I'm curious how others have gone about becoming efficient in excel and how long it took to become comfortable with it


r/dataanalysis • • 6d ago

which ai for data analytics learning phase

1 Upvotes

hey guys, i need an ai to help me throughout my data analyst course. it needs to help me with sql, excel, and data visualization, and also act as a mentor. would you recommend claude pro or chatgpt plus?


r/dataanalysis • • 7d ago

Looking for comprehensive Excel and Power BI courses (beginner to advanced)

21 Upvotes

Hi everyone!
I’m looking for recommendations for comprehensive Excel and Power BI courses that cover everything from beginner to advanced levels.
I already have an intermediate level of Excel, but I’d like to take a structured course starting from the fundamentals and progressing to advanced topics. My goal is to obtain a certificate that reflects a complete learning path, rather than taking several short courses covering isolated topics.
I’m open to both free and paid options. What matters most to me is course quality, practical knowledge, and recognition in the job market.
I’d appreciate recommendations regarding:
Which platforms and courses offer the best beginner-to-advanced learning paths?
Is it worth taking a complete course even if I already have some intermediate knowledge?
Are there recognized certificates or certifications that employers actually value?
Should I learn Excel first and then Power BI, or study both simultaneously?
Which courses include practical exercises and real-world projects?
For context, I have a background in Chemistry and would like to apply these tools to laboratory work, quality control, research, data analysis, and process monitoring.
I’d especially appreciate recommendations from people who have completed these courses or use Excel and Power BI professionally.
Thanks!


r/dataanalysis • • 6d ago

I'm building an interactive site to explain web analytics concepts visually. Would love your feedback!

3 Upvotes

Hi all,

I've started building a free website that explains web analytics concepts (like sessions, bounce rate vs. exits, engaged sessions, active users) through interactive visuals.

The goal is to make tricky measurement rules intuitive without having to dig through dry documentation.

You can check out what I have so far here: https://seeinganalytics.com

I'd love your honest feedback on:

  • Are the visuals clear and accurate?
  • Which confusing analytics concepts should I tackle next?

Thanks!


r/dataanalysis • • 7d ago

Is this the kind of project that gets you entry level jobs?

Thumbnail
github.com
10 Upvotes

r/dataanalysis • • 7d ago

Microsoft Teams 365 reliability

2 Upvotes

My office has 365 and uses Teams and Sharepoint as much as possible. I'm a new data analyst (no actual experience, I've been with them for 20 years in an unrelated role and a few months ago they decided to weaponize my ADHD by anointing me with their first data analyst title). Because we're already so integrated with Teams, I've been trying to build projects within it, but I've been plagued with occasional glitches.

The last time this happened, I was chasing my tail for hours trying to debug something that turned out to be a random issue with Teams hanging up. This time, I'm trying to daisy chain Power Apps, Power Automate, and Sharepoint lists to ghetto rig a free kinda-sorta-database. It's nothing important, we have a legit database for incident logging, I'm just building a tool for front-line personnel to help with assignment rotation and informal analysis of one specific incident type.

Once again, I was just chasing my tail thinking something was wrong with my half-built Power Automate flow that was randomly alternating between working and not working, until I noticed my Outlook and Copilot app were acting up too, and now both are completely down after rebooting everything. I see that Microsoft 365 has a global partial service interruption now and am wondering how much faith I should put into 365 actually working on a daily basis. Is this a common issue? Would it be better to do most things outside of 365 whenever possible? Or is the interconnectivity worth it for the occasional glitch?


r/dataanalysis • • 7d ago

Data Tools Built an open-source archive + API for 8 years of F1 data (telemetry, laps, weather, radio) with CSV/Parquet/SQLite export

Post image
2 Upvotes

Sharing a project that might be useful if anyone here is into sports/motorsport data or just wants a real-world dataset to practice on.

F1Archive is an archive of 8 seasons of Formula 1 session data, lap times, full telemetry (speed, throttle, brake, gear, RPM, DRS), tyres, weather, race control, team radio, stored in Postgres with a documented REST API and bulk export in CSV, JSONL, Parquet, or SQLite. There's a web viewer for exploring it visually, but it's genuinely usable as a raw dataset source for anyone who wants to do their own analysis without having to scrape and clean the data themselves.

One thing I tried to do properly: data completeness is documented, not hidden. If a session is missing telemetry or has partial data, there's a page explaining exactly what's missing and why, which matters a lot if you're doing anything you want to trust the results of.

Fully open source, happy to talk through the schema if anyone wants to use it for a project.

Have a look at f1archive.org


r/dataanalysis • • 7d ago

Preview and process GB-scale CSV files like a database — in just seconds

3 Upvotes

I made a free PC application. Maybe someone still need to handle large files like this.

GB-scale files open instantly; filter, sort, aggregate, derive, and run SQL, with one-click data-quality diagnostics, split large files and export to Excel — everything runs locally, no data uploaded.

Currently, only a Windows version is available, as I don't have a Mac at home. I used to use a Mac when I was employed, but I'm currently unemployed.

You can download from : Lightning CSV — GB-scale CSV desktop tool


r/dataanalysis • • 8d ago

"Do you see the pattern?"

Post image
187 Upvotes

r/dataanalysis • • 8d ago

Career Advice Data Analyst in 2027 Guidance

60 Upvotes

I just started prepping to become a data analyst , i have a degree in Computer Application and i am familiar with python , pandas , numpy , matplotlib and basic ml concpets.
Currently i am studying SQL and i have got decent grip on HAVING , DISTINCT , WHERE , LEFT AND INNER JOINS but i am not really sure how much SQL i actually need to study my for my first job , i have solved 18 questions on SQL50 but i dont understand how am i supposed to apply these concepts in an actual project.
If anyone has any guidance for me tackle this SQL situation and general advise of how i should be prepping to become a Data Analyst in Q1 2027 will be much appreciated, ty again.


r/dataanalysis • • 7d ago

Data Tools GraveTrail Lineage tool

2 Upvotes

Hi All

As a data engineer i spent a lot of annoying time understanding the table Lineage in a prehistoric legacy system.

Based on my hardships and understanding I've built this Lineage tool

https://sahasilak.github.io/GraveTrail/

I would appreciate it if you can spend some time trying it out by sharing feedback like

Good, bad, need improvements , something like this already exists


r/dataanalysis • • 9d ago

power bi alternative: what we learned testing 5 open source bi tools after getting tired of desktop .pbix files + Fabric license creep

28 Upvotes

for the past 4 years or so, our reporting ran almost entirely on Power BI.
it did what it was supposed to do while our data team was small and our business stakeholders were happy receiving scheduled PDF exports / opening dashboard links inside Microsoft Teams.

and yet over the last 18 months, our engineering and analytics setup moved to Linux and Mac, our warehouse matured on Snowflake, and three specific friction points made Power BI painful to live with:

  1. The desktop-client bottleneck. Half our analytics engineers and product managers work on macOS or Linux. Power BI Desktop remains Windows-only. Having engineers spin up Windows VMs or cloud desktop instances simply to tweak a report or verify a measure felt absurd for a modern stack.
  2. Logic trapped in binary .pbix files. DAX measures, table relationships, and row-level security filters lived inside individual report files or workspace models. We could not run standard git pull request reviews on metric changes, track lineage across versions, or prevent two analysts from writing slightly different versions of the same retention calculation.
  3. license sprawl and the Fabric push which was very annoying. What started as $10/user/month Pro licenses steadily escalated with Premium-per-user upgrades, external viewer licensing constraints, and heavy pressure to commit to Microsoft Fabric capacity (F64+) just to access basic direct lake and copilot features.

then we did spend the past month evaluating five open-source and code-first tools to replace Power BI. We wanted an architecture where metric logic lives in version-controlled code, dashboards run cross-platform in the browser, and numbers can be queried both by BI tools and by downstream applications or AI agents.

Here is the comparison breakdown across the options we tested, i have used a bit of claude to structure this output and evaluation, but only a bit. Hope that's more readable now.

Evaluation Dimension Power BI (Baseline) Apache Superset Metabase (OSS) Lightdash Evidencedev Cube (Cube Core OSS)
Primary Mental Model Desktop-first drag-and-drop report builder Open-source web-based dashboard platform Fast self-serve query builder and dashboard cards dbt-native BI built directly on dbt models Code-based reporting rendered from Markdown + SQL Headless semantic layer + open data APIs and web UI
Metric & Logic Storage Proprietary DAX in .pbix files or Fabric semantic models Virtual datasets and SQL Lab queries in metadata DB Questions and Models stored in application DB Defined as metrics in dbt schema YAML files SQL queries embedded directly inside Markdown files Code-first YAML or JavaScript models in Git repositories
Git / PR Workflow Difficult; Git integration requires Fabric / PBIP format Rudimentary; requires manual export/import or API sync Serialization via YAML requires paid Enterprise tier Native; metric definitions live inside your dbt repo Native; entire reporting project is versioned in Git Native; standard repository branch and pull request workflow
Cross-Platform Access Windows-only desktop client for report authoring 100% browser-based authoring and consumption 100% browser-based authoring and consumption 100% browser-based authoring and consumption Local dev server runs on Mac, Linux, and Windows Local dev server runs on Mac, Linux, and Windows
Downstream & API Access Closed; XMLA endpoints require Premium capacity REST API for metadata; chart data exportable REST API returns card query results Query API through dbt Cloud or Lightdash CLI Static site export; not designed as an API service Universal SQL API (Postgres protocol) + REST/GraphQL APIs
AI / Agent Readiness Copilot locked behind Fabric capacity commitments Community AI plugins; mostly raw schema text-to-SQL Metabot assistant; generates queries over Metabase models AI chat grounded in dbt metric definitions LLMs can generate Markdown and SQL files Native remote MCP server and semantic layer context
Biggest Trade-off / Gotcha Windows lock-in, proprietary DAX, per-seat licensing creep Heavy Docker/Celery footprint; complex permission setup Metric governance is light; joins can duplicate easily 100% tied to dbt; cannot query outside the dbt DAG No ad-hoc drag-and-drop exploration for business users Requires explicit YAML data modeling before building visuals

and what we learned testing each option?

  1. Apache Superset: Great for rich charting, heavy on operational maintenance If your primary goal is finding an open-source tool that matches Power BI's extensive chart variety, Superset is the closest visual equivalent. It handles complex dashboards, geospatial visualizations, and slice-and-dice exploration without per-seat licensing.
  • Where it worked: Beautiful out-of-the-box dashboards, zero Windows dependencies, and strong community support.
  • Where it pinched: The permission system is intricate and requires careful role configuration. While Superset has virtual datasets, business logic still ends up scattered across ad-hoc SQL snippets in different charts rather than sitting in a centralized semantic layer.
  1. Metabase: Unmatched for rapid self-serve, but lighter on modeling governance Metabase remains the fastest tool for getting non-technical team members exploring data. The graphical query builder allows sales and product managers to ask questions without writing SQL.
  • Where it worked: Onboarding takes less than an afternoon. Anyone comfortable with Excel filters can build their own cards immediately.
  • Where it pinched: Metric logic is stored in Metabase's application database rather than in code. Version control via YAML requires higher-tier licensing, and managing row-level security across multi-tenant departments required duplicating questions once our role hierarchies became complex.
  1. Lightdash: Ideal if your team is already 100% committed to dbt Lightdash takes a dbt-first stance: your dbt project is your single source of truth, and Lightdash auto-generates your BI layer from your dbt schema YAML files.
  • Where it worked: All metric definitions live in Git pull requests alongside transformation models. Perfect versioning and developer workflow.
  • Where it pinched: If an analysis doesn't fit your pre-compiled dbt DAG, you cannot easily explore it on the fly. Furthermore, you cannot point other non-Lightdash tools or customer-facing apps at its metric engine without going through their specific query layers.
  1. Evidence.dev: Excellent for data engineers, foreign to drag-and-drop business users Evidence replaces traditional BI dashboards with code-generated analytical markdown documents. You write SQL queries in fenced blocks and render charts with declarative tags.
  • Where it worked: Entirely code-driven, fast static rendering, and versioned cleanly in Git. Our analytics engineers loved the developer experience.
  • Where it pinched: It is fundamentally a publishing tool for analysts, not an ad-hoc exploration tool for business stakeholders. If a VP wants to drag a dimension into a pivot table on Friday afternoon, Evidence won't serve that workflow.
  1. Cube (Cube Core): Decoupling the metric layer from the visualization We tested Cube Core as an open-source semantic layer sitting between Snowflake and our visualization tools. Instead of defining metrics inside each dashboard tool, we defined cubes, dimensions, joins, and measures in YAML files stored in our git repository.
  • Where it worked: Universal consumption: We can connect Superset or Metabase to Cube's SQL API (which speaks the Postgres protocol). Both tools query the exact same governed metric definitions, so nobody argues over differing numbers. Performance and caching: Cube's pre-aggregation engine stores partitioned rollups, serving repetitive dashboard filter changes in sub-second response times without triggering live warehouse compute on every query. Multi-surface readiness: Because Cube provides REST, GraphQL, and remote MCP endpoints on top of the same model, our engineers can build embedded customer portal widgets and point LLM agents at governed measures without re-implementing business logic.
  • Where it pinched: Upfront data modeling investment: Unlike Power BI where you can drag raw tables and click "Auto-detect relationships," Cube requires explicit modeling of join paths and primary keys in code. If your underlying schema has messy foreign keys, you must resolve them before metrics compile. Dashboard building requires picking a front-end: While Cube provides built-in workbooks and web exploration, teams wanting traditional heavy dashboards typically pair it with an open-source visualizer like Superset or custom React components.

how we decided to structure our stack?

Rather than trading one monolithic vendor (Microsoft) for another single closed tool, we settled on a two-tier decoupled architecture:

  1. Semantic & Governance Tier: We use Cube Core as our open-source metric layer. All calculations (such as gross retention, ARR, and active seats), join topologies, and role-based access rules are written in code, reviewed in pull requests, and versioned in Git.
  2. Consumption & Visualization Tier: For internal exploratory dashboards and operations teams, we point open-source Superset at Cube's SQL API. For our engineering team's customer-facing portal and agentic workflows, we query Cube's data APIs directly.

would also like to ask those data teams that migrated away from Power BI, did you replace it with an all-in-one platform (like Superset / Metabase), or did you separate the semantic layer from the visualization tool? how did your business analysts transition from writing DAX formulas to code-first Git/YAML modeling?