r/dataengineeringjobs • • 4h ago

Transitioning 4 YOE in Support, Switched to Development — How to Survive?

9 Upvotes

I have around 4 YOE, mostly in Databricks production support in a WITCH company, and recently joined a mid-sized service-based company in a Data Engineering role.

I'm technically comfortable with SQL, PySpark, Databricks playform , debugging, and understanding existing code, but I lack hands-on development experience.

I have little exposure to approaching user stories, GitHub/Azure DevOps, PRs, code reviews, testing, and deployment workflows.

Since I joined as an experienced hire, I'm worried that asking basic questions might raise doubts about my development experience.

How can I bridge these gaps quickly, handle development tasks independently, and avoid raising doubts about my experience? Any practical advice from people who've made a similar transition?

I am not trying to avoid learning or responsibilities. I genuinely want to bridge these gaps quickly and perform at the level expected of my experience.

TL;DR: 4 YOE in support, technically sound but lacking real development workflow experience. Recently switched to a development role. How do I ramp up quickly and meet expectations without appearing inexperienced?


r/dataengineeringjobs • • 6h ago

Career Will LTIMindtree match my ₹21 LPA offer from Sigmoid?

5 Upvotes

I currently have two offers:

  1. LTIMindtree (Noida)
    ● Role: Data Engineer Specialist
    ● CTC: ₹14.5 LPA
    ● Fixed: ₹12.2 LPA
    ● Variable: ₹1.3 LPA
  2. Sigmoid (Bangalore)
    ● Role: SDE 2
    ● CTC: ₹21 LPA
    ● Fixed: ₹20 LPA
    ● Variable: ₹1 LPA
    I’m more inclined towards LTM because Noida is closer to my hometown.
    However, Sigmoid is offering significantly better compensation. I’ve also heard that Sigmoid conducts client evaluation rounds after onboarding, involving DSA and complex coding problems. I’m not very confident in DSA.
    My questions:
  3. Will LTM consider matching Sigmoid’s ₹21 LPA offer if I share the offer letter?
  4. Has anyone successfully negotiated a counteroffer with LTM?
  5. How difficult are Sigmoid’s client evaluation rounds?

r/dataengineeringjobs • • 5h ago

Which of these two courses should I choose to transition from SQL only dev to DE?

2 Upvotes

Idk any Python, have never worked with Python. But now for DE, I want to learn so which one should I do?

  1. Data Engineering for Beginners: Learn SQL, Python & Spark by Durga Viswanatha Gadiraju / ITVersity
  2. The Complete Python Bootcamp From Zero to Hero in Python by Jose Portilla, Pierian

r/dataengineeringjobs • • 7h ago

Need Data Engineer roadmap

3 Upvotes

Please give data engineer roadmap ( I saw on YT, through ai but still give it) 🙏


r/dataengineeringjobs • • 10h ago

Career 1 YOE Data Engineer (Infosys, 10 LPA, 3-month notice, Databricks migration): when to switch & what to target?

4 Upvotes

I'm a Data Engineer with 1 year of experience at Infosys, working on a Databricks migration project. Stack: Python, SQL, ETL, Databricks. Current CTC: 10 LPA. Notice period: 3 months.

Looking for input on:

Best time to switch (now, or after 1.5 to 2 YOE)?

Realistic target package?

Which companies to focus on, given the long notice period?

Any tips on negotiating a notice buyout?

Would appreciate guidance from anyone who's made a similar switch. Thanks!


r/dataengineeringjobs • • 13h ago

Career Seeking Startup Opportunities | Aspiring Data Engineer

4 Upvotes

Hey everyone! 👋

I'm Prudhvi, currently working in the Government sector. I have knowledge of Java, SQL, ETL, Azure, Azure Databricks and PySpark.

I'm interested in exploring opportunities in startups, particularly in Data Engineering, ETL Development and Big Data.

I'm looking for an opportunity to gain real-world industry experience, contribute to projects and improve my technical skills.

If anyone knows of startups hiring freshers or junior-level Data Engineers, or can refer me to relevant opportunities, please feel free to DM me.

Any guidance, referrals or suggestions would be greatly appreciated.

Thank you! 🙌


r/dataengineeringjobs • • 13h ago

Career Looking for startup job

3 Upvotes

Hey everyone! 👋

I'm Prudhvi, currently working in the Government sector. I have knowledge of Java, SQL, ETL, Azure, Azure Databricks and PySpark.

I'm interested in exploring opportunities in startups, particularly in Data Engineering, ETL Development and Big Data.

I'm looking for an opportunity to gain real-world industry experience, contribute to projects and improve my technical skills.

If anyone knows of startups hiring freshers or junior-level Data Engineers, or can refer me to relevant opportunities, please feel free to DM me.

Any guidance, referrals or suggestions would be greatly appreciated.

Thank you! 🙌


r/dataengineeringjobs • • 1d ago

Career Data Engineers with 25+ LPA packages in India, what should I study to make the jump from 10 LPA to 25–30 LPA?

25 Upvotes

I am currently working as a Data Engineer with around 20 months of experience at a US-based company with an office in India. My current CTC is around 10 LPA + variables.

My primary tech stack at work is Snowflake and dbt. Most of my work revolves around SQL, building and maintaining dbt models, and working with data pipelines. I have knowledge of Python, but haven't had much opportunity to use it in production or work extensively with Python-based data engineering libraries and frameworks.

I'm looking to switch jobs and eventually target companies offering 25–30 LPA. I understand that making such a jump with my current experience might be highly ambitious, but I'd rather prepare for that level than set a lower target from the beginning. Obviously I won't only apply to only companies that offer 25-30 LPA but I'd rather have the knowledge to crack 25-30 LPA when interviewing for companies offering lower than that.

I'd really appreciate advice from experienced Data Engineers and people who have made similar transitions.

A few things I'm particularly confused about:

  1. Tech stack: Should I focus on mastering my existing stack (Snowflake, dbt, advanced SQL), or should I start learning other technologies like Spark, Databricks, Airflow, Kafka, AWS/Azure, etc. or both?
  2. Python: How important is Python for landing higher-paying Data Engineering roles? Should I focus on libraries and frameworks commonly used in production DE workflows?
  3. DSA and LeetCode: How much time should I dedicate to DSA? Do companies offering 25–30 LPA expect candidates to be good at LeetCode-style problems?
  4. System Design: At what experience level should I start preparing for Data Engineering system design and pipeline architecture interviews?
  5. Projects and practical experience: Would building end-to-end data engineering projects using tools outside my current workplace stack help compensate for my lack of production experience with them and if so what projects should I build?

For those who have made a similar jump or are currently earning in the 25–30+ LPA range:

* What technologies and skills helped you get there?

* What did your interview preparation look like?

* If you were starting again with 20 months of experience, how would you structure your preparation?

I'm willing to put in the time and effort. I just want to make sure I'm studying the right things instead of spending months learning technologies that won't make much difference in interviews.

Would really appreciate any honest advice, roadmaps, or personal experiences. Thanks!


r/dataengineeringjobs • • 15h ago

Globant L2 Interview gcp data engineer

2 Upvotes

Can someone help me what will they ask in Globant GCP data engineer Interview? F2F round will be there


r/dataengineeringjobs • • 1d ago

Salary Offer evaluation: Senior Data Engineer at L’Oréal (Beauty Tech, Hyderabad), M1, 5.5 YOE. Is asking for a 35L base reasonable?

31 Upvotes

Hi all, I have an offer from L’Oréal India (Global Beauty Tech / India Tech Hub) and would like a sanity check before I negotiate. The acceptance deadline is in 2 days.

About me:

  • YOE: 5.5 years in Data Engineering
  • Education: MS in Computer Science (USA)
  • Certification: Google Cloud Professional Data Engineer
  • Current: Senior Associate Data Engineering at a large IT consultancy
  • Stack: GCP (BigQuery, Dataflow, Composer), Spark, Airflow, Python, SQL and so on

Current package:

  • CTC: ~23 LPA (all fixed, no variable)
  • Fixed: 21.75 LPA

L’Oréal offer (Senior Engineer – Data, level M1, Hyderabad):

  • Base: 29.5 LPA (basic 14.75L, HRA 9.6L, LTA, special allowance, etc.)
  • Variable: ~3.25L (target bonus 1.18L + worldwide profit sharing 2.06L)
  • Employer PF: 1.77L
  • Total CTC: ~34.5 LPA
  • Joining bonus: 3L, paid in 2 halves (month 1 and after 1 year). The full amount is recoverable if I leave within 24 months of a payment.
  • Benefits: gratuity, medical insurance 4L (self + family), term life and accident cover at 3x base

My questions:

  1. With 5.5 YOE, a US Master’s and the GCP DE cert, is a 35L base a reasonable ask for M1 at L’Oréal, or is the band likely capped around 30–32?
  2. How reliable is the profit-sharing / variable payout in practic
  3. My notice period is 60 days and they want me to join mid-December. Are they usually flexible on this?

Any insights from current or ex-L’Oréal or GCC folks are much appreciated. Thanks!


r/dataengineeringjobs • • 1d ago

Upcoming interviews at Mckinsey for Senior Data Engineer, need tips to prepare for interview. How do I go about it

8 Upvotes

I have an upcoming interview at McKinsey for the role of Senior Data Engineer. I understand there will be a HackerRank test, but what else should I expect in the following rounds, and what questions would they ask in the HackerRank test


r/dataengineeringjobs • • 1d ago

Need suggestions/tricks to get the DE interview calls

4 Upvotes

Hi everyone, I'm currently working as a DE in a startup. I have been working there for over 5 years. Now I'm looking for opportunities to switch. My skillset includes Databricks, Snowflake, Airflow, dbt, Python(PySpark), SQL and basic hands on Power BI within the real time project.

I have been aggressively applying for the jobs in all the portals and sending emails to recruiters, still I haven't heard any responses.

Any suggestions to get the calls..


r/dataengineeringjobs • • 1d ago

Career Recently laid off. Looking for Senior Data Engineer / Big Data Engineer roles (8.5 YOE) — Python, PySpark, GCP. Any leads or referrals appreciated!

36 Upvotes

Hey everyone,
Like many others in the industry right now, I was unfortunately impacted by recent layoffs. I'm currently looking for new Senior Data Engineer or Big Data Engineer opportunities and would be incredibly grateful for any referrals, leads, or advice this community might have.

A quick summary of my background:
Bullet Experience: ~8.5 years specializing in distributed systems, modern Data Lakehouse architectures, and cloud data platforms.

Core Stack: Python, PySpark, SQL, Hadoop ecosystem (HDFS, Hive, Spark), and shell scripting.

Cloud & Infrastructure: GCP (GCP Professional Data Engineer certified), Microsoft Fabric, Docker, Kubernetes, Control-M, and CI/CD pipelines.

What I Build: I specialize in designing Medallion data architectures (Bronze, Silver, Gold) using Delta Lake, PySpark, Fabric OneLake, and BigQuery. I also have hands-on experience building conversational AI agents and enterprise workflows (e.g., Copilot Studio).

I am open to remote roles, hybrid setups, or relocating for the right opportunity.

If your team is hiring or if you'd be open to submitting a referral, please drop a comment or shoot me a DM! I’d be happy to share my full resume and LinkedIn profile privately.
Thanks so much in advance for your time and support.


r/dataengineeringjobs • • 1d ago

Interview CIBC DE job interview

4 Upvotes

Hi everyone, I have a job interview with DE team manager in a couple of days, this is at CIBC toronto, once this is done and next one would be with a technical team at toronto downtown office, does anyone have any insights on what I might be asked? I am desperate to get this job. please help anyone if they have any insights


r/dataengineeringjobs • • 1d ago

Career Data Engineer with ~2 years of experience looking to level up. What skills should I focus on to become a stronger candidate for higher-paying roles?

14 Upvotes

I'm currently working as a Data Engineer with around 20 months of experience at a US-based company with an office in India.

My primary tech stack at work is Snowflake and dbt. Most of my work revolves around SQL, building and maintaining dbt models, and working with data pipelines. I also have knowledge of Python, but haven't had much opportunity to use it in production or work extensively with Python-based data engineering libraries and frameworks.

I'm looking to make a significant career jump in my next move and eventually target roles at the higher end of the Data Engineering compensation range for my experience level.

I understand that compensation varies significantly depending on the country, company, and market, but I'm more interested in understanding what skills and knowledge actually make someone a strong candidate for these roles.

A few things I'm particularly confused about:

  1. Tech stack: Should I focus on mastering my existing stack (Snowflake, dbt, advanced SQL), or should I expand into technologies like Spark, Databricks, Airflow, Kafka, AWS/Azure/GCP, etc.? Which of these are actually worth prioritizing?
  2. Python: How important is Python for higher-level Data Engineering roles? Should I focus on libraries and frameworks commonly used in production data engineering workflows?
  3. DSA and LeetCode: How much time should I dedicate to DSA? Are LeetCode-style problems commonly asked for Data Engineering , and at what difficulty?
  4. System Design: At what experience level should I start preparing for Data Engineering system design, distributed systems, and pipeline architecture?
  5. Projects and practical experience: Would building end-to-end data engineering projects using tools outside my current workplace stack help compensate for my lack of production experience with them?

For those with a few years of experience, particularly those who have successfully moved into higher-paying Data Engineering roles:

  • What technologies and skills made the biggest difference in your career progression?
  • What did your preparation look like?
  • How much emphasis should I place on SQL, Python, DSA, system design, and cloud technologies?
  • If you were starting again with around 2 years of experience, how would you structure your learning roadmap?

I'm willing to put in the time and effort. I just want to make sure I'm focusing on skills that have actual industry demand rather than spending months learning technologies that won't make much difference on the job search.

Would really appreciate any honest advice, personal experiences, and learning roadmaps. Thanks!


r/dataengineeringjobs • • 1d ago

Find data big and messy datasets for practice

15 Upvotes

Someone on my youtube channel asked where to find data big and messy enough to justify a real Spark cluster. Most free datasets are clean Parquet that DuckDB handles on a laptop, so they never push you. These do.

GH Archive: every public GitHub event since 2011, as hourly JSON files. Nested, messy, with skew on the big repos.
https://www.gharchive.org

Bluesky Jetstream: free live websocket, hundreds of events a second. Good for Structured Streaming, and a few weeks of it turns into a big batch set too.
https://github.com/bluesky-social/jet...

Wikimedia EventStreams: every Wikipedia edit, live. Slower than Bluesky but rock steady, so it's a good first stream.
https://stream.wikimedia.org

Binance public data: free daily files of tick-level crypto trades. BTC alone gives you natural skew.
https://data.binance.vision

NOAA GHCN weather: about 2.6 billion daily observations on AWS open data. Join it to trades or taxi rides for a real big-join problem.
https://registry.opendata.aws/noaa-ghcn

NYC taxi trips: billions of rows once you stack the years.
https://www.nyc.gov/site/tlc/about/tl...

Massive (formerly Polygon): tick-level US stock trades as daily S3 files. Paid, but about as close to enterprise scale as you'll get on your own.
https://massive.com/docs/flat-files/s...

Pick one and give yourself a real problem. Land Jetstream in bronze, join it to something, force a hot key, then work it in the Spark UI until it's fast. That's the kind of project we build in From Stuck to Hired, and sign-ups close tomorrow. Details are in the pinned comment.


r/dataengineeringjobs • • 1d ago

Career Freshers market ?

4 Upvotes

Im 2026 passed out I have been applying everywhere and started cold mailing companies which offer data engineer services and Nothing works, I just got one interview opportunity in 3 -4 months if I didn't find any there would be a gap year in my cv ,so what are my options now and how could I break into junior data engineer roles as a fresher


r/dataengineeringjobs • • 1d ago

Data Engineering Jobs in India

1 Upvotes

Hi there, I am keen to pursue data engineering positions within India-based GCCs. Having about five years in Azure data engineering and moving toward Fabric, I would value advice on a dependable portal and approach for applying and progressing my career.
Current organisation: KPMG
CTC: 18 LPA

Please also share what should be my expected CTC ?


r/dataengineeringjobs • • 1d ago

Career Anyone here who can refer me at Databricks??

2 Upvotes

r/dataengineeringjobs • • 1d ago

Blog Is your team’s AI underdelivering because of the tools, or because of how you’re using them?

Thumbnail
leaddev.com
1 Upvotes

Capability gap or habit gap? One engineering leader’s test for why AI isn’t speeding up hard work


r/dataengineeringjobs • • 2d ago

Hiring [Hiring] Analytics Engineer at Linear | Remote - North America | $180K - $220K

12 Upvotes

At Linear, we’re building the product development system for teams and agents. AI is fundamentally changing how software gets built, and we’re shaping the tools this new era requires.

Founded in 2019, Linear has become the platform of choice for more than 50,000 companies (including OpenAI, Coinbase, and Ramp) to plan, build, and ship their products. Today, our team is distributed across North America, Europe, and Australia, and we’re continuing to grow internationally. What unites us is relentless focus, fast execution, and a deep care for software craftsmanship.

The Data team works across Linear, supporting Product, Engineering, and GTM. We own our data pipelines, warehouse, dashboards, analysis, and integrations with third‑party tools. As a small team, we focus on building systems that make data accessible and useful across Linear. We’re looking for someone who wants to help shape how we architect, build, and use data as we grow.

Location & work mode

Linear is a remote‑first company, with optional co‑working offices in San Francisco, New York, and London. This role is open to candidates based in North America. You can work from anywhere within this region. We value deep focus and async collaboration, with intentional moments to connect in person through team off‑sites, optional co‑working, and occasional travel.

What you’ll do

  • Work across Product and GTM (Marketing, Sales, Customer Success, and Finance) to turn ambiguous questions and operational needs into useful metrics, models, analyses, and workflows
  • Build and maintain dbt models and pipelines that create trusted views of our product, customers, and business
  • Design clear, maintainable data models and improve the testing, documentation, performance, and reliability of our data stack
  • Build dashboards and self‑service reporting in Metabase and Hex, and dig deeper when the answer requires more than a chart
  • Operationalize data through reverse ETL and partner with GTM Engineering on the scoring, segmentation, automations, and internal tools that help our teams scale
  • Balance fast, pragmatic answers with durable solutions, recognizing when a one‑off request should become a reusable model or workflow
  • Find ways to leverage emerging tools, LLMs, and coding agents to accelerate development, analysis, testing, and documentation while maintaining a high bar for correctness

What we’re looking for

  • 8+ years of experience in analytics engineering, data analytics, or data engineering, ideally at a fast‑moving software company
  • Exceptional SQL and strong hands‑on experience with dbt and a modern cloud data warehouse
  • Track record of owning data projects end‑to‑end, from shaping an ambiguous problem to shipping something people rely on
  • Strong data modeling judgment: you think clearly about grain, reusable components, interfaces, dependencies, and maintainability without relying on a single prescribed methodology
  • Analytical judgment: you know when to answer quickly, when to investigate deeply, and how to turn complex findings into a clear recommendation
  • Comfortable moving between technical implementation and business context, from debugging a data model to understanding product adoption or sales efficiency
  • High ownership mentality: self‑directed, pragmatic, and willing to challenge a request or approach when something does not make sense
  • Strong communication skills and experience partnering directly with both technical and non‑technical teams
  • Comfortable using LLMs and coding agents as part of your day‑to‑day development workflow

Our tech

This stack reflects the systems you’ll work in. You’re not expected to have experience with everything listed, but you should be comfortable learning quickly and working across the full lifecycle of data.

  • Data Warehouse: Snowflake, dbt Cloud
  • Dashboards / Analysis: Metabase, Hex
  • ETL / rETL: Hevo, Fivetran
  • GTM tools: Hubspot, Pocus, Clay

What we offer

We’re a small, focused team that cares deeply about the quality of our work and the people we do it with. Here’s what you can expect:

  • Competitive salary and equity
  • Employee‑friendly equity terms including early exercise in the US and extended exercise windows
  • Daily meal and coffee stipend on every workday
  • Paid co‑working space or desk
  • Health coverage (based on country requirements)
  • 5 weeks paid vacation, plus local statutory holidays
  • 4 months paid parental leave
  • Paid month off after 4 years & every 2 years thereafter
  • Regular team events and off‑sites
  • Remote‑first with no required commute

Compensation

For US‑based candidates, the expected cash compensation range for this role is $180,000—$220,000. For sales roles, this range represents on‑target earnings (OTE), including base salary and variable compensation; for all other roles, it represents base salary. Final compensation is determined based on job‑related knowledge, skills, and experience. For sales roles, actual earnings vary based on sales performance. Equity is a meaningful part of all offers at Linear.

Apply: Analytics Engineer at Linear


r/dataengineeringjobs • • 1d ago

Looking to collaborate with builders and founders.

0 Upvotes

Hello, builders and founders!

Hope you're having a great day.

I'm looking for contract opportunities in Data Analytics or Data Engineering.

I hold a Master's degree from the US and have 4 years of professional experience. I'm eager to collaborate on projects and contribute to growing businesses.

I'm flexible with compensation, with a target budget of around $3,000/month.

If you have any opportunities or know someone looking for data talent, I'd love to connect!

Looking forward to hearing from you.

Thanks!


r/dataengineeringjobs • • 2d ago

Hiring Open Positions

Thumbnail
gallery
21 Upvotes

Lmk anyone interested for these open positions!

I dont know about salary as they are not mentioned in the JD

Thanks


r/dataengineeringjobs • • 1d ago

Need career advice and referrals. More than 8 YOE in data industry as Data Engineer in a startup with 13LPA

3 Upvotes

Been working in a startup from past 15 months now, before that was in LTIM for 7 years straight out of college.
Have good knowledge of Python, SWL, cloud computing, databases, building APIs as well as computer vision models. Have little bit of experience in Agentic AI and Machine Learning. Current package is quite low as per years of experience and have been rejected multiple times by HR in screening process.