r/dataengineeringjobs • • 14h ago

Career Looking for a Data Engineering Professional in Bangalore | Paid Guidance

5 Upvotes

Hey everyone, I’m based in Bangalore and I’m looking for a data engineer mentor to guide me through daily tasks. I’m eager to grow, and I can offer a small stipend. It’s not a big salary, but if you’re willing to help, I’d really appreciate it. If you’re interested, feel free to DM me—I’d love to connect and see if it could work for both of us. Thanks!


r/dataengineeringjobs • • 5h ago

Blog The most common mistake in Data Engineering prep (and what to do instead)

15 Upvotes

A pattern that shows up a lot with people trying to break into DE: SQL, then Python, then PySpark, Kafka, Airflow, AWS, Databricks, Snowflake... and months later they still don’t feel interview-ready.

Usually it’s not effort. It’s that they’re collecting tools instead of understanding how data systems behave.

Try answering these without googling:

  • Why would a Spark job suddenly get much slower?
  • What happens when you join two huge datasets?
  • When does broadcasting a table help?
  • What if one partition is far bigger than the rest?
  • How do you make a pipeline safe to re-run on the same data?
  • What would you monitor in production?
  • What happens when a downstream system goes down?

If these feel shaky, adding another tool won’t fix it. The fundamentals will:

Data → Storage → Compute → Transformation → Orchestration → Reliability → Observability

Learn these properly and a new tool is mostly new syntax.

A better way to prep: build one small pipeline, then break it on purpose.
Duplicate the data, delay a source, skew a key, kill a job halfway.
Fix it and write down what you learned. That teaches more than ten tutorials.

We’re SprintED Academy, and we’ll be sharing practical DE and AI career content here. If you’re preparing right now, tell us where you’re stuck and we’ll try to help.


r/dataengineeringjobs • • 22h ago

Career Will LTIMindtree match my ₹21 LPA offer from Sigmoid?

8 Upvotes

I currently have two offers:

  1. LTIMindtree (Noida)
    ● Role: Data Engineer Specialist
    ● CTC: ₹14.5 LPA
    ● Fixed: ₹12.2 LPA
    ● Variable: ₹1.3 LPA
  2. Sigmoid (Bangalore)
    ● Role: SDE 2
    ● CTC: ₹21 LPA
    ● Fixed: ₹20 LPA
    ● Variable: ₹1 LPA
    I’m more inclined towards LTM because Noida is closer to my hometown.
    However, Sigmoid is offering significantly better compensation. I’ve also heard that Sigmoid conducts client evaluation rounds after onboarding, involving DSA and complex coding problems. I’m not very confident in DSA.
    My questions:
  3. Will LTM consider matching Sigmoid’s ₹21 LPA offer if I share the offer letter?
  4. Has anyone successfully negotiated a counteroffer with LTM?
  5. How difficult are Sigmoid’s client evaluation rounds?

r/dataengineeringjobs • • 20h ago

Transitioning 4 YOE in Support, Switched to Development — How to Survive?

15 Upvotes

I have around 4 YOE, mostly in Databricks production support in a WITCH company, and recently joined a mid-sized service-based company in a Data Engineering role.

I'm technically comfortable with SQL, PySpark, Databricks playform , debugging, and understanding existing code, but I lack hands-on development experience.

I have little exposure to approaching user stories, GitHub/Azure DevOps, PRs, code reviews, testing, and deployment workflows.

Since I joined as an experienced hire, I'm worried that asking basic questions might raise doubts about my development experience.

How can I bridge these gaps quickly, handle development tasks independently, and avoid raising doubts about my experience? Any practical advice from people who've made a similar transition?

I am not trying to avoid learning or responsibilities. I genuinely want to bridge these gaps quickly and perform at the level expected of my experience.

TL;DR: 4 YOE in support, technically sound but lacking real development workflow experience. Recently switched to a development role. How do I ramp up quickly and meet expectations without appearing inexperienced?


r/dataengineeringjobs • • 15h ago

[Hiring] [Remote] [USA and more] - Senior Data Engineer at Lemon.io

4 Upvotes

Lemon.io is hiring a remote Senior Data Engineer. Category: Data and Analytics 📍Location: Remote (LATAM, Europe, USA, Canada, APAC)

See more and apply here!


r/dataengineeringjobs • • 21h ago

Which of these two courses should I choose to transition from SQL only dev to DE?

4 Upvotes

Idk any Python, have never worked with Python. But now for DE, I want to learn so which one should I do?

  1. Data Engineering for Beginners: Learn SQL, Python & Spark by Durga Viswanatha Gadiraju / ITVersity
  2. The Complete Python Bootcamp From Zero to Hero in Python by Jose Portilla, Pierian