Senior Data Engineer

5 days ago

bangalore, India Straive Full time

Job Summary

We're looking for a Senior Data Engineer with 5-8 years of experience to build and maintain scalable, production-grade data pipelines. The ideal candidate is a strong software engineer with hands-on experience in Spark (3.x), Scala, SQL, and Python. You'll be responsible for designing and implementing ETL/ELT solutions, collaborating with teams to deliver data products, and mentoring junior engineers.


Key Responsibilities

  • Design and build data pipelines using Apache Spark 3.x, Scala, Python, and SQL.
  • Tune Spark jobs for performance and cost.
  • Ensure code quality with unit tests, CI/CD, and code reviews.
  • Collaborate with platform and DevOps teams to deploy and monitor pipelines.
  • Troubleshoot production issues and perform root-cause analysis.


Qualifications

  • 5-8 years of experience as a Data Engineer.
  • Strong hands-on experience with Apache Spark 3.x.
  • Proficient in Scala, Python, and advanced SQL.
  • Experience with streaming frameworks (e.g., Spark Structured Streaming, Kafka).
  • Knowledge of orchestration tools (e.g., Apache Airflow).
  • Experience with cloud platforms like AWS Glue, EMR, Athena, Redshift, and S3 is a plus.
  • Solid understanding of software engineering fundamentals (Git, CI/CD).

  • Senior Engineer, Data Engineering

    1 week ago

    Bangalore, India CoreTek Labs Full time

    We’re Hiring for Top MNC –Senior Data Engineer! Experience: 4 - 9 Years Notice Period: immediate to October joiners Skill : Python, Pandas, Snowflake, SQL & Pytest(senior Data Engineer). Do not go for data bricks or data factory. Python, Pandas, SQL, Snowflake, Git Spark, Airflow, ML models.

  • Data Senior Engineer

    2 weeks ago

    HAL Bangalore Airport, India NTT DATA North America Full time

    Req ID: NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Senior Engineer to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Job Duties: 8+ years of experience in a...

  • Senior data engineer

    7 days ago

    Bangalore, India CoreTek Labs Full time

    ???? We’re Hiring for Top MNC –Senior Data Engineer! ???????? Location: PAN India ???? Experience: 4 - 9 Years Notice Period: immediate to October joiners ???? What we’re looking for: Skill : Python, Pandas, Snowflake, SQL & Pytest(senior Data Engineer). Do not go for data bricks or data factory. Must to have skills Python, Pandas, SQL, Snowflake,...

  • Senior data engineer

    7 days ago

    Bangalore, India ITC Infotech Full time

    Senior Data Engineer - Azure Stack Experience - 3-12 years Location : Bangalore, Kolkata, Gurgaon, Pune We are looking for a highly skilled Senior Data Engineer with deep expertise in Azure Stack to join our growing team. As a Senior Data Engineer, you will be instrumental in designing and developing robust data pipelines, data lakes, and cloud-based...

  • Senior Engineer, Data Engineering

    1 week ago

    Bangalore, India ITC Infotech Full time

    Senior Data Engineer - Azure Stack Experience - 3-12 years We are looking for a highly skilled Senior Data Engineer with deep expertise in Azure Stack to join our growing team. As a Senior Data Engineer, you will be instrumental in designing and developing robust data pipelines, data lakes, and cloud-based solutions to support our business intelligence and...

  • Senior Data Engineer

    1 week ago

    Bangalore, India ITC Infotech Full time

    Senior Data Engineer - Azure Stack Experience - 3-12 years Location : Bangalore, Kolkata, Gurgaon, Pune We are looking for a highly skilled Senior Data Engineer with deep expertise in Azure Stack to join our growing team. As a Senior Data Engineer, you will be instrumental in designing and developing robust data pipelines, data lakes, and...

  • Data Engineer

    2 weeks ago

    Bangalore, Karnataka, India NTT DATA Full time

    Req ID 324638NTT DATA strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a Data Engineer to join our team in Bangalore Karnxc4x81taka IN-KA India IN Key Responsibilities Design and implement...

  • Senior Data Engineer

    7 days ago

    bangalore, India ITC Infotech Full time

    Senior Data Engineer - Azure StackExperience - 3-12 yearsLocation : Bangalore, Kolkata, Gurgaon, PuneWe are looking for a highly skilled Senior Data Engineer with deep expertise in Azure Stack to join our growing team. As a Senior Data Engineer, you will be instrumental in designing and developing robust data pipelines, data lakes, and cloud-based solutions...

  • Lead Data Engineer

    1 week ago

    bangalore, India Eucloid Data Solutions Full time

    Eucloid is looking for a Lead Data Engineer to join our Data Platform team supporting various business applications. The ideal candidate will support development of data infrastructure on Databricks for our clients by participating in activities which may include starting from up- stream and down-stream technology selection to designing and building of...

  • Senior Data Engineer

    1 week ago

    Bangalore, India CoreTek Labs Full time

    We’re Hiring for Top MNC –Senior Data Engineer! Location: PAN India Experience: 4 - 9 Years Notice Period: immediate to October joiners What we’re looking for: Skill : Python, Pandas, Snowflake, SQL & Pytest(senior Data Engineer). Do not go for data bricks or data factory. Must to have skills Python, Pandas, SQL, Snowflake,...