Senior Data Engineer

2 days ago

Kakinada, India Straive Full time

Job Summary

We're looking for a Senior Data Engineer with 5-8 years of experience to build and maintain scalable, production-grade data pipelines. The ideal candidate is a strong software engineer with hands-on experience in Spark (3.x), Scala, SQL, and Python. You'll be responsible for designing and implementing ETL/ELT solutions, collaborating with teams to deliver data products, and mentoring junior engineers.


Key Responsibilities

  • Design and build data pipelines using Apache Spark 3.x, Scala, Python, and SQL.
  • Tune Spark jobs for performance and cost.
  • Ensure code quality with unit tests, CI/CD, and code reviews.
  • Collaborate with platform and DevOps teams to deploy and monitor pipelines.
  • Troubleshoot production issues and perform root-cause analysis.


Qualifications

  • 5-8 years of experience as a Data Engineer.
  • Strong hands-on experience with Apache Spark 3.x.
  • Proficient in Scala, Python, and advanced SQL.
  • Experience with streaming frameworks (e.g., Spark Structured Streaming, Kafka).
  • Knowledge of orchestration tools (e.g., Apache Airflow).
  • Experience with cloud platforms like AWS Glue, EMR, Athena, Redshift, and S3 is a plus.
  • Solid understanding of software engineering fundamentals (Git, CI/CD).

  • Senior Process Engineer

    1 week ago

    Kakinada, India OCS Services Full time

    About the jobAre you an experienced Process Engineer with a strong offshore background, ready to step into a senior role where your expertise will directly shape operational excellence? Join us aboard the Ruby FPSO, where your technical leadership, process optimization skills, and safety mindset will ensure world-class performance.About UsOCS Services is a...

  • Senior Process Engineer

    6 days ago

    Kakinada, India OCS Services Full time

    About the jobAre you an experienced Process Engineer with a strong offshore background, ready to step into a senior role where your expertise will directly shape operational excellence? Join us aboard the Ruby FPSO, where your technical leadership, process optimization skills, and safety mindset will ensure world-class performance.About UsOCS Services is a...

  • Senior Process Engineer

    1 week ago

    Kakinada, India OCS Services Full time

    About the job Are you an experienced Process Engineer with a strong offshore background, ready to step into a senior role where your expertise will directly shape operational excellence? Join us aboard the Ruby FPSO, where your technical leadership, process optimization skills, and safety mindset will ensure world-class performance. About Us OCS Services...

  • Big data engineer

    1 week ago

    Kakinada, India Idyllic Services Full time

    Job Title: Big Data Engineer – ScalaLocation: Bangalore, Chennai, Gurgaon, Pune, Mumbai.Experience: 7–10 Years (Minimum 3+ years in Scala)Notice Period: Immediate to 30 DaysMode of Work: Hybrid Role OverviewWe are looking for a highly skilled Big Data Engineer (Scala) with strong expertise in Scala, Spark, Python, Ni Fi, and Apache Kafka to join our data...

  • Senior Process Engineer

    1 week ago

    Kakinada, India OCS Services Full time

    About the job Are you an experienced Process Engineer with a strong offshore background, ready to step into a senior role where your expertise will directly shape operational excellence? Join us aboard the Ruby FPSO, where your technical leadership, process optimization skills, and safety mindset will ensure world-class performance. About Us OCS...

  • Senior Process Engineer

    1 week ago

    Kakinada, India OCS Services Full time

    About the jobAre you an experienced Process Engineer with a strong offshore background, ready to step into a senior role where your expertise will directly shape operational excellence? Join us aboard the Ruby FPSO, where your technical leadership, process optimization skills, and safety mindset will ensure world-class performance.About UsOCS Services is a...

  • Senior Process Engineer

    1 week ago

    Kakinada, India OCS Services Full time

    About the job Are you an experienced Process Engineer with a strong offshore background, ready to step into a senior role where your expertise will directly shape operational excellence? Join us aboard the Ruby FPSO, where your technical leadership, process optimization skills, and safety mindset will ensure world-class performance. About Us OCS Services...

  • Senior Process Engineer

    1 week ago

    Kakinada, India OCS Services Full time

    About the jobAre you an experienced Process Engineer with a strong offshore background, ready to step into a senior role where your expertise will directly shape operational excellence? Join us aboard the Ruby FPSO, where your technical leadership, process optimization skills, and safety mindset will ensure world-class performance.About UsOCS Services is a...

  • Senior Process Engineer

    1 week ago

    Kakinada, India OCS Services Full time

    About the jobAre you an experienced Process Engineer with a strong offshore background, ready to step into a senior role where your expertise will directly shape operational excellence? Join us aboard the Ruby FPSO, where your technical leadership, process optimization skills, and safety mindset will ensure world-class performance.About UsOCS Services is a...

  • Senior Process Improvement Engineer

    1 week ago

    Kakinada, India OCS Services Full time

    About the job Are you an experienced Process Engineer with a strong offshore background, ready to step into a senior role where your expertise will directly shape operational excellence? Join us aboard the Ruby FPSO, where your technical leadership, process optimization skills, and safety mindset will ensure world-class performance. OCS Services is a...