Senior Data Engineer

4 weeks ago


Kakinada, India Straive Full time

Job Summary

We're looking for a Senior Data Engineer with 5-8 years of experience to build and maintain scalable, production-grade data pipelines. The ideal candidate is a strong software engineer with hands-on experience in Spark (3.x), Scala, SQL, and Python. You'll be responsible for designing and implementing ETL/ELT solutions, collaborating with teams to deliver data products, and mentoring junior engineers.


Key Responsibilities

  • Design and build data pipelines using Apache Spark 3.x, Scala, Python, and SQL.
  • Tune Spark jobs for performance and cost.
  • Ensure code quality with unit tests, CI/CD, and code reviews.
  • Collaborate with platform and DevOps teams to deploy and monitor pipelines.
  • Troubleshoot production issues and perform root-cause analysis.


Qualifications

  • 5-8 years of experience as a Data Engineer.
  • Strong hands-on experience with Apache Spark 3.x.
  • Proficient in Scala, Python, and advanced SQL.
  • Experience with streaming frameworks (e.g., Spark Structured Streaming, Kafka).
  • Knowledge of orchestration tools (e.g., Apache Airflow).
  • Experience with cloud platforms like AWS Glue, EMR, Athena, Redshift, and S3 is a plus.
  • Solid understanding of software engineering fundamentals (Git, CI/CD).



  • Kakinada, India Black Dog Labs Full time

    Position : Senior Data Platform Engineer Location : Remote (collaboration across time zones), India or LATAM preferred Engagement Type : Contract (12+ months) Language : Proficient English communication Experience : 5+ years in Data Engineering / Backend Engineering / DevOps About the Role We’re looking for a hands-on Senior Data Platform Engineer to build...


  • Kakinada, India DNA Technology Services Full time

    Snowflake Data Engineer📍 Location: Remote, India 💼 Job Type: Full-timeWe are looking for an experienced Snowflake Data Engineer to join our growing data engineering team. The ideal candidate will have strong expertise in Snowflake, cloud platforms (AWS/Azure), and modern data engineering practices, with the ability to design and implement scalable data...

  • Ai engineer

    15 hours ago


    Kakinada, India Aventis Solutions Full time

    Aventis Solutions is igniting the AI revolution: Now, our tech partner is establishing a new AI Innovation Hub in Pune, India, and we are hiring AI Engineers to design and scale the cloud-native infrastructure that powers next-generation AI solutions. These roles are at the heart of enabling large-scale AI and Gen AI adoption, ensuring platforms are secure,...


  • Kakinada, India Data-Hat AI Full time

    Department: AI Strategy & Implementation Reports To: Chief AI Officer / Lead AI Solutions Architect Travel: International travel required  Position Summary: We are seeking an AI Solutions Architect with over 20 years of experience to serve as a strategic and technical leader in the design, implementation, and evolution of enterprise-grade AI systems....


  • Kakinada, India AceStack Full time

    Job Title: Senior .NET Azure Developer (with Data Engineering and MDM/EDM expertise)Location: 100% Remote – (Bangalore/Hyderabad) Duration: Long Term Contract (6-12+ Months)Client environment is heavily microservices-driven, built on .NET and Microsoft Azure, leveraging REST APIs, Azure Functions, and Graph DB. The team is focused on deepening our data...


  • Kakinada, India KPG99 INC Full time

    Position : SAP Data Engineer Location : Remote in India Duration : 12-month contract with extensions Candidates' Core Skillset Must Be: - DataSphere - S4 Hana - SAC - BW Data Modeling Plusses: - SAP ABAP, HANA/AMDP/CDS, SOAP/OData/Rest API’s etc.


  • Kakinada, India Brace Infotech Private Ltd Full time

    Job Title: Senior Java Developer / Data EngineerExperience Required: 8–12 YearsLocation: [Insert Location or Remote]Employment Type: Full-TimeNotice period: only immediateJob Summary:We are seeking an experienced and highly skilled Senior Java Developer with strong backend development expertise in Core Java, Spring Boot, and JBoss, complemented by a solid...


  • Kakinada, India Brace Infotech Private Ltd Full time

    Job Title: Senior Java Developer / Data EngineerExperience Required: 8–12 YearsLocation: [Insert Location or Remote]Employment Type: Full-TimeNotice period: only immediateJob Summary:We are seeking an experienced and highly skilled Senior Java Developer with strong backend development expertise in Core Java, Spring Boot, and JBoss, complemented by a solid...

  • Senior macos engineer

    3 weeks ago


    Kakinada, India Egnyte Full time

    EGNYTE YOUR CAREER. SPARK YOUR PASSION.Egnyte is a place where we spark opportunities for amazing people. We believe that every role has meaning, and every Egnyter should be respected. With 22,000+ customers worldwide and growing, you can make an impact by protecting their valuable data. When joining Egnyte, you’re not just landing a new career, you become...


  • Kakinada, India IQVIA Full time

    Project role: Senior Clinical data standards specialistWork experiences: 8-10+ years. Education: Bachelor's / Master's Work location: PAN IndiaMode of work: HomebasedRequired skills: 8+ years of experience in Statistical programming domain especially clinical operations (In the area of Data management, Database programming, Data Standards, Statistical...