Specialist - Data Engineering

4 weeks ago


Bengaluru, Karnataka, India Talpro Full time

Job Description

Senior Specialist - Data Engineering

Job Summary :

We are seeking a highly skilled Senior Specialist - Data Engineering with strong Spark Scala knowledge, mandatory for a significant and complex engagement. An AWS background is welcome.

As a Big Data Full Stack Developer, you will work with various underlying tools such as Spark/Scala, Oozie, Postgre, and Couchbase. The role requires collaborating with architects to implement the application solution successfully.

Job Responsibilities :


- Develop Scala/Spark jobs for data transformation and aggregation.

- Modify and enhance the underlying Scala framework, as required.

- Work with Spark Streaming jobs, handle in-memory Spark state, and process messages for near-real-time systems.

- Optimize Spark queries for improved performance.

- Integrate with SQL databases, especially Postgre and Couchbase.

- Collaboratively solve technical problems within specified timelines with minimal guidance.

- Implement various engineering tasks, including gap analysis, data analysis, and impact analysis.

- Independently perform low-level design configuration, code customization, refactoring, and code reviews.

- Demonstrate expertise in design, development, testing, build, and deployment stages of the software lifecycle.

- Ensure thorough documentation and provide reliable engineering support to all stakeholders.

Required Skills :

- Mandatory expertise in Spark Scala.

- AWS background and familiarity with Big Data technologies.

- Proficiency in modifying and enhancing Scala frameworks.

- Experience with Spark Streaming and in-memory processing.

- Strong SQL database integration skills, particularly with Postgre and Couchbase.

- Problem-solving abilities and the ability to meet project deadlines.

- Effective collaboration with team members and architects.

- Documentation skills for maintaining comprehensive project records

(ref:hirist.tech)

  • Bengaluru, Karnataka, India beBeeDataEngineering Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    **Job Title:** Data Engineering SpecialistAs a seasoned data engineer, you will play a pivotal role in designing, developing, and maintaining high-performance data pipelines and ETL processes on Databricks. You will lead the architecture and implementation of scalable, secure, and efficient data solutions.


  • Bengaluru, Karnataka, India NTT DATA Full time

    Req ID 336414 NTT DATA strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a Digital Engineering Networking Engineer Specialist to join our team in Bangalore Karn taka IN-KA India IN At...


  • Bengaluru, Karnataka, India NTT Data Full time

    Job DescriptionNTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Digital Engineering Networking Engineer Specialist to join our team in Bangalore, Karntaka (IN-KA), India (IN).At NTT...

  • Urgent Data Engineer

    2 weeks ago


    Bengaluru, Karnataka, India NTT Data Full time

    Job DescriptionNTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer - ETL to join our team in Bangalore, Karntaka (IN-KA), India (IN).Job Duties:. Migrate ETL workflows from...


  • Bengaluru, Karnataka, India beBeeDataEngineering Full time

    Job Title: Data Engineering SpecialistJob Description:As a seasoned professional in data engineering, you will be responsible for designing, developing, and maintaining complex data pipelines using cutting-edge technologies like Google Cloud Platform (GCP). Your expertise in GCP services such as Dataflow, Dataproc, Pub/Sub, Big Query, Cloud Storage, and...


  • Bengaluru, Karnataka, India NTT DATA, Inc. Full time

    Job DescriptionMake an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion its a place where you can grow, belong and thrive.Your day at NTT DATAThe...


  • Bengaluru, Karnataka, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Senior Data Engineering SpecialistWe are seeking a highly skilled Senior Data Engineering Specialist to join our team. The ideal candidate will have extensive experience in designing, developing, and implementing large-scale data integration pipelines using Informatica BDM/DEI.Job Description:This is a full-time on-site role for a seasoned data engineer...

  • Data Engineer

    4 weeks ago


    Bengaluru, Karnataka, India NTT DATA North America Full time

    Job DescriptionReq ID: 330827NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer to join our team in Bengaluru, Karntaka (IN-KA), India (IN).Sr Developer - Data...

  • Data Engineer

    3 weeks ago


    Bengaluru, Karnataka, India ConcertAI Full time

    Job DescriptionJob RequirementsLooking for energetic, self-motivated and exceptional Data Engineer to work on extraordinary enterprise products based on AI and Big Data engineering. He/she will work with star team of Architects, Data Scientists/AI Specialists, Data Engineers, Integration Specialists and UX developers.Work ExperienceAdvanced working SQL...

  • Data Engineer

    6 days ago


    Bengaluru, Karnataka, India NTT DATA North America Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Req ID: NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer (Talend &Pyspark) to join our team in Bangalore, Karnātaka (IN-KA), India (IN)."Job Duties: Key...