BigData-Hadoop/Scala Engineer

5 months ago

Pune, India F337 Deutsche India Private Limited, Pune Branch Full time

Description

Engineer is responsible for managing or performing work across multiple areas of the bank's overall IT Platform/Infrastructure including analysis, development, and administration. It may also involve taking functional oversight of engineering delivery for specific departments.
Work includes:

Planning and developing entire engineering solutions to accomplish business goals. Building reliability and resiliency into solutions with appropriate testing and reviewing throughout the delivery lifecycle. Ensuring maintainability and reusability of engineering solutions. Ensuring solutions are well architected and can be integrated successfully into the end-to-end business process flow. Reviewing engineering plans and quality to drive re-use and improve engineering capability. Participating in industry forums to drive adoption of innovative technologies, tools and solutions in the Bank.

What we’ll offer you

As part of our flexible scheme, here are just some of the benefits that you’ll enjoy

Best in class leave policy. Gender neutral parental leaves 100% reimbursement under childcare assistance benefit (gender neutral) Sponsorship for Industry relevant certifications and education Employee Assistance Program for you and your family members Comprehensive Hospitalization Insurance for you and your dependents Accident and Term life Insurance Complementary Health screening for 35 yrs. and above

Your key responsibilities

This role is for Software Engineer responsible for Design and Developing software applications. The candidate is expected to work closely with Team Leads or Software Development Managers and other key stake holders to ensure good quality, maintainable, scalable and high performing software applications are delivered to users. Should be coming from a strong technological background. Should be hands on and be able to work independently requiring minimal technical/tool guidance. Should have good communication skill and strong positive outlook.  Experience working in Agile and Scrum delivery. Should be able to contribute towards good software design. Participate in daily stand-up meetings. Analyze software defects and fix them in timely manner. Work closely with Functional Analysis and Quality Assurance teams

Your skills and experience

Must Have

Extensive experience with Hadoop & Java/Scala related technologies such as Understanding of Hadoop ecosystem and HDFS file System.Understanding of different types of nodes in a Hadoop cluster.Experience with MapReduce framework.Experience with Hive, Pig, Impala, Spark SQL etcExperience with Apache Spark and Scala (preferably greater than version 2.0 )Experience Spark job optimizationExperience with File handling such as Avro/Parquet etcGood understanding of BEELINE command to connect to HIVE serverTuning and Troubleshooting, experience with profiling and monitoring toolsExperience on Scala or Java preferably Spring Batch/Core/BootExperience with Messaging and integration, Patterns, REST, SOAExperience with build and deployment tools like Maven/Artifactory/Teamcity or JenkinsUnix scripting and hands on experience

Nice to have

Experience with cloud technologies such as Docker, Kubernetes, Openshift, Azure, GCP Experience with UI frameworks like Angular or React RDBMS /Oracle design, development, tuning

How we’ll support you

Training and development to help you excel in your career Coaching and support from experts in your team A culture of continuous learning to aid progression A range of flexible benefits that you can tailor to suit your needs

  • Big Data Hadoop/Scala Engineer

    4 weeks ago

    Pune, Maharashtra, India F337 Deutsche India Private Limited, Pune Branch Full time

    About the RoleF337 Deutsche India Private Limited, Pune Branch is seeking a highly skilled Big Data Hadoop/Scala Engineer to join our team. As a key member of our engineering team, you will be responsible for designing, developing, and maintaining large-scale data processing systems using Hadoop and Scala.Key ResponsibilitiesDesign and develop scalable data...

  • BigData Engineer

    5 months ago

    Pune, India Fractal Full time

    It's fun to work in a company where people truly BELIEVE in what they are doing!The BigData Engineers have expertise in building horizontally scalable applications using distributed technologies like NoSQL Dbs/Hadoop/Spark and others and we execute projects on-premise and cloud based systems. The AI-Engineers and MLOps Engineers work on scaling AI-systems...

  • Scala Developer

    5 months ago

    Bangalore/Pune/Hyderabad, India T D Newton Full time

    Urgent requirement for Scala Developer.Experience : 4-7 YrsJob Location : Pune/Bangalore/HyderabadMust have : Scala, Spark, CI/CD, Airflow, Hadoop, SQL Job Description :As a key member of the technical team alongside Engineers, Data Scientists and Data Users, you will be expected to define and contribute at a high-level to many aspects of our collaborative...

  • Scala Data Engineer

    3 weeks ago

    Pune, Maharashtra, India TapTalent Full time

    Job Title: Scala Data EngineerJob Description:As a Scala Data Engineer at TapTalent, you will be responsible for designing and developing big data platforms using Spark and Hadoop ecosystem technologies. You will work with agile development methods and have a deep understanding of modern data processing technology stacks. Experience with NoSQL technologies...

  • Senior Software Development Engineer In Test

    4 weeks ago

    Pune H.O, India PubMatic Full time

    Job Title: Senior Software Development Engineer In Test - BigdataWe are seeking a highly skilled Senior Software Development Engineer In Test to join our team. As a Senior Software Development Engineer In Test, you will be responsible for designing, developing, and testing software applications for our Bigdata platform.Key Responsibilities:Design and develop...

  • Data Engineer

    1 week ago

    Pune, India Huntsmen and barons Full time

    Skills : Apache Spark & ScalaKey Responsibilities :Spark Framework Expertise :- Demonstrate a thorough understanding of the Spark framework, including its architecture and core components.- Optimize Spark applications for performance, ensuring efficient data processing and resource management.Programming Skills :- Utilize Scala or PySpark for developing data...

  • Scala Data Engineer

    2 weeks ago

    Pune, Maharashtra, India TapTalent Full time

    Job Requirements:We are seeking a highly skilled Data Engineering Expert with expertise in Scala Spark to join our team at TapTalent.Key Responsibilities:Design and develop big data platforms using Scala Spark.Develop deep understanding of modern data processing technology stacks, including Spark, HBase, Hive, and other Hadoop ecosystem...

  • Senior Hadoop Engineer

    5 months ago

    Pune, India HuQuo Consulting Pvt. Ltd. Full time

    Job Description : - 5-8 years of total experience of solid data engineering experience, especially in Open Source, data-intensive, distributed environments with minimum 5 years of experience in big data related technologies like Spark, Hive, HBase, Hadoop, etc. Programming background : - Mandatory- Scala, Spark and Java / Python - Experience in following...

  • Senior Hadoop Developer

    4 weeks ago

    Pune, Maharashtra, India HuQuo Consulting Pvt. Ltd. Full time

    Job Title: Senior Hadoop EngineerHuQuo Consulting Pvt. Ltd. is seeking a highly skilled Senior Hadoop Engineer to join our team. As a Senior Hadoop Engineer, you will be responsible for designing, developing, and implementing large-scale data processing systems using Hadoop and related technologies.Key Responsibilities:Design and develop data pipelines using...

  • Senior Hadoop Developer

    5 days ago

    Pune, Maharashtra, India SMARTWORK IT SERVICES Full time

    Job Title : Senior Hadoop Developer.Job Summary : We are seeking a highly skilled Senior Hadoop Developer to join our team at SMARTWORK IT SERVICES. The ideal candidate will have extensive experience in Scala, Apache Spark, Hadoop, and related ecosystem.Key Responsibilities :• 5+ years of hands-on experience of Scala SDK 2.11.12 or higher, Apache Spark,...

  • GCP Data Engineer

    2 months ago

    pune, India Tata Consultancy Services Full time

    Job Title : GCP Data Engineer Job Location – Chennai, Hyderabad, Bangalore, Pune, Gurgaon Experience: 5 to 12 Years Requirement: Mandatory to have knowledge of Big Data Architecture Patterns and experience in delivery of BigData and Hadoop Ecosystems. Strong experience required in GCP . Must have done multiple large projects with GCP Big Query and...

  • Senior/Software Development Engineer in Test – Bigdata:

    6 hours ago

    pune, India PubMatic Full time

    Title : Senior/Software Development Engineer in Test – Bigdata: Requirements: - Should have 1-3 years of experience working as SDET and doing meaningful automation. - Good programming skills. Python preferred. - Hands on experience in automating backend applications (e.g., database, REST API's) - Hands on experience with automating any backend...

  • Senior/Software Development Engineer in Test

    4 weeks ago

    Pune, India PubMatic Full time

    Title : Senior/Software Development Engineer in Test – Bigdata: Requirements: Should have 1-3 years of experience working as SDET and doing meaningful automation. Good programming skills. Python preferred. Hands on experience in automating backend applications (e.g., database, REST API's) Hands on experience with automating any backend applications...

  • Senior/Software Development Engineer in Test – Bigdata:

    2 months ago

    pune, India PubMatic Full time

    Title : Senior/Software Development Engineer in Test – Bigdata: Requirements: Should have 1-3 years of experience working as SDET and doing meaningful automation. Good programming skills. Python preferred. Hands on experience in automating backend applications (e.g., database, REST API's) Hands on experience with automating any backend applications (e.g.,...

  • GCP Data Engineer

    2 months ago

    Pune, India Tata Consultancy Services Full time

    Job Title : GCP Data EngineerJob Location – Chennai, Hyderabad, Bangalore, Pune, GurgaonExperience: 5 to 12 YearsRequirement:Mandatory to have knowledge of Big Data Architecture Patterns and experience in delivery of BigData and Hadoop Ecosystems.Strong experience required in GCP . Must have done multiple large projects with GCP Big Query and...

  • Senior/Software Development Engineer in Test

    1 month ago

    Pune, India PubMatic Full time

    Title : Senior/Software Development Engineer in Test – Bigdata: Requirements: Should have 1-3 years of experience working as SDET and doing meaningful automation. Good programming skills. Python preferred. Hands on experience in automating backend applications (e.g., database, REST API's) Hands on experience with automating any backend applications...

  • Scala Developer

    4 weeks ago

    Mumbai/Hyderabad/Chennai/Pune/Bangalore, India Monster Full time

    Job Title: Scala/Spark DeveloperAbout the Role:We are seeking a highly skilled Scala/Spark Developer to join our team at Monster. As a key member of our data engineering team, you will be responsible for designing and developing big data platforms using Scala and Spark.Key Responsibilities:Design and develop big data platforms using Scala and SparkDevelop...

  • Senior Hadoop Developer

    2 weeks ago

    Pune/Chennai, India SMARTWORK IT SERVICES Full time

    Job Title : Senior Hadoop Developer. Job Summary We are seeking a highly skilled Senior Hadoop Developer to join our team at SMARTWORK IT SERVICES. As a Senior Hadoop Developer, you will be responsible for designing, developing, and maintaining large-scale data processing systems using Hadoop and related ecosystem. Responsibilities • Develop and...

  • Senior/Software Development Engineer in Test – Bigdata:

    2 months ago

    pune, India PubMatic Full time

    Title : Senior/Software Development Engineer in Test – Bigdata:Requirements:Should have 1-3 years of experience working as SDET and doing meaningful automation.Good programming skills. Python preferred.Hands on experience in automating backend applications (e.g., database, REST API's)Hands on experience with automating any backend applications (e.g.,...

  • Senior/Software Development Engineer in Test – Bigdata:

    7 days ago

    pune, India PubMatic Full time

    Title : Senior/Software Development Engineer in Test – Bigdata:Requirements:- Should have 1-3 years of experience working as SDET and doing meaningful automation.- Good programming skills. Python preferred.- Hands on experience in automating backend applications (e.g., database, REST API's)- Hands on experience with automating any backend applications...