BigData-Hadoop/Scala Engineer

3 weeks ago


Pune, India F337 Deutsche India Private Limited, Pune Branch Full time
Description

Engineer is responsible for managing or performing work across multiple areas of the bank's overall IT Platform/Infrastructure including analysis, development, and administration. It may also involve taking functional oversight of engineering delivery for specific departments.Work includes:Planning and developing entire engineering solutions to accomplish business goals.Building reliability and resiliency into solutions with appropriate testing and reviewing throughout the delivery lifecycle.Ensuring maintainability and reusability of engineering solutions.Ensuring solutions are well architected and can be integrated successfully into the end-to-end business process flow.Reviewing engineering plans and quality to drive re-use and improve engineering capability.Participating in industry forums to drive adoption of innovative technologies, tools and solutions in the Bank.What we’ll offer youAs part of our flexible scheme, here are just some of the benefits that you’ll enjoyBest in class leave policy.Gender neutral parental leaves100% reimbursement under childcare assistance benefit (gender neutral)Sponsorship for Industry relevant certifications and educationEmployee Assistance Program for you and your family membersComprehensive Hospitalization Insurance for you and your dependentsAccident and Term life InsuranceComplementary Health screening for 35 yrs. and aboveYour key responsibilitiesThis role is for Software Engineer responsible for Design and Developing software applications.The candidate is expected to work closely with Team Leads or Software Development Managers and other key stake holders to ensure good quality, maintainable, scalable and high performing software applications are delivered to users.Should be coming from a strong technological background.Should be hands on and be able to work independently requiring minimal technical/tool guidance.Should have good communication skill and strong positive outlook.Experience working in Agile and Scrum delivery.Should be able to contribute towards good software design.Participate in daily stand-up meetings.Analyze software defects and fix them in timely manner.Work closely with Functional Analysis and Quality Assurance teamsYour skills and experienceMust HaveExtensive experience with Hadoop & Java/Scala related technologies such as Understanding of Hadoop ecosystem and HDFS file System.Understanding of different types of nodes in a Hadoop cluster.Experience with MapReduce framework.Experience with Hive, Pig, Impala, Spark SQL etcExperience with Apache Spark and Scala (preferably greater than version 2.0 )Experience Spark job optimizationExperience with File handling such as Avro/Parquet etcGood understanding of BEELINE command to connect to HIVE serverTuning and Troubleshooting, experience with profiling and monitoring toolsExperience on Scala or Java preferably Spring Batch/Core/BootExperience with Messaging and integration, Patterns, REST, SOAExperience with build and deployment tools like Maven/Artifactory/Teamcity or JenkinsUnix scripting and hands on experienceNice to haveExperience with cloud technologies such as Docker, Kubernetes, Openshift, Azure, GCPExperience with UI frameworks like Angular or ReactRDBMS /Oracle design, development, tuningHow we’ll support youTraining and development to help you excel in your careerCoaching and support from experts in your teamA culture of continuous learning to aid progressionA range of flexible benefits that you can tailor to suit your needs

  • Pune, India F337 Deutsche India Private Limited, Pune Branch Full time

    Description Engineer is responsible for managing or performing work across multiple areas of the bank's overall IT Platform/Infrastructure including analysis, development, and administration. It may also involve taking functional oversight of engineering delivery for specific departments. Work includes: Planning and developing entire engineering...


  • pune, India F337 Deutsche India Private Limited, Pune Branch Full time

    Description Engineer is responsible for managing or performing work across multiple areas of the bank's overall IT Platform/Infrastructure including analysis, development, and administration. It may also involve taking functional oversight of engineering delivery for specific departments.Work includes: Planning and developing entire engineering...

  • Data Engineer

    2 months ago


    Pune, India TD Newton Full time

    - As a key member of the technical team alongside Engineers, Data Scientists and Data Users, you will be expected to define and contribute at a high-level to many aspects of our collaborative Agile development process :- Software design, Scala & Spark development, automated testing of new and existing components in an Agile, DevOps and dynamic environment-...

  • Scala Developer

    4 weeks ago


    Pune/Gurgaon/Gurugram, India IFLOWTECH SOLUTIONS PRIVATE LIMITED Full time

    Job Description : As part of your duties, you will be responsible for : - Design and implement scalable and robust data pipelines using Scala within the Hadoop ecosystem. - Collaborate with cross-functional teams to understand data requirements and deliver solutions that meet business needs. - Perform performance tuning in Hadoop with a focus on...


  • pune, India QAAgility Technologies Full time

    Job Title : Senior Data and Analytics EngineerWork Experience : 3-5 yearsJob Location : PunePosition Overview : We are looking for an experienced Senior Data and Analytics Engineer who will be responsible for designing, developing, and maintaining our data infrastructure and analytics solutions. The ideal candidate will have strong expertise in Hadoop,...


  • Pune, India QAAgility Technologies Full time

    Job Title : Senior Data and Analytics EngineerWork Experience : 3-5 yearsJob Location : PunePosition Overview : We are looking for an experienced Senior Data and Analytics Engineer who will be responsible for designing, developing, and maintaining our data infrastructure and analytics solutions. The ideal candidate will have strong expertise in Hadoop,...


  • Pune, India QAAgility Technologies Full time

    Job Title : Senior Data and Analytics EngineerWork Experience : 3-5 yearsJob Location : PunePosition Overview : We are looking for an experienced Senior Data and Analytics Engineer who will be responsible for designing, developing, and maintaining our data infrastructure and analytics solutions. The ideal candidate will have strong expertise in Hadoop,...


  • Pune, Maharashtra, India QAAgility Technologies Full time

    Job Title : Senior Data and Analytics EngineerWork Experience : 3-5 yearsJob Location : PunePosition Overview : We are looking for an experienced Senior Data and Analytics Engineer who will be responsible for designing, developing, and maintaining our data infrastructure and analytics solutions. The ideal candidate will have strong expertise in Hadoop,...

  • Spark Scala Developer

    2 months ago


    pune, India Corporate Resources Full time

    Job Description 4+ years of experience with Java, Spark, Bigdata & Hadoop with strong Unix background Create Scala/Spark jobs for data transformation and aggregation Experience of writing code in spark and Scala Produce unit tests for Spark transformations and helper methods Write Scaladoc-style...

  • Bigdata

    1 week ago


    Pune, India LTIMindtree Full time

    Exp- 5 to 15 Years Locations- PAN India LTIM locations Rel Experience- 3 Years (in Python/ Pyspar/ ScalaSpark) Scala development and design using Scala 3+ or Python Hadoop, Spark/Pyspark, Hive, YARN Data Modelling: A good data engineer should be able to design, implement and maintain data models that can support the organization‘s data storage and...


  • Pune,Hyderabad, India Idyllic Services Pvt Ltd Full time

    About the job :Job Description :Job Title : Fullstack Data EngineerExperience : 7+ Yrs,Location : Pune, Hyderabad.Full Stack Data Engineer role is expected to own and manage end to end activities within the team. Person would be entrusted to developed solutions/design ideas related to Data Engineering, service upkeep, developing new capabilities and identify...

  • Data Engineer

    2 months ago


    Pune, India TD NEWTON Full time

    Job Description : Must have Requirements : To be successful in this role, you should meet the following requirements : - Scala development and design using Scala 2.10+ or Java development and design using Java 1.8+. - Experience with most of the following technologies : Apache Hadoop, Scala, Apache Spark, Spark streaming, YARN, Kafka, Hive, Python, ETL...

  • Hadoop Developer

    1 month ago


    Pune, India Nityo Infotech Full time

    Should have Hands on Experience of Development on Cloudera Platform.• Developing Unix Shell scripts• Good understating of Hadoop Technologies such as Pig, Hive, HBase, HDFS, Spark,be able to analyze the issues on Hadoop Systems.• Design, development, and implementation of performant ETL pipelines using python API (pySpark) of Apache Spark on AWS...

  • Senior Hadoop Engineer

    2 months ago


    Pune, India HuQuo Consulting Pvt. Ltd. Full time

    Job Description : - 5-8 years of total experience of solid data engineering experience, especially in Open Source, data-intensive, distributed environments with minimum 5 years of experience in big data related technologies like Spark, Hive, HBase, Hadoop, etc. Programming background : - Mandatory- Scala, Spark and Java / Python - Experience in following...

  • Senior Hadoop Engineer

    2 months ago


    Pune, India HuQuo Consulting Pvt. Ltd. Full time

    Job Description :- 5-8 years of total experience of solid data engineering experience, especially in Open Source, data-intensive, distributed environments with minimum 5 years of experience in big data related technologies like Spark, Hive, HBase, Hadoop, etc. Programming background : - Mandatory- Scala, Spark and Java / Python - Experience in following...


  • Pune, Maharashtra, India HuQuo Consulting Pvt. Ltd. Full time

    Job Description :- 5-8 years of total experience of solid data engineering experience, especially in Open Source, data-intensive, distributed environments with minimum 5 years of experience in big data related technologies like Spark, Hive, HBase, Hadoop, etc. Programming background : - Mandatory- Scala, Spark and Java / Python - Experience in following...

  • Hadoop Developer

    2 months ago


    Pune, India Nityo Infotech Full time

    Should have Hands on Experience of Development on Cloudera Platform.• Developing Unix Shell scripts• Good understating of Hadoop Technologies such as Pig, Hive, HBase, HDFS, Spark, be able to analyze the issues on Hadoop Systems.• Design, development, and implementation of performant ETL pipelines using python API (pySpark) of Apache Spark on AWS...


  • Pune, India LTIMindtree Full time

    Exp- 5 to 15 YearsLocations- PAN India LTIM locationsRel Experience- 3 Years (in Python/ Pyspar/ ScalaSpark)Scala development and design using Scala 3+ or PythonHadoop, Spark/Pyspark, Hive, YARNData Modelling: A good data engineer should be able to design, implement and maintain data models that can support the organization's data storage and analysis needs,...


  • Pune, India LTIMindtree Full time

    Exp- 5 to 15 Years Locations- PAN India LTIM locations Rel Experience- 3 Years (in Python/ Pyspar/ ScalaSpark) Scala development and design using Scala 3+ or Python Hadoop, Spark/Pyspark, Hive, YARN Data Modelling: A good data engineer should be able to design, implement and maintain data models that can support the organization's data storage and analysis...


  • Pune, India LTIMindtree Full time

    Exp- 5 to 15 YearsLocations- PAN India LTIM locationsRel Experience- 3 Years (in Python/ Pyspar/ ScalaSpark)Scala development and design using Scala 3+ or PythonHadoop, Spark/Pyspark, Hive, YARNData Modelling: A good data engineer should be able to design, implement and maintain data models that can support the organization's data storage and analysis needs,...