EY - Data Engineer - Scala/Java

4 weeks ago


Pune, Maharashtra, India Ernst and Young Services Pvt. Ltd Full time

To be successful in this role, you should meet the following requirements: (Must have Requirements)

- Scala development and design using Scala 2.10+ or Java development and design using Java 1.8+.

- Experience with most of the following technologies (Apache Hadoop, Scala, Apache Spark, Spark streaming, YARN, Kafka, Hive, Python, ETL frameworks, Map Reduce, SQL, RESTful services).

- Sound knowledge on working Unix/Linux Platform

- Hands-on experience building data pipelines using Hadoop components - Hive, Spark, Spark SQL.

- Experience with industry standard version control tools (Git, GitHub), automated deployment tools (Ansible & Jenkins) and requirement management in JIRA.

- Understanding of big data modelling techniques using relational and non-relational techniques

- Experience on Debugging the Code issues and then publishing the highlighted differences to the development team/Architects;

The successful candidate will also meet the following requirements: (Good to have Requirements)

- Experience with time-series/analytics dB's such as Elastic search.

- Experience with scheduling tools such as Airflow, Control-M.

- Understanding or experience of Cloud design patterns

- Exposure to DevOps & Agile Project methodology such as Scrum and Kanban.

- Experience with developing Hive QL, UDF's for analysing semi structured/structured datasets

(ref:hirist.tech)
  • Big Data Engineer

    3 weeks ago


    Pune, Maharashtra, India Consulting Pandits Full time

    Mandatory Skills:- 4+ years' experience in software development with Big data technologies- Proficiency in at least one of the following programming languages: Java/Scala/Python- Experience of development and deployment of at least one end-to-end data storage/processing pipeline- Basic understanding of RDBMS- Intermediate level expertise in Apache Spark,...


  • Pune, Maharashtra, India Frequence Full time

    Job Description :- You are a 5-8 Years of experienced professional having in-depth knowledge of SQL, Scala, Spark, AWS - EMR, AWS Athena, AWS S3, AWS Glue, and PHP (all skills are required).- Knowledge of scripting languages including Python, Java, C++, and Linux are add-ons.- In-depth Knowledge of NoSQL and RDBMS databases.- Familiarity with Airflow and...


  • Pune, Maharashtra, India QAAgility Technologies Full time

    Job Title : Senior Data and Analytics EngineerWork Experience : 3-5 yearsJob Location : PunePosition Overview : We are looking for an experienced Senior Data and Analytics Engineer who will be responsible for designing, developing, and maintaining our data infrastructure and analytics solutions. The ideal candidate will have strong expertise in Hadoop,...

  • Big Data Engineer

    4 weeks ago


    Pune, Maharashtra, India HyrEzy Talent Solutions Full time

    Role : Big Data EngineerAbout Organization :Our Client is an IT consulting organization focused on providing AI Led Digital Transformation Consulting services to enterprise customers. They have adopted AI First strategy to drive value in form of Agility, Quality, Efficiency, Competitive advantage, Customer experience as core principles. Our focus is to drive...


  • Pune, Maharashtra, India Zimetrics Technologies Private Limited Full time

    Experience :- 4+ years of data engineering or software engineering- 4+ years building data applications in Scala, Java, and Python- Proficient with distributed data processing with Apache Spark- Proficient with SQL and modern data warehouse platforms - Snowflake, Redshift, Big Query, or Synapse- Proficient with workflow management platforms - Airflow, AWS...

  • Big Data Engineer

    4 weeks ago


    Pune, Maharashtra, India Www.Huquo.com Full time

    Big Data Engineer( Lead assistant manager-Manager) Job Description : Must Have : Tech savvy engineer - willing and able to learn new skills, track industry trend.- 5 - 7 years of total experience of solid data engineering experience, especially in Open Source, data-intensive, distributed environments with minimum 5 years of experience in big data related...

  • WovV Technologies

    4 weeks ago


    Pune, Maharashtra, India WovV Technologies Full time

    Location : Pune (Hybrid Work module compulsory, WFH not available).Experience : 5-7 years.Contract Duration : Contract position for 6 months (can be extended).Mandatory Technology : Product development, Application development, Spark, Apache Airflow, Snowflake, BigQuery.Role and Responsibilities :- Scala is a mandatory skill here.- Please ensure that the...


  • Pune, Maharashtra, India HuQuo Consulting Pvt. Ltd. Full time

    Job Description :- 5-8 years of total experience of solid data engineering experience, especially in Open Source, data-intensive, distributed environments with minimum 5 years of experience in big data related technologies like Spark, Hive, HBase, Hadoop, etc. Programming background : - Mandatory- Scala, Spark and Java / Python - Experience in following...


  • Pune, Maharashtra, India Antal International Full time

    Role :As a Senior Software Engineer, you will collaborate closely with the data engineering team and work on developing and maintaining data pipelines, data processing applications, and data integration solutions. You will get a chance to work with brilliant minds in the industry, work on complex use cases enabling steep learning curve, and build products...


  • Pune, Maharashtra, India Huquo Full time

    Job Description :Must Have :Tech savvy engineer - willing and able to learn new skills, track industry trend.- 5 - 7 years of total experience of solid data engineering experience, especially in Open Source, data-intensive, distributed environments with minimum 5 years of experience in big data related technologies like Spark, Hive, HBase, Hadoop, etc.-...


  • Mumbai/Pune, Maharashtra, India Waytogo Consultants Full time

    Job Description :As a Scala Niche Developer (Sr. Associate), you will be responsible for :- Driving Business Value: Delivering on critical business priorities while evolving the platform towards its strategic vision.- You will closely collaborate with product managers, end users, and business analysts to understand business objectives, key success factors,...


  • Pune, Maharashtra, India Coders Brain Technology & Private Limited Full time

    To be successful in this role, you should possess :- Collaborate closely with Product Management and Engineering leadership to devise and build the right solution.- Participate in Design discussions and brainstorming sessions to select, integrate, and maintain Big Data tools and frameworks required to solve Big Data problems at scale.- Design and implement...

  • WovV Technologies

    4 weeks ago


    Pune, Maharashtra, India Wovv Technology Full time

    Job Description: Big Data Pune (Hybrid Work module compulsory, WFH not 5-7 years.Contract Duration: Contract position for 6 months (can be Technology: Product development, Application development, Spark, Apache Airflow, Snowflake, BigQuery.Role and is a mandatory skill here. Please ensure that the candidate has worked into Scala before sharing the profiles....

  • Senior Data Engineer

    2 weeks ago


    Pune, Maharashtra, India Cyber Sphere LLC Full time

    Senior Data EngineerFTE OpportunityLocation : Pun, India - Onsite100%Job Description : - Design and develop data-ingestion frameworks, real-time processing solutions, and data processing and transformation frameworks.- Deploy and provide support for application codes and analytical models.- Create and enhance data solutions that enable seamless integration...

  • Full Stack Developer

    4 weeks ago


    Pune, Maharashtra, India Nirmitee.io Full time

    Job Description : Role : FullStack Developer (Java+Angular)- Full stack development capabilities- Knowledge of Angular JS, Java, Spring Boot, microservices architecture- Must have skills in big data, Hadoop, Spark, Scala- Angular and Java skills are mandatory- 5+ years of hands on Experience Experience : 5 - 8 years of experience in developing application...

  • Intellify Solutions

    24 hours ago


    Pune, Maharashtra, India Intellify Full time

    Job Description :Job Title : Data Engineer and Power BI Data Visualization EngineerWork location : Pune (Kothrud)Job Type : PERMANENT (Full-time and on company payroll)No. of Working days (Per Week) : 5-days week (MON to FRI)Mode of Work : Work From Office (WFO) for 5-days is required (initially from Kothrud office and thereafter from Baner as they are...

  • Java Backend Engineer

    4 weeks ago


    Pune, Maharashtra, India Arting Digital Full time

    Position title : Java Backend Engineer CTC : 30-35% hike Experience : 3-7 yrs Location : Pune Work mode : Onsite Primary skills : Java, Spring, Swagger, JPA,JSF, CXF, Velocity, AWS Lambda (Java), AWS Cognito(OAuth2), MySQL, Jenkins, EKS, Cloud formation. Qualification : Any EngineeringRoles And Responsibilities:A Java Backend Engineer is responsible for...

  • Python Developer

    3 weeks ago


    Pune, Maharashtra, India Corpxcel Consulting Full time

    Location : Pune OnlyRole type : IC and completely hands on Qualifications :- 2+ years of Java/Scala development experience.- 2+ years of SQL and NoSQL experience (handling structured and unstructured data).- 1+ years of extensive experience with Spark Processing engine.- 1+ years of experience with Big data tools / technologies/ Streaming (Hive, Impala,...

  • Technical Architect

    4 days ago


    Pune, Maharashtra, India Consulting Pandits Full time

    Job Description :Mandatory Skills :- 7-15 years of total experience in software development - At least 4 years of experience with Big data technologies- Proficiency in at least one of the following programming languages : Python/Scala/Java- Experience of development and deployment of at least two end-to-end big data solutions- Understanding of RDBMS-...

  • Senior Data Engineer

    2 weeks ago


    Pune, Maharashtra, India timesjobs Full time

    Senior Data EngineerPosition: Senior Data EngineerExperience: 8 yearsJob Location: PuneSkills Required:Developing, maintaining, and documenting reliable and scalable data infrastructure and data products in complex environmentsDevelopment experience in one or more object-oriented programming languages (e.g., Py-spark, Python, Java, C )Experience of working...