Data Engineer

Found in: Talent IN C2 - 3 weeks ago

Mumbai, India Jio Platforms Limited Full time


Big Data COE Data Engineer

Job Description:


Big Data Centre of Excellence is building state-of-the-art Data Analytics and Management systems used across various Jio Platforms. Primarily we enable different businesses - ingest, process, manage and derive insights from data. We developed numerous data intelligence capabilities on top of these systems which communicate with each other and help businesses make informed decisions. Big Data COE encourages the usage of Open Source tools/services to build robust and resilient systems that form the core for various AI/ML capabilities.


This role is for a Data Engineer with solid development experience who will focus on creating robust data pipelines and enhancing existing ETL processes. You will be an integral part of development team examining requirements and designing optimal solutions. The role is for a self-motivated individual with knowledge of Hadoop ecosystem and various Hadoop tools/services. The candidate will perform hands-on activities including design, documentation, development and test of new functionality.

Preferred Qualifications:

  1. Excellent coding skills in Java/Scala/python especially in OOP constructs & concurrency systems; experienced in building highly optimal software systems.
  2. Well versed in shell scripting for working on Unix/Linux based systems.
  3. Experience in designing, building, tuning & troubleshooting distributed, scalable data pipelines & data streaming solutions
  4. In depth knowledge and hands-on experience of
  5. Hadoop based computing solutions including but not limited to MapReduce, Spark, Hive, Tez, YARN, HBase, Kudu, Druid, Presto, Impala
  6. Building real time streaming solutions including but not limited to Kafka, Spark Streaming, Structure Streaming, Apache Flink, Apache Beam, NiFi
  7. Distributed search systems like Solr, Elastic Search
  8. Distributed Memory Grid like Ignite, Redis, Hazelcast.


Responsibilities


  • Build and extend re-usable platform components & frameworks within Big Data Ecosystem, having highly modular and extendible design.
  • Iterative improvement in existing solutions and technology stack by prototyping from latest bleeding edge technologies.
  • Capability to work efficiently in both the roles as an Individual Contributor (IC) or as a Team player
  • Good team player - mentor, guide and lead other developers & team members in building robust, highly resilient data processing pipelines.
  • Encourage use of correct coding practices through aggressive code reviews and TDD approach.



  • Data Engineer with GCP

    Found in: Whatjobs IN C2 - 4 days ago

    Mumbai, India Optimum Data Analytics Full time

    JobDetails:Position: Data Engineer withGCPExperience: 3yearsLocation:MumbaiRequired Skills: Google data lake SQLPythonEmloyement type:FTH RoleOverview: Seeking a highlyskilled and motivated Data Engineer who will beresponsible for managing the data assignmentalong with hands on experience in GoogleData Lake PythonSQL. JobResponsibilities:Google datalake...

  • Data Engineer with GCP

    Found in: Whatjobs IN C2 - 3 days ago

    mumbai, India Optimum Data Analytics Full time

    JobDetails:Position: Data Engineer withGCPExperience: 3yearsLocation:MumbaiRequired Skills: Google data lake SQLPythonEmloyement type:FTHRoleOverview: Seeking a highlyskilled and motivated Data Engineer who will beresponsible for managing the data assignmentalong with hands on experience in GoogleData Lake PythonSQL.JobResponsibilities: Google datalake...

  • Cloud Security Engineer

    Found in: Whatjobs IN C2 - 3 weeks ago

    Mumbai, India NTT DATA Full time

    Cloud Security Engineer – L3Min. 7 – 8 years of Hand-on experience in any two Public Clouds (AWS, GCP and Azure) and total more than 10 years of IT industry experience. Terraform is a must.Technical Skills requirement:Need to write code or scripts to automate security tasks or integrate security tools into the cloud environment. For that familiarity with...

  • Cloud Security Engineer

    Found in: Whatjobs IN C2 - 3 weeks ago

    Mumbai, India NTT DATA Full time

    Cloud Security Engineer – L3 Min. 7 – 8 years of Hand-on experience in any two Public Clouds (AWS, GCP and Azure) and total more than 10 years of IT industry experience. Terraform is a must. Technical Skills requirement: Need to write code or scripts to automate security tasks or integrate security tools into the cloud environment. For that...

  • Cloud Security Engineer

    Found in: Talent IN 2A C2 - 3 weeks ago

    Mumbai, India NTT DATA Full time

    Cloud Security Engineer – L3 Min. 7 – 8 years of Hand-on experience in any two Public Clouds (AWS, GCP and Azure) and total more than 10 years of IT industry experience. Terraform is a must. Technical Skills requirement: Need to write code or scripts to automate security tasks or integrate security tools into the cloud environment. For that familiarity...

  • Cloud Security Engineer

    Found in: Appcast Linkedin IN C2 - 3 weeks ago

    Mumbai, India NTT DATA Full time

    Cloud Security Engineer – L3 Min. 7 – 8 years of Hand-on experience in any two Public Clouds (AWS, GCP and Azure) and total more than 10 years of IT industry experience. Terraform is a must. Technical Skills requirement: Need to write code or scripts to automate security tasks or integrate security tools into the cloud environment. For that familiarity...

  • Data Engineer

    Found in: Whatjobs IN C2 - 2 weeks ago

    Mumbai, India Antal International Full time

    Job DescriptionData Engineer Job Responsibilities:· Develops and maintains scalable data pipelines and builds out new API integrations to support continuing increases in data volume and complexity.· Collaborates with analytics and business teams to improve data models that feed business intelligence tools, increasing data accessibility and fostering...

  • Data Engineer

    Found in: Whatjobs IN C2 - 2 weeks ago

    Mumbai, India Searce Technologies Inc Full time

    about the roleData Engineer identifies the business problem and translates these to data services and engineering outcomes. You will deliver data solutions that empower better decision making and flexibility of your solution that scales to respond to broader business questions.key responsibilitiesAs a Data Engineer, you are a full-stack data engineer that...

  • Data Engineer

    Found in: Whatjobs IN C2 - 4 days ago

    Mumbai, India Living Things Full time

    Company DescriptionLiving Things is a pioneering IoT platform by iCapotech Pvt Ltd, dedicated to accelerating the net zero journey towards a sustainable future. Our solution seamlessly integrates with existing air conditioners, empowering businesses & organisations to optimise & reduce energy usage, enhance operational efficiency, reduce carbon footprints,...

  • Data Engineer

    Found in: Whatjobs IN C2 - 3 weeks ago

    mumbai, India Antal International Full time

    Job Description Data Engineer Job Responsibilities: · Develops and maintains scalable data pipelines and builds out new API integrations to support continuing increases in data volume and complexity. · Collaborates with analytics and business teams to improve data models that feed business intelligence tools, increasing data accessibility and...

  • Data Engineer

    Found in: Talent IN C2 - 3 weeks ago

    Mumbai, India Searce Technologies Inc Full time

    about the role Data Engineer identifies the business problem and translates these to data services and engineering outcomes. You will deliver data solutions that empower better decision making and flexibility of your solution that scales to respond to broader business questions. key responsibilities As a Data Engineer, you are a full-stack...

  • Data Engineer

    Found in: Whatjobs IN C2 - 3 weeks ago

    mumbai, India Searce Technologies Inc Full time

    about the role Data Engineer identifies the business problem and translates these to data services and engineering outcomes. You will deliver data solutions that empower better decision making and flexibility of your solution that scales to respond to broader business questions. key responsibilities As a Data Engineer, you are a...

  • Data Engineer

    Found in: Whatjobs IN C2 - 5 days ago

    Mumbai, India Living Things Full time

    Company Description Living Things is a pioneering IoT platform by iCapotech Pvt Ltd, dedicated to accelerating the net zero journey towards a sustainable future. Our solution seamlessly integrates with existing air conditioners, empowering businesses & organisations to optimise & reduce energy usage, enhance operational efficiency, reduce carbon footprints,...

  • Data Engineer

    Found in: Appcast Linkedin IN C2 - 5 days ago

    Mumbai, India Living Things Full time

    Company Description Living Things is a pioneering IoT platform by iCapotech Pvt Ltd, dedicated to accelerating the net zero journey towards a sustainable future. Our solution seamlessly integrates with existing air conditioners, empowering businesses & organisations to optimise & reduce energy usage, enhance operational efficiency, reduce carbon footprints,...

  • Data Engineer

    Found in: Talent IN 2A C2 - 5 days ago

    Mumbai, India Living Things Full time

    Company Description Living Things is a pioneering IoT platform by iCapotech Pvt Ltd, dedicated to accelerating the net zero journey towards a sustainable future. Our solution seamlessly integrates with existing air conditioners, empowering businesses & organisations to optimise & reduce energy usage, enhance operational efficiency, reduce carbon footprints,...

  • Data Engineer

    Found in: Whatjobs IN C2 - 2 weeks ago

    Mumbai, India Puma Energy Full time

    Main Purpose:Collaborate with data scientists and business stakeholders to design, develop, and maintain efficient data pipelines feeding into the organization's data lake.Ensure the data lake contains accurate, up-to-date, and high-quality data, enabling data scientists to develop insightful analytics and business stakeholders to make well-informed...

  • Data Engineer

    Found in: Whatjobs IN C2 - 3 weeks ago

    mumbai, India Linkage IT Full time

    Job Title: GCP Data Engineer Location: Mumbai, India Company Overview: LinkageIT is a leading IT Consulting company dedicated to (brief company description). We are committed to leveraging cutting-edge technologies to drive innovation and provide exceptional solutions to our clients. As we expand our operations, we are seeking a talented and experienced GCP...

  • Data Engineer

    Found in: Whatjobs IN C2 - 3 weeks ago

    mumbai, India Anicalls (Pty) Ltd Full time

    Candidate should have: Clear, concise communication abilities - writing, verbal, presentation - to all levels of technical and non-technical audiences with the ability to collaborate Strong experience in CICD technologies including Python, SQL, Airflow, and Git in a cloud setting Understanding of ELK stack is a plus for logging and reporting purposes...

  • Data Engineer

    Found in: Whatjobs IN C2 - 2 weeks ago

    Mumbai, India Linkage IT Full time

    Job Title: GCP Data EngineerLocation: Mumbai, IndiaCompany Overview:LinkageIT is a leading IT Consulting company dedicated to (brief company description). We are committed to leveraging cutting-edge technologies to drive innovation and provide exceptional solutions to our clients. As we expand our operations, we are seeking a talented and experienced GCP...

  • Data Engineer

    Found in: Talent IN C2 - 3 weeks ago

    Mumbai, India Linkage IT Full time

    Job Title: GCP Data EngineerLocation: Mumbai, IndiaCompany Overview:LinkageIT is a leading IT Consulting company dedicated to [brief company description]. We are committed to leveraging cutting-edge technologies to drive innovation and provide exceptional solutions to our clients. As we expand our operations, we are seeking a talented and experienced GCP...