Lead Data Engineer_Jio Data Platform_Bangalore

Found in: Talent IN C2 - 2 weeks ago

Bengaluru, India Jio Platforms Limited Full time

Job Description:


We are looking for an experienced and motivated Lead Data Engineer to lead our data engineering team. As the Lead Data Engineer, you will play a critical role in designing, implementing, and managing our data infrastructure and analytics platforms. You will lead a team of data engineers, collaborate with cross-functional teams, and drive the development of innovative solutions to address complex data challenges. The ideal candidate will have a strong technical background in data engineering, leadership experience, and a proven track record of delivering scalable and reliable data solutions.


What you will do:

Lead and mentor a team of data engineers, providing technical guidance, coaching, and support.

Design, develop, and maintain scalable data pipelines and ETL processes to support data analytics and machine learning initiatives.

Architect, design, develop, and implement software applications using cutting-edge technologies and frameworks.

Take complete ownership of individual projects end-to-end. Should become recognized for technical expertise within the company and considered a go-to person within the area of focus and individual modules within projects.

Collaborate with stakeholders to define data architecture, design scalable data pipelines, and develop data models to support business objectives.

Oversee the development and maintenance of ETL processes, data warehouses, and data lakes to ensure data availability, reliability, and performance.

Troubleshoot and debug complex software issues, identify root causes, and implement effective solutions.

Stay current with emerging technologies and industry trends in data engineering and provide recommendations for technology adoption and innovation.

Choose and integrate suitable big data solutions (such as Hadoop, Spark, Kafka) and cloud environments (such as Azure, GCP).

Ensure data quality, security, and compliance with relevant regulations.

Who you are:

Bachelor's degree or higher in Computer Science, Engineering, or a related field.

6 to 10 years of experience in data engineering or a similar role, with at least 2 years of experience in a leadership or managerial capacity.

Proficiency in at least one programming language, such as Java, Python, or Scala.

Strong understanding of object-oriented programming principles and design patterns.

Experience working with relational databases and SQL.

Experience with big data technologies such as Hadoop, Kafka, Spark, NiFi, Hive etc,.

Experience with streaming technologies such as Spark Streaming, Flink, and others.

Experience with cloud platforms such as Microsoft Azure

Excellent leadership and communication skills, with the ability to influence and inspire team members.

Should have excellent experience in CICD frameworks and container-based deployments.

Ability to thrive in a fast-paced and dynamic environment, juggling multiple projects and priorities.

  • Data Analyst

    Found in: Whatjobs IN C2 - 2 weeks ago

    Bengaluru, India NTT DATA Full time

    • Experience in implementing data storage solutions, managing, and developing data processing, and optimizing data solutions (Azure).• Expertise in integrating, transforming, and consolidating data from structured and semi-structured data systems suitable for analytics solutions.• Hands-on experience in integrating event based or streaming data into an...

  • Data Quality Analyst

    Found in: Appcast Linkedin IN C2 - 2 hours ago

    Bengaluru, India Data Poem Full time

    Immediate Joiners or 15 days of Notice Period Job description:You will be responsible for transforming our clients’ data into formats that are compliant with our proprietary AI-based modeling engine, viz. DataPOEM and distill out insights. The successful candidate will also work closely with various departments to perform and validate test cases based on...

  • Data Modeler

    5 days ago

    Bengaluru, India Aptus Data LAbs Full time

    **Job Information**: Number of Positions - 1Industry - TechnologyWork Experience - 5-8 yearsLast Activity Time - 12/02/2021 23:00City - Bangalore NorthState/Province - KarnatakaCountry - IndiaZip/Postal Code - 560002The data modeller designs, implements, and documents data architecture and data modelling solutions, which include the use of relational,...

  • Senior Data Scientist

    Found in: Whatjobs IN C2 - 2 weeks ago

    Bengaluru, India Zen Data Shastra Full time

    Job description – Sr. Data ScientistThe candidate will have to leverage strong collaboration skills and the ability to extract valuable insights from highly complex data sets to ask the right questions. You'd be engaged in a fast-paced learning environment and will be solving problems for the largest organizations in the world mostly Fortune 500. The...

  • Senior Data Scientist

    Found in: Whatjobs IN C2 - 2 weeks ago

    Bengaluru, India Zen Data Shastra Full time

    Job description – Sr. Data Scientist The candidate will have to leverage strong collaboration skills and the ability to extract valuable insights from highly complex data sets to ask the right questions. You'd be engaged in a fast-paced learning environment and will be solving problems for the largest organizations in the world mostly Fortune 500. The...

  • Data Research Executive

    5 days ago

    Koramangala, Bengaluru, Karnataka, India Mailing Data Solutions Full time

    Mailing Data Solutions offers Directory Assistance, Database Management Services. Data Mining and IT Outsourcing services to the Telecommunications, Retail, Manufacturing, Hospitality, Banking & Financial, Contact Center and other enterprise markets across the globe. Innovays has developed service offerings with leading-edge companies like GE, Cartus, O2-...

  • Senior Azure Data Engineer

    Found in: Whatjobs IN C2 - 2 weeks ago

    Bengaluru, India Zen Data Shastra Full time

    Role & Responsibilities:The candidate will have to leverage strong collaboration skills and the ability to independently develop and design highly complex data sets and ETL processes and ask the right questions. You'd be engaged in a fast-paced learning environment and will be solving problems for the largest organizations in the world mostly Fortune 500....

  • Senior Azure Data Engineer

    Found in: Whatjobs IN C2 - 2 weeks ago

    Bengaluru, India Zen Data Shastra Full time

    Role & Responsibilities: The candidate will have to leverage strong collaboration skills and the ability to independently develop and design highly complex data sets and ETL processes and ask the right questions. You'd be engaged in a fast-paced learning environment and will be solving problems for the largest organizations in the world mostly Fortune 500....

  • Senior Azure Data Engineer

    Found in: Appcast Linkedin IN C2 - 2 weeks ago

    Bengaluru, India Zen Data Shastra Full time

    Role & Responsibilities:The candidate will have to leverage strong collaboration skills and the ability to independently develop and design highly complex data sets and ETL processes and ask the right questions. You'd be engaged in a fast-paced learning environment and will be solving problems for the largest organizations in the world mostly Fortune 500....

  • Senior Azure Data Engineer

    Found in: Talent IN 2A C2 - 2 weeks ago

    Bengaluru, India Zen Data Shastra Full time

    Role & Responsibilities:The candidate will have to leverage strong collaboration skills and the ability to independently develop and design highly complex data sets and ETL processes and ask the right questions. You'd be engaged in a fast-paced learning environment and will be solving problems for the largest organizations in the world mostly Fortune 500....

  • Data Analyst

    Found in: Talent IN C2 - 2 weeks ago

    Bengaluru, India NTT DATA Services Full time

    •    Experience in implementing data storage solutions, managing, and developing data processing, and optimizing data solutions (Azure).  •    Expertise in integrating, transforming, and consolidating data from structured and semi-structured data systems suitable for analytics solutions.  •    Hands-on experience in integrating event based or...

  • Data Analyst

    Found in: beBee S IN - 2 weeks ago

    Bengaluru, India NTT DATA Services Full time

    •    Experience in implementing data storage solutions, managing, and developing data processing, and optimizing data solutions (Azure).   •    Expertise in integrating, transforming, and consolidating data from structured and semi-structured data systems suitable for analytics solutions.   •    Hands-on experience in integrating event based...

  • Data Scientist

    5 days ago

    Bengaluru, India Aptus Data LAbs Full time

    **Job Information**: Number of Positions - 8Target Date - 12/31/2021Industry - IT ServicesWork Experience - 2-5 yearsLast Activity Time - 09/22/2021 12:57City - BengaluruState/Province - KarnatakaCountry - IndiaZip/Postal Code - 560002- Are you looking to take your career to the next level in product/solution development? - Do you want to play with user data...

  • Aptus Data Labs

    Found in: Talent IN 2A C2 - 2 weeks ago

    Bengaluru, India Aptus Data Labs Full time

    Role - Sales & Marketing Exp- 0-2 YrsAptus Data Labs is a Bangalore based an innovative Data Engineering and Advanced Analytics company offering analytical solutions and consulting servicesLocation - Bangalore or MumbaiPosition Summary:The role will report and work closely with CMO of Aptus Data Labs' global marketing strategy, focusing on expanding the...

  • Big Data Developer

    Found in: Whatjobs IN C2 - 3 weeks ago

    Bengaluru, India Aptus Data Labs Full time

    Job Title: Big Data DevelopersExperience: Minimum 8 yearsLocation: Remote / core location - BangaloreMandatory Skills ( Hadoop , Hive, HiveQL , Cloudera , ETL, Pyspark/Python, Shell Scripting, Automation )Strong proficiency in Hadoop ecosystem includingHDFS, Hive, and HSQLExtensive experience withPython and PySparkfor data processing and...

  • Big Data Developer

    Found in: Whatjobs IN C2 - 3 weeks ago

    Greater Bengaluru Area, India Aptus Data Labs Full time

    Job Title: Big Data Developers Experience: Minimum 8 years Location: Remote / core location - Bangalore Mandatory Skills (Hadoop , Hive, HiveQL , Cloudera , ETL, Pyspark/Python, Shell Scripting, Automation ) Strong proficiency in Hadoop ecosystem including HDFS, Hive, and HSQL Extensive experience with Python and PySpark for data processing and...

  • Big Data Developer

    Found in: Appcast Linkedin IN C2 - 3 weeks ago

    Greater Bengaluru Area, India Aptus Data Labs Full time

    Job Title: Big Data Developers Experience: Minimum 8 yearsLocation: Remote / core location - BangaloreMandatory Skills (Hadoop , Hive, HiveQL , Cloudera , ETL, Pyspark/Python, Shell Scripting, Automation )Strong proficiency in Hadoop ecosystem including HDFS, Hive, and HSQLExtensive experience with Python and PySpark for data processing and...

  • Data Architect

    3 days ago

    Bengaluru, India Solsten Data Consulting Private Limited Full time

    **JD: Data Architect** 1. Need 6-8 Years of relevant experience 2. Need experience is Data modeling, 3. Proven work experience as a Data Architect - with ML mindset 4. In-depth understanding of database structure principles 5. Experience in working with diff Cloud Environment/s (AWS preferred) 6. Experience gathering and analyzing system...

  • Digital Engineering Lead Engineer

    Found in: Talent IN C2 - 2 weeks ago

    Bengaluru, India NTT DATA Full time

    • Experience in implementing data storage solutions, managing, and developing data processing, and optimizing data solutions (Azure). • Expertise in integrating, transforming, and consolidating data from structured and semi-structured data systems suitable for analytics solutions. • Hands-on experience in integrating event based or streaming data into...

  • Data Annotator

    2 weeks ago

    Bengaluru, India Tika Data Services Pvt Ltd Full time

    **Job Summary** - Tika aspires to enable regular businesses to make full use of their raw domain-specific data, transforming it into a form that ML algorithms can process and deliver results that improve business._ **Responsibilities and Duties** Prepare datasets for machine learning algorithms as given by Tika's clients. The data could be in various...