Big Data Team Lead

2 weeks ago

BangaloreChennaiPune, India Rigel networks Full time
Job Title: Senior Software Developer / Applications Development Manager

Location: Remote

Shift Timings: Flexible

Position Overview:

We are seeking an experienced Senior Software Developer / Applications Development Manager with a strong background in software development and project management. The ideal candidate will possess extensive experience with Scala, Java, and a range of big data technologies, along with proven leadership and stakeholder management skills.

Key Responsibilities:
  • Design, develop, and implement scalable and high-performance software solutions using Scala and Java.
  • Work with big data technologies such as Apache Spark, HDFS, Cloudera, Hive, HBase, and Kafka.
  • Develop and optimize ETL processes, and manage batch scheduling and automation.
  • Handle and process various file formats including JSON, AVRO, Parquet, CSV, XML, and Text Files.
  • Perform data analysis and manipulation using SQL and work with relational databases like Oracle.
  • Utilize tools and frameworks such as Spark-SQL, Spark Streaming, UDF, and Sqoop.
  • Lead and manage software development projects from conception through deployment.
  • Demonstrate strong project management skills and manage successful project implementations.
  • Coordinate with stakeholders, manage expectations, and ensure project objectives are met.
  • Exhibit leadership skills and take ownership of development tasks and project deliverables.
  • Collaborate effectively with team members and contribute to a positive and productive team environment.
  • Demonstrate the ability to adjust priorities quickly and efficiently based on project needs.
  • Stay current with industry practices and standards, and apply this knowledge to improve processes and solutions.
  • Demonstrate a commitment to continuous learning and development.
Qualifications:
  • Experience: 13-16 years of experience as a software developer, with a focus on big data technologies.
  • Proven experience in leading and managing software development projects and teams.
  • Subject Matter Expert (SME) in at least one area of applications development.
  • Technical Skills: Proficiency in Scala, Java, HDFS, Cloudera, Hive, HBase, SQL, Apache Spark, Spark-SQL, Spark Streaming, UDF, and Sqoop.
  • Experience with Kafka and exposure to various file formats (JSON, AVRO, Parquet, CSV, XML, Text Files).
  • Knowledge of ETL batch scheduling and automation.
  • Exposure to relational databases, specifically Oracle.
Preferred Skills:
  • Experience with Neo4j, Gemfire, Cloudera CDP, Apache Iceberg, and Delta Tables.
  • Experience in an Applications Development Manager role.
Soft Skills:
  • Excellent written and verbal communication skills.
  • Strong sense of ownership and a collaborative team player.
  • Demonstrated leadership and project management skills.

  • Big Data Team Lead

    2 weeks ago

    Bangalore/Chennai/Pune, India Rigel networks Full time

    Job Title: Senior Software Developer / Applications Development ManagerWe are seeking an experienced Senior Software Developer / Applications Development Manager with a strong background in software development and project management. The ideal candidate will possess extensive experience with Scala, Java, and a range of big data technologies, along with...

  • Big Data Team Lead

    4 weeks ago

    Bangalore/Chennai/Pune, IN Rigel networks Full time

    Job Title : Senior Software Developer / Applications Development ManagerLocation : Pune, Chennai, Bangalore Shift Timings : 10 AM - 7 PMPosition Overview : We are seeking an experienced Senior Software Developer / Applications Development Manager with a strong background in software development and project management. The ideal candidate will possess...

  • Big Data Team Lead

    4 days ago

    Bangalore/Chennai/Pune, India Rigel networks Full time

    Job Title : Senior Software Developer / Applications Development ManagerLocation : Pune, Chennai, Bangalore Shift Timings : 10 AM - 7 PMPosition Overview : We are seeking an experienced Senior Software Developer / Applications Development Manager with a strong background in software development and project management. The ideal candidate will possess...

  • Big Data Lead

    2 weeks ago

    Chennai, Tamil Nadu, India Virtusa Full time

    Job Description:As a Big Data Lead, you will be responsible for designing, building, and supporting data applications using Spark, Sqoop, and Hive. You will work with large data sets and high-capacity big data processing platforms, leveraging your expertise in Unix and Shell scripting, as well as your knowledge of the Hadoop ecosystem and its...

  • Big Data Lead

    1 week ago

    Chennai, Tamil Nadu, India Virtusa Full time

    Job Description:As a Big Data Lead at Virtusa, you will be responsible for designing, building, and supporting data applications using Spark, Sqoop, and Hive. You will work with large data sets and high-capacity big data processing platforms, leveraging your expertise in Unix and Shell scripting. Your advanced knowledge of the Hadoop ecosystem and its...

  • Big Data Lead

    2 weeks ago

    Chennai, Tamil Nadu, India Virtusa Full time

    Job Title: Big Data LeadJob Summary:We are seeking a highly skilled Big Data Lead to join our team at Virtusa. The successful candidate will have a strong background in designing, building, and supporting data applications using Spark, Sqoop, and Hive.Key Responsibilities:Develop components, application interfaces, and solution enablers while ensuring...

  • Data Engineer

    2 weeks ago

    Pune, Maharashtra, India NTT DATA Services Full time

    Job Title: Data Engineer - Big Data SpecialistWe are seeking a highly skilled Data Engineer to join our team in Pune, India. As a Data Engineer, you will work on exciting big data related projects that require large data sets to be processed via a vendor sourced solution on a daily, weekly and monthly basis.Key Responsibilities:Analyzing data sets and...

  • Big Data Lead

    3 months ago

    Chennai, India Virtusa Full time

    Big Data Lead - CREQ194625 Description Job Description: 5+ years of hands-on experience in designing, building and supporting Data Applications using Spark, Sqoop and Hive Strong knowledge of working with large data sets and high-capacity big data processing platform Strong experience in Unix and Shell scripting Advanced knowledge of the Hadoop...

  • Big Data Engineer/Lead

    5 days ago

    Bangalore, India TekPillar Full time

    Job Title: Big Data Engineer/LeadAbout the Role:We are seeking a highly skilled Big Data Engineer/Lead to join our dynamic team in Bangalore. As a key member of our data engineering initiatives, you will play a crucial role in managing and prioritizing projects while driving strategies and executing data engineering solutions.Key Responsibilities:•...

  • Big Data Team Lead

    2 months ago

    Pune, India Rigel networks Full time

    Job Title : Senior Software Developer / Applications Development ManagerLocation : Pune, Chennai, Bangalore Shift Timings : 10 AM - 7 PMPosition Overview : We are seeking an experienced Senior Software Developer / Applications Development Manager with a strong background in software development and project management. The ideal candidate will possess...

  • Big Data Analytics Lead

    2 weeks ago

    Chennai, India Bigtapp Analytics Full time

    About Bigtapp AnalyticsBigtapp Analytics is a leading provider of data-driven solutions for businesses. Our team of experienced data professionals is passionate about helping companies unlock insights and drive growth through advanced big data analytics, predictive modeling, and machine learning.Job DescriptionWe are seeking a highly skilled Lead Data...

  • Senior Big Data Developer

    4 days ago

    Bangalore/Chennai/Pune, India Rigel networks Full time

    Job Title: Senior Big Data DeveloperLocation: NationwideWe are seeking an experienced Senior Software Developer with a strong background in software development and project management. The ideal candidate will possess extensive experience with Scala, Java, and a range of big data technologies, along with proven leadership and stakeholder management skills....

  • Data Engineering Team Lead

    1 week ago

    Bangalore, India FxConsulting Full time

    Job Title : Lead Data EngineerWe are seeking a highly skilled Lead Data Engineer with expertise in Big Data technologies to drive business insights and innovation at FxConsulting. As a Lead Data Engineer, you will play a pivotal role in designing, building, and optimizing large-scale data pipelines and systems.Key Responsibilities :1. Design, implement, and...

  • Big Data Engineer

    2 weeks ago

    Pune, Maharashtra, India Seven N Half Full time

    Job Title: Lead Big Data DeveloperThis is an exciting opportunity to join our team at Seven N Half as a Lead Big Data Developer. We are a fast-paced software company that partners with innovative B2B and B2C SaaS companies for their digital transformation needs.Job Summary:We are seeking a highly skilled and experienced Big Data Developer to lead our team in...

  • Big Data Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India Virtusa Full time

    Job DescriptionJob Title: Big Data - Tech LeadJob Summary:We are seeking a highly skilled Big Data - Tech Lead to join our team at Virtusa. The successful candidate will be responsible for designing, building, and deploying Big Data solutions.Responsibilities:Design and develop Big Data pipelines and REST APIs using Scala or Java.Develop robust code in Scala...

  • Big Data Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India Virtusa Full time

    Job Title: Big Data - Tech LeadJob Summary:We are seeking a highly skilled Big Data - Tech Lead to join our team at Virtusa. The successful candidate will be responsible for designing, building, and deploying Big Data solutions.Responsibilities:Design and develop Big Data pipelines and REST APIs using Scala or Java.Develop robust code in Scala and have a...

  • Senior Data Engineer

    4 days ago

    Bangalore, India Robosoft Technologies Full time

    As a seasoned Big Data Lead, you will play a pivotal role in driving our company's data-driven initiatives forward. With a strong background in IT and extensive experience in data-related technologies, you will be responsible for architecting and implementing end-to-end big data solutions that drive business growth and innovation.Key ResponsibilitiesDesign...

  • Big Data Engineer

    3 days ago

    Chennai, Tamil Nadu, India ZF Group Full time

    Job Title: Big Data DeveloperJob Summary:At ZF Group, we are searching for a skilled Big Data Developer to contribute to the success of our organization. Responsibilities:- Demonstrable experience as a Big Data Developer, Data Engineer, or similar role with a minimum of 5 years in Big Data technologies and platforms.- Strong understanding of distributed...

  • Big Data Engineer

    2 weeks ago

    Bangalore, India Draup Full time

    Job Title: Big Data EngineerJob Summary:The Big Data Engineer at Draup is responsible for designing and implementing scalable data storage, transformation, and analysis techniques. This role involves working with a proficient team of developers, engineers, and product team to build generic and reusable data platforms and pipelines.Key Responsibilities:Design...

  • Big Data Engineer

    1 week ago

    Bangalore, India Draup Full time

    Job Title: Big Data EngineerAbout the Role:The Big Data Engineer at Draup is responsible for designing and implementing scalable techniques and processes for data storage, transformations, and analysis. This role involves building generic and reusable data platforms and pipelines. You will work with a team of experienced developers, engineers, and product...