Big Data Team Lead

2 months ago

Pune, India Rigel networks Full time

Job Title : Senior Software Developer / Applications Development Manager

Location : Pune, Chennai, Bangalore

Shift Timings : 10 AM - 7 PM

Position Overview :


We are seeking an experienced Senior Software Developer / Applications Development Manager with a strong background in software development and project management. The ideal candidate will possess extensive experience with Scala, Java, and a range of big data technologies, along with proven leadership and stakeholder management skills. This role requires participation in all phases of the development lifecycle and the ability to manage complex projects effectively.

Key Responsibilities :

Software Development:

- Design, develop, and implement scalable and high-performance software solutions using Scala and Java.

- Work with big data technologies such as Apache Spark, HDFS, Cloudera, Hive, HBase, and Kafka.

- Develop and optimize ETL processes, and manage batch scheduling and automation.

Data Management :

- Handle and process various file formats including JSON, AVRO, Parquet, CSV, XML, and Text Files.

- Perform data analysis and manipulation using SQL and work with relational databases like Oracle.

- daUtilize tools and frameworks such as Spark-SQL, Spark Streaming, UDF, and Sqoop.

Project Management :

- Lead and manage software development projects from conception through deployment.

- Demonstrate strong project management skills and manage successful project implementations.

- Coordinate with stakeholders, manage expectations, and ensure project objectives are met.

Leadership and Team Management :

- Exhibit leadership skills and take ownership of development tasks and project deliverables.

- Collaborate effectively with team members and contribute to a positive and productive team environment.

- Demonstrate the ability to adjust priorities quickly and efficiently based on project needs.

Continuous Improvement :

- Stay current with industry practices and standards, and apply this knowledge to improve processes and solutions.

- Demonstrate a commitment to continuous learning and development.

Qualifications :

- Experience : 13-16 years of experience as a software developer, with a focus on big data technologies.

- Proven experience in leading and managing software development projects and teams.

- Subject Matter Expert (SME) in at least one area of applications development.

Technical Skills :

- Proficiency in Scala, Java, HDFS, Cloudera, Hive, HBase, SQL, Apache Spark, Spark-SQL, Spark Streaming, UDF, and Sqoop.

- Experience with Kafka and exposure to various file formats (JSON, AVRO, Parquet, CSV, XML, Text Files).

- Knowledge of ETL batch scheduling and automation.

- Exposure to relational databases, specifically Oracle.

Preferred Skills :

- Experience with Neo4j, Gemfire, Cloudera CDP, Apache Iceberg, and Delta Tables.

- Experience in an Applications Development Manager role.

Soft Skills :

- Excellent written and verbal communication skills.

- Strong sense of ownership and a collaborative team player.

- Demonstrated leadership and project management skills.

Additional Information :

- This position requires a commitment to working within the specified shift timings: 10 AM - 7 PM.

- Candidates must be able to demonstrate clear and concise communication and show adaptability in a dynamic environment.

(ref:hirist.tech)

  • Big Data Team Lead

    2 weeks ago

    Bangalore/Chennai/Pune, India Rigel networks Full time

    Job Title: Senior Software Developer / Applications Development ManagerLocation: RemoteShift Timings: FlexiblePosition Overview:We are seeking an experienced Senior Software Developer / Applications Development Manager with a strong background in software development and project management. The ideal candidate will possess extensive experience with Scala,...

  • Big Data Team Lead

    2 weeks ago

    Bangalore/Chennai/Pune, India Rigel networks Full time

    Job Title: Senior Software Developer / Applications Development ManagerWe are seeking an experienced Senior Software Developer / Applications Development Manager with a strong background in software development and project management. The ideal candidate will possess extensive experience with Scala, Java, and a range of big data technologies, along with...

  • Data Engineer

    2 weeks ago

    Pune, Maharashtra, India NTT DATA Services Full time

    Job Title: Data Engineer - Big Data SpecialistWe are seeking a highly skilled Data Engineer to join our team in Pune, India. As a Data Engineer, you will work on exciting big data related projects that require large data sets to be processed via a vendor sourced solution on a daily, weekly and monthly basis.Key Responsibilities:Analyzing data sets and...

  • Big Data Engineer

    2 weeks ago

    Pune, Maharashtra, India Seven N Half Full time

    Job Title: Lead Big Data DeveloperThis is an exciting opportunity to join our team at Seven N Half as a Lead Big Data Developer. We are a fast-paced software company that partners with innovative B2B and B2C SaaS companies for their digital transformation needs.Job Summary:We are seeking a highly skilled and experienced Big Data Developer to lead our team in...

  • Big Data Team Lead

    4 weeks ago

    Bangalore/Chennai/Pune, IN Rigel networks Full time

    Job Title : Senior Software Developer / Applications Development ManagerLocation : Pune, Chennai, Bangalore Shift Timings : 10 AM - 7 PMPosition Overview : We are seeking an experienced Senior Software Developer / Applications Development Manager with a strong background in software development and project management. The ideal candidate will possess...

  • Big Data Team Lead

    4 days ago

    Bangalore/Chennai/Pune, India Rigel networks Full time

    Job Title : Senior Software Developer / Applications Development ManagerLocation : Pune, Chennai, Bangalore Shift Timings : 10 AM - 7 PMPosition Overview : We are seeking an experienced Senior Software Developer / Applications Development Manager with a strong background in software development and project management. The ideal candidate will possess...

  • Big Data Lead

    5 months ago

    Pune, India Hexaware Technologies Full time

    Description : Expert in Snowflake implementations (with 7 to 10 years in Cloud/Data industry)  7+ years' experience in cloud data engineering experience   5+ years strong experience in SQL, stored procedures, ELT in Snowflake Environment.   2+ years of experience in Python development for Data engineering.  Experience cloud/on-prem devops...

  • Senior Big Data Engineer

    2 weeks ago

    Pune, Maharashtra, India Circana Full time

    Job DescriptionCircana is seeking a highly skilled Senior Big Data Engineer to lead our big data initiatives and drive innovation in data engineering.Key ResponsibilitiesDesign and develop scalable big data architectures using Hadoop and Spark frameworks.Lead a team of data engineers to develop and deploy big data solutions.Collaborate with cross-functional...

  • Big Data Developer

    4 days ago

    Pune, India Talent Toppers Full time

    Job Title: Big Data DeveloperJob Summary: We are seeking a highly skilled Big Data Developer to join our team at Talent Toppers. As a Big Data Developer, you will be responsible for designing, implementing, and maintaining large-scale data processing systems.Key Responsibilities:Undertake complete ownership in accomplishing activities and assigned...

  • Big Data Developer

    2 weeks ago

    Pune, Maharashtra, India 12542 Citicorp Services India Private Limited Full time

    Job Title: Big Data DeveloperCiti is seeking a highly skilled Big Data Developer to join our team. As a Big Data Developer, you will be responsible for designing, developing, and implementing large-scale data processing systems using Big Data technologies such as Hadoop, Python, Hive, and Shell Script.Responsibilities:Design and develop large-scale data...

  • PySpark Team Lead

    2 weeks ago

    Pune, Maharashtra, India DATAECONOMY Full time

    Job Title: PySpark LeadAbout the Role:We are seeking an experienced PySpark Lead to join our team at DATAECONOMY. As a key member of our data engineering team, you will be responsible for leading the design and implementation of big data solutions using PySpark.Key Responsibilities:Lead a team of data engineers in the design and implementation of big data...

  • Big data solutions architect

    1 week ago

    Pune, India BluCognition Full time

    About blu Cognition : blu Cognition is an AI/ML based start-up specializing in developing data products leveraging alternative data sources and providing servicing support to our clients globally. We are headquartered in the US, with the delivery centre in Pune. Our clients are some of the biggest and the most progressive names in the financial &...

  • Big Data Developer

    2 weeks ago

    Pune, Maharashtra, India Talent Toppers Full time

    Job Title: Big Data DeveloperTalent Toppers is seeking a highly skilled Big Data Developer to join our team. As a Big Data Developer, you will be responsible for designing, developing, and implementing large-scale data processing systems using Big Data technologies such as Hadoop, Spark, and NoSQL databases.Key Responsibilities:Design and develop scalable...

  • Big Data Developer

    2 weeks ago

    Pune, Maharashtra, India Talent Toppers Full time

    Job Title: Big Data DeveloperAt Talent Toppers, we are seeking a highly skilled Big Data Developer to join our team. As a key member of our data science team, you will be responsible for designing, developing, and implementing large-scale data processing systems using Big Data technologies.Responsibilities:Design and develop scalable data processing systems...

  • PySpark Team Lead

    2 weeks ago

    Pune, Maharashtra, India DATAECONOMY Full time

    Job OverviewLead a team of data engineers in the design and implementation of big data solutions using PySpark.As a PySpark Lead, you will be responsible for collaborating with cross-functional teams to understand business needs and develop data-driven solutions.Key responsibilities include designing and implementing scalable and robust data pipelines using...

  • Big Data Developer

    2 weeks ago

    Pune, India Talent Toppers Full time

    Job Title: Big Data DeveloperJob Summary:Talent Toppers is seeking a highly skilled Big Data Developer to join our team. As a Big Data Developer, you will be responsible for designing, developing, and implementing large-scale data processing systems using Big Data technologies such as Hadoop, Spark, and NoSQL databases.Key Responsibilities:Design and develop...

  • Big Data

    5 months ago

    Pune, India Virtusa Full time

    **Duties & Responsibilities**: - Requirement Analysis, Design, Develop and Deploy project/tasks while adhering to existing SDLC standards. - Provide project/task effort estimates. - Provide regular project progress & Issue report. - Partner with multiple teams to deliver projects. - Scope and deliver various Big Data solutions. - Ability to design solutions...

  • Big Data Engineer

    2 weeks ago

    Pune, Maharashtra, India Virtusa Full time

    Job Title: Big Data DeveloperWe are seeking a highly skilled Big Data Developer to join our team at Virtusa. The ideal candidate will have a strong background in big data technologies and a passion for working with large datasets.Key Responsibilities:Design, develop, and deploy big data solutions using Apache Spark, Hadoop, and Hive.Work with Cloudera Data...

  • Senior Big Data Engineer

    2 days ago

    Pune, Maharashtra, India Virtusa Full time

    About the RoleAt Virtusa, we are looking for a skilled Senior Big Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining large-scale data processing systems using Apache Spark, Hadoop, Hive, and Impala.Key Responsibilities• Develop and implement data pipelines using...

  • Senior Big Data Engineer

    6 days ago

    Pune, Maharashtra, India Xoriant Full time

    Job OverviewXoriant is seeking a highly skilled Senior Big Data Engineer to join our team. The ideal candidate will have expertise in Apache Spark and Scala, with a strong background in big data processing and analytics.Key ResponsibilitiesDesign and develop scalable big data architectures using Apache SparkDevelop and maintain high-performance data...