Big Data Team Lead

4 weeks ago

Pune, India Rigel networks Full time

Job Title : Senior Software Developer / Applications Development Manager

Location : Pune, Chennai, Bangalore

Shift Timings : 10 AM - 7 PM

Position Overview :


We are seeking an experienced Senior Software Developer / Applications Development Manager with a strong background in software development and project management. The ideal candidate will possess extensive experience with Scala, Java, and a range of big data technologies, along with proven leadership and stakeholder management skills. This role requires participation in all phases of the development lifecycle and the ability to manage complex projects effectively.

Key Responsibilities :

Software Development:

- Design, develop, and implement scalable and high-performance software solutions using Scala and Java.

- Work with big data technologies such as Apache Spark, HDFS, Cloudera, Hive, HBase, and Kafka.

- Develop and optimize ETL processes, and manage batch scheduling and automation.

Data Management :

- Handle and process various file formats including JSON, AVRO, Parquet, CSV, XML, and Text Files.

- Perform data analysis and manipulation using SQL and work with relational databases like Oracle.

- daUtilize tools and frameworks such as Spark-SQL, Spark Streaming, UDF, and Sqoop.

Project Management :

- Lead and manage software development projects from conception through deployment.

- Demonstrate strong project management skills and manage successful project implementations.

- Coordinate with stakeholders, manage expectations, and ensure project objectives are met.

Leadership and Team Management :

- Exhibit leadership skills and take ownership of development tasks and project deliverables.

- Collaborate effectively with team members and contribute to a positive and productive team environment.

- Demonstrate the ability to adjust priorities quickly and efficiently based on project needs.

Continuous Improvement :

- Stay current with industry practices and standards, and apply this knowledge to improve processes and solutions.

- Demonstrate a commitment to continuous learning and development.

Qualifications :

- Experience : 13-16 years of experience as a software developer, with a focus on big data technologies.

- Proven experience in leading and managing software development projects and teams.

- Subject Matter Expert (SME) in at least one area of applications development.

Technical Skills :

- Proficiency in Scala, Java, HDFS, Cloudera, Hive, HBase, SQL, Apache Spark, Spark-SQL, Spark Streaming, UDF, and Sqoop.

- Experience with Kafka and exposure to various file formats (JSON, AVRO, Parquet, CSV, XML, Text Files).

- Knowledge of ETL batch scheduling and automation.

- Exposure to relational databases, specifically Oracle.

Preferred Skills :

- Experience with Neo4j, Gemfire, Cloudera CDP, Apache Iceberg, and Delta Tables.

- Experience in an Applications Development Manager role.

Soft Skills :

- Excellent written and verbal communication skills.

- Strong sense of ownership and a collaborative team player.

- Demonstrated leadership and project management skills.

Additional Information :

- This position requires a commitment to working within the specified shift timings: 10 AM - 7 PM.

- Candidates must be able to demonstrate clear and concise communication and show adaptability in a dynamic environment.

(ref:hirist.tech)

  • Big Data Lead

    4 months ago

    Pune, India Hexaware Technologies Full time

    Description : Expert in Snowflake implementations (with 7 to 10 years in Cloud/Data industry)  7+ years' experience in cloud data engineering experience   5+ years strong experience in SQL, stored procedures, ELT in Snowflake Environment.   2+ years of experience in Python development for Data engineering.  Experience cloud/on-prem devops...

  • Big Data

    3 months ago

    Pune, India Virtusa Full time

    **Duties & Responsibilities**: - Requirement Analysis, Design, Develop and Deploy project/tasks while adhering to existing SDLC standards. - Provide project/task effort estimates. - Provide regular project progress & Issue report. - Partner with multiple teams to deliver projects. - Scope and deliver various Big Data solutions. - Ability to design solutions...

  • Big Data Developer

    4 weeks ago

    Pune, India Solytics Partners Full time

    Job Description:We are seeking a skilled Big Data Engineer to join our dynamic team. The ideal candidate will have extensive experience in Big Data Analytics, Hadoop, and Data Lake technologies. You will be responsible for designing, implementing, and maintaining large-scale data processing systems, ensuring the efficient flow and storage of data within our...

  • Big Data Developer

    3 weeks ago

    Pune, India Solytics Partners Full time

    Job Description: We are seeking a skilled Big Data Engineer to join our dynamic team. The ideal candidate will have extensive experience in Big Data Analytics, Hadoop, and Data Lake technologies. You will be responsible for designing, implementing, and maintaining large-scale data processing systems, ensuring the efficient flow and storage of data within...

  • Big Data Administrator

    4 months ago

    Pune, India TransUnion Full time

    TransUnion's Job Applicant Privacy Notice **What We'll Bring**: We’re looking for a Big Data Administrator to join our growing Big Data Administration team. You will be based both from our offices in Leeds and working remotely as part of our ‘flex together’ approach. In this fast-paced role you’ll work with Data Engineering and Data Science teams to...

  • Big Data Architecture

    4 months ago

    Pune, India Nexgensis Technologies PVT LTD Full time

    Roles & Responsibilities: Architect, design, and develop large scale, end-to-end data platforms across Big Data, Data Science, Cloud Computing, Data Analytics, and Data Visualization domains. Engage with stakeholders and other technical leads to translate complex requirements into actionable platform architectures. Oversee the implementation of designed...

  • Intern - Big Data

    3 months ago

    Pune, Maharashtra, India Seagate Technology Full time

    **About our group**: We are a proactive, highly solutions oriented and collaborative team that works with all the various business groups across the organization. Our purpose is capturing massive amounts of data is to transform this vital information into concrete and valuable insights that will allow Seagate to make better and more strategic business...

  • Intern - Big Data

    3 months ago

    Pune, Maharashtra, India Seagate Technology Full time

    **About our group**: We are a proactive, highly solutions oriented and collaborative team that works with all the various business groups across the organization. Our purpose is capturing massive amounts of data is to transform this vital information into concrete and valuable insights that will allow Seagate to make better and more strategic business...

  • Lead Big Data Developer

    2 months ago

    Pune, India Seven N Half Full time

    This opportunity is with one of our client which is a fast-paced software company that partners with innovative B2B and B2C SaaS companies for their digital transformation needs.Location : Pune (Hybrid - 3 days from Office/week)Experience : 5 - 8 yearsJob Profile :The Client is looking for a Big Data Engineer who will work on building, and managing Big Data...

  • Big Data Architect

    4 months ago

    Pune, India Citi Full time

    As a Big Data Infrastructure Architect, primary responsibility will be to design, implement and maintain the underlying infrastructure required to support large-scale big data solutions. This includes selecting the appropriate hardware and software components, configuring and optimizing the system for performance, and ensuring high availability, fault...

  • Data Engineer

    1 month ago

    Pune, India Rao Career Solutions Full time

    Job Summary :- We are looking for a skilled Data Engineer with hands-on experience in PySpark and Big Data platforms to join our growing team. The ideal candidate will have strong expertise in building data pipelines, working with big data technologies like Apache Hive and Parquet, and handling diverse data use cases. You will work closely with data...

  • Big Data Developer

    7 days ago

    Pune, India Tata Consultancy Services Full time

    Greetings from Tata Consultancy Services!!!Face to Face Interview for Big Data Developer in PuneFace to Face Interview Date: 21st Sep 2024(Saturday)**TCS is Hiring forBig Data Developer**Experience- 5-10 YearsLocation- PuneRequired Skillset:Digital : BigData and Hadoop Ecosystems,Digital : Kafka,Digital : HBaseJob Description:-Supporting HDInsight product...

  • Big Data Developer

    7 days ago

    Pune, India Tata Consultancy Services Full time

    Greetings from Tata Consultancy Services!!!Face to Face Interview for Big Data Developer in PuneFace to Face Interview Date: 21st Sep 2024(Saturday)**TCS is Hiring for Big Data Developer **Experience- 5-10 YearsLocation- PuneRequired Skillset: Digital : BigData and Hadoop Ecosystems,Digital : Kafka,Digital : HBaseJob Description:-Supporting HDInsight...

  • Big Data Engineer

    2 weeks ago

    pune, India Pixeldust Technologies Full time

    Job DescriptionWe are seeking an experienced and highly skilled Data Engineer to join our dynamic team. The ideal candidate will be proficient in designing, building, and operationalizing large-scale data processing systems. This role requires expertise in a wide range of technologies and methodologies, with a strong emphasis on delivering scalable and...

  • Senior Big Data Architect

    3 weeks ago

    pune, India RS Consulting Full time

    Job Title: Senior Big Data Architect - Modern Data StackLocation: PuneExperience Level: 6+ YearsWe are ideally seeking someone who can start as soon as possibleCompany Overview:Join our client a pioneering startup founded by renowned tech experts, marking their second venture in the AI and ML field. The founders previously established a successful IT...

  • Big Data Engineer

    3 months ago

    pune, India Draftmason Enterprises Full time

    Designation : Big Data EngineerExperience : 5 - 8 YearsSalary Range : upto 30 LPAJob Location : Kharadi, PuneType Of Employment : FT, PermanentWorking Mode : Hybrid (3 days WFO)Working Days : Mon - FriReports To : Director - Data EngineeringThe Opportunity : We are looking for talented, motivated, and self-driven Big Data Engineers who specialize in...

  • Big Data Developer

    5 days ago

    pune, India Tata Consultancy Services Full time

    Greetings from Tata Consultancy Services!!!Face to Face Interview for Big Data Developer in PuneFace to Face Interview Date: 21st Sep 2024(Saturday)**TCS is Hiring for Big Data Developer **Experience- 5-10 YearsLocation- PuneRequired Skillset: Digital : BigData and Hadoop Ecosystems,Digital : Kafka,Digital : HBaseJob Description:-Supporting HDInsight product...

  • Big Data Developer

    1 week ago

    pune, India Tata Consultancy Services Full time

    Greetings from Tata Consultancy Services!!! Face to Face Interview for Big Data Developer in Pune Face to Face Interview Date: 21st Sep 2024(Saturday) **TCS is Hiring for Big Data Developer ** Experience- 5-10 Years Location- Pune Required Skillset: Digital : BigData and Hadoop Ecosystems,Digital : Kafka,Digital : HBase Job Description:- Supporting...

  • Data Admin

    5 months ago

    Pune, India TransUnion Full time

    TransUnion's Job Applicant Privacy Notice **What We'll Bring**: Tableau and Big Data admin **What You'll Bring**: Tableau and Big Data admin **Impact You'll Make**: Tableau and Big data admin TransUnion Job Title Sr Analyst, Applications Support

  • Big Data Engineer

    2 weeks ago

    Pune, India Pixeldust Technologies Full time

    Job Description We are seeking an experienced and highly skilled Data Engineer to join our dynamic team. The ideal candidate will be proficient in designing, building, and operationalizing large-scale data processing systems. This role requires expertise in a wide range of technologies and methodologies, with a strong emphasis on delivering scalable and...