Big Data Team Lead

3 weeks ago


BangaloreChennaiPune, IN Rigel networks Full time

Job Title : Senior Software Developer / Applications Development Manager

Location : Pune, Chennai, Bangalore

Shift Timings : 10 AM - 7 PM

Position Overview :


We are seeking an experienced Senior Software Developer / Applications Development Manager with a strong background in software development and project management. The ideal candidate will possess extensive experience with Scala, Java, and a range of big data technologies, along with proven leadership and stakeholder management skills. This role requires participation in all phases of the development lifecycle and the ability to manage complex projects effectively.

Key Responsibilities :

Software Development:

- Design, develop, and implement scalable and high-performance software solutions using Scala and Java.

- Work with big data technologies such as Apache Spark, HDFS, Cloudera, Hive, HBase, and Kafka.

- Develop and optimize ETL processes, and manage batch scheduling and automation.

Data Management :

- Handle and process various file formats including JSON, AVRO, Parquet, CSV, XML, and Text Files.

- Perform data analysis and manipulation using SQL and work with relational databases like Oracle.

- daUtilize tools and frameworks such as Spark-SQL, Spark Streaming, UDF, and Sqoop.

Project Management :

- Lead and manage software development projects from conception through deployment.

- Demonstrate strong project management skills and manage successful project implementations.

- Coordinate with stakeholders, manage expectations, and ensure project objectives are met.

Leadership and Team Management :

- Exhibit leadership skills and take ownership of development tasks and project deliverables.

- Collaborate effectively with team members and contribute to a positive and productive team environment.

- Demonstrate the ability to adjust priorities quickly and efficiently based on project needs.

Continuous Improvement :

- Stay current with industry practices and standards, and apply this knowledge to improve processes and solutions.

- Demonstrate a commitment to continuous learning and development.

Qualifications :

- Experience : 13-16 years of experience as a software developer, with a focus on big data technologies.

- Proven experience in leading and managing software development projects and teams.

- Subject Matter Expert (SME) in at least one area of applications development.

Technical Skills :

- Proficiency in Scala, Java, HDFS, Cloudera, Hive, HBase, SQL, Apache Spark, Spark-SQL, Spark Streaming, UDF, and Sqoop.

- Experience with Kafka and exposure to various file formats (JSON, AVRO, Parquet, CSV, XML, Text Files).

- Knowledge of ETL batch scheduling and automation.

- Exposure to relational databases, specifically Oracle.

Preferred Skills :

- Experience with Neo4j, Gemfire, Cloudera CDP, Apache Iceberg, and Delta Tables.

- Experience in an Applications Development Manager role.

Soft Skills :

- Excellent written and verbal communication skills.

- Strong sense of ownership and a collaborative team player.

- Demonstrated leadership and project management skills.

Additional Information :

- This position requires a commitment to working within the specified shift timings: 10 AM - 7 PM.

- Candidates must be able to demonstrate clear and concise communication and show adaptability in a dynamic environment.

(ref:hirist.tech)
  • Data Engineer

    3 weeks ago


    Bangalore/Pune/Trivandrum/Thiruvananthapuram, IN Rao Career Solutions Full time

    Job Summary :- We are looking for a skilled Data Engineer with hands-on experience in PySpark and Big Data platforms to join our growing team. The ideal candidate will have strong expertise in building data pipelines, working with big data technologies like Apache Hive and Parquet, and handling diverse data use cases. You will work closely with data...


  • Chennai/Bangalore/Hyderabad, IN Resourcetree Full time

    About the role :As Program Lead - Technology Consulting, you will be key member of the teams working on end-to-end AI and analytics solutions being built for our clients. While your primary focus will be on the data engineering and application engineering components of the overall solution, you will collaborate with internal data science teams for the ML...

  • Big Data Engineer

    3 weeks ago


    Chennai/Bangalore/Hyderabad/Mumbai/Pune/Delhi/Coimbatore, IN Flipped.ai Full time

    Job Description : Big Data Engineer - Scala, SparkAbout the Role :We are seeking a highly skilled Big Data Engineer to join our team and help us leverage the power of big data to drive innovation and business value. As a Big Data Engineer, you will be responsible for designing, developing, and maintaining scalable and efficient big data solutions. You will...

  • Big Data Engineer

    3 weeks ago


    Chennai/Hyderabad/Bangalore/Coimbatore/Mumbai/Delhi/Pune, IN GAIUS HYPERLOCAL PRIVATE LIMITED Full time

    Job Description : Big Data Engineer - Scala, SparkYears of exp: 6 to 13 yearsJob location: Chennai / Hyderabad / Bangalore / Pune / Mumbai / Delhi / CoimbatoreAbout the Role :We are seeking a highly skilled Big Data Engineer to join our team and help us leverage the power of big data to drive innovation and business value. As a Big Data Engineer, you will be...

  • Big Data Developer

    3 weeks ago


    Hyderabad/Bangalore/Chennai/Bhubaneshwar, IN Rigel networks Full time

    Job Title : Big Data/Spark Scala DeveloperLocation : Type : Full-TimeJob Overview : We are looking for an experienced Big Data/Spark Scala Developer to join our team. The ideal candidate will have a deep understanding of big data technologies and strong programming skills in Scala. In this role, you will be responsible for designing, developing, and...

  • Big Data Engineer

    3 weeks ago


    Bangalore/Pune/Mumbai/Chennai, IN a client of change leaders Full time

    Job Description : - 5+ years of experience developing scalable Big Data applications or solutions on distributed platforms- Design and implement data pipelines using Snowflake, PostgreSQL, and Python.- Experience in AWS/ Azure/ GCP and good to have other cloud platform tools- Experience working with Big Data platforms, including Hadoop- Hive, Data Bricks...

  • Big Data Engineer

    3 weeks ago


    Chennai/Pune, IN Pan Asia Man power Consultants Recruiting agency Full time

    Job Title : Big Data EngineerExperience Range : 6+ YearsLocation : Chennai/Pune (Hybrid - 2 Days Work From Office in a Week)Job Description :We are seeking a skilled Big Data Engineer to join our Agile team and contribute to building backend data applications and services that support our analytics platforms. This role requires a hands-on developer with...


  • Udaipur/Jaipur/Bangalore/Kolkata, IN Kadel Labs Private Limited Full time

    Kadel Labs is a first-of-its-kind Venture Studio in India. It is a global software technology system incubator with synergetic blend of IT Services and SaaS products under its portfolio. Since 2017, KL has grown organically (180+ employees and expanding) and served 200+ Customers. At the core, KL is a people's company. We serve clients by practicing an...

  • Big Data Engineer

    3 weeks ago


    Hyderabad/Pune/Delhi NCR, IN Ace Recruit Full time

    Job Description :As a Big Data Engineer (Azure), you will build and learn about a variety of analytics solutions & platforms, data lakes, modern data platforms, data fabric solutions, etc. using different Open Source, Big Data, and Cloud technologies on Microsoft Azure. On a typical day, you might :- Design and build scalable & metadata-driven data ingestion...


  • Pune/Noida/Hyderabad/Chennai/Bangalore, IN TETRAHED INC Full time

    About the Role : We are seeking a highly skilled Senior Big Data Engineer/Architect to design, develop, and implement robust data solutions on the Google Cloud Platform (GCP). You will be responsible for architecting and building scalable data pipelines, data warehouses, and data lakes to support critical business operations.Responsibilities : - Define and...

  • PySpark Developer

    3 weeks ago


    Pune/Bangalore/Chennai/Hyderabad/Mysore, IN Vtricks Technologies Full time

    Job Title : PySpark Developer Location : Pune, Bangalore, Chennai, Hyderabad, MysoreMode of Work : Onsite/HybridNotice Period : Immediate to 10 daysJob Description :We are looking for an experienced PySpark Developer with strong hands-on experience in working with Data Frames and the PySpark development process using Azure services. The ideal candidate...

  • Big Data Developer

    3 weeks ago


    Pune/Gurgaon/Gurugram, IN Talent Toppers LLP Full time

    Responsibilities :- Undertake complete ownership in accomplishing activities and assigned responsibilities across all phases of project lifecycle to solve business problems across one or more client engagements;- Apply appropriate development methodologies (e.g.: agile, waterfall) and best practices (e.g.: mid-development client reviews, embedded QA...


  • Bangalore/Gurgaon/Gurugram/Nagpur, IN Intuitive Apps Full time

    As a Big Data Admin, you will play a crucial role in ensuring the smooth operation and optimization of our Hadoop and Spark infrastructure. Your responsibilities will include :Hadoop Installation and Deployment :- Install Hadoop in Linux environments.- Deploy and maintain Hadoop clusters.- Monitor cluster health to ensure continuous uptime.- Analyze storage...

  • Big Data Engineer

    3 weeks ago


    Chennai/Noida/Gurgaon/Gurugram/Mumbai, IN ANRI Solutions HR Services Full time

    Role : Big Data Engineer Looking for an experienced Spark and Scala developer able to create an end-to-end data pipeline.Associate should be self-driven, can work with minimal guidance and guide the team technically. Job Details : 1. Expertise in Spark framework with scala language and Pyspark 2. Expertise in ETL and Data Warehousing and cloud concepts 3....

  • Hadoop Administrator

    4 months ago


    Mumbai/Bangalore/Bhubaneshwar/Anywhere in India/Multiple Locations, IN Tehno Right Full time

    Job Role : Hadoop Administrator (Role open for multiple locations) - WFH and WFOJob description :What is your Role ?- You will manage Hadoop clusters, data storage, server resources, and other virtual computing platforms. - You perform a variety of functions, including data migration, virtual machine set-up and training, troubleshooting end-user problems,...


  • Pune/Gurgaon/Gurugram/Bangalore, IN ZS Full time

    Comapany Description :ZS is a place where passion changes lives. As a management consulting and technology firm focused on transforming global healthcare and beyond, our most valuable asset is our people. Here you'll work side-by-side with a powerful collective of thinkers and experts shZS is a place where passion changes lives. As a management...

  • Data Modeler

    3 weeks ago


    Bangalore/Hyderabad/Chennai/Pune, IN Hashone Careers Private Limited Full time

    Role Overview :We are seeking an experienced Data Modeller with a strong foundation in data architecture, modelling, and analysis. The ideal candidate will be proficient in Erwin Data Modelling and have a deep understanding of data quality, data lineage, and data cataloging. You will play a crucial role in designing and optimizing data models for both OLTP...

  • Lead Data Scientist

    3 weeks ago


    Pune/Remote, IN i2e Consulting Pvt Ltd Full time

    Job Description :As a Lead Data Scientist at i2eConsulting, you will partner closely with a team of stakeholders, data scientists, and data engineers to solve real problems in healthcare domain. We are looking for great problem solvers who can tap into the potential of data and deliver scalable and robust data solutions. Our potential members would work on...

  • Senior Data Scientist

    3 weeks ago


    Bangalore/Pune, IN Elite recruitments Full time

    About the Role :We are seeking a highly skilled and experienced Senior Data Science Specialist to join our team. This role requires an individual with 8-10 years of experience in data science, who can leverage their expertise to drive data-driven decision-making and provide actionable insights. The ideal candidate will have a strong background in statistical...

  • Data Scientist

    3 weeks ago


    Bangalore/Pune, IN Elite recruitments Full time

    Position Overview : As a Data Scientist, you will be responsible for developing and implementing advanced data-driven solutions to meet business needs. You will collaborate with specialized teams to understand operational challenges, translate them into mathematical models, and develop effective data processing solutions. This role involves leading and...