Spark Developer

1 month ago


Anywhere in IndiaMultiple LocationsMetrosPune Talent Pro Full time
Job Description

As a Spark Developer at Talent Pro, you will play a key role in building scalable and efficient data processing pipelines using Apache Spark. Your primary responsibility will be to design, develop, and manage large-scale data processing systems, ensuring high performance and reliability.

Key Responsibilities:
  • Collaborate with development teams and product managers to build new product features and enhancements.
  • Develop and manage well-functioning databases and applications using Spark.
  • Design and develop data and event processing pipelines using Spark.
  • Test software to ensure responsiveness and efficiency.
  • Troubleshoot, debug, and upgrade software.
  • Manage the development of scalable distributed architectures defined by the Architect or Tech Lead.
  • Analyze and assemble large data sets to meet functional and non-functional requirements.
  • Develop ETL scripts for big data sources.
  • Identify, design, and optimize data processing for reports and dashboards.
  • Work with stakeholders to ensure end-to-end requirements are addressed.
  • Strong team player to adhere to Software Development Life Cycle (SDLC) and documentations needed to represent every stage of SDLC.
Requirements:
  • 3+ years of experience in Java/Scala as a Backend developer.
  • Working experience in Big Data is essential.
  • Programming experience in Java/Scala is required. Experience in Python is an advantage.
  • Writing ETL Stack in scalable optimized fashion using Apache Spark/Hadoop/Kafka.
  • Experience building and optimizing data pipelines and data sets.
  • Working experience with Kafka, at least one NoSQL database (e.g., Cassandra, MongoDB, Elastic DB), and at least one RDBMS (e.g., MySQL).
  • Working knowledge of Docker and Kubernetes is a plus.
Preferred Skills:
  • Spark Streaming experience.
  • Scala or Java-based work experience using Spark.
  • Python usage with Spark is optional.

Why Talent Pro? We are a company that values innovation and collaboration. As a Spark Developer, you will have the opportunity to work with a talented team of engineers and product managers to build cutting-edge data processing systems.


  • Spark Developer

    4 weeks ago


    Anywhere in India/Multiple Locations/Metros/Pune Talent Pro Full time

    Job Title: Spark DeveloperAt Talent Pro, we are seeking a highly skilled Spark Developer to join our team. As a Spark Developer, you will be responsible for designing and developing scalable distributed architecture using Apache Spark.Responsibilities:Work with development teams and product managers to build new product features, enhancements, and data...

  • Spark Developer

    2 months ago


    Anywhere in India/Multiple Locations/Metros/Pune, IN Talent Pro Full time

    Role : Spark DeveloperJob Description :- Work with development teams and product managers to build new product features, enhancements etc.- Build the front-end of applications through appealing visual design- Develop and manage well-functioning databases and applications- Design & develop data and event processing pipelines- Test software to ensure...


  • Anywhere in India/Multiple Locations IT Source Global Full time

    Job Title: Apache Spark DeveloperWe are seeking a highly skilled Apache Spark Developer to join our team at IT Source Global. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining data processing pipelines using Apache Spark and Scala.Key Responsibilities:Design and develop data processing pipelines...

  • Apache Spark Engineer

    4 weeks ago


    Anywhere in India/Multiple Locations IT Source Global Full time

    Job Title: Apache Spark DeveloperWe are seeking a highly skilled Apache Spark Developer to join our team at IT Source Global. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining large-scale data processing pipelines using Apache Spark and Scala.Key Responsibilities:Design and develop efficient data...

  • Apache Spark Developer

    2 months ago


    Anywhere in India/Multiple Locations, IN IT Source Global Full time

    We have Immediate openings on Apache developerJob description : - Data Pipeline Development : Design, develop, and maintain data processing pipelines using Apache Spark and Scala, ensuring high performance and scalability.- Data Transformation and Analysis : Implement complex data transformations, aggregations, and analytics using Spark, optimizing for...


  • Anywhere in India/Multiple Locations IT Source Global Full time

    We have Immediate openings on Apache developerJob description : - Data Pipeline Development : Design, develop, and maintain data processing pipelines using Apache Spark and Scala, ensuring high performance and scalability.- Data Transformation and Analysis : Implement complex data transformations, aggregations, and analytics using Spark, optimizing for...

  • Data Engineer

    2 months ago


    Anywhere in India/Multiple Locations, IN Huntsmen & Barons Full time

    Role : Data Engineer - Apache spark,Spark, Scala, PYspark, Hadoop, Hbase, HiveLocation : Pan IndiaWork Mode- HybridYear of Experience :Minimum 5 Years tp 12 YearsJob Description :- Relevant Experience 5 years.- The indent is created for Apache spark. But the actual demand is for Spark/ Scala.- Expertise in Data Engineering.- Hands-on experience in design and...

  • Data Engineer

    4 weeks ago


    Anywhere in India/Multiple Locations Huntsmen & Barons Full time

    Role : Data Engineer - Apache spark,Spark, Scala, PYspark, Hadoop, Hbase, HiveLocation : Pan IndiaWork Mode- HybridYear of Experience :Minimum 5 Years tp 12 YearsJob Description :- Relevant Experience 5 years.- The indent is created for Apache spark. But the actual demand is for Spark/ Scala.- Expertise in Data Engineering.- Hands-on experience in design and...

  • Data Engineer

    1 month ago


    Anywhere in India/Multiple Locations Huntsmen & Barons Full time

    Role : Data Engineer - Spark/Scala. Job Description : - Relevant Experience 5 years.- The indent is created for Apache spark. But the actual demand is for Spark/ Scala.- Expertise in Data Engineering. - Hands-on experience in design and development of big data platform.- Deep understanding of modern data processing technology stacks: Spark, HBase, Hive...

  • Senior Data Engineer

    4 weeks ago


    Anywhere in India/Multiple Locations Huntsmen & Barons Full time

    Job Description:Data Engineer - Spark/ScalaAt Huntsmen & Barons, we are seeking a highly skilled Data Engineer - Spark/Scala to join our team. As a key member of our data engineering team, you will be responsible for designing and developing our big data platform using Spark and Scala. Your expertise in data engineering will enable us to process and analyze...

  • Data Engineer

    3 weeks ago


    Anywhere in India/Multiple Locations Huntsmen & Barons Full time

    About the Role:Data Engineer - Apache Spark ExpertHuntsmen & Barons is seeking an experienced Data Engineer with a strong background in Apache Spark to join our team. As a Data Engineer, you will play a key role in designing and developing big data platforms, leveraging expertise in data engineering, Spark, HBase, Hive, and other Hadoop ecosystem...

  • Data Architect

    2 months ago


    Anywhere in India/Multiple Locations, IN RAPINNO TECH SOLUTIONS PRIVATE LIMITED Full time

    Position Overview :We are looking for an experienced Data Architect with expertise in Databricks, Apache Spark, and ETL processes. The ideal candidate will have a proven track record of designing and building robust data applications from the ground up. You will play a key role in shaping our data strategy and ensuring our data solutions meet business needs...

  • Data Engineer

    2 months ago


    Anywhere in India/Multiple Locations FluxLogix Full time

    Job Description : Role Objective :Data Engineer will be responsible for expanding and optimizing our data and database architecture, as well as optimizing data flow and collection for cross functional teams.The ideal candidate is an experienced data pipeline builder and data wrangler who enjoys optimizing data systems and building. The Data Engineer will...

  • Big Data Engineer

    4 weeks ago


    Anywhere in India/Multiple Locations/Remote Hum Technologies Full time

    Big Data Engineer with strong exp in Hadoop, Spark, SQL & AWS for one of the Fortune 500 Clients Company Name : Hum TechnologiesClient : One of the Fortune 500 CompaniesLocation : : Apache NiFi, HDFS, Hive, Impala, Spark, Spark Streaming, Kafka, Java/Scala, SQL, Shell scripting Roles & Responsibilities : - Responsible for designing and implementing...

  • Big Data Engineer

    2 months ago


    Anywhere in India/Multiple Locations/Remote, IN Hum Technologies Full time

    Big Data Engineer with strong exp in Hadoop, Spark, SQL & AWS for one of the Fortune 500 Clients Company Name : Hum TechnologiesClient : One of the Fortune 500 CompaniesLocation : : Apache NiFi, HDFS, Hive, Impala, Spark, Spark Streaming, Kafka, Java/Scala, SQL, Shell scriptingRoles & Responsibilities :- Responsible for designing and implementing data...

  • AWS Data Engineer

    1 month ago


    Anywhere in India/Multiple Locations ARR Recruitment Solutions Full time

    Role and Responsibilities :- Data Engineering : Design, develop, and implement data pipelines and ETL processes using AWS services like Glue, Python, Redshift, and Spark.- Data Warehousing : Build and maintain data warehouses and data lakes on AWS.- Data Migration : Migrate data from legacy systems to AWS cloud platforms.- Data Governance : Implement data...

  • Data Engineer

    2 months ago


    Anywhere in India/Multiple Locations, IN Praxis Consultants Full time

    Job SummaryWe are looking for a highly skilled and experienced Technical Lead (Sr. Data Engineer/Data Architect / Data Modeler) to join our team. will play a crucial role in designing data architecture and models based on business requirements, ensuring data integrity, security, and performance. Oversee technical aspects of data integration and management...

  • Data Engineer

    4 weeks ago


    Anywhere in India/Multiple Locations Praxis Consultants Full time

    Job Summary We are looking for a highly skilled and experienced Technical Lead (Sr. Data Engineer/Data Architect / Data Modeler) to join our team. will play a crucial role in designing data architecture and models based on business requirements, ensuring data integrity, security, and performance. Oversee technical aspects of data integration and management...


  • Anywhere in India/Multiple Locations/Remote, IN NucleusTeq Consulting Pvt. Ltd. Full time

    Role : Big Data Engineer Responsibilities :- Big Data Engineer with 5-6 years of experience- Experience in leading a team of engineers and a good attitude toward learning the domain and implementation- Strong exposure and expertise in Spark (Primary), Scala/Java (Scala Primary), Airflow Orchestration and AWS.- Finalizing the scope of the system and...

  • Senior Data Engineer

    1 month ago


    Anywhere in India/Multiple Locations iKonsult Full time

    Job Description : Essential Technical Skills :- Technical expertise with emerging Big Data technologies, such as : Python, Spark, Hadoop, Clojure, Git, SQL and Databricks; and visualization tools : Tableau and PowerBI- Experience with cloud, container and micro service infrastructures- Experience working with divergent data sets that meet the requirements...