Spark Developer

4 weeks ago


Anywhere in IndiaMultiple LocationsMetrosPune Talent Pro Full time

Job Title: Spark Developer

At Talent Pro, we are seeking a highly skilled Spark Developer to join our team. As a Spark Developer, you will be responsible for designing and developing scalable distributed architecture using Apache Spark.

Responsibilities:

  • Work with development teams and product managers to build new product features, enhancements, and data processing pipelines.
  • Develop and manage well-functioning databases and applications using Spark and Hadoop.
  • Design and develop data and event processing pipelines using Spark Streaming and Kafka.
  • Test software to ensure responsiveness and efficiency.
  • Troubleshoot, debug, and upgrade software.
  • Analyze, assemble, and optimize large data sets for functional and non-functional requirements.
  • Develop ETL scripts for big data sources.
  • Identify, design, and optimize data processing and automation for reports and dashboards.
  • Work with stakeholders to ensure end-to-end requirements are addressed.

Requirements:

  • Strong experience in Java/Scala programming languages.
  • Experience in Big Data tools, HIVE, and HBASE tables.
  • Experience in Spark Streaming and Kafka.
  • Good knowledge of SQL and Data Warehouse concepts.
  • Good analytical skills to analyze issues.
  • Hands-on experience with Unix/Linux.
  • Good client communication and interfacing skills.

General Qualifications:

  • Overall experience in the field of Java/Scala as a Backend developer: 3 years.
  • Working experience in Big Data is important.

Technical Skills:

  • Programming experience in Java/Scala.
  • Writing ETL Stack in scalable optimized fashion using Apache Spark/Hadoop/Kafka.
  • Experience in writing distributed optimized Apache Spark jobs for various Machine Learning Algorithms.
  • Experience building and optimizing data pipeline and data sets.
  • Experience working with Kafka, NoSQL databases, and RDBMS.

  • Spark Developer

    1 month ago


    Anywhere in India/Multiple Locations/Metros/Pune Talent Pro Full time

    Job DescriptionAs a Spark Developer at Talent Pro, you will play a key role in building scalable and efficient data processing pipelines using Apache Spark. Your primary responsibility will be to design, develop, and manage large-scale data processing systems, ensuring high performance and reliability.Key Responsibilities:Collaborate with development teams...

  • Spark Developer

    2 months ago


    Anywhere in India/Multiple Locations/Metros/Pune, IN Talent Pro Full time

    Role : Spark DeveloperJob Description :- Work with development teams and product managers to build new product features, enhancements etc.- Build the front-end of applications through appealing visual design- Develop and manage well-functioning databases and applications- Design & develop data and event processing pipelines- Test software to ensure...


  • Anywhere in India/Multiple Locations IT Source Global Full time

    Job Title: Apache Spark DeveloperWe are seeking a highly skilled Apache Spark Developer to join our team at IT Source Global. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining data processing pipelines using Apache Spark and Scala.Key Responsibilities:Design and develop data processing pipelines...

  • Apache Spark Engineer

    4 weeks ago


    Anywhere in India/Multiple Locations IT Source Global Full time

    Job Title: Apache Spark DeveloperWe are seeking a highly skilled Apache Spark Developer to join our team at IT Source Global. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining large-scale data processing pipelines using Apache Spark and Scala.Key Responsibilities:Design and develop efficient data...


  • Anywhere in India/Multiple Locations IT Source Global Full time

    We have Immediate openings on Apache developerJob description : - Data Pipeline Development : Design, develop, and maintain data processing pipelines using Apache Spark and Scala, ensuring high performance and scalability.- Data Transformation and Analysis : Implement complex data transformations, aggregations, and analytics using Spark, optimizing for...

  • Apache Spark Developer

    2 months ago


    Anywhere in India/Multiple Locations, IN IT Source Global Full time

    We have Immediate openings on Apache developerJob description : - Data Pipeline Development : Design, develop, and maintain data processing pipelines using Apache Spark and Scala, ensuring high performance and scalability.- Data Transformation and Analysis : Implement complex data transformations, aggregations, and analytics using Spark, optimizing for...

  • Data Engineer

    4 weeks ago


    Anywhere in India/Multiple Locations Huntsmen & Barons Full time

    Role : Data Engineer - Apache spark,Spark, Scala, PYspark, Hadoop, Hbase, HiveLocation : Pan IndiaWork Mode- HybridYear of Experience :Minimum 5 Years tp 12 YearsJob Description :- Relevant Experience 5 years.- The indent is created for Apache spark. But the actual demand is for Spark/ Scala.- Expertise in Data Engineering.- Hands-on experience in design and...

  • Data Engineer

    2 months ago


    Anywhere in India/Multiple Locations, IN Huntsmen & Barons Full time

    Role : Data Engineer - Apache spark,Spark, Scala, PYspark, Hadoop, Hbase, HiveLocation : Pan IndiaWork Mode- HybridYear of Experience :Minimum 5 Years tp 12 YearsJob Description :- Relevant Experience 5 years.- The indent is created for Apache spark. But the actual demand is for Spark/ Scala.- Expertise in Data Engineering.- Hands-on experience in design and...

  • Data Engineer

    1 month ago


    Anywhere in India/Multiple Locations Huntsmen & Barons Full time

    Role : Data Engineer - Spark/Scala. Job Description : - Relevant Experience 5 years.- The indent is created for Apache spark. But the actual demand is for Spark/ Scala.- Expertise in Data Engineering. - Hands-on experience in design and development of big data platform.- Deep understanding of modern data processing technology stacks: Spark, HBase, Hive...

  • Senior Data Engineer

    4 weeks ago


    Anywhere in India/Multiple Locations Huntsmen & Barons Full time

    Job Description:Data Engineer - Spark/ScalaAt Huntsmen & Barons, we are seeking a highly skilled Data Engineer - Spark/Scala to join our team. As a key member of our data engineering team, you will be responsible for designing and developing our big data platform using Spark and Scala. Your expertise in data engineering will enable us to process and analyze...

  • Data Engineer

    3 weeks ago


    Anywhere in India/Multiple Locations Huntsmen & Barons Full time

    About the Role:Data Engineer - Apache Spark ExpertHuntsmen & Barons is seeking an experienced Data Engineer with a strong background in Apache Spark to join our team. As a Data Engineer, you will play a key role in designing and developing big data platforms, leveraging expertise in data engineering, Spark, HBase, Hive, and other Hadoop ecosystem...

  • Data Architect

    2 months ago


    Anywhere in India/Multiple Locations, IN RAPINNO TECH SOLUTIONS PRIVATE LIMITED Full time

    Position Overview :We are looking for an experienced Data Architect with expertise in Databricks, Apache Spark, and ETL processes. The ideal candidate will have a proven track record of designing and building robust data applications from the ground up. You will play a key role in shaping our data strategy and ensuring our data solutions meet business needs...

  • Data Engineer

    2 months ago


    Anywhere in India/Multiple Locations FluxLogix Full time

    Job Description : Role Objective :Data Engineer will be responsible for expanding and optimizing our data and database architecture, as well as optimizing data flow and collection for cross functional teams.The ideal candidate is an experienced data pipeline builder and data wrangler who enjoys optimizing data systems and building. The Data Engineer will...

  • Big Data Engineer

    4 weeks ago


    Anywhere in India/Multiple Locations/Remote Hum Technologies Full time

    Big Data Engineer with strong exp in Hadoop, Spark, SQL & AWS for one of the Fortune 500 Clients Company Name : Hum TechnologiesClient : One of the Fortune 500 CompaniesLocation : : Apache NiFi, HDFS, Hive, Impala, Spark, Spark Streaming, Kafka, Java/Scala, SQL, Shell scripting Roles & Responsibilities : - Responsible for designing and implementing...

  • Big Data Engineer

    2 months ago


    Anywhere in India/Multiple Locations/Remote, IN Hum Technologies Full time

    Big Data Engineer with strong exp in Hadoop, Spark, SQL & AWS for one of the Fortune 500 Clients Company Name : Hum TechnologiesClient : One of the Fortune 500 CompaniesLocation : : Apache NiFi, HDFS, Hive, Impala, Spark, Spark Streaming, Kafka, Java/Scala, SQL, Shell scriptingRoles & Responsibilities :- Responsible for designing and implementing data...

  • AWS Data Engineer

    1 month ago


    Anywhere in India/Multiple Locations ARR Recruitment Solutions Full time

    Role and Responsibilities :- Data Engineering : Design, develop, and implement data pipelines and ETL processes using AWS services like Glue, Python, Redshift, and Spark.- Data Warehousing : Build and maintain data warehouses and data lakes on AWS.- Data Migration : Migrate data from legacy systems to AWS cloud platforms.- Data Governance : Implement data...

  • Data Engineer

    2 months ago


    Anywhere in India/Multiple Locations, IN Praxis Consultants Full time

    Job SummaryWe are looking for a highly skilled and experienced Technical Lead (Sr. Data Engineer/Data Architect / Data Modeler) to join our team. will play a crucial role in designing data architecture and models based on business requirements, ensuring data integrity, security, and performance. Oversee technical aspects of data integration and management...

  • Data Engineer

    4 weeks ago


    Anywhere in India/Multiple Locations Praxis Consultants Full time

    Job Summary We are looking for a highly skilled and experienced Technical Lead (Sr. Data Engineer/Data Architect / Data Modeler) to join our team. will play a crucial role in designing data architecture and models based on business requirements, ensuring data integrity, security, and performance. Oversee technical aspects of data integration and management...


  • Anywhere in India/Multiple Locations/Remote, IN NucleusTeq Consulting Pvt. Ltd. Full time

    Role : Big Data Engineer Responsibilities :- Big Data Engineer with 5-6 years of experience- Experience in leading a team of engineers and a good attitude toward learning the domain and implementation- Strong exposure and expertise in Spark (Primary), Scala/Java (Scala Primary), Airflow Orchestration and AWS.- Finalizing the scope of the system and...

  • Senior Data Engineer

    1 month ago


    Anywhere in India/Multiple Locations iKonsult Full time

    Job Description : Essential Technical Skills :- Technical expertise with emerging Big Data technologies, such as : Python, Spark, Hadoop, Clojure, Git, SQL and Databricks; and visualization tools : Tableau and PowerBI- Experience with cloud, container and micro service infrastructures- Experience working with divergent data sets that meet the requirements...