Spark Streaming

4 weeks ago


Hyderabad Secunderabad Telangana Bengaluru Bangalore, India Staidlogic Software Private Limited Full time
Total Experience - 4 years
Relevant Experience - 4 years
Location - PAN India

Mandatory Skills:
Flink and Java Spring Boot

Job Description Specifically on Kafka + Flink + Java Spring Boot + Bigdata:
- Design and implement broker and partition architecture
- Develop consumable topics and corresponding API/microservices using Java Spring boot to render data consumable.
- Configure Producers and Consumers
- Mastering all core components required in a Kafka eco-system, like Zookeeper, YARN
- Stream processing knowledge Kafka with Flink
- Know-how of a Kafka administration profile is a plus
- Experience in Java and/or Python programming languages.
Knowledge on Bigdata eco system ( Spark , Hive)

Good To Have Skills:
- Apache Kafka and Spark streaming

Skills :
- Spark Streaming
- Kafka
- Flink
- Java Spring boot

Soft Skills:
- Autonomous
- Open mind
- Good inter-personal cooperation
- Eager to learn new technologies
- Capability to document the work with relevant details
  • Data Streaming

    4 weeks ago


    Bengaluru, India ACE Talent Consulting Full time

    ob Description: Spark/Scala/PySpark developer who knows how to fully exploit the potential of our Spark cluster. Should have ability to clean, transform, and analyze vast amounts of raw data from various systems using Spark to provide ready-to-use data. **Responsibilities**: Create Scala/Spark/Pyspark jobs for data transformation and aggregation Produce...

  • Data Streaming

    4 weeks ago


    Bengaluru, India ACE Talent Consulting Full time

    Job Description: Spark/Scala/PySpark developer who knows how to fully exploit the potential of our Spark cluster. Should have ability to clean, transform, and analyze vast amounts of raw data from various systems using Spark to provide ready-to-use data. **Responsibilities**: Create Scala/Spark/Pyspark jobs for data transformation and aggregation Produce...

  • Spark- Scala

    1 month ago


    Hyderabad, India Nityo Infotech Full time

    • working experience in Scala• experience using Spark programming model in Scala.• 3-4 years of experience in Advanced Java development and MongoDB• Experience in working with Core Spark, Spark Streaming, Data Frame API, Data set API, Data Source API & Spark SQL• Experience in working with Apache Kafka, developing consumers & producers using...


  • Hyderabad, India Unison Consulting Pte Ltd Full time

    Experienced Apache Spark & Java developer will be responsible for supporting and enhancing enterprise wide data platform. In this role, you will be not only be designing and coding, but also collaborating with team members to help support core capabilities in the enterprise wide data programRequirements• 5+ years of progressive experience in development...


  • Hyderabad, India Unison Consulting Pte Ltd Full time

    Experienced Apache Spark & Java developer will be responsible for supporting and enhancing enterprise wide data platform. In this role, you will be not only be designing and coding, but also collaborating with team members to help support core capabilities in the enterprise wide data programRequirements• 5+ years of progressive experience in development...


  • hyderabad, India Unison Consulting Pte Ltd Full time

    Experienced Apache Spark & Java developer will be responsible for supporting and enhancing enterprise wide data platform. In this role, you will be not only be designing and coding, but also collaborating with team members to help support core capabilities in the enterprise wide data program Requirements • 5+ years of progressive experience in development...

  • Spark Scala Developer

    4 weeks ago


    Hyderabad, India Corporate Resources Full time

    Job Description4+ years of experience with Java, Spark, Bigdata & Hadoop with strong Unix backgroundCreate Scala/Spark jobs for data transformation and aggregationExperience of writing code in spark and ScalaProduce unit tests for Spark transformations and helper methodsWrite Scaladoc-style documentation with all codeDesign data processing pipelinesScala...

  • Data Engineer

    1 month ago


    bangalore, India gethyr Full time

    We are seeking a talented and motivated Data Engineer stream processing, particularly utilizing Flink and Kafka, alongside expertise in Spark and AWS technologies. As a Data Engineer, you will play a crucial role in designing, implementing, and maintaining robust stream processing solutions to handle large volumes of data in real-time, ensuring high...

  • Senior Data Analyst

    4 weeks ago


    Hyderabad, India Ivy comptech Full time

    About The RoleAsSenior Data Analystwill contribute to various phases and activities of the software development process or software testing. Candidate must be willing to work in a fast-paced, multi-tasking, team environment, the engineer works with tech Lead, software engineers, internal partners, and stakeholders.Key...

  • Data Engineer

    4 weeks ago


    Bangalore/Pune, IN Gethyr Full time

    We are seeking a talented and motivated Data Engineer stream processing, particularly utilizing Flink and Kafka, alongside expertise in Spark and AWS technologies. As a Data Engineer, you will play a crucial role in designing, implementing, and maintaining robust stream processing solutions to handle large volumes of data in real-time, ensuring high...

  • Data Engineer

    2 weeks ago


    Bangalore/Pune, India Gethyr Full time

    We are seeking a talented and motivated Data Engineer stream processing, particularly utilizing Flink and Kafka, alongside expertise in Spark and AWS technologies. As a Data Engineer, you will play a crucial role in designing, implementing, and maintaining robust stream processing solutions to handle large volumes of data in real-time, ensuring high...

  • Kafka Architect

    2 weeks ago


    Bangalore/Pune/Kolkata/Chennai, IN Ultrabot Innovations Full time

    Job Description :As a Kafka Architect specializing in Spark and Apache Server, you will play a key role in designing, architecting, and implementing real-time data streaming solutions using Apache Kafka, Apache Spark, and related technologies. You will work closely with our clients and internal teams to understand business requirements, design robust...

  • Kafka Architect

    2 weeks ago


    Bangalore/Pune/Kolkata/Chennai, India Ultrabot Innovations Full time

    Job Description :As a Kafka Architect specializing in Spark and Apache Server, you will play a key role in designing, architecting, and implementing real-time data streaming solutions using Apache Kafka, Apache Spark, and related technologies. You will work closely with our clients and internal teams to understand business requirements, design robust...

  • Data Engineer

    2 weeks ago


    Bengaluru, India Gethyr Full time

    We are seeking a talented and motivated Data Engineer stream processing, particularly utilizing Flink and Kafka, alongside expertise in Spark and AWS technologies. As a Data Engineer, you will play a crucial role in designing, implementing, and maintaining robust stream processing solutions to handle large volumes of data in real-time, ensuring high...

  • Senior Data Analyst

    1 month ago


    Hyderabad, India Ivy comptech Full time

    About The Role As Senior Data Analyst will contribute to various phases and activities of the software development process or software testing. Candidate must be willing to work in a fast-paced, multi-tasking, team environment, the engineer works with tech Lead, software engineers, internal partners, and stakeholders. Key...

  • Senior Data Engineer

    4 weeks ago


    Bangalore, Karnataka, India CliqHR Full time

    Job Description :Mandatory Skills : Microsoft Azure, Hadoop, Spark, Databricks, Airflow, Kafka, Py sparkRequirements :- Experience working with distributed technology tools for developing Batch and Streaming pipelines using SQL, Spark, Python, Airflow, Scala, Kafka- Experience in Cloud Computing, e.g., AWS, GCP, Azure, etc.- Able to quickly pick up new...

  • Senior Data Engineer

    1 month ago


    Bangalore, India CliqHR Full time

    Job Description : Mandatory Skills : Microsoft Azure, Hadoop, Spark, Databricks, Airflow, Kafka, Py sparkRequirements :- Experience working with distributed technology tools for developing Batch and Streaming pipelines using SQL, Spark, Python, Airflow, Scala, Kafka- Experience in Cloud Computing, e.g., AWS, GCP, Azure, etc.- Able to quickly pick up new...

  • Senior Data Analyst

    1 month ago


    hyderabad, India Ivy comptech Full time

    About The Role As Senior Data Analyst will contribute to various phases and activities of the software development process or software testing. Candidate must be willing to work in a fast-paced, multi-tasking, team environment, the engineer works with tech Lead, software engineers, internal partners, and stakeholders. Key...


  • Bangalore,Anywhere in India,Multiple Locations CYBERSAPIENT TECHNOLOGIES PRIVATE LIMITED Full time

    About the job :Job Description / Duties & Responsibilities :- Develop, program, and maintain applications using the Apache Spark open-source framework.- Work with different aspects of the Spark ecosystem, including Spark SQL, DataFrames, Datasets, and streaming.- Spark Developer must have strong programming skills in Java, Scala, or Python.- Familiar with...

  • Senior Data Engineer

    4 weeks ago


    Bangalore/Hyderabad/Mumbai/Pune, IN MLOPS SOLUTIONS PRIVATE LIMITED Full time

    Job Description :Primary skillset :Experience working with distributed technology tools for developing Batch and Streaming pipelines using :- SQL, Spark, PySpark - Airflow - Spark with Scala .(optional)- Able to write code which is optimized for performance.- Experience in Cloud platform, e.g., AWS, GCP, Azure, etc.- Able to quickly pick up new programming...