Spark Streaming
4 weeks ago
Relevant Experience - 4 years
Location - PAN India
Mandatory Skills:
Flink and Java Spring Boot
Job Description Specifically on Kafka + Flink + Java Spring Boot + Bigdata:
- Design and implement broker and partition architecture
- Develop consumable topics and corresponding API/microservices using Java Spring boot to render data consumable.
- Configure Producers and Consumers
- Mastering all core components required in a Kafka eco-system, like Zookeeper, YARN
- Stream processing knowledge Kafka with Flink
- Know-how of a Kafka administration profile is a plus
- Experience in Java and/or Python programming languages.
Knowledge on Bigdata eco system ( Spark , Hive)
Good To Have Skills:
- Apache Kafka and Spark streaming
Skills :
- Spark Streaming
- Kafka
- Flink
- Java Spring boot
Soft Skills:
- Autonomous
- Open mind
- Good inter-personal cooperation
- Eager to learn new technologies
- Capability to document the work with relevant details
-
Data Streaming
4 weeks ago
Bengaluru, India ACE Talent Consulting Full timeob Description: Spark/Scala/PySpark developer who knows how to fully exploit the potential of our Spark cluster. Should have ability to clean, transform, and analyze vast amounts of raw data from various systems using Spark to provide ready-to-use data. **Responsibilities**: Create Scala/Spark/Pyspark jobs for data transformation and aggregation Produce...
-
Data Streaming
4 weeks ago
Bengaluru, India ACE Talent Consulting Full timeJob Description: Spark/Scala/PySpark developer who knows how to fully exploit the potential of our Spark cluster. Should have ability to clean, transform, and analyze vast amounts of raw data from various systems using Spark to provide ready-to-use data. **Responsibilities**: Create Scala/Spark/Pyspark jobs for data transformation and aggregation Produce...
-
Spark- Scala
1 month ago
Hyderabad, India Nityo Infotech Full time• working experience in Scala• experience using Spark programming model in Scala.• 3-4 years of experience in Advanced Java development and MongoDB• Experience in working with Core Spark, Spark Streaming, Data Frame API, Data set API, Data Source API & Spark SQL• Experience in working with Apache Kafka, developing consumers & producers using...
-
Spark and Java Developer
4 weeks ago
Hyderabad, India Unison Consulting Pte Ltd Full timeExperienced Apache Spark & Java developer will be responsible for supporting and enhancing enterprise wide data platform. In this role, you will be not only be designing and coding, but also collaborating with team members to help support core capabilities in the enterprise wide data programRequirements• 5+ years of progressive experience in development...
-
Spark and Java Developer
1 month ago
Hyderabad, India Unison Consulting Pte Ltd Full timeExperienced Apache Spark & Java developer will be responsible for supporting and enhancing enterprise wide data platform. In this role, you will be not only be designing and coding, but also collaborating with team members to help support core capabilities in the enterprise wide data programRequirements• 5+ years of progressive experience in development...
-
Spark and Java Developer
1 month ago
hyderabad, India Unison Consulting Pte Ltd Full timeExperienced Apache Spark & Java developer will be responsible for supporting and enhancing enterprise wide data platform. In this role, you will be not only be designing and coding, but also collaborating with team members to help support core capabilities in the enterprise wide data program Requirements • 5+ years of progressive experience in development...
-
Spark Scala Developer
4 weeks ago
Hyderabad, India Corporate Resources Full timeJob Description4+ years of experience with Java, Spark, Bigdata & Hadoop with strong Unix backgroundCreate Scala/Spark jobs for data transformation and aggregationExperience of writing code in spark and ScalaProduce unit tests for Spark transformations and helper methodsWrite Scaladoc-style documentation with all codeDesign data processing pipelinesScala...
-
Data Engineer
1 month ago
bangalore, India gethyr Full timeWe are seeking a talented and motivated Data Engineer stream processing, particularly utilizing Flink and Kafka, alongside expertise in Spark and AWS technologies. As a Data Engineer, you will play a crucial role in designing, implementing, and maintaining robust stream processing solutions to handle large volumes of data in real-time, ensuring high...
-
Senior Data Analyst
4 weeks ago
Hyderabad, India Ivy comptech Full timeAbout The RoleAsSenior Data Analystwill contribute to various phases and activities of the software development process or software testing. Candidate must be willing to work in a fast-paced, multi-tasking, team environment, the engineer works with tech Lead, software engineers, internal partners, and stakeholders.Key...
-
Data Engineer
4 weeks ago
Bangalore/Pune, IN Gethyr Full timeWe are seeking a talented and motivated Data Engineer stream processing, particularly utilizing Flink and Kafka, alongside expertise in Spark and AWS technologies. As a Data Engineer, you will play a crucial role in designing, implementing, and maintaining robust stream processing solutions to handle large volumes of data in real-time, ensuring high...
-
Data Engineer
2 weeks ago
Bangalore/Pune, India Gethyr Full timeWe are seeking a talented and motivated Data Engineer stream processing, particularly utilizing Flink and Kafka, alongside expertise in Spark and AWS technologies. As a Data Engineer, you will play a crucial role in designing, implementing, and maintaining robust stream processing solutions to handle large volumes of data in real-time, ensuring high...
-
Kafka Architect
2 weeks ago
Bangalore/Pune/Kolkata/Chennai, IN Ultrabot Innovations Full timeJob Description :As a Kafka Architect specializing in Spark and Apache Server, you will play a key role in designing, architecting, and implementing real-time data streaming solutions using Apache Kafka, Apache Spark, and related technologies. You will work closely with our clients and internal teams to understand business requirements, design robust...
-
Kafka Architect
2 weeks ago
Bangalore/Pune/Kolkata/Chennai, India Ultrabot Innovations Full timeJob Description :As a Kafka Architect specializing in Spark and Apache Server, you will play a key role in designing, architecting, and implementing real-time data streaming solutions using Apache Kafka, Apache Spark, and related technologies. You will work closely with our clients and internal teams to understand business requirements, design robust...
-
Data Engineer
2 weeks ago
Bengaluru, India Gethyr Full timeWe are seeking a talented and motivated Data Engineer stream processing, particularly utilizing Flink and Kafka, alongside expertise in Spark and AWS technologies. As a Data Engineer, you will play a crucial role in designing, implementing, and maintaining robust stream processing solutions to handle large volumes of data in real-time, ensuring high...
-
Senior Data Analyst
1 month ago
Hyderabad, India Ivy comptech Full timeAbout The Role As Senior Data Analyst will contribute to various phases and activities of the software development process or software testing. Candidate must be willing to work in a fast-paced, multi-tasking, team environment, the engineer works with tech Lead, software engineers, internal partners, and stakeholders. Key...
-
Senior Data Engineer
4 weeks ago
Bangalore, Karnataka, India CliqHR Full timeJob Description :Mandatory Skills : Microsoft Azure, Hadoop, Spark, Databricks, Airflow, Kafka, Py sparkRequirements :- Experience working with distributed technology tools for developing Batch and Streaming pipelines using SQL, Spark, Python, Airflow, Scala, Kafka- Experience in Cloud Computing, e.g., AWS, GCP, Azure, etc.- Able to quickly pick up new...
-
Senior Data Engineer
1 month ago
Bangalore, India CliqHR Full timeJob Description : Mandatory Skills : Microsoft Azure, Hadoop, Spark, Databricks, Airflow, Kafka, Py sparkRequirements :- Experience working with distributed technology tools for developing Batch and Streaming pipelines using SQL, Spark, Python, Airflow, Scala, Kafka- Experience in Cloud Computing, e.g., AWS, GCP, Azure, etc.- Able to quickly pick up new...
-
Senior Data Analyst
1 month ago
hyderabad, India Ivy comptech Full timeAbout The Role As Senior Data Analyst will contribute to various phases and activities of the software development process or software testing. Candidate must be willing to work in a fast-paced, multi-tasking, team environment, the engineer works with tech Lead, software engineers, internal partners, and stakeholders. Key...
-
Senior Spark Developer
1 month ago
Bangalore,Anywhere in India,Multiple Locations CYBERSAPIENT TECHNOLOGIES PRIVATE LIMITED Full timeAbout the job :Job Description / Duties & Responsibilities :- Develop, program, and maintain applications using the Apache Spark open-source framework.- Work with different aspects of the Spark ecosystem, including Spark SQL, DataFrames, Datasets, and streaming.- Spark Developer must have strong programming skills in Java, Scala, or Python.- Familiar with...
-
Senior Data Engineer
4 weeks ago
Bangalore/Hyderabad/Mumbai/Pune, IN MLOPS SOLUTIONS PRIVATE LIMITED Full timeJob Description :Primary skillset :Experience working with distributed technology tools for developing Batch and Streaming pipelines using :- SQL, Spark, PySpark - Airflow - Spark with Scala .(optional)- Able to write code which is optimized for performance.- Experience in Cloud platform, e.g., AWS, GCP, Azure, etc.- Able to quickly pick up new programming...