Tcs data Streaming

2 days ago

Pashan Pune Maharashtra, India Response Informatics Full time

JOB DESCRIPTION:
Spark/Scala/PySpark developer who knows how to fully exploit the potential of
our Spark cluster.
Should have ability to clean, transform, and analyze vast amounts of raw data
from various systems using Spark to provide ready-to-use data.

SKILLS:
Pyspark

Scala (with a focus on the functional programming paradigm)

Apache Spark 2.x, 3.x
- Apache Spark RDD API
- Apache Spark SQL DataFrame API
- Apache Spark Streaming API

Spark query tuning and performance optimization

SQL database integration (Postgres, and/or MySQL)

Experience working with HDFS, AWS ( S3, Redshift, EMR, IAM, Polices, Routing)

CI-CD Pipleline, Jenkins, Gitlab /Bitbucket

Deep understanding of distributed systems (e.g. partitioning, replication, consistency,

and consensus)

  • Stream Data Engineer

    3 days ago

    Pune, Maharashtra, India beBeeKafka Full time ₹ 15,00,000 - ₹ 25,00,000

    **Job Title:** "Stream Data Engineer"">Job Summary">We are seeking an experienced Stream Data Engineer to design and implement real-time data processing systems using Apache Kafka. The ideal candidate will have a strong background in stream processing, data engineering, and software development.">Required Skills and Qualifications:">">Apache Kafka: Proven...

  • Data Streaming Specialist

    5 days ago

    Chennai, Bengaluru, Pune, India beBeeKafka Full time ₹ 15,00,000 - ₹ 25,00,000

    Kafka Professional About the Role We are seeking an experienced Kafka professional to join our team. As a key member of our data streaming solutions group, you will be responsible for managing and supporting the Kafka ecosystem. Key Responsibilities Ecosystem Management: Manage and support the Kafka ecosystem, focusing primarily on Level 2 (L2) support...

  • Data Streaming Specialist

    4 days ago

    Pune, Bengaluru / Bangalore, Chennai, India beBeeStreaming Full time ₹ 1,04,000 - ₹ 1,30,878

    Job Title: Data Streaming SpecialistWe are seeking a skilled Data Streaming Specialist to join our team. As a Data Streaming Specialist, you will be responsible for designing and implementing data streaming pipelines using Spark and Flink.The ideal candidate will have experience with Spark and Flink, as well as strong knowledge of data processing concepts...

  • Streaming Data Architect

    3 days ago

    Chennai, Bengaluru, Pune, India beBeeData Full time ₹ 10,00,000 - ₹ 15,00,000

    Job Posting for Data EngineerAbout the Role:We are looking for a highly skilled data engineer to join our team. The ideal candidate will have experience with streaming data and be able to design, develop, and implement data pipelines using Spark.Key Responsibilities:Design, develop, and maintain large-scale data processing systems using Apache...

  • Tcs datastage

    2 days ago

    Pashan, Pune, Maharashtra, India Response Informatics Full time

    Data modelling, Database design, Data ware housing ecosystem. - ETL Platform

  • Senior Data Streaming Specialist

    3 days ago

    Pune, Bengaluru / Bangalore, Chennai, India beBeeDataStreaming Full time ₹ 1,04,000 - ₹ 1,30,878

    **Job Overview**We are seeking an experienced professional to join our team as a Data Streaming Expert. As a key member of our organization, you will be responsible for managing and supporting the Kafka ecosystem.

  • Data Migration Specialist

    3 days ago

    Pune, Maharashtra, India beBeeMigration Full time ₹ 20,00,000 - ₹ 25,00,000

    Job DescriptionWe are seeking a seasoned professional with expertise in complex data migration from Legacy Systems to Teamcenter. This includes experience with CAD NX Data to TC Migration, as well as proficiency in Teamcenter Migration tools such as csv2tcxml, tcxml export, tcxml import, ips upload, and SQL, Python, Java, Windows Batch Scripting, XML...

  • Big Data Engineer

    13 hours ago

    Pune, Maharashtra, India Tata Consultancy Services Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    Greetings from TCSTCS is hiring forBig DataLocation: -Chennai/Mumbai/PuneDesired Experience Range:6 to 12 yearsMust-Have• PySpark • HiveGood-to-Have• Spark • HBase • DQ tool • Agile Scrum experience • Exposure in data ingestion from disparate sources onto Big Data platformThanksAnshika

  • Data Streaming

    5 days ago

    Pune, India ACE Talent Consulting Full time

    Job Description: Spark/Scala/PySpark developer who knows how to fully exploit the potential of our Spark cluster. Should have ability to clean, transform, and analyze vast amounts of raw data from various systems using Spark to provide ready-to-use data. **Responsibilities**: Create Scala/Spark/Pyspark jobs for data transformation and aggregation Produce...

  • Data Streaming

    5 days ago

    Pune, India ACE Talent Consulting Full time

    ob Description: Spark/Scala/PySpark developer who knows how to fully exploit the potential of our Spark cluster. Should have ability to clean, transform, and analyze vast amounts of raw data from various systems using Spark to provide ready-to-use data. **Responsibilities**: Create Scala/Spark/Pyspark jobs for data transformation and aggregation Produce...