Data Streaming

1 day ago

Chennai, India ACE Talent Consulting Full time

Job Description:
Spark/Scala/PySpark developer who knows how to fully exploit the potential of our Spark cluster.

Should have ability to clean, transform, and analyze vast amounts of raw data from various systems using Spark to provide ready-to-use data.

**Responsibilities**:
Create Scala/Spark/Pyspark jobs for data transformation and aggregation

Produce unit tests for Spark transformations and helper methods

Write Scaladoc-style documentation with all code

Design data processing pipelines

**Skills**:Pyspark

Scala (with a focus on the functional programming paradigm)

Apache Spark 2.x, 3.x
- Apache Spark RDD API
- Apache Spark SQL DataFrame API
- Apache Spark Streaming API

Spark query tuning and performance optimization

SQL database integration (Postgres, and/or MySQL)

Experience working with HDFS, AWS ( S3, Redshift, EMR, IAM, Polices, Routing)

CI-CD Pipleline, Jenkins, Gitlab /Bitbucket

Deep understanding of distributed systems (e.g. partitioning, replication, consistency, and consensus)

**Salary**: ₹300,000.00 - ₹1,500,000.00 per year

Schedule:

- Day shift

Ability to commute/relocate:

- Chennai, Tamil Nadu: Reliably commute or planning to relocate before starting work (required)

**Experience**:

- total work: 3 years (preferred)

Work Location: One location

  • Tibco Streaming Lead

    2 weeks ago

    Chennai, India HIKING IT Full time

    Description :- Design, develop, and deploy complex event processing (CEP) and real-time streaming analytics solutions using TIBCO Streaming (StreamBase, LiveView).- Integrate and visualize real-time data using TIBCO Spotfire, including live dashboards and interactive reporting.- Architect scalable, end-to-end streaming data pipelines, from ingestion to...

  • Tibco Streaming Lead

    2 weeks ago

    Chennai, Tamil Nadu, India HIKING IT Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Description : - Design, develop, and deploy complex event processing (CEP) and real-time streaming analytics solutions using TIBCO Streaming (StreamBase, LiveView). - Integrate and visualize real-time data using TIBCO Spotfire, including live dashboards and interactive reporting. - Architect scalable, end-to-end streaming data pipelines, from...

  • Data Engineer

    1 week ago

    Chennai, Tamil Nadu, India NTT DATA Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Req ID: 336026NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer - Azure to join our team in Chennai, Tamil Nādu (IN-TN), India (IN). "Job Duties: Key Responsibilities:...

  • Data Engineer

    1 week ago

    Chennai, Tamil Nadu, India NTT DATA North America Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Req ID:336025NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer - Azure to join our team in Chennai, Tamil Nādu (IN-TN), India (IN)."Job Duties: Key...

  • Data Streaming

    1 day ago

    Chennai, India ACE Talent Consulting Full time

    ob Description: Spark/Scala/PySpark developer who knows how to fully exploit the potential of our Spark cluster. Should have ability to clean, transform, and analyze vast amounts of raw data from various systems using Spark to provide ready-to-use data. **Responsibilities**: Create Scala/Spark/Pyspark jobs for data transformation and aggregation Produce...

  • Eucloid - Senior/Lead Data Engineer - Python

    3 weeks ago

    Chennai, India Eucloid Data Solutions Full time

    Job Description Job Description Eucloid is looking for a Lead Data Engineer to join our Data Platform team supporting various business applications. The ideal candidate will support development of data infrastructure for our clients by participating in activities which may include starting from up- stream and down-stream technology selection to designing and...

  • Data Engineer

    1 week ago

    Chennai, Tamil Nadu, India NTT DATA Global Delivery Services Ltd Full time ₹ 10,00,000 - ₹ 25,00,000 per year

    Data Engineer - Azure Req ID: 336026 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer - Azure to join our team in Chennai, Tamil Nādu (IN-TN), India (IN). "Job...

  • Senior tableau data consultant

    3 days ago

    Chennai, India Eucloid Data Solutions Full time

    We are looking for a high-energy individual for the role of Data Consultant – Tableau Expert at Eucloid. The candidate will collaborate with client stakeholders on multiple projects, primarily focusing on building impactful visualizations and dashboards that drive business decisions.The candidate is expected to lead the following work-streams: Partner...

  • Senior Tableau Data Consultant

    3 days ago

    Chennai, India Eucloid Data Solutions Full time

    We are looking for a high-energy individual for the role of Data Consultant – Tableau Expert at Eucloid. The candidate will collaborate with client stakeholders on multiple projects, primarily focusing on building impactful visualizations and dashboards that drive business decisions. The candidate is expected to lead the following work-streams:  Partner...

  • Senior Tableau Data Consultant

    3 days ago

    Chennai, India Eucloid Data Solutions Full time

    We are looking for a high-energy individual for the role of Data Consultant – Tableau Expert at Eucloid. The candidate will collaborate with client stakeholders on multiple projects, primarily focusing on building impactful visualizations and dashboards that drive business decisions. The candidate is expected to lead the following work-streams: Partner...