PySpark/Apache Spark

3 days ago


Chennai, Tamil Nadu, India Tata Consultancy Services (TCS) Full time US$ 30,000 - US$ 90,000 per year
  • Strong Knowledge on Spark, Scala, Python, PySpark
  • Strong in SQL concepts
  • Good to have Knowledge on Bigdata Technologies like Hive ,Sqoop,Pig,Kafka,Flume.
  • Experience in Version Control tools like SVN, GITHUB as well as experiences in Production deployment process.
  • Basic knowledge in below skill sets:

a. SQL Server

  • Linux Shell Scripting

  • Data Warehousing concepts

Location

Chennai

Job Function

IT INFRASTRUCTURE SERVICES

Role

Lead

Job Id

383391

Desired Skills

Python | Scala | Spark | SQL | Apache Spark

Desired Candidate Profile

Qualifications : BACHELOR OF ENGINEERING


  • Pyspark

    2 weeks ago


    Chennai, Tamil Nadu, India Cognizant Technology Solutions Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job SummaryAs a Sr. Developer you will play a pivotal role in optimizing and enhancing our data processing capabilities using PySpark and AWS technologies. Your expertise in Python and domain knowledge in Cards & Payments will drive impactful solutions. This hybrid role offers the flexibility of day shifts ensuring a balanced work-life...

  • Bigdata Pyspark

    2 weeks ago


    Chennai, Tamil Nadu, India Virtusa Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    7 to 11 years of Java based application development Hands on Java 8 2 to 4 years of Apache Spark based application development.2 to 4 years as Hadoop developerExperience in building batch and Streaming applications. Experience with Apache Spark batch frameworkKnowledge of Apache Spark structured streaming is a nice to haveKnowledge of advanced Spark usage...

  • Big Data Developer

    5 hours ago


    Chennai, Tamil Nadu, India, Tamil Nadu HCLTech Full time

    Position: Senior Data Engineer – Experience: 6–9 YearsRole SummaryWe are seeking Senior Data Engineer resources to work on the migration of applications from our legacy Cloudera environment to the new Kubernetes-based data platform. The role requires strong hands-on development skills in data engineering, with the ability to deliver high-quality...


  • Chennai, Tamil Nadu, India Virtusa Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    7+ years of experience in Big Data with strong expertise in Spark and ScalaMandatory Skills: Big Data Primarily Spark and ScalaStrong Knowledge in HDFS, Hive, Impala with knowledge on Unix , Oracle, Autosys,Good to Have : Agile Methodology and Banking ExpertiseStrong Communication SkillsNot limited to Spark batch, need Spark streaming experienceNo SQL DB...

  • Bigdata Pyspark

    2 weeks ago


    Chennai, Tamil Nadu, India Virtusa Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    7 to 11 years of Java based application development Hands on Java 82 to 4 years of Apache Spark based application development.2 to 4 years as Hadoop developerExperience in building batch and Streaming applications.Experience with Apache Spark batch frameworkKnowledge of Apache Spark structured streaming is a nice to haveKnowledge of advanced Spark usage...

  • pyspark+gcp

    2 weeks ago


    Chennai, Tamil Nadu, India Cognizant Technology Solutions Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Job SummaryThe Sr. Developer role is pivotal in driving the success of our data-driven projects. With a focus on Big Data and AWS technologies the candidate will design and implement scalable solutions. This hybrid role requires expertise in Apache Spark and Python ensuring efficient data processing and storage. The position offers a dynamic work environment...

  • AWS + Pyspark

    2 weeks ago


    Chennai, Tamil Nadu, India Cognizant Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Skills- AWS +PysparkExperience: 4 to 9 yearsLocation: AIA-PuneAs an AWS Data Engineer, you will design, build, and manage robust data pipelines on the AWS cloud platform. You will leverage your expertise in AWS data services and programming languages to ingest, process, transform, and store data efficiently, enabling data-driven insights and...


  • Chennai, Tamil Nadu, India Coders Brain Technology Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Location : Chennai/Hyderabad/Bangalore Details JD:   1. Minimum 6+ years of experience in creating SPARK Jobs using Java/Scala  2. Should have very good experience in developing data loading and transformation tasks using external sources, merge data, perform data enrichment and load in to target data destinations 3. Must have good knowledge on Big data...


  • Chennai, Tamil Nadu, India Prodapt Solutions Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Overview:We are looking for a highly skilled Big Data Engineer with extensive experience in Spark and Scala to join our team. The ideal candidate will play a crucial role in designing, developing, and optimizing large-scale data processing systems. You will work closely with data scientists, analysts, and other stakeholders to deliver high-quality data...


  • Chennai, Tamil Nadu, India Prodapt Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Overview   We are looking for a highly skilled Big Data Engineer with extensive experience in Spark and Scala to join our team. The ideal candidate will play a crucial role in designing, developing, and optimizing large-scale data processing systems. You will work closely with data scientists, analysts, and other stakeholders to deliver high-quality data...