GCP data engineer(Hadoop+Scala) Chennai 5 to 7

5 days ago


Chennai, India Tata Consultancy Services Full time

Job Role: GCP data engineer(Hadoop+Scala) Chennai 5 to 7

Job Location: Chennai


Experience Range: Min 5 years to 7 years


Job Description:

Must-Have

  1. 5+ years of strong experience in delivering Big Data solutions.
  2. Experience in developing and deploying big data pipelines in Cloud preferably GCP.
  3. Experience in deploying Spark/Scala built applications in Cloud.
  4. Excel in programming with Pyspark/Scala with known best practices to adopt.
  5. In-depth knowledge of Hadoop, Spark, Python, Schell scripting and similar frameworks.
  6. At least 2 + years of experience in creating real-time pipelines using Kafka, Pub/sub, Spark Streaming
  7. Experience in optimizing Hadoop and spark jobs.
  8. Should be familiar with agile methodology.
  9. Should be able to analyze, develop and implement database designs, data models and logical data specifications.
  10. Should have strong hold on SQL queries.
  11. Knowledge of GitHub Actions for CI/CD

Knowledge of data security concepts, best practices, and common vulnerabilities


  1. Proven Experience in migrating Hadoop eco system from on-prem to cloud (preferably GCP) will be an added advantage

Should have experience with Oozie scheduling / Airflow



  • Chennai, India Tata Consultancy Services Full time

    Job Role: GCP data engineer(Hadoop+Scala) Chennai 5 to 7Job Location: ChennaiExperience Range: Min 5 years to 7 yearsJob Description:Must-Have5+ years of strong experience in delivering Big Data solutions.Experience in developing and deploying big data pipelines in Cloud preferably GCP.Experience in deploying Spark/Scala built applications in Cloud.Excel in...


  • chennai, India Tata Consultancy Services Full time

    Job Role: GCP data engineer(Hadoop+Scala) Chennai 5 to 7 Job Location: Chennai Experience Range: Min 5 years to 7 years Job Description: Must-Have 5+ years of strong experience in delivering Big Data solutions. Experience in developing and deploying big data pipelines in Cloud preferably GCP. Experience in deploying Spark/Scala built applications in Cloud....


  • chennai, India Tata Consultancy Services Full time

    Job Role: GCP data engineer(Hadoop+Scala) Chennai 5 to 7Job Location: ChennaiExperience Range: Min 5 years to 7 yearsJob Description:Must-Have5+ years of strong experience in delivering Big Data solutions.Experience in developing and deploying big data pipelines in Cloud preferably GCP. Experience in deploying Spark/Scala built applications in Cloud.Excel in...


  • Chennai, India Tata Consultancy Services Full time

    Job Role: GCP data engineer(Hadoop+Scala) Chennai 5 to 7Job Location: ChennaiExperience Range: Min 5 years to 7 yearsJob Description:Must-Have5+ years of strong experience in delivering Big Data solutions.Experience in developing and deploying big data pipelines in Cloud preferably GCP. Experience in deploying Spark/Scala built applications in Cloud.Excel in...

  • GCP Data Engineer

    5 days ago


    Chennai, India Tata Consultancy Services Full time

    Greetings from TCSTCS presents an excellent opportunity for GCP Data EngineerRelevant Experience (Yrs) :5-7 yrsRole: GCP Data EngineerLocation: ChennaiDesired Competencies (Technical/Behavioral Competency)Must-Have5+ years of strong experience in delivering Big Data solutions.Experience in developing and deploying big data pipelines in Cloud preferably...

  • GCP Data Engineer

    5 days ago


    Chennai, India Tata Consultancy Services Full time

    Greetings from TCSTCS presents an excellent opportunity for GCP Data EngineerRelevant Experience (Yrs) :5-7 yrsRole: GCP Data EngineerLocation: ChennaiDesired Competencies (Technical/Behavioral Competency)Must-Have5+ years of strong experience in delivering Big Data solutions.Experience in developing and deploying big data pipelines in Cloud preferably...

  • GCP Data Engineer

    7 days ago


    Chennai, India Tata Consultancy Services Full time

    Greetings from TCSTCS presents an excellent opportunity for GCP Data EngineerRelevant Experience (Yrs) :5-7 yrsRole: GCP Data EngineerLocation: ChennaiDesired Competencies (Technical/Behavioral Competency)Must-Have5+ years of strong experience in delivering Big Data solutions.Experience in developing and deploying big data pipelines in Cloud preferably GCP....

  • GCP Data Engineer

    6 days ago


    chennai, India Tata Consultancy Services Full time

    Greetings from TCS TCS presents an excellent opportunity for GCP Data Engineer Relevant Experience (Yrs) :5-7 yrs Role: GCP Data Engineer Location: Chennai Desired Competencies (Technical/Behavioral Competency) Must-Have 5+ years of strong experience in delivering Big Data solutions. Experience in developing and deploying big data pipelines in Cloud...

  • GCP Data Engineer

    5 days ago


    Chennai, India Tata Consultancy Services Full time

    Greetings from TCSTCS presents an excellent opportunity for GCP Data EngineerRelevant Experience (Yrs) :5-7 yrsRole: GCP Data EngineerLocation: ChennaiDesired Competencies (Technical/Behavioral Competency)Must-Have5+ years of strong experience in delivering Big Data solutions.Experience in developing and deploying big data pipelines in Cloud preferably GCP....

  • Data Engineer

    3 months ago


    Hyderabad/Bangalore/Chennai, India SPG Consulting Solutions Pvt.Ltd Full time

    Job Description: Senior Data EngineerLocation: Hyderabad, Chennai, BangaloreExperience: 4 to 10 YearsPrimary Skills:- Hadoop- Spark (Mandatory)- ScalaSecondary Skills:- Python- SQLRole Summary/Purpose:The Senior Data Engineer will join our dynamic scrum teams to perform functional and system development for Hadoop applications as part of our Enterprise Data...


  • Chennai, India PTS Consulting Full time

    We are seeking Experienced Hadoop developers with extensive expertise in Hadoop to join our growing Data Engineering practice delivering transformative solutions using Hadoop.At this time, We welcome Freelancers, Contractors and other immediate joiners.Experience:5+Years of Relevant experienceLocation - Chennai / Bangalore/ Hyderabad/NoidaMode - HybridJOB...

  • GCP Data Engineer

    1 month ago


    Chennai, India Xebia Full time

    Establish scalable, efficient, automated processes for data analyses, model development, validation and implementationWork closely with data scientists and analysts to create and deploy new featuresWrite efficient and well-organized software to ship products in an iterative, continual release environmentMonitor and plan out core infrastructure...


  • Chennai, India PTS Consulting Full time

    We are seeking Experienced Hadoop developers with extensive expertise in Hadoop to join our growing Data Engineering practice delivering transformative solutions using Hadoop.At this time, We welcome Freelancers, Contractors and other immediate joiners.Experience: 5+ Years of Relevant experienceLocation - Chennai / Bangalore/ Hyderabad/NoidaMode - HybridJOB...


  • Chennai, India PTS Consulting Full time

    We are seeking Experienced Hadoop developers with extensive expertise in Hadoop to join our growing Data Engineering practice delivering transformative solutions using Hadoop.At this time, We welcome Freelancers, Contractors and other immediate joiners.Experience: 5+ Years of Relevant experienceLocation - Chennai / Bangalore/ Hyderabad/NoidaMode - HybridJOB...


  • Chennai, India PTS Consulting Full time

    We are seeking Experienced Hadoop developers with extensive expertise in Hadoop to join our growing Data Engineering practice delivering transformative solutions using Hadoop. At this time, We welcome Freelancers, Contractors and other immediate joiners. Experience: 5+ Years of Relevant experience Location - Chennai / Bangalore/ Hyderabad/Noida Mode -...

  • Data Engineer

    2 days ago


    chennai, India HCLTech Full time

    Exp - 5+ Years Location - Chennai & Bangalore Job Profile: Hadoop/Omnia Dev Engineers To develop and deliver codes for the work assigned in accordance with time| quality and cost standards Job responsibilities: •Interact with business stake holders and designers to implement to understand business requirements. •Hadoop development and...

  • Senior Data Engineer

    2 weeks ago


    Chennai, India Programming.com Full time

    Job DescriptionJob Title: Senior Data EngineerLocation : ChennaiSalary : ₹13 LPAExperience Required : 6 YearsNotice Period : Immediate to 15 daysResponsibilities :♦ Design and optimize data processing systems.♦ Collaborate with teams to implement data models.♦ Ensure data architecture aligns with business needs.♦ Build and maintain data...


  • Chennai, India GIT Infosys Full time

    We need a proficient and seasoned Big Data Engineer with GCP cloud expertise and Lumi tool migration for our client American Express, Chennai. Someone with at least 5+ years of experience and who can join in 2-3 weeks. ResponsibilitiesTools & Technologies: Big Data (Hadoop, HBase, Hive, etc.), GCP cloud expertise, Lumi tool migrationQualificationsBachelors...


  • Chennai, India GIT Infosys Full time

    We need a proficient and seasoned Big Data Engineer with GCP cloud expertise and Lumi tool migration for our client American Express, Chennai. Someone with at least 5+ years of experience and who can join in 2-3 weeks. ResponsibilitiesTools & Technologies: Big Data (Hadoop, HBase, Hive, etc.), GCP cloud expertise, Lumi tool migrationQualificationsBachelors...

  • GCP Data Engineer

    1 month ago


    Chennai, India Xebia Full time

    Establish scalable, efficient, automated processes for data analyses, model development, validation and implementation Work closely with data scientists and analysts to create and deploy new features Write efficient and well-organized software to ship products in an iterative, continual release environment Monitor and plan out core infrastructure...