Big Data Engineer

5 days ago


Chennai, Tamil Nadu, India Tata Consultancy Services Full time
Job Description:

Tata Consultancy Services is looking for highly skilled Big Data Engineers with expertise in Scala, Hadoop, and Spark to join our team.

We are seeking talented individuals who can design, develop, and implement large-scale data processing systems using Scala, Hadoop, and Spark. If you have a strong background in big data technologies and experience with data ingestion, processing, and storage, we encourage you to apply.

About the Role:

This role involves working on various projects that require processing and analyzing large datasets using Hadoop and Spark. You will be responsible for designing and developing scalable data pipelines, optimizing system performance, and ensuring data quality and security.

Key Responsibilities:

  • Design and develop large-scale data processing systems using Scala, Hadoop, and Spark
  • Develop data ingestion pipelines using Sqoop and HTTPFS
  • Implement job scheduling using OOZIE
  • Perform data analysis and provide insights to stakeholders
  • Maintain security and data privacy

Requirements:

  • 4-9 years of experience in big data technologies, including Hadoop, Spark, and Scala
  • Strong knowledge of data ingestion, processing, and storage
  • Experience with data analytics and visualization tools
  • Good understanding of Unix, SQL, and HQL
  • Ability to work in a fast-paced environment and meet deadlines

Preferred Skills:

  • Hadoop development and implementation
  • Loading from disparate data sets
  • High-speed querying

What We Offer:

TCS offers a competitive salary package, along with opportunities for career growth and professional development. Our team is passionate about delivering high-quality solutions and collaborating with clients to drive business success.

Estimated Salary: ₹1,200,000 - ₹1,800,000 per annum (based on location and experience)


  • Big Data Engineer

    2 weeks ago


    Chennai, Tamil Nadu, India LTIMindtree Full time

    Job Title: Big Data EngineerCompany Overview: LTIMindtree is a leading digital transformation consulting and technology services company, seeking an experienced Big Data Engineer to join our team.Salary: The estimated annual salary for this position is around $120,000-$180,000, depending on location and experience.Job Description: As a Big Data Engineer at...

  • Big Data Engineer

    4 weeks ago


    Chennai, Tamil Nadu, India Tata Consultancy Services Full time

    Job Title: Big Data EngineerTata Consultancy Services is seeking a skilled Big Data Engineer to join our team. As a leading global consulting and IT services company, we empower our clients to become digital businesses.The estimated salary for this role is ₹1,200,000 - ₹2,500,000 per annum, based on location and experience.About the Role:We are looking...


  • Chennai, Tamil Nadu, India myGwork Full time

    About UsmyGwork is an inclusive employer and a member of the largest global platform for the LGBTQ+ business community. Our company is all about innovation and pushing boundaries.Job Title: Data Engineer and Big Data SpecialistLocation: Amazon, USA (Note: Location may vary based on the actual requirement)Estimated Salary: $140,000 - $200,000 per yearAbout...

  • Big Data Engineer

    17 hours ago


    Chennai, Tamil Nadu, India ALP Full time

    Job DescriptionWe are seeking a highly skilled Big Data Engineer to join our team at ALP Consulting.The ideal candidate will have 4-14 years of experience in Big Data & Data related technology, with expert-level understanding of distributed computing principles.A strong background in Apache Spark, Hadoop v2, Map Reduce, HDFS, Sqoop, and proficiency in...

  • Big Data Engineer

    3 weeks ago


    Chennai, Tamil Nadu, India LTIMindtree Full time

    Job DescriptionLTIMindtree is seeking an experienced Big Data Engineer to join our team. As a key member of our data analytics group, you will be responsible for designing, developing, and maintaining large-scale data processing systems.Key ResponsibilitiesDesign and develop scalable data pipelines using Apache SparkWork with Kafka to implement real-time...

  • Big Data Engineer

    3 weeks ago


    Chennai, Tamil Nadu, India Tata Consultancy Services Full time

    Tata Consultancy Services is a leading global consulting and IT services company that requires highly skilled professionals to join its team.We are seeking a talented Big Data Engineer to work with us in our Chennai location. The successful candidate will have the opportunity to work on various projects, leveraging their skills in data analysis, machine...


  • Chennai, Tamil Nadu, India Tata Consultancy Services Full time

    Job Overview:We are seeking a highly skilled Senior Big Data Engineer to join our team at Tata Consultancy Services in Chennai. This is an exciting opportunity for a seasoned professional to leverage their expertise in big data processing, storage, and analytics to drive business growth and innovation.About the Role:As a Senior Big Data Engineer, you will be...


  • Chennai, Tamil Nadu, India InfoCentroid Software Solutions Pvt. Ltd Full time

    Job Title: Senior Big Data EngineerAbout the Role:We are seeking an experienced Senior Big Data Engineer to join our team at InfoCentroid Software Solutions Pvt. Ltd in Chennai. The ideal candidate will have a strong background in data engineering, a deep understanding of Google Cloud Platform (GCP) services, and hands-on experience with SQL, Python,...


  • Chennai, Tamil Nadu, India Wipro Ltd Full time

    About the RoleWipro Ltd is seeking an experienced Data Engineer to join our team. In this role, you will be responsible for designing and developing batch and streaming solutions using various Big Data technologies.You will work closely with our architect to design secure and scalable solutions that meet the needs of our business. Additionally, you will be...


  • Chennai, Tamil Nadu, India Mavinsys Full time

    Job Overview: Mavinsys is seeking a highly skilled Senior Big Data Engineer to join our team. This role will focus on designing and developing scalable data pipelines using Scala and Spark, implementing robust and efficient Spark applications for data processing, and developing RESTful APIs to provide access to processed data for various applications.


  • Chennai, Tamil Nadu, India Nextgen Creation Inc Full time

    Job Description:We are looking for a Big Data Architect and Engineer to join our team at Nextgen Creation Inc. As a senior architect, you will be responsible for designing and implementing big data architectures, working closely with cross-functional teams to drive business outcomes.Estimated Salary Range: ₹1,800,000 - ₹3,600,000 per annum based on...


  • Chennai, Tamil Nadu, India Tata Consultancy Services Full time

    About the RoleWe are seeking a highly skilled Big Data Engineer to join our team at Tata Consultancy Services. This is an excellent opportunity for individuals with experience in working with big data ecosystems and delivering high-quality solutions.Key ResponsibilitiesTo design, develop, and deploy big data solutions using Hadoop, Python, PySpark, and...


  • Chennai, Tamil Nadu, India Tata Consultancy Services Full time

    Job DescriptionTata Consultancy Services is seeking an experienced Cloud Engineer for Big Data SolutionsAbout the RoleWe are looking for a highly skilled Cloud Engineer to join our team in Chennai. As a Cloud Engineer, you will be responsible for designing, developing, and deploying big data pipelines in Cloud platforms preferably Google Cloud Platform...


  • Chennai, Tamil Nadu, India Cynosure Corporate Solutions Full time

    About Cynosure Corporate SolutionsCynosure Corporate Solutions is a leading organization in the field of data engineering and big data solutions.

  • Big Data Architect

    3 weeks ago


    Chennai, Tamil Nadu, India Trinity Technology solutions Full time

    We are Trinity Technology Solutions, a forward-thinking company seeking an exceptional Senior Cloud Data Engineer to drive the development and deployment of robust data pipelines and warehouse solutions on Google Cloud Platform (GCP). With over 5+ years of experience in big data engineering or a related field, you will leverage your expertise in big data...

  • Big Data Engineer

    4 weeks ago


    Chennai, Tamil Nadu, India Tata Consultancy Services Full time

    Company OverviewTata Consultancy Services (TCS) is a leading global IT services company that empowers its clients to succeed in an increasingly digital world. With over four decades of experience, TCS has established itself as a trusted partner for businesses across the globe.SalaryWe offer a competitive salary package, estimated to be around ₹25-35 lakhs...


  • Chennai, Tamil Nadu, India ANRI Solutions HR Services Full time

    At ANRI Solutions HR Services, we are looking for a highly skilled Big Data Engineering Specialist to lead our data engineering efforts. The ideal candidate will have extensive experience in Spark and Scala, with a strong background in creating end-to-end data pipelines.Key Responsibilities:Design and develop scalable data pipelines using Spark and...

  • Big Data Engineer

    1 month ago


    Chennai, Tamil Nadu, India Tata Consultancy Services Full time

    We are looking for a highly skilled Big Data Engineer to join our team in Chennai or Pune. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining large-scale data processing systems using Pyspark.The ideal candidate should have experience with Pyspark, Python (Pandas and Numpy), Azure...


  • Chennai, Tamil Nadu, India LTIMindtree Full time

    We are seeking a highly skilled Big Data Developer to join our team at LTIMindtree. As a Big Data Developer, you will be responsible for designing and developing large-scale data processing systems using Spark/Pyspark/Scala Spark/Java Spark skills.Company OverviewLTIMindtree is a leading IT consulting company that provides innovative solutions to clients...

  • Data Engineer

    5 days ago


    Chennai, Tamil Nadu, India Tata Consultancy Services Full time

    Job Description:Tata Consultancy Services is seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will be responsible for designing, building, and maintaining large-scale data processing systems.Key Responsibilities:Design and develop scalable data pipelines using Google Cloud Platform (GCP) services such as BigQuery, Dataflow,...