Data Engineer for Big Data Solutions

1 day ago


Chennai, Tamil Nadu, India Tata Consultancy Services Full time
Job Title: Data Engineer for Big Data Solutions

About Us: Tata Consultancy Services (TCS) is a leading IT services company that has been a driving force in the digital transformation of businesses across the globe.

Salary: The estimated salary for this role is around ₹25,00,000 - ₹35,00,000 per annum based on industry standards and the location of Chennai.

Job Description:

We are seeking an experienced Data Engineer to join our team at TCS. As a Data Engineer, you will be responsible for designing, building, and maintaining large-scale data processing systems and pipelines. You will work closely with cross-functional teams to develop and deploy big data solutions using cloud-based technologies such as Google Cloud Platform (GCP).



Responsibilities:

  • Design, build, and maintain large-scale data processing systems and pipelines.
  • Develop and deploy big data solutions using cloud-based technologies such as GCP.
  • Analyze, develop, and implement database designs, data models, and logical data specifications.
  • Code quality, security, performance measurement, and troubleshooting/debugging.


Required Skills and Qualifications:

To be successful in this role, you should have:



  • Experience in delivering big data solutions.
  • Experience in developing and deploying big data pipelines in cloud preferably GCP.
  • Experience in deploying Spark/Scala built applications in Cloud.
  • Excellent programming skills with PySpark/Scala and known best practices.
  • In-depth knowledge of Hadoop, Spark, Python, Shell scripting, and similar frameworks.
  • At least 2+ years of experience in creating real-time pipelines using Kafka, Pub/sub, Spark Streaming.
  • Experience in optimizing Hadoop and Spark jobs.
  • Familiarity with agile methodology.
  • Strong hold on SQL queries.
  • Knowledge of GitHub Actions for CI/CD.


Benefits:

TCS offers a comprehensive benefits package that includes:



  • A competitive salary range of ₹25,00,000 - ₹35,00,000 per annum.
  • Opportunities for professional growth and development.
  • A collaborative and dynamic work environment.
  • A wide range of employee benefits and perks.


  • Chennai, Tamil Nadu, India Wipro Ltd Full time

    About the RoleWipro Ltd is seeking an experienced Data Engineer to join our team. In this role, you will be responsible for designing and developing batch and streaming solutions using various Big Data technologies.You will work closely with our architect to design secure and scalable solutions that meet the needs of our business. Additionally, you will be...


  • Chennai, Tamil Nadu, India Wavicle Data Solutions Full time

    OverviewWelcome to Wavicle Data Solutions, a leading provider of innovative data management solutions. We are seeking an experienced Data Engineering Director to join our team and lead the development of our data engineering initiatives.

  • Data Engineer

    4 weeks ago


    Chennai, Tamil Nadu, India MNR Solutions Full time

    About UsMNR Solutions is a leading technology firm with a strong presence in Bangalore and Chennai, India. Our company culture values innovation and collaboration, making us an ideal place for talented professionals to grow.Job SummaryWe are seeking an experienced Data Engineer to join our dynamic team as a Big Data Solutions Specialist. The successful...


  • Chennai, Tamil Nadu, India Wavicle Data Solutions Full time

    Wavicle Data Solutions is seeking a highly experienced Data Solutions Architect Lead to join our team.Estimated salary for this role in the United States: $160,000 - $240,000 per year.About the RoleWe are looking for a seasoned professional with a strong background in data engineering and analytics. The ideal candidate will have experience leading...

  • Lead Data Engineer

    2 weeks ago


    Chennai, Tamil Nadu, India Wavicle Data Solutions Full time

    Job Title: Lead Data Engineer**Overview**We are seeking an experienced Lead Data Engineer to join our team at Wavicle Data Solutions. The successful candidate will play a pivotal role in architecting and implementing data solutions, leveraging their expertise in managing data-related projects, including Data Engineering and Data Analytics...


  • Chennai, Tamil Nadu, India Cynosure Corporate Solutions Full time

    About Cynosure Corporate SolutionsCynosure Corporate Solutions is a leading organization in the field of data engineering and big data solutions.

  • Big Data Engineer

    3 weeks ago


    Chennai, Tamil Nadu, India LTIMindtree Full time

    Job Title: Big Data EngineerCompany Overview: LTIMindtree is a leading digital transformation consulting and technology services company, seeking an experienced Big Data Engineer to join our team.Salary: The estimated annual salary for this position is around $120,000-$180,000, depending on location and experience.Job Description: As a Big Data Engineer at...

  • Big Data Architect

    3 weeks ago


    Chennai, Tamil Nadu, India Trinity Technology solutions Full time

    We are Trinity Technology Solutions, a forward-thinking company seeking an exceptional Senior Cloud Data Engineer to drive the development and deployment of robust data pipelines and warehouse solutions on Google Cloud Platform (GCP). With over 5+ years of experience in big data engineering or a related field, you will leverage your expertise in big data...


  • Chennai, Tamil Nadu, India InfoCentroid Software Solutions Pvt. Ltd Full time

    Job Title: Senior Big Data EngineerAbout the Role:We are seeking an experienced Senior Big Data Engineer to join our team at InfoCentroid Software Solutions Pvt. Ltd in Chennai. The ideal candidate will have a strong background in data engineering, a deep understanding of Google Cloud Platform (GCP) services, and hands-on experience with SQL, Python,...


  • Chennai, Tamil Nadu, India Tata Consultancy Services Full time

    Job DescriptionTata Consultancy Services is seeking an experienced Cloud Engineer for Big Data SolutionsAbout the RoleWe are looking for a highly skilled Cloud Engineer to join our team in Chennai. As a Cloud Engineer, you will be responsible for designing, developing, and deploying big data pipelines in Cloud platforms preferably Google Cloud Platform...

  • Big Data Engineer

    1 month ago


    Chennai, Tamil Nadu, India Tata Consultancy Services Full time

    Job Title: Big Data EngineerTata Consultancy Services is seeking a skilled Big Data Engineer to join our team. As a leading global consulting and IT services company, we empower our clients to become digital businesses.The estimated salary for this role is ₹1,200,000 - ₹2,500,000 per annum, based on location and experience.About the Role:We are looking...


  • Chennai, Tamil Nadu, India BigIdea Technology Solutions Full time

    About the RoleWe are seeking a highly skilled Big Data Engineer to join our team at BigIdea Technology Solutions. As a Snowflake Developer, you will be responsible for designing, developing, and maintaining efficient data storage and retrieval solutions within the Snowflake platform.The ideal candidate will have a deep understanding of data warehousing...


  • Chennai, Tamil Nadu, India 1HResource Solutions Full time

    Job OverviewAt 1HResource Solutions, we are seeking a highly skilled Senior Big Data Solutions Architect to join our team in Chennai. As a key member of our technical leadership team, you will be responsible for designing and implementing large-scale big data platforms to support critical business projects.


  • Chennai, Tamil Nadu, India ANRI Solutions HR Services Full time

    At ANRI Solutions HR Services, we are looking for a highly skilled Big Data Engineering Specialist to lead our data engineering efforts. The ideal candidate will have extensive experience in Spark and Scala, with a strong background in creating end-to-end data pipelines.Key Responsibilities:Design and develop scalable data pipelines using Spark and...

  • Big Data Developer

    3 weeks ago


    Chennai, Tamil Nadu, India Hirexa Solutions Full time

    About the RoleWe are seeking an experienced Big Data Developer to join our team at Hirexa Solutions. As a key member of our data engineering group, you will be responsible for designing and implementing efficient data pipelines using Scala and Spark.

  • Big Data Engineer

    3 weeks ago


    Chennai, Tamil Nadu, India Tata Consultancy Services Full time

    Tata Consultancy Services is a leading global consulting and IT services company that requires highly skilled professionals to join its team.We are seeking a talented Big Data Engineer to work with us in our Chennai location. The successful candidate will have the opportunity to work on various projects, leveraging their skills in data analysis, machine...


  • Chennai, Tamil Nadu, India Hexaware Technologies Full time

    Exciting Career Opportunity at Hexaware TechnologiesWe are looking for a highly skilled Data Engineer to join our team at Hexaware Technologies in Chennai. As a key member of our technology team, you will be responsible for designing and implementing scalable data engineering solutions using Azure Databricks, Data Lakes, and other cutting-edge...

  • Big Data Engineer

    3 days ago


    Chennai, Tamil Nadu, India ALP Full time

    Job DescriptionWe are seeking a highly skilled Big Data Engineer to join our team at ALP Consulting.The ideal candidate will have 4-14 years of experience in Big Data & Data related technology, with expert-level understanding of distributed computing principles.A strong background in Apache Spark, Hadoop v2, Map Reduce, HDFS, Sqoop, and proficiency in...


  • Chennai, Tamil Nadu, India Crayon Data Full time

    We are seeking a highly skilled Senior Machine Learning Engineer to join our team in Chennai. This is a fantastic opportunity to work on large scale data solutions using machine learning, operation research and pattern searching methods.About Crayon DataCrayon Data is a leading provider of AI-led revenue acceleration solutions, headquartered in Singapore...


  • Chennai, Tamil Nadu, India myGwork Full time

    About UsmyGwork is an inclusive employer and a member of the largest global platform for the LGBTQ+ business community. Our company is all about innovation and pushing boundaries.Job Title: Data Engineer and Big Data SpecialistLocation: Amazon, USA (Note: Location may vary based on the actual requirement)Estimated Salary: $140,000 - $200,000 per yearAbout...