Senior Data Engineer

6 hours ago

Bareilly, Uttar Pradesh, India Tata Consultancy Services Full time

Greetings from TCS

TCS has been a great pioneer in feeding the fire of Techies like you. We are a global leader in the technology arena and there's nothing that can stop us from growing together.

Your role is of key importance, as it lays down the foundation for the entire project.

Make sure you have a valid EP number before the interview. To create an EP Number, please visit https://ibegin.tcs.com/iBegin/register

Kindly complete the registration if you have not done it yet.

Role: Principal Data Engineer

Experience: 10-15 years

Location: Bangalore

Skills: AWS Data engineer python Spark, ETL data processing,. Implementation of data pipelines using tools like EMR, AWS Glue, AWS Lambda, AWS Step Functions, API Gateway, Athena

Must Have Tech Skills:

  • Prior Principal Engineer experience, leading team best practices in design, development, and implementation, mentoring team members, and fostering a culture of continuous learning and innovation
  • Extensive experience in software architecture and solution design, including microservices, distributed systems, and cloud-native architectures.
  • Expert in Python and Spark, with a deep focus on ETL data processing and data engineering practices.
  • Deep technical knowledge of AWS data services and engineering practices, with demonstrable experience of implementing data pipelines using tools like EMR, AWS Glue, AWS Lambda, AWS Step Functions, API Gateway, Athena
  • Experience of delivering Lakehouse solutions/architectures
  • A master's degree or relevant certifications (e.g., AWS Certified Solutions Architect, Certified Data Analytics) is advantageous

Key Skills:

  • Deep technical knowledge of data engineering solutions and practices. Expert in AWS services and cloud solutions, particularly as they pertain to data engineering practices
  • Extensive experience in software architecture and solution design
  • Specialized expertise in Python and Spark
  • Ability to provide technical direction, set high standards for code quality and optimize performance in data-intensive environments.
  • Skilled in leveraging automation tools and Continuous Integration/Continuous Deployment (CI/CD) pipelines to streamline development, testing, and deployment.
  • Exceptional communicator who can translate complex technical concepts for diverse stakeholders, including engineers, product managers, and senior executives.
  • Provides thought leadership within the engineering team, setting high standards for quality, efficiency, and collaboration. Experienced in mentoring engineers, guiding them in advanced coding practices, architecture, and strategic problem-solving to enhance team capabilities.
  • Financial Services expertise preferred, working with Equity and Fixed Income asset classes and a working knowledge of Indices.

  • Senior Data Engineer

    4 days ago

    Bareilly, Uttar Pradesh, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Senior Data EngineerJoin us in shaping the future of data engineering with a challenging role that offers opportunities for growth and development.Location: Mumbai, IndiaDesign, develop, and maintain large-scale data pipelines using PySpark.Implement complex business logic using Spark SQL, DataFrame, and RDD APIs.Proficient in Python programming...

  • Data Engineering Leader

    4 days ago

    Bareilly, Uttar Pradesh, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Title:Senior Data Engineer(Lead)DescriptionWe are seeking a highly skilled and experienced Senior Data Engineer to lead our team in designing, developing, and optimizing large-scale data pipelines using Apache Spark, AWS Glue, and Azure Data Factory.Around 6+ years of experience in data engineering or cloud computing data development is required.The...

  • A Highly Experienced Data Engineer

    4 days ago

    Bareilly, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Senior Data EngineerA highly skilled and experienced data engineer is required to join our organization.

  • Data Engineer Lead Role

    4 days ago

    Bareilly, Uttar Pradesh, India beBeeDataEngineering Full time ₹ 20,00,000 - ₹ 25,00,000

    Senior Data Engineering Manager Position AvailableA leading organization seeks an experienced Senior Data Engineering Manager to lead our Data Engineering team.The successful candidate will have a strong background in data engineering, excellent technical skills, and the ability to collaborate with both technical teams and business stakeholders.This is an...

  • Senior Data Architect

    1 week ago

    Bareilly, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Key Data Engineering RoleHiring Now: Senior Data Engineers for Banking Project. A remote opportunity to work on cutting-edge data pipelines, streaming platforms, and cloud-based infrastructures.Designing and implementing ETL pipelines for large-scale data ingestion and transformation.Building real-time streaming solutions using Apache Kafka.Implementing...

  • Senior Data Engineer

    4 weeks ago

    Bareilly, Uttar Pradesh, India NEXWARE TECHNOLOGIES PRIVATE LIMITED Full time

    Mandatory Skills : Microsoft Fabric, PySpark, SQL, Data Factory, Power BI, Data Modeling, ETL/ELTExperience : 6-8 YrsPreferred Skills:- Microsoft Fabric: Experience with Lakehouse architecture, notebooks, and warehousing- PySpark: Proficiency in writing PySpark code for data transformation- SQL: Advanced knowledge of SQL for data manipulation and analysis-...

  • Data Engineer

    6 days ago

    Bareilly, Uttar Pradesh, India beBeeData Full time ₹ 1,80,00,000 - ₹ 2,50,00,000

    Senior Data Engineering SpecialistWe are seeking a highly skilled data engineer to assume the role of Senior Data Engineering Specialist. This position involves working on high-level marketing platforms and performing in-depth data analysis.This role requires expertise in API extraction, automation, and orchestration using advanced Python programming...

  • Highly Skilled Data Engineer Wanted

    2 days ago

    Bareilly, Uttar Pradesh, India beBeeDataEngineering Full time ₹ 90,00,000 - ₹ 1,40,00,000

    Senior Data Engineering ProfessionalWe are seeking a skilled Senior Data Engineering Professional to join our team. The ideal candidate will have extensive experience in designing and building large-scale data pipelines, with a strong focus on scalability, reliability, and high availability.Design and implement end-to-end data pipelines that handle terabytes...

  • Azure Data Engineer Lead

    14 minutes ago

    Bareilly, Uttar Pradesh, India beBeeDataMigration Full time ₹ 20,00,000 - ₹ 25,00,000

    Senior Data Migration EngineerWe are seeking a skilled Senior Data Migration Engineer to lead complex data migration projects within the Azure ecosystem. The ideal candidate will have a strong foundation in data integration, transformation, and migration.Key Responsibilities:Lead the migration of large-scale SQL workloads from on-premise environments to...

  • Senior Data Engineer Position

    4 days ago

    Bareilly, Uttar Pradesh, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Unlock Your Data Engineering PotentialWe are seeking a highly skilled Data Engineer to join our team and contribute to the development of innovative data solutions.As a Data Engineer, you will be responsible for designing, building, and maintaining scalable data pipelines using Azure Databricks, PySpark, and Delta Lake. You will work closely with...