Senior Data Engineer

14 hours ago


Kolkata, West Bengal, India Tata Consultancy Services Full time

Greetings from TCS

Job Title: Senior Data Engineer

Required Skillset: Python, Spark, Databricks, AWS (S3, Glue, AirFlow, Cloudwatch, Lambda)

Experience Range: 8+ years

Job Description

ROLE AND MISSION DESCRIPTION

Main tasks

  • Master Databricks tools (job creation, cluster, notebook) and be able to query efficiently with SQL
  • Maintain the platform in operational condition in production (analyze and correct incidents and defects)
  • Development of Python data ingestion and transformation jobs with Spark on large volumes of data
  • Provide a long-term vision, both operationally and in terms of data platform strategy
  • Support and promote best practices
  • Participate in technical and functional design workshops
  • Write and update technical documentation

Technical skills required in order of priority :

  • MUST
  • Python
  • Spark
  • Databricks
  • SQL
  • SHOULD
  • AWS (S3, Glue, AirFlow, Cloudwatch, Lambda, IAM)
  • COULD
  • Big DATA
  • WOULD
  • GIT

Methodologies :

  • CI/CD avec Gitlab
  • JIRA / Confluence
  • Scrum

Thanks & Regards,

Ria Aarthi A.


  • Data Engineer

    2 weeks ago


    Kolkata, West Bengal, India Nilasu Consulting Services Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Mandatory skill databricks + Python Overall Exp Years Databricks & Python years Location Kolkata , Vizag , Pune, Bangalore , Hyderabad ,Chennai , Coimbatore , Kochi , Delhi/NCR   JOBCODE Role : Data Engineer (Sr) The Senior Data Engineer will be responsible for the build of Enterprise Data platform. Setting up the data pipelines that are scalable, robust...

  • Data Engineer

    2 days ago


    Kolkata, West Bengal, India Workmates Core2cloud Full time ₹ 4,00,000 - ₹ 12,00,000 per year

    Role & responsibilitiesAbout the role:As a Junior/Senior Data Engineer, you'll be taking the lead in designing and maintaining complex data ecosystems. Your experience will be instrumental in optimizing data processes, ensuring data quality, and driving data-driven decision-making within the organization.Architecting and designing complex data systems and...


  • Kolkata, West Bengal, India NTT DATA Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can grow, belong and thrive.Your day at NTT DATAThe Senior...

  • Senior Data Engineer

    16 hours ago


    Kolkata, West Bengal, India Sundew Full time

    About the role :We are looking for a Data Engineer with strong Databricks expertise to join our team. This role will be pivotal in building robust ingestion pipelines, creating curated data views, and normalizing legacy datasets from sources like SharePoint, Excel, and other business systems. The ideal candidate will bring hands-on technical skills along...

  • Senior Data Science

    3 days ago


    Kolkata, West Bengal, India TuTeck Technologies Full time US$ 12,00,000 - US$ 18,00,000 per year

    Job Title:Senior Data Science & Advanced Analytics LeaderLocation:KolkataExperience:10+ years in Data Science/Advanced Analytics/BI, including 4+ years leading teamsEmployment Type:Full-TimeNotice Period:ImmediateRole SummaryThe Senior Data Science & Advanced Analytics Leader will be responsible for driving data strategy, leading the design and development...


  • Kolkata, West Bengal, India HR Ways - Hiring Tech Talent Full time US$ 9,00,000 - US$ 12,00,000 per year

    Client Company Introduction:It is a leadingsoftware engineering company delivering innovative, AI-powered platforms for global clients.Opening:AWS Data Engineer (AWS Integration)Key Responsibilities:Data Lake Architecture:-Design, implement, and maintain a data lake on AWS using Iceberg tables on S3, ensuring data consistency, high availability, and easy...

  • Azure Data Engineer

    1 week ago


    Kolkata, West Bengal, India Sys Edge Micro Informatics Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Role & responsibilitiesAssist in data collection, cleansing, and preparation from various sources.Support basic data modelling and documentation efforts.Develop and maintain simple data pipelines using tools like Azure Data Factory (ADF).Write and optimize queries using SQL.Use Python or PySpark scripts to perform data transformations.Perform data...

  • MS Engineer

    11 hours ago


    Kolkata, West Bengal, India NTT DATA Full time

    Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can grow, belong and thrive.Your day at NTT DATAAs a Cross...


  • Kolkata, West Bengal, India Lexmark Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Responsibilities :About Lexmark:Founded in 1991 and headquartered in Lexington, Kentucky, Lexmark is recognized as a global leader in print hardware, service, software solutions and security by many of the technology industry's leading market analyst firms. Lexmark creates cloud-enabled imaging and IoT solutions that help customers in more than 170 countries...


  • Kolkata, West Bengal, India, West Bengal Tata Consultancy Services Full time

    Greetings from TCS!Job Title: Senior Data EngineerRequired Skillset: Python, Spark, Databricks, AWS (S3, Glue, AirFlow, Cloudwatch, Lambda)Experience Range: 8+ yearsJob DescriptionROLE AND MISSION DESCRIPTION Main tasksMaster Databricks tools (job creation, cluster, notebook) and be able to query efficiently with SQLMaintain the platform in operational...