Senior Data Engineer
14 hours ago
Greetings from TCS
Job Title: Senior Data Engineer
Required Skillset: Python, Spark, Databricks, AWS (S3, Glue, AirFlow, Cloudwatch, Lambda)
Experience Range: 8+ years
Job Description
ROLE AND MISSION DESCRIPTION
Main tasks
- Master Databricks tools (job creation, cluster, notebook) and be able to query efficiently with SQL
- Maintain the platform in operational condition in production (analyze and correct incidents and defects)
- Development of Python data ingestion and transformation jobs with Spark on large volumes of data
- Provide a long-term vision, both operationally and in terms of data platform strategy
- Support and promote best practices
- Participate in technical and functional design workshops
- Write and update technical documentation
Technical skills required in order of priority :
- MUST
- Python
- Spark
- Databricks
- SQL
- SHOULD
- AWS (S3, Glue, AirFlow, Cloudwatch, Lambda, IAM)
- COULD
- Big DATA
- WOULD
- GIT
Methodologies :
- CI/CD avec Gitlab
- JIRA / Confluence
- Scrum
Thanks & Regards,
Ria Aarthi A.
-
Data Engineer
2 weeks ago
Kolkata, West Bengal, India Nilasu Consulting Services Full time ₹ 15,00,000 - ₹ 25,00,000 per yearMandatory skill databricks + Python Overall Exp Years Databricks & Python years Location Kolkata , Vizag , Pune, Bangalore , Hyderabad ,Chennai , Coimbatore , Kochi , Delhi/NCR JOBCODE Role : Data Engineer (Sr) The Senior Data Engineer will be responsible for the build of Enterprise Data platform. Setting up the data pipelines that are scalable, robust...
-
Data Engineer
2 days ago
Kolkata, West Bengal, India Workmates Core2cloud Full time ₹ 4,00,000 - ₹ 12,00,000 per yearRole & responsibilitiesAbout the role:As a Junior/Senior Data Engineer, you'll be taking the lead in designing and maintaining complex data ecosystems. Your experience will be instrumental in optimizing data processes, ensuring data quality, and driving data-driven decision-making within the organization.Architecting and designing complex data systems and...
-
Kolkata, West Bengal, India NTT DATA Full time ₹ 12,00,000 - ₹ 36,00,000 per yearMake an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can grow, belong and thrive.Your day at NTT DATAThe Senior...
-
Senior Data Engineer
16 hours ago
Kolkata, West Bengal, India Sundew Full timeAbout the role :We are looking for a Data Engineer with strong Databricks expertise to join our team. This role will be pivotal in building robust ingestion pipelines, creating curated data views, and normalizing legacy datasets from sources like SharePoint, Excel, and other business systems. The ideal candidate will bring hands-on technical skills along...
-
Senior Data Science
3 days ago
Kolkata, West Bengal, India TuTeck Technologies Full time US$ 12,00,000 - US$ 18,00,000 per yearJob Title:Senior Data Science & Advanced Analytics LeaderLocation:KolkataExperience:10+ years in Data Science/Advanced Analytics/BI, including 4+ years leading teamsEmployment Type:Full-TimeNotice Period:ImmediateRole SummaryThe Senior Data Science & Advanced Analytics Leader will be responsible for driving data strategy, leading the design and development...
-
Senior Data Engineer
1 week ago
Kolkata, West Bengal, India HR Ways - Hiring Tech Talent Full time US$ 9,00,000 - US$ 12,00,000 per yearClient Company Introduction:It is a leadingsoftware engineering company delivering innovative, AI-powered platforms for global clients.Opening:AWS Data Engineer (AWS Integration)Key Responsibilities:Data Lake Architecture:-Design, implement, and maintain a data lake on AWS using Iceberg tables on S3, ensuring data consistency, high availability, and easy...
-
Azure Data Engineer
1 week ago
Kolkata, West Bengal, India Sys Edge Micro Informatics Full time ₹ 6,00,000 - ₹ 18,00,000 per yearRole & responsibilitiesAssist in data collection, cleansing, and preparation from various sources.Support basic data modelling and documentation efforts.Develop and maintain simple data pipelines using tools like Azure Data Factory (ADF).Write and optimize queries using SQL.Use Python or PySpark scripts to perform data transformations.Perform data...
-
MS Engineer
11 hours ago
Kolkata, West Bengal, India NTT DATA Full timeMake an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can grow, belong and thrive.Your day at NTT DATAAs a Cross...
-
Senior Data Integration Engineer
2 weeks ago
Kolkata, West Bengal, India Lexmark Full time ₹ 12,00,000 - ₹ 36,00,000 per yearResponsibilities :About Lexmark:Founded in 1991 and headquartered in Lexington, Kentucky, Lexmark is recognized as a global leader in print hardware, service, software solutions and security by many of the technology industry's leading market analyst firms. Lexmark creates cloud-enabled imaging and IoT solutions that help customers in more than 170 countries...
-
Senior Data Engineer
1 week ago
Kolkata, West Bengal, India, West Bengal Tata Consultancy Services Full timeGreetings from TCS!Job Title: Senior Data EngineerRequired Skillset: Python, Spark, Databricks, AWS (S3, Glue, AirFlow, Cloudwatch, Lambda)Experience Range: 8+ yearsJob DescriptionROLE AND MISSION DESCRIPTION Main tasksMaster Databricks tools (job creation, cluster, notebook) and be able to query efficiently with SQLMaintain the platform in operational...