Azure Databricks Engineer
5 days ago
Choosing Capgemini means choosing a company where you will be empowered to shape your career in the way you'd like, where you'll be supported and inspired by a collaborative community of colleagues around the world, and where you'll be able to reimagine what's possible. Join us and help the world's leading organizations unlock the value of technology and build a more sustainable, more inclusive world.
Your Role- Designing and developing end-to-end data pipelines using Azure Data Factory and Databricks, PySpark, SQL, Delta Lake, azure data lake Building and optimizing ETL workflows for ingestion, transformation, and loading of structured and semi-structured data into Azure Synapse Analytics and ADLS.
- Implementing data validation and quality frameworks to ensure data reliability.Writing efficient PySpark and SQL code for complex transformations, aggregations, and performance tuning.
- Managing secure access using Azure Key Vault, role-based permissions, and compliance best practices.
- Working in an Agile/Scrum environment, delivering solutions aligned with business needs, currently as part of Cognizant's Data Engineering practice.
- Very good judgement skills and ability to shape compelling solutions.
- Very good collaboration skills and ability to interact with multi-cultural and multi-functional teams spread
- Should have 4+ years of experience in Azure Databricks with strong pyspark experience
- Experience with Azure Data Bricks, Data Factory
- Experience with Azure Data components such as Azure SQL Database, Azure SQL Warehouse, SYNAPSE Analytics
- Experience in Python/Pyspark/Scala/Hive Programming.
- Experience with Azure Databricks/ADB
- Experience with building CI/CD pipelines in Data environments.
Choosing Capgemini means having the opportunity to make a difference, whether for the world's leading businesses or for society. It means getting the support you need to shape your career in the way that works for you. It means when the future doesn't look as bright as you'd like, you have the opportunity to make change: to rewrite it. When you join Capgemini, you don't just start a new job. You become part of something bigger. A diverse collective of free-thinkers, entrepreneurs and experts, all working together to unleash human energy through technology, for an inclusive and sustainable future. At Capgemini, people are at the heart of everything we do You can exponentially grow your career by being part of innovative projects and taking advantage of our extensive Learning & Development programs. With us, you will experience an inclusive, safe, healthy, and flexible work environment to bring out the best
in you You also get a chance to make positive social change and build a better world by taking an active role in our Corporate Social Responsibility and Sustainability initiatives. And whilst you make a difference, you will also have a lot of fun.
Capgemini is a global business and technology transformation partner, helping organizations to accelerate their dual transition to a digital and sustainable world, while creating tangible impact for enterprises and society. It is a responsible and diverse group of 340,000 team members in more than 50 countries. With its strong over 55-year heritage, Capgemini is trusted by its clients to unlock the value of technology to address the entire breadth of their business needs. It delivers end-to-end services and solutions leveraging strengths from strategy and design to engineering, all fueled by its market leading capabilities in AI, generative AI, cloud and data, combined with its deep industry expertise and partner ecosystem.
-
Azure Databricks + Pyspark
1 day ago
Chennai, Tamil Nadu, India Cognizant Technology Solutions Full time ₹ 15,00,000 - ₹ 20,00,000 per yearAzure DatabricksLocation - Hyderabad / Experience - 9 to 12 YearsJob Summary8plus years of technical and development experience3 plus years of Experience with Azure Data Factory Azure Synapse and DatabricksExperience with ETL SQL PySparkExperience managing cloud applications (Managing network security is a plus)Experience with git repositories and release...
-
Senior Data Engineer- Azure Databricks
1 day ago
Chennai, Tamil Nadu, India InfoCepts Full time ₹ 12,00,000 - ₹ 36,00,000 per yearPosition: Data Engineer- Azure DatabricksPurpose of the Position:To design, build, and optimize scalable data pipelines and solutions using Azure Databricks and related technologies, enabling Zodiac Maritime to make faster, data-driven decisions as part of its data transformation journey.Proficiency in data integration techniques, ETL processes and data...
-
Databrick
1 day ago
Chennai, Tamil Nadu, India Virtusa Full time ₹ 12,00,000 - ₹ 36,00,000 per yearWe are seeking an experienced Databricks Developer with 5 to 7 years of expertise in big data engineering and analytics platforms. The ideal candidate will have deep experience in Apache Spark Databricks PySpark and cloud platforms such as Azure or AWS and a strong background in data pipeline development performance optimization and data governance.Key...
-
Databricks Architect
3 days ago
Chennai, Tamil Nadu, India NotionMindz Technology LLP Full time ₹ 20,00,000 - ₹ 25,00,000 per yearRole:Databricks ArchitectDesignation:Data ArchitectExperience:7–10 yearsLocation:ChennaiAbout the role:We're looking for aDatabricks Architectto design, build, and optimize data pipelines and large-scale integrations for enterprise-grade data environments. The ideal candidate will bring strong experience inAzure Databricks, Data Factory, and SQL-based data...
-
Databricks
1 day ago
Chennai, Tamil Nadu, India Cognizant Technology Solutions Full time ₹ 8,00,000 - ₹ 15,00,000 per yearJob descriptionAzure Databricks + PysparkLocation - CoimbatoreExpereince - 6 to 8 YearsExperience with Azure Data Bricks, Data FactoryExperience with Azure Data components such as Azure SQL Database, Azure SQL Warehouse, SYNAPSE AnalyticsExperience in Python/Pyspark/Scala/Hive Programming.Experience with Azure Databricks/ADBExperience with building CI/CD...
-
Senior Data Engineer – Databricks
1 day ago
Chennai, Tamil Nadu, India Zillion Technologies Full time ₹ 8,00,000 - ₹ 24,00,000 per yearSenior Data Engineer – DatabricksLocation: Hyderabad/ChennaiWork Schedule: Timings 2:30 PM to 11:30 PMRole Overview:We are seeking a highly skilled Senior Data Engineer with deep expertise in Databricks to design, build, and optimize scalable data pipelines and architectures. You will collaborate with cross-functional teams including data scientists,...
-
Azure Data Engineer
1 day ago
Chennai, Tamil Nadu, India DataEngine Full time ₹ 12,00,000 - ₹ 36,00,000 per yearHiring for Azure Data EngineerExperience: 8+ yearsLocation: Chennai, Hyderabad, BangaloreNotice Period: Immediate to 30 daysKey ResponsibilitiesData Pipelines: Build pipelines for raw data ingestion and orchestration using Azure Data Factory (ADF) and DatabricksData Transformation: Develop and maintain innovative Azure solutions, perform transformation using...
-
Data Engineer – Databricks
2 weeks ago
Chennai, Tamil Nadu, India Tata Consultancy Services Full time ₹ 15,00,000 - ₹ 25,00,000 per yearRole Summary:We are looking for aData Engineerwith expertise inAzure Databricks,data transformation, andintegration pipelinesto support forecasting, scheduling, and analytics flows in the WFM Re-Platform program.Key ResponsibilitiesDesign and implement data pipelines in Azure Databricks for ingesting and transforming data from upstream systems (SAP, PIPS,...
-
Azure Data Engineer
2 weeks ago
Chennai, Tamil Nadu, India Colan Infotech Private Limited Full time ₹ 6,00,000 - ₹ 18,00,000 per yearJob descriptionRole: Azure Data EngineerExperience: 3-5 YearsSkill set:Pyspark / Scala Spark, Python, Azure Databricks and Azure Data Factory Roles and Responsibilities: Should have programming skills with the ability to write optimized and reusable high-quality code. Design, develop and maintain scalable data pipelines using Pyspark / Scala Spark,...
-
Azure Data Engineer
6 days ago
Chennai, Tamil Nadu, India D2KSS SOFTWARE SERVICES PRIVATE LIMITED Full time ₹ 8,00,000 - ₹ 24,00,000 per yearIndustry & Sector:IT services and enterprise data engineering — delivering cloud-native analytics, ETL/ELT pipelines, and modern data platform implementations on Microsoft Azure for large enterprise customers. This is an on-site, hands-on engineering role supporting strategic data modernization initiatives across business domains.Primary Job TitleSenior...