Azure Databricks Engineer

2 weeks ago


Chennai Mumbai, India Capgemini Full time

Job Description Choosing Capgemini means choosing a company where you will be empowered to shape your career in the way you'd like, where you'll be supported and inspired by a collaborative community of colleagues around the world, and where you'll be able to reimagine what's possible. Join us and help the world's leading organizations unlock the value of technology and build a more sustainable, more inclusive world. Your Role - Designing and developing end-to-end data pipelines using Azure Data Factory and Databricks, PySpark, SQL, Delta Lake,azure data lake Building and optimizing ETL workflows for ingestion, transformation, and loading of structured and semi-structured data into Azure Synapse Analytics and ADLS. - Implementing data validation and quality frameworks to ensure data reliability.Writing efficient PySpark and SQL code for complex transformations, aggregations, and performance tuning. - Managing secure access using Azure Key Vault, role-based permissions, and compliance best practices. - Working in an Agile/Scrum environment, delivering solutions aligned with business needs, currently as part of Cognizant's Data Engineering practice. - Very good judgement skills and ability to shape compelling solutions. - Very good collaboration skills and ability to interact with multi-cultural and multi-functional teams spread Your Profile - Should have 4+ years of experience in Azure Databricks with strong pyspark experience - Experience with Azure Data Bricks, Data Factory - Experience with Azure Data components such as Azure SQL Database, Azure SQL Warehouse, SYNAPSE Analytics - Experience in Python/Pyspark/Scala/Hive Programming. - Experience with Azure Databricks/ADB - Experience with building CI/CD pipelines in Data environments. What you'll love about working here Choosing Capgemini means having the opportunity to make a difference, whetherfor the world's leading businesses or for society. It means getting the support youneed to shape your career in the way that works for you. It means when the futuredoesn't look as bright as you'd like, youhave the opportunity tomake change: torewrite it.When you join Capgemini, you don't just start a new job. You become part of something bigger. A diverse collective of free-thinkers, entrepreneurs and experts, all working together to unleash human energy through technology, for an inclusive and sustainable future. At Capgemini, people are at the heart of everything we do You can exponentially grow your career by being part of innovative projects and taking advantage of our extensive Learning & Development programs. With us, you will experience an inclusive, safe, healthy, and flexible work environment to bring out the best in you You also get a chance to make positive social change and build a better world by taking an active role in our Corporate Social Responsibility and Sustainability initiatives. And whilst you make a difference, you will also have a lot of fun. Capgemini is a global business and technology transformation partner, helping organizations to accelerate their dual transition to a digital and sustainable world, while creating tangible impact for enterprises and society. It is a responsible and diverse group of 340,000 team members in more than 50 countries. With its strong over 55-year heritage, Capgemini is trusted by its clients to unlock the value of technology to address the entire breadth of their business needs. It delivers end-to-end services and solutions leveraging strengths from strategy and design to engineering, all fueled by its market leading capabilities in AI, generative AI, cloud and data, combined with its deep industry expertise and partner ecosystem.



  • Chennai, India Tata Consultancy Services Full time

    Role**Databricks Engineer (Individual Contributor)Required Technical Skill Set**Azure Databricks, PysparkExperience: 4 to 10 YearsLocation: Hyd,Kolkata, Noida, Chennai, BangaloreDesired Competencies (Technical/Behavioral Competency)Must-Have**1. Azure Data Bricks (Python)2. Pyspark3. ADLS4. complex problem-solving skillGood-to-Have- Azure Devops- Azure Data...


  • Chennai, India Tata Consultancy Services Full time

    Role**Databricks Engineer (Individual Contributor)Required Technical Skill Set**Azure Databricks, PysparkExperience: 4 to 10 YearsLocation: Hyd,Kolkata, Noida, Chennai, BangaloreDesired Competencies (Technical/Behavioral Competency)Must-Have**1. Azure Data Bricks (Python)2. Pyspark3. ADLS4. complex problem-solving skillGood-to-Have- Azure Devops- Azure Data...


  • Chennai, India Tata Consultancy Services Full time

    Role**Databricks Engineer (Individual Contributor) Required Technical Skill Set**Azure Databricks, Pyspark Experience: 4 to 10 Years Location: Hyd,Kolkata, Noida, Chennai, Bangalore Desired Competencies (Technical/Behavioral Competency) Must-Have** 1. Azure Data Bricks (Python) 2. Pyspark 3. ADLS 4. complex problem-solving skill Good-to-Have Azure Devops...


  • Chennai, India Tata Consultancy Services Full time

    Role**Databricks Engineer (Individual Contributor) Required Technical Skill Set**Azure Databricks, Pyspark Experience: 4 to 10 Years Location: Hyd,Kolkata, Noida, Chennai, Bangalore Desired Competencies (Technical/Behavioral Competency) Must-Have** 1. Azure Data Bricks (Python) 2. Pyspark 3. ADLS 4. complex problem-solving skill Good-to-Have Azure Devops...


  • Chennai, India Tata Consultancy Services Full time

    Role**Databricks Engineer (Individual Contributor) Required Technical Skill Set**Azure Databricks, Pyspark Experience: 4 to 10 Years Location: Hyd,Kolkata, Noida, Chennai, Bangalore Desired Competencies (Technical/Behavioral Competency) Must-Have** 1. Azure Data Bricks (Python) 2. Pyspark 3. ADLS 4. complex problem-solving skill Good-to-Have Azure Devops...


  • Chennai, India Tata Consultancy Services Full time

    Role**Databricks Engineer (Individual Contributor)Required Technical Skill Set**Azure Databricks, PysparkExperience: 4 to 10 YearsLocation: Hyd,Kolkata, Noida, Chennai, BangaloreDesired Competencies (Technical/Behavioral Competency)Must-Have**1. Azure Data Bricks (Python)2. Pyspark3. ADLS4. complex problem-solving skillGood-to-HaveAzure DevopsAzure Data...


  • Chennai, India Tata Consultancy Services Full time

    Role** Databricks Engineer (Individual Contributor)Required Technical Skill Set** Azure Databricks, PysparkExperience: 4 to 10 YearsLocation: Hyd, Kolkata, Noida, Chennai, BangaloreDesired Competencies (Technical/Behavioral Competency)Must-Have**1. Azure Data Bricks (Python)2. Pyspark3. ADLS4. complex problem-solving skillGood-to-HaveAzure DevopsAzure Data...


  • Chennai, India Tata Consultancy Services Full time

    Role** Databricks Engineer (Individual Contributor)Required Technical Skill Set** Azure Databricks, PysparkExperience: 4 to 10 YearsLocation: Hyd,Kolkata, Noida, Chennai, BangaloreDesired Competencies (Technical/Behavioral Competency)Must-Have**1. Azure Data Bricks (Python)2. Pyspark3. ADLS4. complex problem-solving skillGood-to-HaveAzure DevopsAzure Data...

  • Azure DataBricks

    7 days ago


    Chennai, Tamil Nadu, India Hexaware Technologies Full time ₹ 15,00,000 - ₹ 28,00,000 per year

    We're on the lookout for passionate Azure Data Engineers who want to redefine the future of data with Databricks & Azure.Role: ADB – Data Engineer (Azure, Databricks, ADF, PySpark/Python)Date: Saturday, 13/09/2025Mode: F2F Discussion at Hexaware Technologies , Siruseri ,Chennai ,Bring your expertise in:Datawarehousing & ETL (10+ yrs)Azure, ADF, Synapse,...

  • Azure Databricks

    4 days ago


    Mumbai, India Teamware Solutions Full time

    Job Description Key Responsibilities: - Data Pipeline Development: Design, build, and maintain scalable ETL (Extract, Transform, Load) data pipelines using Azure Databricks, Apache Spark, and Python. - Spark Optimization: Develop and optimize Spark jobs for large-scale data processing on Databricks. Ensure that the jobs run efficiently, leveraging the...