Azure Databricks, Pyspark

3 weeks ago


Mumbai, Maharashtra, India Tata Consultancy Services Full time

About the Company

Tata consultancy services is committed to delivering innovative solutions and fostering a culture of excellence.

About the Role

The role requires a professional with 5+ years of relevant experience in Pyspark and Azure Databricks, focusing on data integration and transformation.

Responsibilities

  • 5+ years of relevant experience in Pyspark and Azure Databricks.
  • Proficiency in integrating, transforming and consolidating data from various structured and unstructured data sources.
  • Good experience in SQL or native SQL query languages.
  • Strong experience in implementing Databricks notebooks using Python.
  • Good experience in Azure Data Factory, ADLS, Storage Services, Synapse, Serverless architecture, Azure functions.
  • Experience in Azure DevOps and CI/CD deployments

Qualifications

  • Exp : 5 to 8 Years
  • Location : Mumbai, Bhubaneswar
  • Notice period : 30 days

Required Skills

  • Pyspark
  • Azure Databricks
  • SQL
  • Python
  • Azure Data Factory

Preferred Skills

  • Experience with ADLS
  • Familiarity with Storage Services
  • Knowledge of Synapse
  • Understanding of Serverless architecture
  • Experience with Azure functions

Equal Opportunity Statement

Tata consultancy services is an equal opportunity employer and is committed to fostering a diverse and inclusive workplace.


  • Databricks

    3 days ago


    Mumbai, Maharashtra, India Talent Worx Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Every day, your work will make an impact that matters, while you thrive in a dynamic culture of inclusion, collaboration, and high performance. As the undisputed leader in professional services, Our Client is where you will find unrivaled opportunities to succeed and realize your full potential.We are seeking highly skilled Databricks Data Engineers to join...

  • Azure Engieering

    4 days ago


    Mumbai, Maharashtra, India LTIMindtree Full time

    Key SkillsAzure Data Engineer who has hands on Experience in Azure Data Factory Pyspark, Azure devops, Azure delta lake,Job Description:Utilizes software engineering principles to deploy and maintain fully automated data transformation pipelines that combine a large variety of storage and computation technologies to handle a distribution of data types and...


  • Mumbai, Maharashtra, India beBeeDataEngineering Full time ₹ 20,00,000 - ₹ 25,00,000

    Job SummaryWe are seeking a seasoned Data Engineer to lead the development of end-to-end data pipelines and deliver scalable data solutions on Azure.The ideal candidate will have strong expertise in PySpark, SQL, and Azure services such as Azure Data Factory (ADF), Databricks (ADB), and Data Lake (ADLS Gen2).They will be responsible for designing,...

  • Azure Engieering

    4 weeks ago


    Mumbai, Maharashtra, India LTIMindtree Full time

    Key SkillsAzure Data Engineer who has hands on Experience in Azure Data Factory Pyspark, Azure devops, Azure delta lake,Job Description:Utilizes software engineering principles to deploy and maintain fully automated data transformation pipelines that combine a large variety of storage and computation technologies to handle a distribution of data types and...

  • Azure Engieering

    2 weeks ago


    Mumbai, Maharashtra, India LTIMindtree Full time

    Key Skills Azure Data Engineer who has hands on Experience in Azure Data Factory Pyspark, Azure devops, Azure delta lake, Job Description: Utilizes software engineering principles to deploy and maintain fully automated data transformation pipelines that combine a large variety of storage and computation technologies to handle a distribution of data types...

  • Senior Data Engineer

    6 hours ago


    Mumbai, Maharashtra, India beBeeData Full time US$ 1,04,000 - US$ 1,30,878

    Job Title: Azure Databricks LeadAs a senior data engineer, you will play a crucial role in designing and developing scalable data pipelines using Azure Databricks and PySpark/Scala.Our ideal candidate has experience architecting and building data platforms on Azure and is proficient in Azure Databricks, PySpark, and SQL. You will work closely with data...


  • Mumbai, Maharashtra, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Contract Role: High-Performance Databricks DeveloperAbout the PositionWe are seeking an experienced Databricks developer to join our team on a short-term contract basis. As a key member of our engineering team, you will be responsible for designing and implementing high-performance data pipelines using Azure Data Factory.Key Responsibilities:Design and...


  • Mumbai, Maharashtra, India beBeeMachineLearning Full time

    We are seeking a talented professional to join our team as a Machine Learning Engineer. The ideal candidate will have hands-on experience with designing, building, and deploying scalable machine learning solutions within the Microsoft Azure ecosystem.Key Responsibilities:Machine Learning Solution Development: Design, develop, and implement end-to-end machine...

  • Azure data engineer

    2 weeks ago


    Mumbai, Maharashtra, India M&G plc Full time ₹ 6,00,000 - ₹ 12,00,000 per year

    We are M&G Global Services Private Limited (formerly known as 10FA India Private Limited, and prior to that Prudential Global Services Private Limited). We are a fully owned subsidiary of the M&G plc group of companies, operating as a Global Capability Centre providing a range of value adding services to the Group since 2003. At M&G our purpose is to give...


  • Mumbai, Maharashtra, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Title: Azure Data EngineerLocation: Remote. A career opportunity has arisen for an experienced data professional to join our team.Notice Period: Immediate Joiners Only. We are seeking a highly skilled and motivated individual to fill this role.Experience: 4–6 Years.Job OverviewWe are looking for a talented Azure Data Engineer to work in a hybrid...