Azure Databricks + Pyspark

1 week ago

Bhubaneswar Orissa, India Cognizant Full time

**Job Summary**

**Responsibilities**
- Analyze complex data sets to identify trends and patterns that can inform business decisions.
- Develop and maintain data pipelines using Azure Data Factory to ensure seamless data integration.
- Utilize PySpark and Python to perform data transformations and analytics.
- Implement and manage workflows using BMC Control-M WA to ensure timely data processing.
- Collaborate with cross-functional teams to understand data requirements and deliver actionable insights.
- Create and maintain data models in Azure Databricks to support advanced analytics.
- Ensure data quality and integrity by performing regular audits and validations.
- Design and implement ETL processes to extract transform and load data into Azure Data Lake Store.
- Provide technical support and troubleshooting for data-related issues.
- Develop and maintain documentation for data processes and workflows.
- Monitor and optimize data pipelines for performance and efficiency.
- Stay updated with the latest industry trends and technologies to continuously improve data analytics capabilities.
- Communicate findings and insights to stakeholders through reports and presentations.

**Qualifications**
- Possess a Bachelors degree in Computer Science Information Technology or a related field.
- Demonstrate proficiency in BMC Control-M WA PySpark and Python.
- Have hands-on experience with Azure Databricks Azure Data Lake Store and Azure Data Factory ETL.
- Show strong analytical and problem-solving skills.
- Exhibit excellent communication and collaboration abilities.
- Display a proactive and self-motivated attitude.
- Have a solid understanding of data modeling and data warehousing concepts.
- Be familiar with data governance and data quality best practices.
- Show experience in developing and maintaining data pipelines.
- Demonstrate the ability to work in a hybrid work model.
- Have a minimum of 4 years and a maximum of 6 years of relevant experience.
- Be able to work effectively during the day shift.
- Show no requirement for travel.

**Certifications Required**
- Certified Data Management Professional (CDMP) Microsoft Certified: Azure Data Engineer Associate

  • Databricks + Pyspark

    4 days ago

    Bhubaneswar, Orissa, India Cognizant Technology Solutions Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    Job SummaryWe are seeking a highly skilled Sr. Developer with 6 to 9 years of experience to join our dynamic team. The ideal candidate will have expertise in Delta Live Pipelines Python Databricks SQL Databricks Workflows and PySpark. This hybrid role involves working on cutting-edge projects that drive innovation and efficiency. The position is based on a...

  • Databricks + Pyspark

    4 days ago

    Bhubaneswar, Orissa, India Cognizant Full time

    **Job Summary** **Responsibilities** - Develop and implement robust data solutions using Delta Live Pipelines to enhance data processing capabilities. - Collaborate with cross-functional teams to design and optimize Databricks SQL queries for improved performance. - Utilize Python to automate data workflows and streamline processes ensuring high-quality...

  • Azure data Engineer

    4 weeks ago

    Bhubaneswar, India Tata Consultancy Services Full time

    Role: Azure data EngineerExperience: 4Location: BhubaneswarMust-Have- 4+ years of hands-on experience in development.- Azure – cloud technology – Function Apps, API, Azure DevOps, Databricks, Data Factory, Synapse- Strong knowledge Incident, problem, Change management, service management, service request.- Must have hands on experience code versioning...

  • Azure data Engineer

    6 days ago

    Bhubaneswar, India Tata Consultancy Services Full time

    Role: Azure data EngineerExperience: 4Location: BhubaneswarMust-Have- 4+ years of hands-on experience in development.- Azure – cloud technology – Function Apps, API, Azure DevOps, Databricks, Data Factory, Synapse- Strong knowledge Incident, problem, Change management, service management, service request.- Must have hands on experience code versioning...

  • Azure data Engineer

    5 days ago

    Bhubaneswar, India Tata Consultancy Services Full time

    Role: Azure data Engineer Experience: 4 Location: Bhubaneswar Must-Have 4+ years of hands-on experience in development. Azure – cloud technology – Function Apps, API, Azure DevOps, Databricks, Data Factory, Synapse Strong knowledge Incident, problem, Change management, service management, service request. Must have hands on experience code versioning...

  • Azure data Engineer

    7 days ago

    Bhubaneswar, India Tata Consultancy Services Full time

    Role: Azure data EngineerExperience: 4Location: BhubaneswarMust-Have4+ years of hands-on experience in development.Azure – cloud technology – Function Apps, API, Azure DevOps, Databricks, Data Factory, SynapseStrong knowledge Incident, problem, Change management, service management, service request.Must have hands on experience code versioning tool ...

  • Azure data engineer

    2 weeks ago

    Bhubaneswar, India Tata Consultancy Services Full time

    Role: Azure data EngineerExperience: 4Location: BhubaneswarMust-Have4+ years of hands-on experience in development.Azure – cloud technology – Function Apps, API, Azure Dev Ops, Databricks, Data Factory, SynapseStrong knowledge Incident, problem, Change management, service management, service request.Must have hands on experience code versioning tool...

  • Azure data engineer

    1 week ago

    Bhubaneswar, India Tata Consultancy Services Full time

    Role: Azure data EngineerExperience: 4Location: BhubaneswarMust-Have4+ years of hands-on experience in development.Azure – cloud technology – Function Apps, API, Azure Dev Ops, Databricks, Data Factory, SynapseStrong knowledge Incident, problem, Change management, service management, service request.Must have hands on experience code versioning tool...

  • Azure data Engineer

    4 weeks ago

    Bhubaneswar, India Tata Consultancy Services Full time

    Role: Azure data EngineerExperience: 4Location: BhubaneswarMust-Have4+ years of hands-on experience in development.Azure – cloud technology – Function Apps, API, Azure DevOps, Databricks, Data Factory, SynapseStrong knowledge Incident, problem, Change management, service management, service request.Must have hands on experience code versioning tool ...

  • Azure data Engineer

    2 weeks ago

    Bhubaneswar, Odisha, India, IN Tata Consultancy Services Full time

    Role: Azure data EngineerExperience: 4Location: BhubaneswarMust-Have4+ years of hands-on experience in development.Azure – cloud technology – Function Apps, API, Azure DevOps, Databricks, Data Factory, SynapseStrong knowledge Incident, problem, Change management, service management, service request.Must have hands on experience code versioning tool...