Databricks + Pyspark

5 days ago

Bhubaneswar Orissa, India Cognizant Full time

**Job Summary**

**Responsibilities**
- Develop and implement robust data solutions using Delta Live Pipelines to enhance data processing capabilities.
- Collaborate with cross-functional teams to design and optimize Databricks SQL queries for improved performance.
- Utilize Python to automate data workflows and streamline processes ensuring high-quality data management.
- Oversee the deployment and maintenance of Databricks Workflows to support seamless data integration.
- Leverage PySpark to process large datasets efficiently contributing to data-driven decision-making.
- Ensure data accuracy and integrity by implementing best practices in data engineering and management.
- Provide technical guidance and support to junior developers fostering a collaborative team environment.
- Conduct regular code reviews to maintain high standards of code quality and performance.
- Identify and resolve technical issues promptly to minimize disruptions in data operations.
- Stay updated with the latest industry trends and technologies to continuously improve data solutions.
- Document processes and solutions to facilitate knowledge sharing and team collaboration.
- Engage in continuous learning to enhance skills and contribute to innovative solutions.
- Drive the implementation of data solutions that align with the companys strategic goals and societal impact.

**Qualifications**
- Possess a strong background in Delta Live Pipelines and Databricks SQL with proven experience in data engineering.
- Demonstrate proficiency in Python and PySpark with a focus on developing scalable data solutions.
- Experience in designing and optimizing Databricks Workflows for efficient data integration.
- Strong problem-solving skills and the ability to troubleshoot complex data issues effectively.
- Excellent communication skills to collaborate with team members and stakeholders.
- A proactive approach to learning and adapting to new technologies and methodologies.
- A bachelors degree in Computer Science Information Technology or a related field is preferred.

**Certifications Required**

Databricks Certified Data Engineer Associate Python Certification

  • Databricks + Pyspark

    4 days ago

    Bhubaneswar, Orissa, India Cognizant Technology Solutions Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    Job SummaryWe are seeking a highly skilled Sr. Developer with 6 to 9 years of experience to join our dynamic team. The ideal candidate will have expertise in Delta Live Pipelines Python Databricks SQL Databricks Workflows and PySpark. This hybrid role involves working on cutting-edge projects that drive innovation and efficiency. The position is based on a...

  • Azure Databricks + Pyspark

    1 week ago

    Bhubaneswar, Orissa, India Cognizant Full time

    **Job Summary** **Responsibilities** - Analyze complex data sets to identify trends and patterns that can inform business decisions. - Develop and maintain data pipelines using Azure Data Factory to ensure seamless data integration. - Utilize PySpark and Python to perform data transformations and analytics. - Implement and manage workflows using BMC...

  • Azure data Engineer

    1 week ago

    Bhubaneswar, India Tata Consultancy Services Full time

    Role: Azure data EngineerExperience: 4Location: BhubaneswarMust-Have4+ years of hands-on experience in development.Azure – cloud technology – Function Apps, API, Azure DevOps, Databricks, Data Factory, SynapseStrong knowledge Incident, problem, Change management, service management, service request.Must have hands on experience code versioning tool ...

  • Azure data engineer

    2 weeks ago

    Bhubaneswar, India Tata Consultancy Services Full time

    Role: Azure data EngineerExperience: 4Location: BhubaneswarMust-Have4+ years of hands-on experience in development.Azure – cloud technology – Function Apps, API, Azure Dev Ops, Databricks, Data Factory, SynapseStrong knowledge Incident, problem, Change management, service management, service request.Must have hands on experience code versioning tool...

  • Azure data engineer

    1 week ago

    Bhubaneswar, India Tata Consultancy Services Full time

    Role: Azure data EngineerExperience: 4Location: BhubaneswarMust-Have4+ years of hands-on experience in development.Azure – cloud technology – Function Apps, API, Azure Dev Ops, Databricks, Data Factory, SynapseStrong knowledge Incident, problem, Change management, service management, service request.Must have hands on experience code versioning tool...

  • Azure data Engineer

    4 weeks ago

    Bhubaneswar, India Tata Consultancy Services Full time

    Role: Azure data EngineerExperience: 4Location: BhubaneswarMust-Have- 4+ years of hands-on experience in development.- Azure – cloud technology – Function Apps, API, Azure DevOps, Databricks, Data Factory, Synapse- Strong knowledge Incident, problem, Change management, service management, service request.- Must have hands on experience code versioning...

  • Azure data Engineer

    6 days ago

    Bhubaneswar, India Tata Consultancy Services Full time

    Role: Azure data EngineerExperience: 4Location: BhubaneswarMust-Have- 4+ years of hands-on experience in development.- Azure – cloud technology – Function Apps, API, Azure DevOps, Databricks, Data Factory, Synapse- Strong knowledge Incident, problem, Change management, service management, service request.- Must have hands on experience code versioning...

  • Azure data Engineer

    5 days ago

    Bhubaneswar, India Tata Consultancy Services Full time

    Role: Azure data Engineer Experience: 4 Location: Bhubaneswar Must-Have 4+ years of hands-on experience in development. Azure – cloud technology – Function Apps, API, Azure DevOps, Databricks, Data Factory, Synapse Strong knowledge Incident, problem, Change management, service management, service request. Must have hands on experience code versioning...

  • Azure data Engineer

    4 weeks ago

    Bhubaneswar, India Tata Consultancy Services Full time

    Role: Azure data EngineerExperience: 4Location: BhubaneswarMust-Have4+ years of hands-on experience in development.Azure – cloud technology – Function Apps, API, Azure DevOps, Databricks, Data Factory, SynapseStrong knowledge Incident, problem, Change management, service management, service request.Must have hands on experience code versioning tool ...

  • Azure data Engineer

    2 weeks ago

    Bhubaneswar, Odisha, India, IN Tata Consultancy Services Full time

    Role: Azure data EngineerExperience: 4Location: BhubaneswarMust-Have4+ years of hands-on experience in development.Azure – cloud technology – Function Apps, API, Azure DevOps, Databricks, Data Factory, SynapseStrong knowledge Incident, problem, Change management, service management, service request.Must have hands on experience code versioning tool...