Pyspark + Databricks

19 hours ago

Hyderabad Telangana, India Cognizant Full time

**Job Summary**

**Responsibilities**
- Develop and maintain scalable data pipelines using Databricks SQL and Databricks Workflows.
- Implement and optimize PySpark code for data processing and analytics.
- Collaborate with cross-functional teams to understand data requirements and deliver solutions.
- Ensure data quality and integrity through rigorous testing and validation.
- Provide technical guidance and support to junior developers.
- Monitor and troubleshoot data pipeline performance and resolve issues promptly.
- Participate in code reviews to maintain high coding standards.
- Stay updated with the latest industry trends and technologies in data engineering.
- Contribute to the continuous improvement of development processes and best practices.
- Document technical specifications and maintain comprehensive project documentation.
- Work closely with stakeholders to gather requirements and provide timely updates on project progress.
- Utilize domain knowledge in Cards & Payments to enhance data solutions.
- Ensure compliance with data security and privacy regulations.

**Qualifications**
- Possess strong expertise in Databricks SQL and Databricks Workflows.
- Demonstrate proficiency in PySpark for data processing and analytics.
- Have experience in developing and maintaining scalable data pipelines.
- Show ability to collaborate effectively with cross-functional teams.
- Exhibit strong problem-solving skills and attention to detail.
- Have knowledge of data quality and validation techniques.
- Possess excellent communication and documentation skills.
- Experience in the Cards & Payments domain is a plus.
- Familiarity with data security and privacy regulations is desirable.
- Ability to work in a hybrid work model with day shifts.
- Minimum of 6 years and maximum of 10 years of relevant experience.
- Bachelors degree in Computer Science Engineering or a related field is preferred.
- Strong commitment to continuous learning and professional development.

  • Pyspark + Databricks

    2 days ago

    Hyderabad, Telangana, India Cognizant Technology Solutions Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job SummaryWe are seeking a highly skilled Sr. Developer with 6 to 10 years of experience to join our team. The ideal candidate will have expertise in Databricks SQL Databricks Workflows and PySpark. Experience in the Cards & Payments domain is a plus. This is a hybrid work model with day shifts and no travel required.ResponsibilitiesDevelop and maintain...

  • ML Engineer

    7 days ago

    Hyderabad, India Tiger Analytics Full time

    Job Description ML Engineer (Databricks + PySpark) Locations: Chennai / Hyderabad / Bangalore Tiger Analytics is a global leader in AI and analytics, helping Fortune companies solve their toughest challenges. We are on a mission to push the boundaries of what AI and analytics can do to help enterprises navigate uncertainty and move forward...

  • Databricks+spark

    3 days ago

    Hyderabad, Telangana, India Cognizant Full time

    **Job Summary** **Responsibilities** - Develop and maintain scalable data pipelines using Databricks SQL and PySpark to support business analytics needs. - Optimize data workflows and processes within Databricks Delta Lake to ensure data integrity and performance. - Collaborate with cross-functional teams to understand data requirements and translate them...

  • pyspark

    2 days ago

    Hyderabad, Telangana, India Cognizant Technology Solutions Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job SummaryWe are seeking a Sr. Developer with 8 to 12 years of experience to join our dynamic team. The ideal candidate will have strong expertise in Databricks SQL Databricks Workflows and PySpark. Experience in the Cards & Payments domain is a plus. This hybrid role offers the flexibility of working both remotely and on-site during day shifts. No travel...

  • Consultant- Databricks

    1 day ago

    Hyderabad, Telangana, India GENPACT Full time

    Ready to shape the future of work At Genpact we don t just adapt to change we drive it AI and digital innovation are redefining industries and we re leading the charge Genpact s our industry-first accelerator is an example of how we re scaling advanced technology solutions to help global enterprises work smarter grow faster and transform at scale From...

  • Pyspark Developer

    3 weeks ago

    Hyderabad, India KloudPortal Technology Solutions PVT. LTD Full time

    Job Description Job SummaryWe are hiring a Senior PySpark Developer with 4-7 years of experience in building and optimising data pipelines using PySpark on Databricks, within AWS cloud environments. This role involves modernising legacy systems, integrating with Kafka, and collaborating across cross-functional teams. Key Responsibilities Develop and optimise...

  • PySpark Developer

    3 weeks ago

    Hyderabad, India Algoleap Technologies Full time

    SUMMARY Job Summary We are looking for a Senior PySpark Developer with 3 to 6 years of experience in building and optimizing data pipelines using PySpark on Databricks, within AWS cloud environments. This role focuses on the modernization of legacy domains, involving integration with systems like Kafka and collaboration across cross-functional teams. Key...

  • Pyspark Developer

    1 week ago

    Hyderabad, Telangana, India KloudPortal Technology Solutions PVT. LTD Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Job DescriptionJob Summary We are hiring a Senior PySpark Developer with 4-7 years of experience in building and optimising data pipelines using PySpark on Databricks, within AWS cloud environments. This role involves modernising legacy systems, integrating with Kafka, and collaborating across cross-functional teams.Key ResponsibilitiesDevelop and optimise...

  • PySpark Developer

    1 week ago

    Hyderabad, Telangana, India Algoleap Technologies Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    SUMMARY Job SummaryWe are looking for a Senior PySpark Developer with 3 to 6 years of experience in building and optimizing data pipelines using PySpark on Databricks, within AWS cloud environments. This role focuses on the modernization of legacy domains, involving integration with systems like Kafka and collaboration across cross-functional teams.Key...

  • PySpark Developer

    3 weeks ago

    Hyderabad, Bengaluru, Chennai, India Coders Brain Technology Private Limited Full time

    Job Description ROLE RESPONSIBILITIES Data Engineering and Processing: Develop and manage data pipelines using PySpark on Databricks. Implement ETL/ELT processes to process structured and unstructured data at scale. Optimize data pipelines for performance, scalability, and cost-efficiency in Databricks. Databricks Platform Expertise: Experience in...