Pyspark + Databricks

4 days ago

Hyderabad, Telangana, India Cognizant Technology Solutions Full time ₹ 12,00,000 - ₹ 36,00,000 per year

Job Summary

We are seeking a highly skilled Sr. Developer with 6 to 10 years of experience to join our team. The ideal candidate will have expertise in Databricks SQL Databricks Workflows and PySpark. Experience in the Cards & Payments domain is a plus. This is a hybrid work model with day shifts and no travel required.

Responsibilities

  • Develop and maintain scalable data pipelines using Databricks SQL and Databricks Workflows.
  • Implement and optimize PySpark code for data processing and analytics.
  • Collaborate with cross-functional teams to understand data requirements and deliver solutions.
  • Ensure data quality and integrity through rigorous testing and validation.
  • Provide technical guidance and support to junior developers.
  • Monitor and troubleshoot data pipeline performance and resolve issues promptly.
  • Participate in code reviews to maintain high coding standards.
  • Stay updated with the latest industry trends and technologies in data engineering.
  • Contribute to the continuous improvement of development processes and best practices.
  • Document technical specifications and maintain comprehensive project documentation.
  • Work closely with stakeholders to gather requirements and provide timely updates on project progress.
  • Utilize domain knowledge in Cards & Payments to enhance data solutions.
  • Ensure compliance with data security and privacy regulations.

Qualifications

  • Possess strong expertise in Databricks SQL and Databricks Workflows.
  • Demonstrate proficiency in PySpark for data processing and analytics.
  • Have experience in developing and maintaining scalable data pipelines.
  • Show ability to collaborate effectively with cross-functional teams.
  • Exhibit strong problem-solving skills and attention to detail.
  • Have knowledge of data quality and validation techniques.
  • Possess excellent communication and documentation skills.
  • Experience in the Cards & Payments domain is a plus.
  • Familiarity with data security and privacy regulations is desirable.
  • Ability to work in a hybrid work model with day shifts.
  • Minimum of 6 years and maximum of 10 years of relevant experience.
  • Bachelors degree in Computer Science Engineering or a related field is preferred.
  • Strong commitment to continuous learning and professional development.

  • Databricks + Pyspark

    3 days ago

    Hyderabad, Telangana, India Cognizant Full time ₹ 1,00,00,000 - ₹ 3,00,00,000 per year

    Skills- Databricks+ PysparkExperience: 4 to 13 yearsLocation: AIA-PuneWe are looking for a highly skilled Data Engineer with expertise in PySpark and Databricks to design, build, and optimize scalable data pipelines for processing massive datasets.Key Responsibilities:Build & Optimize Pipelines: Develop high-throughput ETL workflows using PySpark on...

  • pyspark

    3 days ago

    Hyderabad, Telangana, India Cognizant Technology Solutions Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job SummaryWe are seeking a Sr. Developer with 8 to 12 years of experience to join our dynamic team. The ideal candidate will have strong expertise in Databricks SQL Databricks Workflows and PySpark. Experience in the Cards & Payments domain is a plus. This hybrid role offers the flexibility of working both remotely and on-site during day shifts. No travel...

  • Pyspark Developer

    2 weeks ago

    Hyderabad, Telangana, India NTT DATA Business Solutions Full time ₹ 8,00,000 - ₹ 12,00,000 per year

    Job SummaryWe are looking for a Senior PySpark Developer with 3 to 6 years of experience in building and optimizing data pipelines using PySpark on Databricks, within AWS cloud environments. This role focuses on the modernization of legacy domains, involving integration with systems like Kafka and collaboration across cross-functional teams.Key...

  • Databricks+spark

    3 days ago

    Hyderabad, Telangana, India Cognizant Technology Solutions Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job SummaryWe are seeking a highly skilled Sr. Developer with 8 to 12 years of experience to join our team in a hybrid work model. The ideal candidate will have expertise in Databricks SQL Databricks Delta Lake Databricks Workflows and PySpark. Experience in Sales & Marketing domains is a plus. The role involves developing and optimizing data solutions to...

  • Databricks Engineer

    2 days ago

    Hyderabad, Telangana, India NTT DATA Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Design, build, and maintain robust ETL/ELT data pipelines using Apache Spark on Databricks. Implement data Lakehouse architecture using Delta Lake for cost-effective data storage and analytics. Use Databricks Workflows for orchestrating batch and streaming pipelines. Develop and maintain CI/CD pipelines for data applications using tools such as Azure DevOps,...

  • Azure Databricks Engineer

    2 weeks ago

    Hyderabad, Telangana, India Tekskills Inc. Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Job Role: Azure Databricks EngineerJob Location: Pune, MH / Chennai, TN / Hyderabad. TG / Indore, MP / Kolkata, WB / Bangalore, TNWork Mode: (WFO)Skills Required: Digital: DatabricksExperience: 6-8 Years(5+ yrs)Job Description:Should build Databricks Notebook developed in spark sql/pysparkShould be able to create unity catalog tablesShould have good hands on...

  • Databricks with Python

    3 days ago

    Hyderabad, Telangana, India Tata Consultancy Services Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Role - Databricks with PythonExp - 5 to 9 YrsLocation - HyderabadNote - This is a scheduled drive. Only eligible candidates who receive invite from us will be allowed inside Campus.Job DescriptionExtensive expertise in designing and implementing data load processes using Azure Data Factory, Azure Databricks, Delta Lake, Azure Delta Lake Storage and...

  • Databricks with Python

    2 weeks ago

    Hyderabad, Telangana, India Tata Consultancy Services Full time ₹ 1,00,00,000 - ₹ 2,00,00,000 per year

    Role:Databricks with PythonExperience range: 5-8 yearsLocation: HyderabadNOTE: Relevant Databricks experience must be 5 years and only apply if interested for WALK-IN Drive in HyderabadJob description:Must Have:Extensive expertise in designing and implementing data load processes using Azure Data Factory, Azure Databricks, Delta Lake, Azure Delta Lake...

  • DataBricks-BigData Development – Lead Programmer Analyst

    2 weeks ago

    Hyderabad, Telangana, India Bilvantis Technologies Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Job Description: DataBricks-BigData Development – Lead Programmer Analyst (Exp: 5 Years to 7 Years)We are looking for a highly skilled and experienced DataBricks-BigData Development skilled as a Lead Programmer Analyst.Experience should have 5 Years to 7 Years into BigData, DataBricks, Python & PySpark development.Experience in data engineering with strong...

  • Python And PySpark Developer

    2 days ago

    Hyderabad, Telangana, India Nisum Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    Company DescriptionNisum is a global consulting partner specializing in digital commerce and evolution, offering AI-powered platforms and tailor-made solutions to unlock growth, optimize operations, and create long-term value. With over 25 years of proven experience, Nisum has a consistent track record of delivering complex digital transformations for...