Pyspark + Databricks

12 hours ago

Hyderabad, Telangana, India Cognizant Technology Solutions Full time ₹ 12,00,000 - ₹ 36,00,000 per year

Job Summary

We are seeking a highly skilled Sr. Developer with 6 to 10 years of experience to join our team. The ideal candidate will have expertise in Databricks SQL Databricks Workflows and PySpark. Experience in the Cards & Payments domain is a plus. This is a hybrid work model with day shifts and no travel required.

Responsibilities

  • Develop and maintain scalable data pipelines using Databricks SQL and Databricks Workflows.
  • Implement and optimize PySpark code for data processing and analytics.
  • Collaborate with cross-functional teams to understand data requirements and deliver solutions.
  • Ensure data quality and integrity through rigorous testing and validation.
  • Provide technical guidance and support to junior developers.
  • Monitor and troubleshoot data pipeline performance and resolve issues promptly.
  • Participate in code reviews to maintain high coding standards.
  • Stay updated with the latest industry trends and technologies in data engineering.
  • Contribute to the continuous improvement of development processes and best practices.
  • Document technical specifications and maintain comprehensive project documentation.
  • Work closely with stakeholders to gather requirements and provide timely updates on project progress.
  • Utilize domain knowledge in Cards & Payments to enhance data solutions.
  • Ensure compliance with data security and privacy regulations.

Qualifications

  • Possess strong expertise in Databricks SQL and Databricks Workflows.
  • Demonstrate proficiency in PySpark for data processing and analytics.
  • Have experience in developing and maintaining scalable data pipelines.
  • Show ability to collaborate effectively with cross-functional teams.
  • Exhibit strong problem-solving skills and attention to detail.
  • Have knowledge of data quality and validation techniques.
  • Possess excellent communication and documentation skills.
  • Experience in the Cards & Payments domain is a plus.
  • Familiarity with data security and privacy regulations is desirable.
  • Ability to work in a hybrid work model with day shifts.
  • Minimum of 6 years and maximum of 10 years of relevant experience.
  • Bachelors degree in Computer Science Engineering or a related field is preferred.
  • Strong commitment to continuous learning and professional development.

  • pyspark

    6 hours ago

    Hyderabad, Telangana, India Cognizant Technology Solutions Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job SummaryWe are seeking a Sr. Developer with 8 to 12 years of experience to join our dynamic team. The ideal candidate will have strong expertise in Databricks SQL Databricks Workflows and PySpark. Experience in the Cards & Payments domain is a plus. This hybrid role offers the flexibility of working both remotely and on-site during day shifts. No travel...

  • PySpark Developer

    2 weeks ago

    Hyderabad, Telangana, India algoleap Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Job SummaryWe are looking for a Senior PySpark Developer with 3 to 6 years of experience in building and optimizing data pipelines using PySpark on Databricks, within AWS cloud environments. This role focuses on the modernization of legacy domains, involving integration with systems like Kafka and collaboration across cross-functional teams.Key...

  • PySpark Developer

    6 days ago

    Hyderabad, Telangana, India Algoleap Technologies Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    SUMMARY Job SummaryWe are looking for a Senior PySpark Developer with 3 to 6 years of experience in building and optimizing data pipelines using PySpark on Databricks, within AWS cloud environments. This role focuses on the modernization of legacy domains, involving integration with systems like Kafka and collaboration across cross-functional teams.Key...

  • Pyspark Developer

    1 week ago

    Hyderabad, Telangana, India KloudPortal Technology Solutions PVT. LTD Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Job DescriptionJob Summary We are hiring a Senior PySpark Developer with 4-7 years of experience in building and optimising data pipelines using PySpark on Databricks, within AWS cloud environments. This role involves modernising legacy systems, integrating with Kafka, and collaborating across cross-functional teams.Key ResponsibilitiesDevelop and optimise...

  • Databricks

    6 days ago

    Hyderabad, Telangana, India Cognizant Technology Solutions Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Job SummaryWe are seeking a highly skilled Sr. Developer with 8 to 12 years of experience to join our team. The ideal candidate will have extensive experience in Spark in Scala Delta Sharing Databricks Unity Catalog Admin Databricks CLI Delta Live Pipelines Structured Streaming Risk Management Apache Airflow Amazon S3 Amazon Redshift Python Databricks SQL...

  • Azure + Databricks + Pyspark + ADF + SQL + Production support

    1 week ago

    Hyderabad, Telangana, India Tech Mahindra Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Job Summary5 8 years proven experience as a data engineer with a focus on Azure data services. · Hands on experience with Azure Data Factory, Azure Synapse Analytics, Azure Databricks, PySpark, and SQL. · Should have experience on Databricks services like Unity Catalog and should be able to demonstrate the expertise on spark optimization are mandatory,...

  • Databricks+spark

    5 hours ago

    Hyderabad, Telangana, India Cognizant Technology Solutions Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job SummaryWe are seeking a highly skilled Sr. Developer with 8 to 12 years of experience to join our team in a hybrid work model. The ideal candidate will have expertise in Databricks SQL Databricks Delta Lake Databricks Workflows and PySpark. Experience in Sales & Marketing domains is a plus. The role involves developing and optimizing data solutions to...

  • Databricks Developer

    1 week ago

    Hyderabad, Telangana, India Zetamicron Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    Job Title:Databricks DeveloperLocation:Bangalore, Chennai, Hyderabad, PuneExperience:5–7 YearsAbout the RoleWe are seeking an experiencedDatabricks Developerwith 5–7 years of expertise in Big Data engineering and analytics platforms. The ideal candidate will have strong hands-on experience inApache Spark, Databricks, PySpark, and cloud platforms such...

  • Digital: Databricks

    1 week ago

    Hyderabad, Telangana, India Tata Consultancy Services Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Experience: 3-9yearsLocation: HyderabadRequired Technical Skill Set:Spark-SQL, Pyspark, Pandas,DevOps, CI/CD ,as SQL server, Oracle3+ years experienced data engineer with sound ADF, Databricks and Pyspark knowledge and able to interact independently with customer technical team/leadsResponsibilities:Assure that data is cleansed, mapped, transformed, and...

  • Databricks Engineer

    1 week ago

    Hyderabad, Telangana, India Oblytech Full time US$ 90,000 - US$ 1,20,000 per year

    Job Title:Databricks Engineer (PySpark Developer)Employment Type:Full-Time | Permanent | Remote (Work From Home)Industry:IT Services & Consulting | Software Development | Data Engineering | Cloud ServicesFunctional Area:Data Engineering | Big Data | Cloud Platforms | AnalyticsAbout Oblytech:Oblytech is a fast-growing IT consulting and software services firm,...