Databricks PySpark Developer

1 week ago

Hyderabad Secunderabad Telangana, India beBeePySpark Full time ₹ 1,04,000 - ₹ 1,30,878
  • Job Title: Databricks PySpark Developer
About the Job

We are seeking a skilled Databricks PySpark developer to join our team. The ideal candidate will have extensive experience in developing and optimizing data processing jobs using PySpark, as well as designing and implementing robust data pipelines on the AWS platform.

Key Responsibilities
  • Develop and optimize data processing jobs using PySpark to handle complex transformations and aggregations efficiently
  • Design and implement robust data pipelines on the AWS platform (Databricks exposure is a plus)
  • Utilize AWS services like EC2, S3 for scalable data processing and storage
  • Manage SQL database schema design, query optimization, and performance tuning
  • Design and maintain data warehouses following best practices in data modeling and ETL
  • Use Databricks clusters and Spark jobs to ensure data quality and performance
  • Implement security measures, backup, and disaster recovery using AWS best practices
  • Use GitHub and CI/CD for source code management and deployment
  • Orchestrate data workflows using Apache Airflow
  • Collaborate with data scientists and business analysts for advanced analytics projects
Mandatory Skills
  • Databricks
  • PySpark
What We Offer

We offer a dynamic work environment that fosters collaboration and innovation. Our team is committed to delivering high-quality solutions that meet the needs of our clients.

About Us

We are a leading provider of data analytics solutions. Our team of experts has extensive experience in developing and deploying data processing jobs using PySpark.

  • Pyspark Developer

    2 weeks ago

    Hyderabad, Telangana, India KloudPortal Technology Solutions PVT. LTD Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Job DescriptionJob Summary We are hiring a Senior PySpark Developer with 4-7 years of experience in building and optimising data pipelines using PySpark on Databricks, within AWS cloud environments. This role involves modernising legacy systems, integrating with Kafka, and collaborating across cross-functional teams.Key ResponsibilitiesDevelop and optimise...

  • PySpark Developer

    1 week ago

    Hyderabad, Telangana, India Algoleap Technologies Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    SUMMARY Job SummaryWe are looking for a Senior PySpark Developer with 3 to 6 years of experience in building and optimizing data pipelines using PySpark on Databricks, within AWS cloud environments. This role focuses on the modernization of legacy domains, involving integration with systems like Kafka and collaboration across cross-functional teams.Key...

  • PySpark Developer

    1 day ago

    Hyderabad, India Algoleap Technologies Full time

    SUMMARY Job Summary We are looking for a Senior PySpark Developer with 3 to 6 years of experience in building and optimizing data pipelines using PySpark on Databricks, within AWS cloud environments. This role focuses on the modernization of legacy domains, involving integration with systems like Kafka and collaboration across cross-functional teams. Key...

  • Pyspark Developer

    1 day ago

    Hyderabad, India KloudPortal Technology Solutions PVT. LTD Full time

    Job Description Job SummaryWe are hiring a Senior PySpark Developer with 4-7 years of experience in building and optimising data pipelines using PySpark on Databricks, within AWS cloud environments. This role involves modernising legacy systems, integrating with Kafka, and collaborating across cross-functional teams. Key Responsibilities Develop and optimise...

  • PySpark Developer

    4 days ago

    Hyderabad, Bengaluru, Chennai, India Coders Brain Technology Private Limited Full time

    Job Description ROLE RESPONSIBILITIES Data Engineering and Processing: Develop and manage data pipelines using PySpark on Databricks. Implement ETL/ELT processes to process structured and unstructured data at scale. Optimize data pipelines for performance, scalability, and cost-efficiency in Databricks. Databricks Platform Expertise: Experience in...

  • Databricks

    1 week ago

    Hyderabad, Telangana, India Cognizant Full time

    **Job Summary** **Responsibilities** - Develop and maintain scalable data processing solutions using Spark in Scala to enhance data analytics capabilities. - Implement and manage Delta Sharing to ensure seamless data exchange across platforms. - Administer Databricks Unity Catalog to maintain data governance and security. - Utilize Databricks CLI for...

  • PySpark Developer

    3 weeks ago

    Hyderabad, Bengaluru, Chennai, India Coders Brain Technology Private Limited Full time

    Job DescriptionROLE RESPONSIBILITIESData Engineering and Processing:Develop and manage data pipelines using PySpark on Databricks.Implement ETL/ELT processes to process structured and unstructured data at scale.Optimize data pipelines for performance, scalability, and cost-efficiency in Databricks.Databricks Platform Expertise:Experience in Perform Design,...

  • eSoftLabs - PySpark Developer

    2 weeks ago

    Hyderabad, Telangana, India ENTERPRISE SOFTLABS PRIVATE LINITED Full time

    Job Title : Pyspark DeveloperLocation : HyderabadExperience Required : 4- 8Keywords : AWS, Pyspark, DatabricksSkills and experiences required :- 3- 6 years of hands-on development in PySpark.- Experience with Databricks and performance tuning using Spark UI.- Strong understanding of AWS services, Kafka, and distributed data processing.- Proficient in...

  • eSoftLabs - PySpark Developer

    4 days ago

    Hyderabad, India ENTERPRISE SOFTLABS PRIVATE LINITED Full time

    Job Title : Pyspark DeveloperLocation : HyderabadExperience Required : 4- 8Keywords : AWS, Pyspark, Databricks Skills and experiences required :- 3- 6 years of hands-on development in PySpark.- Experience with Databricks and performance tuning using Spark UI.- Strong understanding of AWS services, Kafka, and distributed data processing.- Proficient in...

  • Databricks Developer

    2 weeks ago

    Hyderabad, Telangana, India Zetamicron Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    Job Title:Databricks DeveloperLocation:Bangalore, Chennai, Hyderabad, PuneExperience:5–7 YearsAbout the RoleWe are seeking an experiencedDatabricks Developerwith 5–7 years of expertise in Big Data engineering and analytics platforms. The ideal candidate will have strong hands-on experience inApache Spark, Databricks, PySpark, and cloud platforms such...