Databricks + Pyspark

4 days ago


Hyderabad Telangana, India Cognizant Full time

**Skills
- Databricks+ Pyspark**

**Experience: 4 to 13 years**

**Location: AIA-Pune**

**We are looking for a highly skilled Data Engineer with expertise in PySpark and Databricks to design, build, and optimize scalable data pipelines for processing massive datasets.**

**Key Responsibilities**:

- Build & Optimize Pipelines: Develop high-throughput ETL workflows using PySpark on Databricks.
- Data Architecture & Engineering: Work on distributed computing solutions, optimize Spark jobs, and build efficient data models.
- Performance & Cost Optimization: Fine-tune Spark configurations, optimize Databricks clusters, and reduce compute/storage costs.
- Collaboration: Work closely with Data Scientists, Analysts, and DevOps teams to ensure data reliability.
- ETL & Data Warehousing: Implement scalable ETL processes for structured & unstructured data.
- Monitoring & Automation: Implement logging, monitoring, and alerting mechanisms for data pipeline health and fault tolerance.



  • Hyderabad, Telangana, India Cognizant Full time ₹ 1,00,00,000 - ₹ 3,00,00,000 per year

    Skills- Databricks+ PysparkExperience: 4 to 13 yearsLocation: AIA-PuneWe are looking for a highly skilled Data Engineer with expertise in PySpark and Databricks to design, build, and optimize scalable data pipelines for processing massive datasets.Key Responsibilities:Build & Optimize Pipelines: Develop high-throughput ETL workflows using PySpark on...


  • Hyderabad, Telangana, India Cognizant Technology Solutions Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job SummaryWe are seeking a highly skilled Sr. Developer with 6 to 10 years of experience to join our team. The ideal candidate will have expertise in Databricks SQL Databricks Workflows and PySpark. Experience in the Cards & Payments domain is a plus. This is a hybrid work model with day shifts and no travel required.ResponsibilitiesDevelop and maintain...


  • Hyderabad, Telangana, India Tata Consultancy Services Full time

    TCS Hiring !!! Role: Azure databricks with Pyspark Exp: 4-8 Yr Location: Hyd JD - Total 4to 7 years of IT development experience - Minimum 4 years of experience on data warehouse or ETL platforms(including data mapping, ETL, data load and transformation) - Minimum 2 years of experience working as Azure engineer on AzureCloud platform. - Good hands-on...

  • Databricks Pyspark

    1 week ago


    Hyderabad, India Fusion Plus Solutions Full time

    Job Description - Develop and optimize data processing jobs using PySpark to handle complex data transformations and aggregations efficiently. - Design and implement robust data pipelines on the AWS platform, ensuring scalability and efficiency. - Leverage AWS services such as EC2, S3 for comprehensive data processing and storage solutions. - Manage SQL...


  • Hyderabad, India Fusion Plus Solutions Full time

    Job Description Roles and Responsibilities - 5+ years of experience on IT industry in Data Engineering & Data Analyst role. - 5 years of development experience using tool Databricks and PySpark, Python, SQL - Proficient in writing SQL queries including writing of windows functions - Good communication skills with analytical abilities in doing problem solving...

  • Azure Databricks

    2 days ago


    Hyderabad, Telangana, India Cognizant Full time

    **Skill: Azure Databricks** **Experience**: 4 to 6 years **Location: AIA-Gurgaon** **Job Summary** **Responsibilities** - Develop and maintain scalable data pipelines using Databricks SQL and PySpark to support business analytics and reporting needs. - Collaborate with cross-functional teams to understand data requirements and translate them into...


  • Hyderabad, India Fusion Plus Solutions Full time

    Job Description - Total Yrs. of Experience6+Relevant Yrs. of experience5+Detailed JD (Roles and Responsibilities)5+ years of hands-on Python development experience with excellent programming skills, 3+ years of experience with cloud-based platform, ideally Microsoft Azure, working experience and skills on big data technologies such as PySpark, Databricks,...

  • pyspark

    4 days ago


    Hyderabad, Telangana, India Cognizant Technology Solutions Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job SummaryWe are seeking a Sr. Developer with 8 to 12 years of experience to join our dynamic team. The ideal candidate will have strong expertise in Databricks SQL Databricks Workflows and PySpark. Experience in the Cards & Payments domain is a plus. This hybrid role offers the flexibility of working both remotely and on-site during day shifts. No travel...


  • Hyderabad, India JRD Systems Private Ltd Full time

    Key Responsibilities :- Design, develop, and maintain scalable data pipelines and ETL/ELT processes using PySpark, SQL, and Python.- Build and manage data workflows on Azure Data Lake, Azure Data Factory (ADF), and Databricks.- Collaborate with data scientists, analysts, and other stakeholders to understand data needs and ensure data quality and...


  • Hyderabad, Telangana, India GENPACT Full time

    Ready to shape the future of work At Genpact we don t just adapt to change we drive it AI and digital innovation are redefining industries and we re leading the charge Genpact s our industry-first accelerator is an example of how we re scaling advanced technology solutions to help global enterprises work smarter grow faster and transform at scale From...