Databricks Pyspark Developer

6 days ago


Bengaluru, Karnataka, India Nous Infosystems Full time
Data Engineer - Databricks/Pyspark Position

We are seeking an experienced Data Engineer with expertise in Databricks & Pyspark to join our team.

  • Develop ETL Pipelines: Utilize Databricks on cloud platforms (AWS, Azure, or GCP) to create, optimize, and maintain efficient ETL pipelines.
  • Implement Workflows and Jobs: Automate data processing and transformations using Databricks Workflows and Jobs.
  • Leverage Databricks SQL and Delta Live Tables: Create real-time and batch data processing pipelines using Databricks SQL and Delta Live Tables.
Key Responsibilities:
  1. Optimize Apache Spark jobs for performance and cost efficiency within Databricks.
  2. Work extensively with Databricks Delta Lake to enable data versioning, ACID transactions, and schema evolution.
  3. Develop and manage Unity Catalog for improved data governance and access control.
  4. Monitor and troubleshoot Databricks clusters, jobs, and notebooks to ensure high availability and reliability.


  • Bengaluru, Karnataka, India Nous Infosystems Full time

    Nous Infosystems is a leading provider of software solutions and IT-enabled support services. We are looking for a highly skilled Data Engineer to join our team and contribute to the development of cloud-based data solutions.Responsibilities:Design and implement efficient ETL pipelines using Databricks on cloud platforms.Develop and maintain complex data...


  • Bengaluru, Karnataka, India ARA Resources Full time

    About The Company ARA s client is a leading IT solutions provider offering Applications Business Process Outsourcing BPO and Infrastructure services globally through a combination of technology knowhow domain and process expertise Over the years we have left an indelible impression in the IT solutions domain with an impressive clientele and an...


  • Bengaluru, Karnataka, India Databricks Full time

    About UsDatabricks is the data and AI company, empowering organizations to unify and democratize data, analytics, and AI. With over 10,000 customers worldwide, including top brands like Comcast, Cond Nast, and Grammarly, we help businesses make informed decisions with deep data insights.Job OverviewWe are seeking a highly skilled Staff Backend Developer to...


  • Bengaluru, Karnataka, India Hexaware Technologies Full time

    Job OpportunityHexaware Technologies is currently conducting a drive for Azure Databricks. If you have the required skills and experience, we encourage you to apply.About the RoleWe are looking for highly skilled individuals with expertise in Azure Databricks, PySpark, and SQL. The ideal candidate should have a minimum of 4 years of relevant experience and...


  • Bengaluru, Karnataka, India Hexaware Technologies Full time

    About the Role:Hexaware Technologies is seeking a skilled Azure Databricks developer to join our team. As a cloud data engineer, you will be responsible for designing and implementing data processing solutions using Azure Databricks.Key Responsibilities:Designing and developing scalable data processing pipelines using Azure DatabricksWorking with big data...


  • Bengaluru, Karnataka, India Hexaware Technologies Full time

    About the RoleAzure Databricks Developer Position Overview:We require a skilled Azure Databricks developer to create innovative data engineering solutions. The selected candidate will design, implement, and deploy comprehensive data processing systems utilizing Azure Databricks. This involves crafting efficient Pyspark code and refining data pipelines to...


  • Bengaluru, Karnataka, India Tata Consultancy Services Full time

    Job Title: Databricks Developer with Python We are seeking a seasoned Databricks developer with expertise in designing and implementing data load processes using Azure Data Factory, Azure Databricks, Delta Lake, and Python/PySpark. Key Responsibilities: Design and implement data load processes using Azure Data Factory and Azure Databricks Develop...


  • Bengaluru, Karnataka, India Genpact Full time

    Genpact (NYSE: G) is a global professional services and solutions firm delivering outcomes that shape the future. Our 125,000+ people across 30+ countries are driven by our innate curiosity, entrepreneurial agility, and desire to create lasting value for clients. Powered by our purpose – the relentless pursuit of a world that works better for people –...

  • Databricks Engineer

    3 weeks ago


    Bengaluru, Karnataka, India Infogain Pte Ltd Full time

    Job DescriptionRole & responsibilities- Experience with Databricks, PySpark, and handling large volume of data- Strong experience in data migration, ETL, and data integration processes.- Proficient in Python, SQL, Pyspark and Scala (knowledge of Java is a plus).- Knowledge of data warehousing and data lakes concepts.- Familiarity with CI/CD processes for...


  • Bengaluru, Karnataka, India Genpact Full time

    Genpact (NYSE: G) is a global professional services and solutions firm delivering outcomes that shape the future. Our 125,000+ people across 30+ countries are driven by our innate curiosity, entrepreneurial agility, and desire to create lasting value for clients. Powered by our purpose – the relentless pursuit of a world that works better for people –...


  • Bengaluru, Karnataka, India Tata Consultancy Services Full time

    Job Summary: We are seeking a highly experienced Azure Databricks Engineer with 10-15 years of experience in ADF/Databricks development. The ideal candidate will have excellent data modeling understanding and strong communication skills. The successful candidate will be responsible for designing and building data pipelines using Spark-SQL and PySpark in...


  • Bengaluru, Karnataka, India Genpact Full time

    Genpact (NYSE: G) is a global professional services and solutions firm delivering outcomes thatshape the future. Our 125,000+ people across 30+ countries are driven by our innate curiosity,entrepreneurial agility, and desire to create lasting value for clients. Powered by our purpose –the relentless pursuit of a world that works better for people – we...


  • Bengaluru, Karnataka, India Genpact Full time

    Genpact (NYSE: G) is a global professional services and solutions firm delivering outcomes that shape the future. Our 125,000+ people across 30+ countries are driven by our innate curiosity, entrepreneurial agility, and desire to create lasting value for clients. Powered by our purpose – the relentless pursuit of a world that works better for people –...


  • Bengaluru, Karnataka, India Hexaware Technologies Full time

    At Hexaware Technologies, we are committed to delivering innovative solutions that drive business growth. As a seasoned professional in the field of data engineering, you have a unique opportunity to join our team as an Azure Databricks Developer.About the RoleWe are seeking an experienced Azure Databricks developer to join our team. The ideal candidate will...


  • Bengaluru, Karnataka, India Tata Consultancy Services Full time

    Data Engineering Lead PositionTata Consultancy Services is looking for an experienced data engineer to lead the design and implementation of data load processes using Azure Data Factory, Azure Databricks, Delta Lake, and Python/PySpark.ResponsibilitiesLead the design and implementation of efficient data pipelines using Azure Data Factory and Azure...


  • Bengaluru, Karnataka, India Hexaware Technologies Full time

    Join our team at Hexaware Technologies as we embark on an exciting journey in the world of Azure Databricks!About us: We are a global leader in digital transformation, providing innovative solutions to our clients.We're looking for skilled professionals who can leverage their expertise in Azure Databricks to drive business growth.Essential Skills:Azure...


  • Bengaluru, Karnataka, India Genpact Full time

    Job DescriptionGenpact (NYSE: G) is a global professional services and solutions firm delivering outcomes that shape the future. Our 125,000+ people across 30+ countries are driven by our innate curiosity, entrepreneurial agility, and desire to create lasting value for clients. Powered by our purpose - the relentless pursuit of a world that works better for...


  • Bengaluru, Karnataka, India Genpact Full time

    Job DescriptionGenpact (NYSE: G) is a global professional services and solutions firm delivering outcomes that shape the future. Our 125,000+ people across 30+ countries are driven by our innate curiosity, entrepreneurial agility, and desire to create lasting value for clients. Powered by our purpose - the relentless pursuit of a world that works better for...


  • Bengaluru, Karnataka, India Hexaware Technologies Full time

    Senior Data Engineer Position SummaryWe are seeking a highly skilled Senior Data Engineer to lead our Azure Databricks development team. The ideal candidate will have extensive experience in cloud computing, specifically with Azure Databricks, and exceptional programming skills in Python.Key ResponsibilitiesLead the design and development of end-to-end data...


  • Bengaluru, Karnataka, India Ahvi Infotech Full time

    Position OverviewAhvi Infotech is a premier technology company seeking an experienced Senior Engineer to lead our cloud data engineering efforts. The successful candidate will be responsible for designing, developing, and maintaining large-scale hosted solutions using Azure ADF, Azure Data Lake Storage, and Databricks.This role requires strong technical...