Azure Databricks/PySpark Developer

2 weeks ago


Bengaluru, Karnataka, India JRD Systems Private Ltd Full time

Key Responsibilities :

- Design, develop, and maintain scalable data pipelines and ETL/ELT processes using PySpark, SQL, and Python.

- Build and manage data workflows on Azure Data Lake, Azure Data Factory (ADF), and Databricks.

- Collaborate with data scientists, analysts, and other stakeholders to understand data needs and ensure data quality and availability.

- Implement data modeling, transformation, and integration solutions from various structured and unstructured data sources.

- Design and implement CI/CD pipelines for data engineering projects using industry best practices.

- Monitor and optimize performance of data systems, ensuring high availability and reliability.

- Document data workflows, schemas, and architectures to support knowledge sharing and maintenance.

- Actively participate in code reviews and contribute to a culture of continuous improvement.

- Communicate effectively with technical and non-technical stakeholders, translating business requirements into technical Qualifications :

- 6+ years of hands-on experience in Data Engineering.

- Proficiency in SQL, Python, and PySpark for data processing and transformation.

- Experience working with Azure Data Lake Storage, Azure Data Factory, and Databricks.

- Solid understanding of data warehousing concepts, data modeling, and data integration.

- Experience with CI/CD tools and deployment practices (e.g., Azure DevOps, Git, Jenkins).

- Strong analytical, problem-solving, and debugging skills.

- Excellent verbal and written communication skills.

- Strong team player with the ability to work independently when needed

(ref:hirist.tech)
  • AZURE DATABRICKS

    1 week ago


    Bengaluru, Karnataka, India Contactx Resource Management Pvt. Ltd. Full time ₹ 15,00,000 - ₹ 28,00,000 per year

    AZURE DATABRICKS (7-17 YEARS), IMMEDIATE TO 60 DAYS JOINER, BANGALORE LOCATIONHiring for 1 of BIG4,Immediate to 60 days Joiner,Data Bricks AM Level (7-10 Years)Data Bricks Manager Level Years)D esigning and developing scalable data pipelines and ETL processes using Azure Databricks and PySpark , optimizing data workflows, ensuring data quality, collaborating...


  • Bengaluru, Karnataka, India Swift Strategic Solutions Inc Full time US$ 90,000 - US$ 1,20,000 per year

    Our technology services client is seeking multipleAzure Databricks Developer- Japanese Languageto join their team on a contract basis. These positions offer a strong potential for conversion to full-time employment upon completion of the initial contract period. Below are further details about the role:Role: Azure Databricks Developer- Japanese...


  • Bengaluru, Karnataka, India Tata Consultancy Services Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Please find below JD for the same as requested. Technical Skills:"Pyspark" "Azure data bricks" "Azure Data Factory"Experienced level - 5 yearsShould have hands-on experience in writing PySpark code on Databricks and expertise in Spark-Sql and Python coding as well. Should have worked on Azure Data lake Gen2 storage or good to have knowledgeHands-on exp in...

  • - Data Engineer

    2 weeks ago


    Bengaluru, Karnataka, India Skan ai Full time

    Job Summary :We are seeking a skilled Data Engineer with 3 to 5 years of experience in building scalable data pipelines and solutions, with strong hands-on expertise in Databricks. The ideal candidate should be proficient in working with large-scale data processing frameworks and have a solid understanding of Delta Lake, PySpark, and cloud-based data...


  • Bengaluru, Karnataka, India Suzva Software Technologies Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    As a Senior Azure Data Engineer, your responsibilities will include: Building scalable data pipelines using Databricks and PySpark Transforming raw data into usable business insights Integrating Azure services like Blob Storage, Data Lake, and Synapse Analytics Deploying and maintaining machine learning models using MLlib or TensorFlow Executing...


  • Bengaluru, Karnataka, India Compunnel Full time ₹ 12,00,000 - ₹ 15,00,000 per year

    Senior Azure Databricks DeveloperWeekend Virtual Drive on 30 Aug - Between 11am to 3pmSalary up to 15 LPAExp: 7+ YearsPOSITION GENERAL DUTIES AND TASKS :Advanced experience with Databricks, including Databricks SQL, DataFrames, and Spark (PySpark or Scala).Deep understanding of Spark architecture and optimization strategies (e.g., tuning Spark SQL...


  • Bengaluru, Karnataka, India Tech Mahindra Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    Job SummaryWe are seeking a skilled Data Solution Architect to design Solution and Lead the implementation on Azure + Databricks & MS Fabric. The ideal candidate will possess extensive experience in data Architecting, Solution design and data management practices. Experience: years Responsibilities: Architect end-to-end modern data platforms on Azure,...


  • Bengaluru, Karnataka, India beBeeDatabricks Full time ₹ 15,00,000 - ₹ 28,00,000

    Job Opportunity: We are seeking a highly skilled Python Developer with Databricks Experience.The ideal candidate will have extensive experience in designing and implementing data load processes using Azure Data Factory, Azure Databricks, Delta Lake, Azure Delta Lake Storage and Python/PySpark. Proficiency with Databricks & Python is also essential.Key...

  • Azure Databricks

    4 days ago


    Bengaluru, Karnataka, India Apex One Full time ₹ 15,00,000 - ₹ 28,00,000 per year

    Power Bi and AAS expert (Strong SC or Specialist Senior)Should have hands-on experience of Data Modelling in Azure SQL Data Warehouse and Azure Analysis ServiceShould be able to write and test Dex queries.Should be able generate Paginated Reports in Power BIShould have minimum 3 Years working experience in delivering projects in Power BiMust Have:-3 to 8...

  • Databricks Developer

    2 weeks ago


    Bengaluru, Karnataka, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Summary:We are seeking a highly skilled data professional to design, develop, and maintain efficient ETL processes for extracting, transforming, and loading data from various sources into our data lake and warehouse.Key Responsibilities:Design and implement robust ETL workflows using Databricks PySpark and Spark SQL.Develop and optimize data pipelines...