Azure Databricks Data Engineer|3 to 5 Years| Gyansys

3 days ago


Bengaluru, Karnataka, India PradeepIT Consulting Services Full time ₹ 12,00,000 - ₹ 36,00,000 per year


Job Description: Data Engineer (Azure Databricks & PySpark)

Position: Data Engineer
Experience: 3 to 12 years
Primary Skills: Azure Databricks, PySpark, SQL
Secondary Skills: ADF (Azure Data Factory)
Location: Bengaluru/Hyderabad
Mode of Work: Hybrid
Notice Period: 0 to 30 Days

Key Responsibilities:

ETL Development & Data Processing:

  • Design, develop, and maintain ETL pipelines using Azure Databricks, PySpark, and ADF.
  • Extract, transform, and load data from multiple sources into Azure Data Lake Storage.
  • Optimize and fine-tune ETL workflows for performance and scalability.

SQL & Query Optimization:

  • Write complex SQL queries, joins, subqueries, and functions for data processing.
  • Perform SQL tuning and query optimization for improved efficiency.
  • Work with large datasets and ensure optimal data handling.

Azure Cloud Integration:

  • Implement data solutions using Azure technologies (Databricks, ADF, ADLS).
  • Work with batch and streaming data processing for real-time analytics (preferred).
  • Ensure data security, compliance, and reliability in cloud-based systems.

Collaboration & Problem-Solving:

  • Work closely with cross-functional teams to support data analytics and business intelligence initiatives.
  • Identify and resolve data-related issues proactively.
  • Provide insights and recommendations for improving ETL performance.
Required Skills & Qualifications:

3 to 5 years of experience in Azure Databricks, PySpark, and SQL.
Strong SQL skills complex joins, functions, procedures, query tuning.
Hands-on experience in ADF (Azure Data Factory) and Azure Data Lake Storage.
Ability to handle large datasets efficiently.
Experience in performance optimization of ETL workflows.
Good understanding of batch and streaming data processing (preferred).
Strong analytical and problem-solving skills.
Ability to work independently and take ownership of tasks.




  • Bengaluru, Karnataka, India PradeepIT Consulting Services Full time ₹ 12,00,000 - ₹ 18,00,000 per year

    Job Description: Data Engineer (Azure Databricks & PySpark)Position: Data EngineerExperience: 6 to 8 years Primary Skills: Azure Databricks, PySpark, SQL (M)Secondary Skills: ADF (Azure Data Factory) (M)Project Exposure: Cloud migration (M)Location: Bengaluru/HyderabadMode of Work: HybridSalary : 13 lac to 17 lacNotice Period: 15 to 30 Days (M)Databricks...


  • Bengaluru, Karnataka, India Onebridge Full time ₹ 10,00,000 - ₹ 12,00,000 per year

    Onebridge, a Marlabs Company, is a global AI and Data Analytics Consulting Firm that empowers organizations worldwide to drive better outcomes through data and technology. Since 2005, we have partnered with some of the largest healthcare, life sciences, financial services, and government entities across the globe. We have an exciting opportunity for a highly...


  • Bengaluru, Karnataka, India Reveille Technologies,Inc Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    We're Hiring: Azure Databricks Data Engineers – Lead Level - FTELocation:Bangalore – OfficeWork Mode:5 Days WFOShift:12:30 PM – 9:30 PM ISTOpenings:20 PositionsNotice Period:Immediate to 30 days (serving only)Role OverviewWe're looking for experiencedData Engineerswith deep expertise inAzure Databricks,ADF, andPySpark/Pythonto join our growing team in...

  • DataBricks Consultant

    2 weeks ago


    Bengaluru, Karnataka, India GyanSys Inc. Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    In this position you will be responsible for providing insights to clients. To do so, you will first meet with our clients to uncover their business needs and challenges. Then, you will use your strong analytical skills to perform quantitative and observational data analyses. From these analyses, you will form and present your recommendations to our...


  • Bengaluru, Karnataka, India krtrimaIQ Cognitive Solutions Full time ₹ 12,00,000 - ₹ 36,00,000 per year

     Position: Azure Databricks EngineerCompany: KrtrimaIQ Cognitive SolutionsLocation: Bangalore (Hybrid / Remote)Experience: 4–8 YearsCertifications: Microsoft Certified – Azure Data Engineer Associate (DP-203) (Mandatory)About KrtrimaIQ Cognitive Solutions:At KrtrimaIQ, we are a next-generation AI & Data Engineering company enabling enterprises...

  • Sr. Data Engineer

    6 days ago


    Bengaluru, Karnataka, India Databricks Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    GAQ126R127As aSenior Data Engineerin the IT team, you will work on variousbig data challenges using the Databricks platform. You will provide data engineering, data science, and cloud technology projects which require integrating with client systems, training, and other technical tasks to help business to get most value out of their data.The Impact You Will...


  • Bengaluru, Karnataka, India Tata Consultancy Services (TCS) Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    Role**Databricks DeveloperRequired Technical Skill Set**Azure Databricks,PysparkDesigning and building Databricks data pipelines is requiredExperience in transforming the data using Azure Databricks & Delta lakeHands-on experience implementing Big Data solutions in a cloud ecosystem, including Data/Delta LakesSQL experience, specifically to write complex,...


  • Bengaluru, Karnataka, India Talent Bee Consulting Full time ₹ 7,20,000 - ₹ 14,40,000 per year

    Ideal Candidate3+ years in Azure Data EngineeringVery good at ADF (Azure Data Factory)Hands-on experience in designing and implementing data solutions on Azure Organization A global provider of Automation solutions in Assembly, Inspection, and Testing for manufacturing industries. With a mission to enhance the efficiency of the manufacturing processes of...

  • DataBricks Consultant

    10 hours ago


    Bengaluru, Karnataka, India, Karnataka GyanSys Inc. Full time

    In this position you will be responsible for providing insights to clients. To do so, you will first meet with our clients to uncover their business needs and challenges. Then, you will use your strong analytical skills to perform quantitative and observational data analyses. From these analyses, you will form and present your recommendations to our...

  • Azure Data Engineer

    2 weeks ago


    Bengaluru, Karnataka, India 9934de03-039b-4729-b375-69ab7aba7f96 Full time ₹ 5,56,000 - ₹ 19,43,725 per year

    Job SummaryWe are seeking a skilled and experienced Data Engineer with strong expertise in Azure Databricks, Spark/PySpark, and Big Data technologies. The ideal candidate will design, develop, and optimize scalable data pipelines while ensuring performance, reliability, and data quality across large datasets. This role requires strong technical capability...