Azure Databricks

1 day ago

Bengaluru Karnataka, India PradeepIT Consulting Services Full time

**About the job Azure Databricks**:
**Job Description: Data Engineer (Azure Databricks & PySpark)**:
**Position**: Data Engineer
**Experience**: 3 to 5 years
**Primary Skills**: Azure Databricks, PySpark, SQL
**Secondary Skills**: ADF (Azure Data Factory)
**Location**: Bengaluru/Hyderabad
**Mode of Work**: Hybrid
**Notice Period**: 0 to 30 Days

**Key Responsibilities**:
**ETL Development & Data Processing**:

- Design, develop, and maintain **ETL pipelines** using **Azure Databricks, PySpark, and ADF**.
- Extract, transform, and load data from multiple sources into **Azure Data Lake Storage**.
- Optimize and fine-tune **ETL workflows for performance and scalability**.

**SQL & Query Optimization**:

- Write **complex SQL queries, joins, subqueries, and functions** for data processing.
- Perform **SQL tuning and query optimization** for improved efficiency.
- Work with **large datasets** and ensure optimal data handling.

**Azure Cloud Integration**:

- Implement **data solutions using Azure technologies** (Databricks, ADF, ADLS).
- Work with **batch and streaming data processing** for real-time analytics (preferred).
- Ensure **data security, compliance, and reliability** in cloud-based systems.

**Collaboration & Problem-Solving**:

- Work closely with cross-functional teams to support **data analytics and business intelligence initiatives**.
- Identify and resolve **data-related issues proactively**.
- Provide insights and recommendations for **improving ETL performance**.

**Required Skills & Qualifications**:
**3 to 5 years of experience** in **Azure Databricks, PySpark, and SQL**.
**Strong SQL skills** complex joins, functions, procedures, query tuning.
Hands-on experience in **ADF (Azure Data Factory) and Azure Data Lake Storage**.
Ability to handle **large datasets efficiently**.
Experience in **performance optimization of ETL workflows**.
Good understanding of **batch and streaming data processing** (preferred).
Strong analytical and problem-solving skills.
Ability to **work independently** and take ownership of tasks.

  • Azure Databricks

    1 week ago

    Bengaluru, Karnataka, India PradeepIT Consulting Services Full time

    **About the job Azure Databricks**: **Position**: Lead - Azure Databricks **Overall IT experience**:8 to 13 years **Primary Skills**:Azure Databricks, Hadoop, Hive, Pig, Impala, ETL, Data warehouse **Secondary Skills**:U-SQL, Spark, Scala, Python **Work Location**:Bengaluru, Hyderabad **Notice Period**:0 to 30 Days **Essential experience**: Experience...

  • Azure Databricks with Pyspark

    1 day ago

    Bengaluru, Karnataka, India BirlaSoft Full time

    Country/Region: IN - Requisition ID: 25276 - Work Model: - Position Type: - Salary Range: - Location: INDIA - BENGALURU - HP **Title**:Azure Databricks with Pyspark**: - Description: **Area(s) of responsibility**: Birlasoft, a global leader at the forefront of Cloud, AI, and Digital technologies, seamlessly blends domain expertise with enterprise...

  • Azure Databricks

    3 days ago

    Bengaluru, Karnataka, India Apex One Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Power Bi and AAS expert (Strong SC or Specialist Senior)Should have hands-on experience of Data Modelling in Azure SQL Data Warehouse and Azure Analysis ServiceShould be able to write and test Dex queries.Should be able generate Paginated Reports in Power BIShould have minimum 3 Years working experience in delivering projects in Power BiMust Have:-3 to 8...

  • Azure Databricks

    1 week ago

    Bengaluru, India Pradeepit Consulting Services Full time

    Job Description - - Experience in building ETL / data warehouse transformation processes Direct experience of building data pipelines using Azure Data Factory and Apache Spark (preferably Databricks) - Experience with other Open-Source big data products Hadoop (incl. Hive, Pig, Impala) Evaluating the performance and applicability of multiple tools against...

  • Azure Databricks Along with Python

    3 days ago

    Bengaluru, Karnataka, India Tata Consultancy Services Full time

    Inviting Applications for Azure Databricks along with Python Job Title: Azure Databricks along with Python Experience Required: 4 to 10 Years Location: Bangalore - Extensive expertise in designing and implementing data load processes using Azure Data Factory, Azure Databricks, Delta Lake, Azure Delta Lake Storage and Python/PySpark - Proficient with...

  • AZURE DATABRICKS

    1 week ago

    Bengaluru, Karnataka, India Contactx Resource Management Pvt. Ltd. Full time ₹ 15,00,000 - ₹ 28,00,000 per year

    AZURE DATABRICKS (7-17 YEARS), IMMEDIATE TO 60 DAYS JOINER, BANGALORE LOCATIONHiring for 1 of BIG4,Immediate to 60 days Joiner,Data Bricks AM Level (7-10 Years)Data Bricks Manager Level Years)D esigning and developing scalable data pipelines and ETL processes using Azure Databricks and PySpark , optimizing data workflows, ensuring data quality, collaborating...

  • Azure Databricks Architect

    2 weeks ago

    Bengaluru, Karnataka, India, Karnataka Spectral Consultants Full time

    Hiring: Azure Databricks Architect | Locations – Chennai | Bangalore | Hyderabad | We’re looking for an experienced Azure Databricks Architect to design and deliver scalable, modern data platforms across Azure and Databricks. This role blends hands-on technical architecture, team leadership, and innovation — perfect for those who thrive on building...

  • Azure Databricks+ Spark

    1 week ago

    Bengaluru, Karnataka, India Cognizant Full time

    **Skill: Azure Databricks+ Spark** **Experience: 6 to 9 years** **Location: AIA Kochi** **Responsibilities** - Develop and implement scalable data processing solutions using Spark in Scala to enhance data-driven decision-making. - Manage and administer Databricks Unity Catalog to ensure data governance and security compliance. - Utilize Delta Sharing to...

  • Azure databricks, PySpark

    4 weeks ago

    Bengaluru, Karnataka, India, Karnataka Tata Consultancy Services Full time

    Role: Azure Data Engineer(ADF, ADB)Required Technical Skill Set: Azure Data Engineer, ADF, Azure Databricks Spark (PySpark or Scala), Python, PL/SQLExp : 4 to 6 YearLocation : Kolkata, Pune, Mumbai, Bangalore, BhubaneshwarMust-Have · Strong experience in Azure Data Factory , ADB( Azure Databricks) Synapse; establishing the cloud connectivity between...

  • Azure Databricks

    1 day ago

    Bengaluru, Chennai, Hyderabad, India Eniac Systems Full time ₹ 6,00,000 - ₹ 12,00,000 per year

    Role & responsibilitiesJob Title: DeveloperWork Location: NOIDA, UP / HYDERABAD, TG / CHENNAI, TN / PUNE, MH / BANGALORE, KA / INDORE / KOLKATA, WBSkills Required: Azure Data FactoryExperience: yearsSkillCategoryTest1_MNDigital : Azure DatabricksYes14-7 yearsShould build Databricks Notebook developed in spark SQL/ pyspark• Should be able to create unity...