Lead Azure Databricks Engineer

4 weeks ago

Bangalore, India VIDPRO CONSULTANCY SERVICES Full time

Primary Roles and Responsibilities :

- Developing Modern Data Warehouse solutions using Databricks and AWS/ AzureStack.

- Ability to provide solutions that are forward-thinking in data engineering and analytics space.

- Collaborate with DW/BI leads to understand new ETL pipeline development requirements.

- Triage issues to find gaps in existing pipelines and fix the issues.

- Work with business to understand the need in reporting layer and develop data model to fulfill reporting needs.

- Help joiner team members to resolve issues and technical challenges.

- Drive technical discussion with client architect and team members.

- Orchestrate the data pipelines in scheduler via AirflowSkills.

Qualifications :

- Bachelor's and/or master's degree in computer science or equivalent experience.

- We are looking for 5+ to 15 Years of experience as Azure Data Engineer.

Mandatory skills :


- Azure Databricks, Azure Data Factory, Azure Data Lake, Python, Pyspark, SQL.

- Deep understanding of Star and Snowflake dimensional modeling.

- Strong knowledge of Data Management principles.

- Good understanding of Databricks Data & AI platform and Databricks DeltaLake Architecture.

- Should have hands-on experience in SQL, Python And Spark (PySpark).

- Candidate must have experience in AWS/ Azure Stack.

- Desirable to have ETL with batch and streaming(Kinesis).

- Experience in building ETL / data warehouse transformation processes.

- Experience with Apache Kafka for use with streaming data / event-based data.

- Experience with other Open-Source big data products Hadoop (incl. Hive, Pig, Impala).

- Experience with Open Source non-relational / NoSQL data repositories (incl. MongoDB, Cassandra, Neo4J).

- Experience working with structured and unstructured data including imaging & geospatial data.

- Experience working in a Dev/Ops environment with tools such as Terraform,CircleCI, GIT.

- Proficiency in RDBMS, complex SQL, PL/SQL,Unix Shell Scripting, performance tuning and troubleshoot.

- Databricks Certified Data Engineer Associate / Professional Certification (Desirable).

- Comfortable working in a dynamic, fast-paced, innovative environment with several ongoing concurrent projects.

- Should have experience working in Agile methodology.

- Strong verbal and written communication skills.

- Strong analytical and problem-solving skills with a high attention to detail.

Mandatory Skills: Python/ PySpark / Spark with Azure/ AWS Databricks.

(ref:hirist.tech)

  • Lead Azure Databricks Engineer

    4 weeks ago

    Bangalore, India ResourceTree Global Services Full time

    Resource Tree Global Services Pvt Ltd is hiring Senior Databricks Data Engineer for one of its leading client in Content & Data Analytics. Below are the details .Job Title : Senior Databricks Data EngineerSkills Required : Azure, Databricks, Datalake, Python/Scala/Java, Data Migration Strategies, Data Warehiusing, Data Modelling, Strong knowledge on Data...

  • Azure Databricks Engineer

    4 weeks ago

    bangalore, India Tredence Inc. Full time

    Role: Senior Databricks Engineer / Databricks Technical Lead/ Data ArchitectExperience: 3-12 yearsLocation: Bangalore, Chennai, Delhi, Pune, KolkataAbout Tredence:Tredence focuses on last-mile delivery of powerful insights into profitable actions by uniting its strengths in business analytics, data science and software engineering. The largest companies...

  • Technical Lead

    4 weeks ago

    bangalore, India Marlabs LLC Full time

    Marlabs is a digital innovation company helping enterprises innovate & capture digital opportunities to enable swifter solutions. Our focus is to help each of our clients find and capture their unique opportunities and empower them with digital technologies so that they can run a purposeful business. Visit and know more about us – .Work Location -...

  • Azure Databricks Engineer

    4 weeks ago

    Bangalore, India ResourceTree Global Services Full time

    Job Title : Senior Databricks Data EngineerSkillset : Databricks, Datalake Architecture, AzureExperience : 6 - 8 yearsLocation : ChennaiJob Summary : We are seeking an experienced Senior Databricks Data Engineer with a very good understanding of Databricks, Lakehouse concepts, with architecture experience, and a sound knowledge of Azure and its services....

  • Technical Lead

    4 weeks ago

    bangalore, India Marlabs LLC Full time

    Marlabs is a digital innovation company helping enterprises innovate & capture digital opportunities to enable swifter solutions. Our focus is to help each of our clients find and capture their unique opportunities and empower them with digital technologies so that they can run a purposeful business. Visit and know more about us – Work Location -...

  • Data Engineering Lead

    5 days ago

    Coimbatore/Tamil Nadu/Kerala/Chennai/Pondicherry/Bangalore/Cochin/Kochi/Hosur, India QBrainX Full time

    Job Title : Data Engineering Lead (With Architecture Experience) Exp level : 10+ years Location : Coimbatore Position Type : Full-Time No of opening : 2- Immediate Joiner (OR) Who can join us within 15 to 20 days is preferred.Key Responsibilities : Architect and Design Data Solutions : - Collaborate with cross-functional teams to understand business...

  • Data Engineering Lead

    2 weeks ago

    Coimbatore/Tamil Nadu/Kerala/Chennai/Pondicherry/Bangalore/Cochin/Kochi/Hosur, IN QBrainX Full time

    Job Title : Data Engineering Lead (With Architecture Experience) Exp level : 10+ yearsLocation : Coimbatore Position Type : Full-Time No of opening : 2- Immediate Joiner (OR) Who can join us within 15 to 20 days is preferred.Key Responsibilities : Architect and Design Data Solutions : - Collaborate with cross-functional teams to understand business...

  • Data Engineer

    4 weeks ago

    Bangalore/Hyderabad/Chennai, India Mouri Tech (P) Ltd Full time

    Job Title : Azure Data EngineerWork Location : Hyderabad , Bangalore, ChennaiExperience : 5+ yearsRequired Skills : Azure, Python, Azure DatabricksResponsibilities : . 5+ years as a data engineer.- 2- 3 years' experience in python- 2 years of experience in Azure SQL- Experience in DataBricks- Familiarity with Azure DevOps & database CI/CD.- Knowledge of...

  • Azure Databricks Engineer

    1 month ago

    Bangalore, India ARR Recruitment Solutions Full time

    Azure Databricks Engineer About the Role :- We are seeking a highly skilled Azure Databricks Engineer to join our team and play a vital role in developing and maintaining our big data processing pipelines.- This role is ideal for a candidate with extensive experience in Azure data services and a strong understanding of Apache Spark for large-scale data...

  • Azure Databricks Engineer

    1 month ago

    Bangalore, Karnataka, India ARR Recruitment Solutions Full time

    Azure Databricks Engineer About the Role :- We are seeking a highly skilled Azure Databricks Engineer to join our team and play a vital role in developing and maintaining our big data processing pipelines.- This role is ideal for a candidate with extensive experience in Azure data services and a strong understanding of Apache Spark for large-scale data...

  • Data Engineer

    2 months ago

    Bangalore, India Career Soft Solutions Full time

    Job Description : - 3+ years of relevant experience in Pyspark and Azure Databricks.- Proficiency in integrating, transforming and consolidating data from various structured and -unstructured data sources.- Good experience in SQL or native SQL query languages.- Strong experience in implementing Databricks notebooks using Python.- Good experience in Azure...

  • Architect - Azure Databricks

    4 weeks ago

    bangalore, India Marlabs LLC Full time

    Marlabs is a digital innovation company helping enterprises innovate & capture digital opportunities to enable swifter solutions. Our focus is to help each of our clients find and capture their unique opportunities and empower them with digital technologies so that they can run a purposeful business. Visit and know more about us – Work Location -...

  • ADC Data Engineering Lead

    4 weeks ago

    Bangalore, India Growel Softech Pvt. Ltd. Full time

    Job Description:We are seeking an experienced ADC (Advanced Data Computing) Data Engineering Lead with 10-13 years of experience to join our team. The ideal candidate will have a strong background in Big Data engineering, with expertise in tools such as Databricks, Azure Data Factory, and SQL. As an ADC Data Engineering Lead, you will be responsible for...

  • ADC Data Engineering Lead

    4 weeks ago

    bangalore, India Growel Softech Pvt. Ltd. Full time

    Job Description:We are seeking an experienced ADC (Advanced Data Computing) Data Engineering Lead with 10-13 years of experience to join our team. The ideal candidate will have a strong background in Big Data engineering, with expertise in tools such as Databricks, Azure Data Factory, and SQL. As an ADC Data Engineering Lead, you will be responsible for...

  • ADC Data Engineering Lead

    4 weeks ago

    Bangalore, Karnataka, India Growel Softech Pvt. Ltd. Full time

    Job Description:We are seeking an experienced ADC (Advanced Data Computing) Data Engineering Lead with 10-13 years of experience to join our team. The ideal candidate will have a strong background in Big Data engineering, with expertise in tools such as Databricks, Azure Data Factory, and SQL. As an ADC Data Engineering Lead, you will be responsible for...

  • Data Scientist

    1 month ago

    bangalore, India VIDPRO CONSULTANCY SERVICES Full time

    About the job:Job Description:We are seeking an experienced data scientist who apart from the required mathematical and statistical expertise also possesses the natural curiosity and creative mind to ask questions, connect the dots, and uncover opportunities that lie hidden with the ultimate goal of realizing the data's full potential.Primary Roles And...

  • Azure Databricks Engineer

    2 weeks ago

    Pune/Bangalore/Hyderabad, India Advitha Tech Solutions Full time

    Job Description : - Should have 10+ years of experience, minimum 8+ in Data engineering and Analytics with Microsoft cloud technologies.- Expertise to Implementing Data warehousing Solutions. - experience as Data Engineer in Azure Data Bricks with design and solutioning.- Strong Programming experience in Python, SQL- Must have Strong technical experience in...

  • Azure Databricks Engineer

    2 weeks ago

    Pune/Bangalore/Hyderabad, IN Advitha Tech Solutions Full time

    Job Description :- Should have 10+ years of experience, minimum 8+ in Data engineering and Analytics with Microsoft cloud technologies.- Expertise to Implementing Data warehousing Solutions. - experience as Data Engineer in Azure Data Bricks with design and solutioning.- Strong Programming experience in Python, SQL- Must have Strong technical experience in...

  • Senior Technical Solutions Engineer- Platform

    2 weeks ago

    bangalore, India Databricks Full time

    CSQ424R4 Mission As a Platform Technical Solutions Engineer, you will provide technical support for Databricks Platform related issues and resolve any challenges involving the Databricks unified analytics platform. You will assist customers in their Databricks journey and provide them with the guidance, knowledge, and expertise that they need to realize...

  • Data Scientist

    4 weeks ago

    Bangalore, India VIDPRO CONSULTANCY SERVICES Full time

    About the job:Job Description:We are seeking an experienced data scientist who apart from the required mathematical and statistical expertise also possesses the natural curiosity and creative mind to ask questions, connect the dots, and uncover opportunities that lie hidden with the ultimate goal of realizing the data's full potential.Primary Roles And...