Databricks Engineer

3 weeks ago

BangaloreChennaiDelhi NCRPuneKolkata, India Futureleap search partners LLP Full time

Main Skills - Azure Databricks, PySpark, SQL and Azure Cloud.

Role : Senior Databricks Engineer / Databricks Technical Lead/ Data Architect

Experience : 8-15 years

Location : Bangalore, Chennai, Delhi, Pune

About Company :

We focus on last-mile delivery of powerful insights into profitable actions by uniting its strengths in business analytics, data science and software engineering. The largest companies across industries are engaging with us and deploying their prediction and optimization solutions at scale. Head quartered in the San Francisco Bay Area, we serve clients in the US, Canada, Europe, and South East Asia.

We are seeking an experienced data scientist who apart from the required mathematical and statistical expertise also possesses the natural curiosity and creative mind to ask questions, connect the dots, and uncover opportunities that lie hidden with the ultimate goal of realizing the data's full potential.

Primary Roles and Responsibilities:

- Developing Modern Data Warehouse solutions using Databricks and AWS/ Azure Stack

- Ability to provide solutions that are forward-thinking in data engineering and analytics space

- Collaborate with DW/BI leads to understand new ETL pipeline development requirements.

- Triage issues to find gaps in existing pipelines and fix the issues

- Work with business to understand the need in reporting layer and develop data model to fulfill reporting needs

- Help joiner team members to resolve issues and technical challenges.

- Drive technical discussion with client architect and team members

- Orchestrate the data pipelines in scheduler via Airflow

Skills and Qualifications:

- Bachelor's and/or master's degree in computer science or equivalent experience.

- Must have total 6+ yrs. of IT experience and 3+ years, experience in Data warehouse/ETL projects.

- Deep understanding of Star and Snowflake dimensional modelling.

- Strong knowledge of Data Management principles

- Good understanding of Databricks Data & AI platform and Databricks Delta Lake Architecture

- Should have hands-on experience in SQL, Python and Spark (PySpark)

- Candidate must have experience in AWS/ Azure stack

- Desirable to have ETL with batch and streaming (Kinesis).

- Experience in building ETL / data warehouse transformation processes

- Experience with Apache Kafka for use with streaming data / event-based data

- Experience with other Open-Source big data products Hadoop (incl. Hive, Pig, Impala)

- Experience with Open Source non-relational / NoSQL data repositories (incl. MongoDB, Cassandra, Neo4J)

- Experience working with structured and unstructured data including imaging & geospatial data.

- Experience working in a Dev/Ops environment with tools such as Terraform, CircleCI, GIT.

- Proficiency in RDBMS, complex SQL, PL/SQL, Unix Shell Scripting, performance tuning and troubleshoot

- Databricks Certified Data Engineer Associate/Professional Certification (Desirable).

- Comfortable working in a dynamic, fast-paced, innovative environment with several ongoing concurrent projects

- Should have experience working in Agile methodology

- Strong verbal and written communication skills.

- Strong analytical and problem-solving skills with a high attention to detail.

(ref:hirist.tech)

  • Databricks Engineer

    1 month ago

    Bangalore/Chennai/Delhi NCR/Pune/Kolkata, IN Futureleap search partners LLP Full time

    Main Skills - Azure Databricks, PySpark, SQL and Azure Cloud.Role : Senior Databricks Engineer / Databricks Technical Lead/ Data ArchitectExperience : 8-15 yearsLocation : Bangalore, Chennai, Delhi, PuneAbout Company :We focus on last-mile delivery of powerful insights into profitable actions by uniting its strengths in business analytics, data science and...

  • Databricks Engineer

    3 weeks ago

    Bangalore/Chennai/Delhi NCR/Pune/Kolkata, IN Futureleap search partners LLP Full time

    Main Skills - Azure Databricks, PySpark, SQL and Azure Cloud.Role : Senior Databricks Engineer / Databricks Technical Lead/ Data ArchitectExperience : 8-15 yearsLocation : Bangalore, Chennai, Delhi, PuneAbout Company :We focus on last-mile delivery of powerful insights into profitable actions by uniting its strengths in business analytics, data science and...

  • Engineering Manager

    1 month ago

    bangalore, India Databricks Full time

    P-995 At Databricks, we are passionate about enabling data teams to solve the world's toughest problems — from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. We do this by building and running the world's best data and AI infrastructure platform so our customers can use deep data insights to...

  • Engineering Manager

    3 weeks ago

    bangalore, India Databricks Full time

    P-995 At Databricks, we are passionate about enabling data teams to solve the world's toughest problems — from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. We do this by building and running the world's best data and AI infrastructure platform so our customers can use deep data insights to...

  • Sr Engineering Manager

    1 month ago

    bangalore, India Databricks Full time

    P-995 At Databricks, we are passionate about enabling data teams to solve the world's toughest problems — from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. We do this by building and running the world's best data and AI infrastructure platform so our customers can use deep data insights to...

  • Sr Engineering Manager

    3 weeks ago

    bangalore, India Databricks Full time

    P-995 At Databricks, we are passionate about enabling data teams to solve the world's toughest problems — from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. We do this by building and running the world's best data and AI infrastructure platform so our customers can use deep data insights to...

  • Technical Solutions Engineer- Platform

    3 weeks ago

    bangalore, India Databricks Full time

    CSQ424R4 Mission As a Platform Technical Solutions Engineer, you will provide technical support for Databricks Platform related issues and resolve any challenges involving the Databricks unified analytics platform. You will assist customers in their Databricks journey and provide them with the guidance, knowledge, and expertise that they need to realize...

  • Technical Solutions Engineer- Platform

    1 month ago

    bangalore, India Databricks Full time

    CSQ424R4 Mission As a Platform Technical Solutions Engineer, you will provide technical support for Databricks Platform related issues and resolve any challenges involving the Databricks unified analytics platform. You will assist customers in their Databricks journey and provide them with the guidance, knowledge, and expertise that they need to realize...

  • Databricks Engineer

    3 weeks ago

    pune, India Celebal Technologies Full time

    Job Description: Databricks EngineerPosition: Databricks EngineerExperience Required: 3 to 8 years overall experience in Data engineering on DatabricksLocation: Pune and NoidaJob Summary: The Databricks Engineer will be responsible for developing and managing data pipelines, loading data from SAP and non-SAP sources, and developing models on these...

  • Senior Technical Solutions Engineer- Platform

    3 weeks ago

    bangalore, India Databricks Full time

    CSQ424R4 Mission As a Platform Technical Solutions Engineer, you will provide technical support for Databricks Platform related issues and resolve any challenges involving the Databricks unified analytics platform. You will assist customers in their Databricks journey and provide them with the guidance, knowledge, and expertise that they need to realize...

  • Senior Technical Solutions Engineer- Platform

    1 month ago

    bangalore, India Databricks Full time

    CSQ424R4 Mission As a Platform Technical Solutions Engineer, you will provide technical support for Databricks Platform related issues and resolve any challenges involving the Databricks unified analytics platform. You will assist customers in their Databricks journey and provide them with the guidance, knowledge, and expertise that they need to realize...

  • Backline Engineer, Platform

    2 months ago

    bangalore, India Databricks Full time

    At Databricks, we are passionate about enabling data teams to solve the world’s toughest problems — from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. We do this by building and running the world’s best data and AI infrastructure platform so our customers can use deep data insights to improve...

  • Backline Engineer, Platform

    3 weeks ago

    bangalore, India Databricks Full time

    At Databricks, we are passionate about enabling data teams to solve the world’s toughest problems — from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. We do this by building and running the world’s best data and AI infrastructure platform so our customers can use deep data insights to improve...

  • Databricks Engineer

    3 weeks ago

    Pune, India Celebal Technologies Full time

    Job Description: Databricks EngineerPosition: Databricks EngineerExperience Required: 3 to 8 years overall experience in Data engineering on DatabricksLocation: Pune and NoidaJob Summary: The Databricks Engineer will be responsible for developing and managing data pipelines, loading data from SAP and non-SAP sources, and developing models on these datasets...

  • Databricks Engineer

    3 weeks ago

    Pune, India Celebal Technologies Full time

    Job Description: Databricks Engineer Position: Databricks Engineer Experience Required: 3 to 8 years overall experience in Data engineering on Databricks Location: Pune and Noida Job Summary: The Databricks Engineer will be responsible for developing and managing data pipelines, loading data from SAP and non-SAP sources, and developing models on these...

  • Databricks Engineer

    1 month ago

    Pune, India Celebal Technologies Full time

    Job Description: Databricks EngineerPosition: Databricks EngineerExperience Required: 3 to 8 years overall experience in Data engineering on DatabricksLocation: Pune and NoidaJob Summary: The Databricks Engineer will be responsible for developing and managing data pipelines, loading data from SAP and non-SAP sources, and developing models on these datasets...

  • Databricks Engineer

    3 weeks ago

    Pune, India Celebal Technologies Full time

    Job Description: Databricks EngineerPosition: Databricks EngineerExperience Required: 3 to 8 years overall experience in Data engineering on DatabricksLocation: Pune and NoidaJob Summary: The Databricks Engineer will be responsible for developing and managing data pipelines, loading data from SAP and non-SAP sources, and developing models on these datasets...

  • Databricks Engineer

    1 month ago

    Pune, India Celebal Technologies Full time

    Job Description: Databricks EngineerPosition: Databricks EngineerExperience Required: 3 to 8 years overall experience in Data engineering on DatabricksLocation: Pune and NoidaJob Summary: The Databricks Engineer will be responsible for developing and managing data pipelines, loading data from SAP and non-SAP sources, and developing models on these datasets...

  • Databricks Engineer

    6 days ago

    Pune, Maharashtra, India Celebal Technologies Full time

    Job Description: Databricks Engineer Position: Databricks Engineer Experience Required: 3 to 8 years overall experience in Data engineering on Databricks Location: Pune and Noida Job Summary: The Databricks Engineer will be responsible for developing and managing data pipelines, loading data from SAP and non-SAP sources, and developing models on these...

  • Databricks Engineer

    1 month ago

    pune, India Celebal Technologies Full time

    Job Description: Databricks Engineer Position: Databricks Engineer Experience Required: 3 to 8 years overall experience in Data engineering on Databricks Location: Pune and Noida Job Summary: The Databricks Engineer will be responsible for developing and managing data pipelines, loading data from SAP and non-SAP sources, and developing models on these...