Databricks Engineer

3 weeks ago

BangaloreChennaiDelhi NCRPuneKolkata, IN Futureleap search partners LLP Full time

Main Skills - Azure Databricks, PySpark, SQL and Azure Cloud.

Role : Senior Databricks Engineer / Databricks Technical Lead/ Data Architect

Experience : 8-15 years

Location : Bangalore, Chennai, Delhi, Pune

About Company :

We focus on last-mile delivery of powerful insights into profitable actions by uniting its strengths in business analytics, data science and software engineering. The largest companies across industries are engaging with us and deploying their prediction and optimization solutions at scale. Head quartered in the San Francisco Bay Area, we serve clients in the US, Canada, Europe, and South East Asia.

We are seeking an experienced data scientist who apart from the required mathematical and statistical expertise also possesses the natural curiosity and creative mind to ask questions, connect the dots, and uncover opportunities that lie hidden with the ultimate goal of realizing the data's full potential.

Primary Roles and Responsibilities:

- Developing Modern Data Warehouse solutions using Databricks and AWS/ Azure Stack

- Ability to provide solutions that are forward-thinking in data engineering and analytics space

- Collaborate with DW/BI leads to understand new ETL pipeline development requirements.

- Triage issues to find gaps in existing pipelines and fix the issues

- Work with business to understand the need in reporting layer and develop data model to fulfill reporting needs

- Help joiner team members to resolve issues and technical challenges.

- Drive technical discussion with client architect and team members

- Orchestrate the data pipelines in scheduler via Airflow

Skills and Qualifications:

- Bachelor's and/or master's degree in computer science or equivalent experience.

- Must have total 6+ yrs. of IT experience and 3+ years, experience in Data warehouse/ETL projects.

- Deep understanding of Star and Snowflake dimensional modelling.

- Strong knowledge of Data Management principles

- Good understanding of Databricks Data & AI platform and Databricks Delta Lake Architecture

- Should have hands-on experience in SQL, Python and Spark (PySpark)

- Candidate must have experience in AWS/ Azure stack

- Desirable to have ETL with batch and streaming (Kinesis).

- Experience in building ETL / data warehouse transformation processes

- Experience with Apache Kafka for use with streaming data / event-based data

- Experience with other Open-Source big data products Hadoop (incl. Hive, Pig, Impala)

- Experience with Open Source non-relational / NoSQL data repositories (incl. MongoDB, Cassandra, Neo4J)

- Experience working with structured and unstructured data including imaging & geospatial data.

- Experience working in a Dev/Ops environment with tools such as Terraform, CircleCI, GIT.

- Proficiency in RDBMS, complex SQL, PL/SQL, Unix Shell Scripting, performance tuning and troubleshoot

- Databricks Certified Data Engineer Associate/Professional Certification (Desirable).

- Comfortable working in a dynamic, fast-paced, innovative environment with several ongoing concurrent projects

- Should have experience working in Agile methodology

- Strong verbal and written communication skills.

- Strong analytical and problem-solving skills with a high attention to detail.

(ref:hirist.tech)

  • Databricks Engineer

    4 weeks ago

    Bangalore/Hyderabad/Pune, IN Prometheus Consulting Full time

    Role : Databricks Engineer.Experience Required : 6 To 10 years.Location : Experience Required : ML Engineer with STRONG Databricks experience, Spark, Python, SQLAbout the Role :Are you a passionate Databricks engineer looking to join a top MNC and revolutionize the way data is processed and analyzed? We are searching for a talented individual to design,...

  • Databricks Engineer

    3 weeks ago

    Bangalore/Hyderabad/Pune, IN Prometheus Consulting Full time

    Role : Databricks Engineer.Experience Required : 6 To 10 years.Location : Experience Required : ML Engineer with STRONG Databricks experience, Spark, Python, SQLAbout the Role :Are you a passionate Databricks engineer looking to join a top MNC and revolutionize the way data is processed and analyzed? We are searching for a talented individual to design,...

  • Senior Software Engineer

    6 days ago

    Udaipur/Kolkata, IN Kadel Labs Private Limited Full time

    Senior Software Engineer - Databricks EngineerKadel Labs is a first-of-its-kind Venture Studio in India. It is a global software technology system incubator with synergetic blend of IT Services and SaaS products under its portfolio. Since 2017, KL has grown organically (180+ employees and expanding) and served 200+ Customers. At the core, KL is a...

  • Data Engineer

    3 weeks ago

    Pune/Hyderabad/Remote, IN HARP Technologies and Services Full time

    Job Location : Pune & Hyderabad (Initial 1 -2 months hybrid and then complete remote job. Client will offer accommodation(stay), food & travel exp. )Exp range : 6+ years Shift timings : General 9am - 6pm IST or 10am - 7pm IST Mandatory skills : Data engineering (4+years), Databricks (3.5+ years), Pyspark (3+ years), Python (preferred) or bash, Data pipeline,...

  • Data Engineer

    2 months ago

    Pune/Hyderabad/Remote, IN HARP Technologies and Services Full time

    Job Location : Pune & Hyderabad (Initial 1 -2 months hybrid and then complete remote job. Client will offer accommodation(stay), food & travel exp. )Exp range : 6+ years Shift timings : General 9am - 6pm IST or 10am - 7pm IST Mandatory skills : Data engineering (4+years), Databricks (3.5+ years), Pyspark (3+ years), Python (preferred) or bash, Data pipeline,...

  • Data Engineer

    3 weeks ago

    Pune/Hyderabad, IN EDGESOFT Full time

    Job Description :The ideal candidate should have a robust understanding and hands-on expertise in PySpark and various components within DataBricks. As a crucial member of our data team, you will play a pivotal role in developing, optimizing, and maintaining our data infrastructure, ensuring seamless and efficient data processing.Responsibilities :- Design,...

  • Data Engineer

    3 weeks ago

    Pune/Hyderabad, IN EDGESOFT Full time

    Job Description :The ideal candidate should have a robust understanding and hands-on expertise in PySpark and various components within DataBricks. As a crucial member of our data team, you will play a pivotal role in developing, optimizing, and maintaining our data infrastructure, ensuring seamless and efficient data processing.Responsibilities :- Design,...

  • Databricks Architect

    6 days ago

    Pune/Chennai, IN Allime Tech Solutions Full time

    Responsibilities :- Lead the design and implementation of scalable and secure data architectures on the Databricks platform.- Collaborate with business stakeholders and data scientists to understand data needs and translate them into technical requirements.- Design and develop efficient data pipelines for data ingestion, transformation, and processing using...

  • Azure Databricks Engineer

    3 weeks ago

    Pune/Bangalore/Hyderabad, IN Advitha Tech Solutions Full time

    Job Description :- Should have 10+ years of experience, minimum 8+ in Data engineering and Analytics with Microsoft cloud technologies.- Expertise to Implementing Data warehousing Solutions. - experience as Data Engineer in Azure Data Bricks with design and solutioning.- Strong Programming experience in Python, SQL- Must have Strong technical experience in...

  • Azure Databricks Engineer

    1 month ago

    Pune/Bangalore/Hyderabad, IN Advitha Tech Solutions Full time

    Job Description :- Should have 10+ years of experience, minimum 8+ in Data engineering and Analytics with Microsoft cloud technologies.- Expertise to Implementing Data warehousing Solutions. - experience as Data Engineer in Azure Data Bricks with design and solutioning.- Strong Programming experience in Python, SQL- Must have Strong technical experience in...

  • DevOps Engineer

    4 weeks ago

    Mumbai/Chennai, IN Anlage Infotech Pvt. Ltd. Full time

    Devops Engineer Mandatory Skills :- Experience with Azure Databricks and Delta Lake- Experience with Apache Spark- Experience with Data Factory for data orchestration- Terraform / Bicep or ARM for Infrastructure-as-Code- Azure Synapse, Apache Spark, and Delta Lake in Azure- Certifications: Microsoft Azure DevOps Engineer certification (AZ-400) or equivalent-...

  • DevOps Engineer

    3 weeks ago

    Mumbai/Chennai, IN Anlage Infotech Pvt. Ltd. Full time

    Devops Engineer Mandatory Skills :- Experience with Azure Databricks and Delta Lake- Experience with Apache Spark- Experience with Data Factory for data orchestration- Terraform / Bicep or ARM for Infrastructure-as-Code- Azure Synapse, Apache Spark, and Delta Lake in Azure- Certifications: Microsoft Azure DevOps Engineer certification (AZ-400) or equivalent-...

  • Azure Data Engineer

    3 weeks ago

    Pune/Bangalore/Chennai, IN Growel Softech Pvt. Ltd. Full time

    Job Title : Azure Data EngineerLocations : Pune, Bangalore, ChennaiExperience Required : 4 - 10 yearsJob Description :We are looking for an experienced Azure Data Engineer to join our dynamic team. The ideal candidate will have a strong background in data engineering with hands-on experience in designing and implementing data solutions using Microsoft Azure....

  • Big Data/Databricks Developer

    2 weeks ago

    Bangalore/Pune, IN Xcelyst Full time

    Big Data + Data Bricks DeveloperExperience : 5-8Years- 3+ Years in Big Data Engineer/Min 1 yr in DatabricksNotice Period : Immediate - 30 Days Location : Bangalore / PuneSkills : - Experience in Big Data/Hadoop Ecosystem. Hands on experience in Spark and Hive. Mandatory in DatabricksData Pipeline Development : Design, develop, and maintain scalable and...

  • Azure Databricks Engineer

    3 weeks ago

    Hyderabad/Pune/Bangalore, IN manogna it services private limited Full time

    Job Description :- Should have 10+ years of experience, minimum 8+ in Data engineering and Analytics with Microsoft cloud technologies.- Expertise to Implementing Data warehousing Solutions. - Experience as Data Engineer in Azure Data Bricks with design and solutioning.- Strong Programming experience in Python, SQL- Must have Strong technical experience in...

  • Azure Databricks Engineer

    1 month ago

    Hyderabad/Pune/Bangalore, IN manogna it services private limited Full time

    Job Description :- Should have 10+ years of experience, minimum 8+ in Data engineering and Analytics with Microsoft cloud technologies.- Expertise to Implementing Data warehousing Solutions. - Experience as Data Engineer in Azure Data Bricks with design and solutioning.- Strong Programming experience in Python, SQL- Must have Strong technical experience in...

  • Databricks Solutions Architect

    2 months ago

    Bangalore/Hyderabad/Pune, IN Huquo Full time

    Job Description :- 7+ years of Data engineering experience with 3+ years hands on Databricks (DB) experience.- Should have thorough knowledge in creation of jobs using Pyspark. Should be extremely good with SQL and possess good exposure to Python.- Should be able to create New Clusters , Cluster Pools and attach existing clusters to pool in DB.- Should have...

  • Databricks Solutions Architect

    3 weeks ago

    Bangalore/Hyderabad/Pune, IN Huquo Full time

    Job Description :- 7+ years of Data engineering experience with 3+ years hands on Databricks (DB) experience.- Should have thorough knowledge in creation of jobs using Pyspark. Should be extremely good with SQL and possess good exposure to Python.- Should be able to create New Clusters , Cluster Pools and attach existing clusters to pool in DB.- Should have...

  • Databricks Engineer

    3 weeks ago

    Pune/Hyderabad/Indore/Ahmedabad/Gurgaon/Gurugram, IN Arting Digital Full time

    Job Title : Databricks Engineer Experience : 7+yrLocation : Hyderabad, Indore, Ahmadabad, Pune, GurgaonWork Mode : OnsiteQualification : B.TECH, M.tech, MCASkills : Databricks, Databricks Admin, Spark, Azure, Docker, Github, Jenkins and Linux/Unix etc.Requirements :- Bachelor's degree in computer science or related field. - 7+ years of IT experience,...

  • Infinite Computer Solutions

    1 month ago

    Bangalore/Chennai/Hyderabad, IN Infinite Computer Solutions Full time

    Job Description :As a Databricks Architect with expertise in AWS, you will be responsible for designing and implementing end-to-end data solutions architecture on AWS leveraging Databricks capabilities. You will lead the planning, implementation, optimization, and governance of Databricks deployments on AWS, ensuring scalability, reliability, and performance...