Databricks Engineer

1 week ago

india Futureleap search partners LLP Full time

Main Skills - Azure Databricks, PySpark, SQL and Azure Cloud.

Role : Senior Databricks Engineer / Databricks Technical Lead/ Data Architect

Experience : 8-15 years

Location : Bangalore, Chennai, Delhi, Pune

About Company :

We focus on last-mile delivery of powerful insights into profitable actions by uniting its strengths in business analytics, data science and software engineering. The largest companies across industries are engaging with us and deploying their prediction and optimization solutions at scale. Head quartered in the San Francisco Bay Area, we serve clients in the US, Canada, Europe, and South East Asia.

We are seeking an experienced data scientist who apart from the required mathematical and statistical expertise also possesses the natural curiosity and creative mind to ask questions, connect the dots, and uncover opportunities that lie hidden with the ultimate goal of realizing the data's full potential.

Primary Roles and Responsibilities:

- Developing Modern Data Warehouse solutions using Databricks and AWS/ Azure Stack

- Ability to provide solutions that are forward-thinking in data engineering and analytics space

- Collaborate with DW/BI leads to understand new ETL pipeline development requirements.

- Triage issues to find gaps in existing pipelines and fix the issues

- Work with business to understand the need in reporting layer and develop data model to fulfill reporting needs

- Help joiner team members to resolve issues and technical challenges.

- Drive technical discussion with client architect and team members

- Orchestrate the data pipelines in scheduler via Airflow

Skills and Qualifications:

- Bachelor's and/or master's degree in computer science or equivalent experience.

- Must have total 6+ yrs. of IT experience and 3+ years, experience in Data warehouse/ETL projects.

- Deep understanding of Star and Snowflake dimensional modelling.

- Strong knowledge of Data Management principles

- Good understanding of Databricks Data & AI platform and Databricks Delta Lake Architecture

- Should have hands-on experience in SQL, Python and Spark (PySpark)

- Candidate must have experience in AWS/ Azure stack

- Desirable to have ETL with batch and streaming (Kinesis).

- Experience in building ETL / data warehouse transformation processes

- Experience with Apache Kafka for use with streaming data / event-based data

- Experience with other Open-Source big data products Hadoop (incl. Hive, Pig, Impala)

- Experience with Open Source non-relational / NoSQL data repositories (incl. MongoDB, Cassandra, Neo4J)

- Experience working with structured and unstructured data including imaging & geospatial data.

- Experience working in a Dev/Ops environment with tools such as Terraform, CircleCI, GIT.

- Proficiency in RDBMS, complex SQL, PL/SQL, Unix Shell Scripting, performance tuning and troubleshoot

- Databricks Certified Data Engineer Associate/Professional Certification (Desirable).

- Comfortable working in a dynamic, fast-paced, innovative environment with several ongoing concurrent projects

- Should have experience working in Agile methodology

- Strong verbal and written communication skills.

- Strong analytical and problem-solving skills with a high attention to detail.

(ref:hirist.tech)

  • Databricks Engineer

    2 weeks ago

    india Arting Digital Private Limited Full time

    Job Description Job Title:-Databricks Engineer Experience:-7+yrLocation:-Hyderabad, Indore, Ahmadabad, Pune, GurgaonWork Mode:- OnsiteQualification:-B.TECH, M.tech, MCASkills:- Databricks, Databricks Admin, Spark, Azure, Docker, Github, Jenkins and Linux/Unix...

  • Databricks Engineer

    1 month ago

    India KniTT Full time

    Job Responsibilities:Write pyspark, sql queries on databricksImplement data flows to load dataWrite transformations based on the business logic for a given usecasePerformance optimizationDesigning ETL frameworksSkill set:Essential-Overall Data Engineer ExpSound with Databricks concepts with all the latest features of it (should be the recent one).Proficient...

  • Databricks Engineer

    1 month ago

    india KniTT Full time

    Job Responsibilities: Write pyspark, sql queries on databricks Implement data flows to load data Write transformations based on the business logic for a given usecase Performance optimization Designing ETL frameworks Skill set: Essential- Overall Data Engineer Exp Sound with Databricks concepts with all the latest features of it (should be the recent...

  • Databricks Engineer

    3 weeks ago

    India KniTT Full time

    Job Responsibilities:Write pyspark, sql queries on databricksImplement data flows to load dataWrite transformations based on the business logic for a given usecasePerformance optimizationDesigning ETL frameworksSkill set:Essential-Overall Data Engineer ExpSound with Databricks concepts with all the latest features of it (should be the recent one).Proficient...

  • Databricks Engineer

    3 weeks ago

    India KniTT Full time

    Job Responsibilities: Write pyspark, sql queries on databricks Implement data flows to load data Write transformations based on the business logic for a given usecase Performance optimization Designing ETL frameworks Skill set: Essential- Overall Data Engineer Exp Sound with Databricks concepts with all the latest features of it (should be the recent...

  • Databricks Engineer

    1 week ago

    India Futureleap search partners LLP Full time

    Main Skills - Azure Databricks, PySpark, SQL and Azure Cloud. Role : Senior Databricks Engineer / Databricks Technical Lead/ Data ArchitectExperience : 8-15 yearsLocation : Bangalore, Chennai, Delhi, PuneAbout Company : We focus on last-mile delivery of powerful insights into profitable actions by uniting its strengths in business analytics, data science...

  • Databricks Admin

    2 weeks ago

    India growel softech Full time

    **Databricks Admin 4+ years Remote Max 1.5 LPM **Responsibilities**: - Install, configure, and maintain Databricks environments to support data engineering and analytics activities. - Collaborate with cross-functional teams to understand data requirements and optimize Databricks clusters accordingly. - Monitor Databricks performance, troubleshoot issues,...

  • Data Engineer

    2 months ago

    india The Ksquare Group Full time

    Requirements Bachelor's degree in computer science, information technology, or a related field. Prior experience with data lakes and data warehouses, working knowledge with dimensional modeling is must. Demonstrate advanced understanding in data engineering practices, Including ETL/ELT, data integrations, reusable data pipelines, data management methods....

  • Azure Databricks Engineer

    1 week ago

    India Optivalue tek consulting Full time

    Key Responsibilities : Work on client projects to deliver AWS, PySpark, Databricks based Data engineering & Analytics solutions. Build and operate very large data warehouses or data lakes. ETL optimization, designing, coding, & tuning big data processes using Apache Spark. Build data pipelines & applications to stream and process datasets at low latencies....

  • Azure Databricks Engineer

    1 week ago

    India Talent-Max Consultant Full time

    Experience: 4-7 YearsLocation : Bhilai, Indore, BangaloreJob Description :We are seeking a skilled DataBricks Engineer to join our team. In this role, you will be responsible for engineering reliable data pipelines for sourcing, processing, distributing, and storing data in various ways using cloud data platform infrastructure. Your primary focus will be on...

  • Data Engineer

    2 months ago

    india HARP Technologies and Services Full time

    Job Location : Pune & Hyderabad (Initial 1 -2 months hybrid and then complete remote job. Client will offer accommodation(stay), food & travel exp. )Exp range : 6+ years Shift timings : General 9am - 6pm IST or 10am - 7pm IST Mandatory skills : Data engineering (4+years), Databricks (3.5+ years), Pyspark (3+ years), Python (preferred) or bash, Data...

  • Databricks ML Ops Engineer

    2 weeks ago

    india KPI Partners Full time

    Databricks Platform with Unity Catalog Administrator Responsibilities: Manage and administer the Databricks platform, including the Unity Catalog, to support data engineering and data science workflows. Collaborate with data engineers and data scientists to understand their requirements and configure the Databricks platform accordingly. Create and manage...

  • Databricks

    2 months ago

    India Tredence Full time

    MUST HAVE - Minimum of 3 years of Azure DE experience - In-depth technical knowledge of tools like Azure Data Factory, Databricks, Azure Synapse, SQL DB, ADLS etc. - Experience in collaborating with business stakeholders to identify and meet data requirements - Experience in using Azure services and tools to ingest, egress, and transform data from multiple...

  • DevOps Engineer

    1 month ago

    india Sam manpower services & Career LLP Full time

    Require a DevOps Engineer Azure Databricks ETL Pipeline Specialist. Key Pointers :- Building CI/CD pipelines for migrating in Databricks .- Building Jenkins and Bitbucket.- Azure Fundamentals : A solid understanding of the core concepts, services, and infrastructure components of the Azure cloud platform.- Cloud Architecture : Proficiency in designing and...

  • Senior Engineer

    1 month ago

    India Bristlecone Full time

    ABOUT US:Bristlecone is the leading provider of AI-powered application transformation services for the connected supply chain. We empower our customers with speed, visibility, automation, and resiliency – to thrive on change.Our transformative solutions in Digital Logistics, Cognitive Manufacturing, Autonomous Planning, Smart Procurement and Digitalization...

  • Senior Engineer

    1 month ago

    india Bristlecone Full time

    ABOUT US : Bristlecone is the leading provider of AI-powered application transformation services for the connected supply chain. We empower our customers with speed, visibility, automation, and resiliency – to thrive on change. Our transformative solutions in Digital Logistics, Cognitive Manufacturing, Autonomous Planning, Smart Procurement and...

  • Senior Engineer

    3 weeks ago

    India Bristlecone Full time

    ABOUT US : Bristlecone is the leading provider of AI-powered application transformation services for the connected supply chain. We empower our customers with speed, visibility, automation, and resiliency – to thrive on change. Our transformative solutions in Digital Logistics, Cognitive Manufacturing, Autonomous Planning, Smart Procurement and...

  • Senior Engineer

    3 weeks ago

    India Bristlecone Full time

    ABOUT US:Bristlecone is the leading provider of AI-powered application transformation services for the connected supply chain. We empower our customers with speed, visibility, automation, and resiliency – to thrive on change.Our transformative solutions in Digital Logistics, Cognitive Manufacturing, Autonomous Planning, Smart Procurement and Digitalization...

  • Databricks

    1 week ago

    India Tredence Full time

    MUST HAVE Minimum of 3 years of Azure DE experience Indepth technical knowledge of tools like Azure Data Factory, Databricks, Azure Synapse, SQL DB, ADLS etc. Experience in collaborating with business stakeholders to identify and meet data requirements Experience in using Azure services and tools to ingest, egress, and transform data from multiple sources...

  • Data Engineer

    2 weeks ago

    india Excelra Knowledge Solutions Full time

    Job Description : At Excelra ,We are seeking a highly skilled Data Engineer with expertise in Databricks, SQL, Python, and data flow pipelines. The ideal candidate will have experience in creating Azure Data Factory (ADF) pipelines, deploying code in Azure DevOps using Git Repos and YAML files, and exposure to Snowflake. This role involves designing,...