Senior Data Engineer

1 month ago

bangalore, India Tredence Inc. Full time

Primary Roles and Responsibilities:


● Developing Modern Data Warehouse solutions using Databricks and AWS/ Azure Stack

● Ability to provide solutions that are forward-thinking in data engineering and analytics space

● Collaborate with DW/BI leads to understand new ETL pipeline development requirements.

● Triage issues to find gaps in existing pipelines and fix the issues

● Work with business to understand the need in reporting layer and develop data model to fulfill reporting needs

● Help joiner team members to resolve issues and technical challenges.

● Drive technical discussion with client architect and team members

● Orchestrate the data pipelines in scheduler via Airflow


Skills and Qualifications:

● Bachelor's and/or master’s degree in computer science or equivalent experience.

● Must have total 6+ yrs. of IT experience and 3+ years' experience in Data warehouse/ETL projects.

● Deep understanding of Star and Snowflake dimensional modelling.

● Strong knowledge of Data Management principles

● Good understanding of Databricks Data & AI platform and Databricks Delta Lake Architecture

● Should have hands-on experience in SQL, Python and Spark (PySpark)

● Candidate must have experience in AWS/ Azure stack

● Desirable to have ETL with batch and streaming (Kinesis).

● Experience in building ETL / data warehouse transformation processes

● Experience with Apache Kafka for use with streaming data / event-based data

● Experience with other Open-Source big data products Hadoop (incl. Hive, Pig, Impala)

● Experience with Open Source non-relational / NoSQL data repositories (incl. MongoDB, Cassandra, Neo4J)

● Experience working with structured and unstructured data including imaging & geospatial data. ● Experience working in a Dev/Ops environment with tools such as Terraform, CircleCI, GIT.

● Proficiency in RDBMS, complex SQL, PL/SQL, Unix Shell Scripting, performance tuning and troubleshoot

● Databricks Certified Data Engineer Associate/Professional Certification (Desirable).

● Comfortable working in a dynamic, fast-paced, innovative environment with several ongoing concurrent projects

● Should have experience working in Agile methodology

● Strong verbal and written communication skills.

● Strong analytical and problem-solving skills with a high attention to detail

  • Senior Mechanical Engineer

    1 month ago

    bangalore, India Abha Engineer Full time

    We are looking for a Senior Mechanical Engineer Roles are described below. 1. Manpower Planning. 2. Preparing of Project Cost. 3. Schedule wise work execution. 4. As Drawing & quality work execution. 5. Client & Third Party Manage. 6. Working Team Manage & Review. 7. Reporting to Management. 8. ROB & FOB Fabrication & Erection Work Knowledge.

  • Data Specialist

    1 month ago

    Bangalore, India NTT DATA Services Full time

    Req ID: 287764  NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Specialist / Engineer to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Data...

  • Senior Data Engineer

    6 days ago

    Bangalore, India ADVANSOFT Full time

    Job Title: Senior Data EngineerJob Summary:We are seeking a highly skilled Senior Data Engineer to join our team at Advansoft. As a Senior Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data systems that support our business operations.Key Responsibilities:Design and develop complex data pipelines using PySpark,...

  • Senior data engineer

    6 days ago

    Bangalore, India ThoughtFocus Full time

    Job Description: Senior Data Engineer Position: Senior Data Engineer Experience: 8-10 Years Location: Bangalore Employment Type: Full-Time --- Summary: We are looking for a highly skilled Senior Data Engineer with 8-10 years of experience in SQL, Azure Data Factory (ADF), SQL Server Integration Services (SSIS), SQL Server Reporting Services (SSRS), and...

  • Senior Data Engineer

    6 days ago

    bangalore, India ThoughtFocus Full time

    Job Description: Senior Data EngineerPosition: Senior Data Engineer Experience: 8-10 Years Location: Bangalore Employment Type: Full-Time---Summary:We are looking for a highly skilled Senior Data Engineer with 8-10 years of experience in SQL, Azure Data Factory (ADF), SQL Server Integration Services (SSIS), SQL Server Reporting Services (SSRS), and...

  • Senior Data Engineer

    6 days ago

    Bangalore, India Aeries Technology Group Full time

    Job Title: Senior Data EngineerJob Summary: We are seeking a highly skilled Senior Data Engineer to join our team at Aeries Technology Group. As a Senior Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data engineering systems.Key Responsibilities:Collaborate with cross-functional teams to understand data...

  • Senior Data Engineer

    7 days ago

    Bangalore, India KreditBee Full time

    Job Title: Senior Data EngineerJob Summary:We are seeking a highly skilled Senior Data Engineer to join our team at KreditBee. As a Senior Data Engineer, you will be responsible for developing and implementing data engineering solutions to support our digital lending platform.Key Responsibilities:Develop and maintain data pipelines to extract, transform, and...

  • Senior Data Engineer

    5 days ago

    Bangalore, India SKYLARK HR SOLUTIONS Pvt Ltd Full time

    Job Title: Senior Data EngineerJob Summary:We are seeking a highly skilled Senior Data Engineer to join our team at SKYLARK HR SOLUTIONS Pvt Ltd. As a Senior Data Engineer, you will be responsible for designing and implementing data processing pipelines using PySpark and Python, collaborating with cross-functional teams to understand data requirements, and...

  • Data engineer

    7 days ago

    Bangalore, India Data Labs - LANDMARK GROUP Full time

    Job Title: Lead Data Engineer Location: Yemalur, Bangalore Your Key Responsibilities: Lead our engineering team successfully build and deploy cutting edge analytics products for consumption by different stakeholders. Lead the architecture, design, and delivery of enterprise grade microservices. Deliver assigned projects within budgeted time, cost...

  • Senior Data Engineer

    1 week ago

    Bangalore, India HAD Recruitment Services Full time

    Senior Data EngineerJob Summary:We are seeking a highly skilled Senior Data Engineer to join our team at HAD Recruitment Services. As a Senior Data Engineer, you will be responsible for designing, developing, and maintaining robust data pipelines and architectures on the Azure platform.Key Responsibilities:Design and develop data pipelines and architectures...

  • Senior Data Engineer

    7 days ago

    Bangalore, India HAD Recruitment Services Full time

    Job Title: Senior Data EngineerJob Summary:We are seeking a highly skilled Senior Data Engineer to join our team at HAD Recruitment Services. As a Senior Data Engineer, you will be responsible for designing, developing, and maintaining robust data pipelines and architectures on the Azure platform.Key Responsibilities:Design and develop data pipelines and...

  • Data Engineer

    6 days ago

    Bangalore, India Data Labs - LANDMARK GROUP Full time

    Job Title: Lead Data Engineer Location: Yemalur, Bangalore Your Key Responsibilities: Lead our engineering team successfully build and deploy cutting edge analytics products for consumption by different stakeholders. Lead the architecture, design, and delivery of enterprise grade microservices. Deliver assigned projects within budgeted time, cost and...

  • Senior Data Engineer

    2 days ago

    Bangalore, India HAD Recruitment Services Full time

    Job Title: Senior Data EngineerJob Summary:We are seeking a highly skilled Senior Data Engineer to join our team at HAD Recruitment Services. As a Senior Data Engineer, you will be responsible for designing, developing, and maintaining robust data pipelines and architectures on the Azure platform.Key Responsibilities:Design and develop data pipelines and...

  • Data Engineer

    1 month ago

    bangalore, India NTT DATA Full time

    Job Description Data Engineer Grade 07ResponsibilitiesAssure that data is cleansed, mapped, transformed, and otherwise optimised for storage and use according to business and technical requirements using Azure data factory and Azure databricksDevelop and maintain innovative Azure Azure data factory and Azure databricksSolution design using Microsoft Azure...

  • Data Engineer

    1 month ago

    bangalore, India NTT DATA Full time

    Job Description Data Engineer Grade 07 ResponsibilitiesAssure that data is cleansed, mapped, transformed, and otherwise optimised for storage and use according to business and technical requirements using Azure data factory and Azure databricksDevelop and maintain innovative Azure Azure data factory and Azure databricksSolution design using Microsoft...

  • Senior Data Engineer

    1 week ago

    Bangalore, India Squareroot Consulting Pvt Ltd Full time

    Job Title: Senior Data EngineerAbout the Role:We are seeking a highly skilled Senior Data Engineer to join our team at Squareroot Consulting Pvt Ltd. The ideal candidate will have extensive experience in Azure Data Factory (ADF) and Snowflake, with a strong background in data warehousing, ETL processes, and cloud platforms.Key Responsibilities:Design,...

  • Data Engineer

    6 days ago

    bangalore, India Data Labs - LANDMARK GROUP Full time

    Job Title: Lead Data Engineer Location: Yemalur, Bangalore Your Key Responsibilities: Lead our engineering team successfully build and deploy cutting edge analytics products for consumption by different stakeholders.Lead the architecture, design, and delivery of enterprise grade microservices. Deliver assigned projects within budgeted time, cost and agreed...

  • Senior Data Engineer

    1 week ago

    Bangalore, India Talent Corner HR Services Full time

    Job Title: Senior Data EngineerJob Summary:We are seeking a highly skilled Senior Data Engineer to join our dynamic team at Talent Corner HR Services. As a Senior Data Engineer, you will be responsible for designing, implementing, and maintaining our data infrastructure, pipelines, and systems.Key Responsibilities:Lead the design and implementation of robust...

  • Senior Data Engineer

    2 weeks ago

    bangalore, India ThoughtFocus Full time

    Job Description: Senior Data EngineerPosition: Senior Data Engineer Experience: 8-10 Years Location: Bangalore Employment Type: Full-Time---Summary:We are looking for a highly skilled Senior Data Engineer with 8-10 years of experience in SQL, Azure Data Factory (ADF), SQL Server Integration Services (SSIS), SQL Server Reporting Services (SSRS), and...

  • Senior Data Engineer

    6 days ago

    Bangalore, India Visionyle Solutions Full time

    Senior Data EngineerAt Visionyle Solutions, we are seeking a highly skilled Senior Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining large-scale data processing systems.Key Responsibilities:Design and develop scalable Big Data applications using distributed...