Current jobs related to Senior Data Engineer - bangalore - Web Idea Solution LLP

  • Senior Data Engineer

    2 weeks ago

    Bangalore, India Junglee Games India Private Limited Full time

    Job Title: Senior Data EngineerDescription:As a Senior Data Engineer at Junglee Games India Private Limited, you will play a key role in evolving the design and architecture of our data infrastructure. You will be responsible for writing code primarily in Spark, Python, and/or Scala, and developing streaming applications like Spark structured streaming and...

  • Senior Data Engineer

    3 weeks ago

    Bangalore, India ADVANSOFT Full time

    Job Title: Senior Data EngineerJob Summary:We are seeking a highly skilled Senior Data Engineer to join our team at Advansoft. As a Senior Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data systems that support our business operations.Key Responsibilities:Design and develop complex data pipelines using PySpark,...

  • Senior data engineer

    3 weeks ago

    Bangalore, India ThoughtFocus Full time

    Job Description: Senior Data Engineer Position: Senior Data Engineer Experience: 8-10 Years Location: Bangalore Employment Type: Full-Time --- Summary: We are looking for a highly skilled Senior Data Engineer with 8-10 years of experience in SQL, Azure Data Factory (ADF), SQL Server Integration Services (SSIS), SQL Server Reporting Services (SSRS), and...

  • Senior Data Engineer

    3 weeks ago

    bangalore, India ThoughtFocus Full time

    Job Description: Senior Data EngineerPosition: Senior Data Engineer Experience: 8-10 Years Location: Bangalore Employment Type: Full-Time---Summary:We are looking for a highly skilled Senior Data Engineer with 8-10 years of experience in SQL, Azure Data Factory (ADF), SQL Server Integration Services (SSIS), SQL Server Reporting Services (SSRS), and...

  • Data engineer

    3 weeks ago

    Bangalore, India Data Labs - LANDMARK GROUP Full time

    Job Title: Lead Data Engineer Location: Yemalur, Bangalore Your Key Responsibilities: Lead our engineering team successfully build and deploy cutting edge analytics products for consumption by different stakeholders. Lead the architecture, design, and delivery of enterprise grade microservices. Deliver assigned projects within budgeted time, cost...

  • Data Engineer

    3 weeks ago

    Bangalore, India Data Labs - LANDMARK GROUP Full time

    Job Title: Lead Data Engineer Location: Yemalur, Bangalore Your Key Responsibilities: Lead our engineering team successfully build and deploy cutting edge analytics products for consumption by different stakeholders. Lead the architecture, design, and delivery of enterprise grade microservices. Deliver assigned projects within budgeted time, cost and...

  • Senior Data Engineer

    3 weeks ago

    Bangalore, India Aeries Technology Group Full time

    Job Title: Senior Data EngineerJob Summary: We are seeking a highly skilled Senior Data Engineer to join our team at Aeries Technology Group. As a Senior Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data engineering systems.Key Responsibilities:Collaborate with cross-functional teams to understand data...

  • Senior Data Engineer

    3 weeks ago

    Bangalore, India KreditBee Full time

    Job Title: Senior Data EngineerJob Summary:We are seeking a highly skilled Senior Data Engineer to join our team at KreditBee. As a Senior Data Engineer, you will be responsible for developing and implementing data engineering solutions to support our digital lending platform.Key Responsibilities:Develop and maintain data pipelines to extract, transform, and...

  • Senior Data Engineer

    3 weeks ago

    Bangalore, India SKYLARK HR SOLUTIONS Pvt Ltd Full time

    Job Title: Senior Data EngineerJob Summary:We are seeking a highly skilled Senior Data Engineer to join our team at SKYLARK HR SOLUTIONS Pvt Ltd. As a Senior Data Engineer, you will be responsible for designing and implementing data processing pipelines using PySpark and Python, collaborating with cross-functional teams to understand data requirements, and...

  • Senior Data Engineer

    2 weeks ago

    Bangalore, India Kloud9 Full time

    Job Title: Senior Data EngineerKloud9 is seeking an experienced Senior Data Engineer to join our team. As a Senior Data Engineer, you will play a key role in designing, developing, and maintaining our data infrastructure.Key Responsibilities:Collaborate with cross-functional teams to understand data requirements and design optimal data solutions on...

  • Data Engineer

    3 weeks ago

    bangalore, India Data Labs - LANDMARK GROUP Full time

    Job Title: Lead Data Engineer Location: Yemalur, Bangalore Your Key Responsibilities: Lead our engineering team successfully build and deploy cutting edge analytics products for consumption by different stakeholders.Lead the architecture, design, and delivery of enterprise grade microservices. Deliver assigned projects within budgeted time, cost and agreed...

  • Senior Data Engineer

    4 weeks ago

    Bangalore, India HAD Recruitment Services Full time

    Senior Data EngineerJob Summary:We are seeking a highly skilled Senior Data Engineer to join our team at HAD Recruitment Services. As a Senior Data Engineer, you will be responsible for designing, developing, and maintaining robust data pipelines and architectures on the Azure platform.Key Responsibilities:Design and develop data pipelines and architectures...

  • Senior Data Engineer

    3 weeks ago

    Bangalore, India HAD Recruitment Services Full time

    Job Title: Senior Data EngineerJob Summary:We are seeking a highly skilled Senior Data Engineer to join our team at HAD Recruitment Services. As a Senior Data Engineer, you will be responsible for designing, developing, and maintaining robust data pipelines and architectures on the Azure platform.Key Responsibilities:Design and develop data pipelines and...

  • Senior Data Engineer

    3 weeks ago

    Bangalore, India HAD Recruitment Services Full time

    Job Title: Senior Data EngineerJob Summary:We are seeking a highly skilled Senior Data Engineer to join our team at HAD Recruitment Services. As a Senior Data Engineer, you will be responsible for designing, developing, and maintaining robust data pipelines and architectures on the Azure platform.Key Responsibilities:Design and develop data pipelines and...

  • Senior Data Engineer

    2 weeks ago

    Bangalore, India Expian Technologies Pvt Ltd Full time

    About the RoleWe are seeking a skilled Senior Data Engineer to join our team at Expian Technologies Pvt Ltd. As a Senior Data Engineer, you will be responsible for designing, implementing, and maintaining data processing pipelines and workflows using Databricks on the Azure platform.Key ResponsibilitiesCollaborate with cross-functional teams to understand...

  • Senior Data Engineer

    4 weeks ago

    Bangalore, India Squareroot Consulting Pvt Ltd Full time

    Job Title: Senior Data EngineerAbout the Role:We are seeking a highly skilled Senior Data Engineer to join our team at Squareroot Consulting Pvt Ltd. The ideal candidate will have extensive experience in Azure Data Factory (ADF) and Snowflake, with a strong background in data warehousing, ETL processes, and cloud platforms.Key Responsibilities:Design,...

  • Senior Data Engineer

    4 weeks ago

    Bangalore, India Talent Corner HR Services Full time

    Job Title: Senior Data EngineerJob Summary:We are seeking a highly skilled Senior Data Engineer to join our dynamic team at Talent Corner HR Services. As a Senior Data Engineer, you will be responsible for designing, implementing, and maintaining our data infrastructure, pipelines, and systems.Key Responsibilities:Lead the design and implementation of robust...

  • Senior Data Engineer

    4 weeks ago

    bangalore, India ThoughtFocus Full time

    Job Description: Senior Data EngineerPosition: Senior Data Engineer Experience: 8-10 Years Location: Bangalore Employment Type: Full-Time---Summary:We are looking for a highly skilled Senior Data Engineer with 8-10 years of experience in SQL, Azure Data Factory (ADF), SQL Server Integration Services (SSIS), SQL Server Reporting Services (SSRS), and...

  • Senior Data Engineer

    1 week ago

    Bangalore, India ThoughtFocus Full time

    Job Description: Senior Data Engineer Position: Senior Data Engineer Experience: 8-10 Years Location: Bangalore Employment Type: Full-Time Must have experience in Capital Markets, Investment banking domain. --- Summary: We are looking for a highly skilled Senior Data Engineer with 8-10 years of experience in SQL, Azure Data Factory (ADF),...

  • Senior Data Engineer

    1 week ago

    bangalore, India ThoughtFocus Full time

    Job Description: Senior Data Engineer Position: Senior Data Engineer Experience: 8-10 Years Location: Bangalore Employment Type: Full-Time Must have experience in Capital Markets, Investment banking domain. --- Summary: We are looking for a highly skilled Senior Data Engineer with 8-10 years of experience in SQL, Azure Data Factory (ADF), SQL Server...

Senior Data Engineer

5 months ago

bangalore, India Web Idea Solution LLP Full time

Senior Data Engineer


Job Description :


- Design and build reusable components, frameworks and libraries at scale to support analytics products.

- Design and implement product features in collaboration with business and Technology stakeholders.

- Anticipate, identify and solve issues concerning data management to improve data quality.

- Clean, prepare and optimize data at scale for ingestion and consumption.

- Drive the implementation of new data management projects and re-structure of the current data architecture.

- Implement complex automated workflows and routines using workflow scheduling tools.

- Build continuous integration, test-driven development and production deployment frameworks.

- Drive collaborative reviews of design, code, test plans and dataset implementation performed by other data engineers in support of maintaining data engineering standards.

- Analyze and profile data for the purpose of designing scalable solutions.

- Troubleshoot complex data issues and perform root cause analysis to proactively resolve product and operational issues.

- Mentor and develop other data engineers in adopting best practices.

Qualifications :

Primary skillset :

- Experience working with distributed technology tools for developing Batch and Streaming pipelines using :

1. SQL, Spark, Python, PySpark (4+ years)

2. Airflow (3+ years)

3. Scala (2+ years).

- Able to write code which is optimized for performance.

- Experience in Cloud platform, e.g., AWS, GCP, Azure, etc.

- Able to quickly pick up new programming languages, technologies, and frameworks.

- Strong skills building positive relationships across Product and Engineering.

- Able to influence and communicate effectively, both verbally and written, with team members and business stakeholders

- Experience with creating/ configuring Jenkins pipeline for smooth CI/CD process for Managed Spark jobs, build Docker images, etc.

- Working knowledge of Data warehousing, Data modelling, Governance and Data Architecture

Good to have :

- Experience working with Data platforms, including EMR, Airflow, Databricks (Data Engineering & Delta Lake components, and Lakehouse Medallion architecture), etc.

- Experience working in Agile and Scrum development process.

- Experience in EMR/ EC2, Databricks etc.

- Experience working with Data warehousing tools, including SQL database, Presto, and Snowflake

- Experience architecting data product in Streaming, Serverless and Microservices Architecture and platform.

(ref:hirist.tech)