Senior Data Engineer

4 weeks ago

Bengaluru, Karnataka, India Sourcebae Full time
About the Role

As a key member of our Data Science team, you will play a critical role in enriching and maintaining the central repository of datasets, which is leveraged for advanced data analytics and machine learning techniques to extract actionable insights from financial and market data.

You will work closely with cross-functional teams to develop and implement robust data pipelines that automate the updation of data in our cloud-based repository, increasing data accessibility for the entire organization.

Key Responsibilities
  1. Design, develop, and maintain efficient ETL processes for multi-scale data sets.
  2. Implement and optimize data transformation and validation processes to ensure data accuracy and consistency.
  3. Collaborate with cross-functional teams to understand data requirements and business logic.
Data Pipeline Architecture

Architect, build and maintain scalable and high-performance data pipelines that meet the needs of the organization. Evaluate and implement new technologies to enhance data pipeline efficiency and reliability.

Pipelines for extracting data through scraping for ad-hoc sector specific datasets are also required.

Data Modelling

Develop and implement data models to support analytics and reporting needs.

Optimize database structures for performance and scalability.

Data Quality and Governance

Implement data quality checks and governance processes to ensure data integrity.

Collaborate with stakeholders to define and enforce data quality standards.

Documentation and Communication

Document ETL processes, data models, and other relevant information.

Communicate complex technical concepts to non-technical stakeholders effectively.

Requirements
  • Bachelor's degree in Computer Science, Information Technology, or a related field.
  • Proven experience as a Data Engineer with expertise in ETL techniques (2+ years).
  • Strong programming skills in languages such as Python, Java, or Scala.
  • Skillset to scrape and transform data off of the publicly available web sources.
  • Experience with cloud-based data platforms (e.g., AWS, Azure, GCP).
  • Proficiency in SQL and experience working with relational and non-relational databases.
  • Knowledge of data warehousing concepts and architectures.
  • Familiarity with big data technologies such as Hadoop, Spark, and Kafka.
  • Experience with data modeling tools and techniques.
  • Excellent problem-solving and analytical skills.
  • Strong communication and collaboration skills.

The estimated salary for this position is ₹1,200,000 per annum, considering the location in Bangalore and the required skills and qualifications.

  • Senior Data Engineering Manager

    4 weeks ago

    Bengaluru, Karnataka, India Data Labs - LANDMARK GROUP Full time

    About the RoleWe are seeking a Senior Data Engineering Manager to lead our engineering team in successfully building and deploying cutting-edge analytics products for consumption by various stakeholders.As a key member of our team, you will be responsible for leading the architecture, design, and delivery of enterprise-grade microservices. You will also...

  • Data Engineering Lead with Scalable Platforms

    3 weeks ago

    Bengaluru, Karnataka, India HEVO DATA Full time

    Unlock Career Growth as a Data Engineering LeadWe're seeking an exceptional Data Engineering Lead to join our team at Hevo Data. In this role, you'll have the opportunity to own and build scalable platform services that support thousands of customers' data pipelines and ensure load data reliability to cloud warehouses.The Hevo platform core services will...

  • Senior Analytics Engineer

    3 weeks ago

    Bengaluru, Karnataka, India Data Labs - LANDMARK GROUP Full time

    Job Title:Senior Analytics EngineerAbout the Role:We are seeking a highly skilled Senior Analytics Engineer to join our team at Data Labs - LANDMARK GROUP. As a key member of our engineering team, you will play a crucial role in designing, building, and deploying cutting-edge analytics products for consumption by different stakeholders.The ideal candidate...

  • Data Engineering Director

    3 weeks ago

    Bengaluru, Karnataka, India HEVO DATA Full time

    Engineering Leadership OpportunityThis is a unique chance to own and build scalable platform services that support thousands of customers' data pipelines, ensuring load data reliability to cloud warehouses.The Hevo platform core services will provide no-code-low pipeline building capabilities, making a significant impact on the company's business.About the...

  • Senior Data Solutions Consultant

    4 weeks ago

    Bengaluru, Karnataka, India HEVO DATA Full time

    Overview: We're seeking a skilled Senior Data Solutions Consultant to join our Sales team. This role involves working closely with the sales team to understand customers' business and technical needs and demonstrating how Hevo's platform can address their real-time data replication requirements.

  • Senior Data Engineer

    3 weeks ago

    Bengaluru, Karnataka, India Prodcon Tech Services Pvt Ltd Full time

    Job Title: Senior Data EngineerOverview of the Role: We are seeking a highly skilled Senior Data Engineer to join our team at Prodcon Tech Services Pvt Ltd. This individual will be responsible for designing, developing, and maintaining data pipelines and data warehousing solutions.The ideal candidate will have strong expertise in Amazon Data Warehouse (ADB)...

  • Data Engineering Leader

    4 days ago

    Bengaluru, Karnataka, India Data Inc Full time

    Job SummaryWe are seeking a highly skilled and experienced Data Architect to lead our team at Data Inc. This is a key role in shaping the future of our data architecture and driving business growth.About the RoleThe successful candidate will be responsible for overseeing the development and implementation of our data architecture strategy, ensuring alignment...

  • Senior Data Engineer

    1 month ago

    Bengaluru, Karnataka, India Kloud9 Full time

    Job Description for Senior Data EngineerCompany OverviewKloud9 is a dynamic and innovative company that requires a skilled Senior Data Engineer to join our team. As a Senior Data Engineer, you will play a key role in designing, developing, and maintaining our data pipelines and ETL processes.ResponsibilitiesCollaborate with cross-functional teams to...

  • Senior Data Engineer

    4 weeks ago

    Bengaluru, Karnataka, India Mouri Tech (P) Ltd Full time

    Job Title: Senior Data EngineerAbout Mouri Tech (P) LtdMouri Tech (P) Ltd is a leading technology company that requires experienced data engineers to drive our business growth. We are seeking a skilled Senior Data Engineer to join our team and help us develop innovative data-driven solutions.Salary: ₹1,200,000 - ₹2,500,000 per annumJob Description:We are...

  • Senior Data Engineer

    3 weeks ago

    Bengaluru, Karnataka, India TMRW Full time

    About TMRWTMRW is a company that values innovation and excellence in data engineering. We are looking for a talented Senior Data Engineer to join our team.

  • Data Engineering Manager Lead

    3 weeks ago

    Bengaluru, Karnataka, India HEVO DATA Full time

    Scale Data Pipeline Services with HevoWe are seeking an experienced Data Engineering Manager to lead the development of scalable platform services supporting thousands of customers' data pipelines.This role offers a unique opportunity to build and own critical components of our cloud warehouse solution, ensuring reliable data loading and streamlining...

  • Senior Data Engineer

    6 days ago

    Bengaluru, Karnataka, India Coffeee Full time

    We are seeking a skilled Data Engineer to join our innovative team at Coffeee.About the RoleWe are looking for a highly motivated and experienced professional to lead our Hadoop development efforts. As a Senior Data Engineer, you will be responsible for designing, implementing, and supporting large-scale data processing systems using the Hadoop...

  • Senior Data Engineer

    2 months ago

    Bengaluru, Karnataka, India StockX Full time

    About the Role: We are seeking a highly skilled Senior Data Engineer to join our team at StockX. As a Senior Data Engineer, you will be responsible for designing and building mission-critical data pipelines with a highly scalable distributed architecture.Key Responsibilities: Help continually improve ongoing financial reporting and analysis processes,...

  • Senior Data Engineer Leader

    3 days ago

    Bengaluru, Karnataka, India Indium Full time

    Indium is Seeking a Senior Data EngineerWe are looking for an experienced Senior Data Engineer to join our team. As a key member of our data engineering group, you will be responsible for designing and implementing large-scale data pipelines using Snowflake.Responsibilities:Design, implement, and maintain complex data pipelines in SnowflakeCollaborate with...

  • Chief Data Engineering Lead

    3 weeks ago

    Bengaluru, Karnataka, India Data Inc Full time

    About the RoleWe are seeking a highly skilled Chief Data Engineering Lead to join our team at Data Inc.This is an exciting opportunity to lead the development and implementation of architecture strategy and standards pertinent to the domain, and establish Standards and Best practices.

  • Senior Data Engineering Lead

    4 weeks ago

    Bengaluru, Karnataka, India ONE SAVING BANK Full time

    Job SummaryWe are seeking a highly experienced Senior Data Engineering Lead to join our team at ONE SAVING BANK. The successful candidate will have a strong background in data engineering, with expertise in Azure Data Factory, Azure Synapse, and Big Data Architecture Patterns.About the RoleThe Senior Data Engineering Lead will be responsible for designing...

  • Senior Data Engineering Strategist

    2 weeks ago

    Bengaluru, Karnataka, India Grid Dynamics Full time

    Job Title: Senior Data Engineering Strategist About Grid Dynamics:We are a leading provider of technology consulting, platform and product engineering, and advanced analytics services. We enable positive business outcomes for enterprise companies undergoing business transformation by solving their most pressing technical challenges. Role Overview:We are...

  • Senior Data Engineering Professional

    3 weeks ago

    Bengaluru, Karnataka, India Publicis Sapient Full time

    Job Summary:We are seeking a highly skilled Senior Data Engineering Professional to join our team. In this role, you will be responsible for designing and implementing data engineering solutions that meet the needs of our clients.About the Role:This is an exciting opportunity for a senior-level data engineer with expertise in big data technologies to make a...

  • Senior Data Engineer and Developer

    1 month ago

    Bengaluru, Karnataka, India Capco Full time

    Capco is seeking a highly skilled Senior Data Engineer and Developer to join our team in the United States.The estimated salary for this position is $170,000 - $200,000 per year, depending on experience and location.Job Description:We are looking for a Senior Data Engineer/Developer with expertise in designing, developing, and maintaining scalable data...

  • Senior Data Engineer Lead

    3 weeks ago

    Bengaluru, Karnataka, India Peoplepro Staffing Agency Full time

    About the RoleWe are seeking a highly skilled Senior Data Engineer to join our team at Peoplepro Staffing Agency.As a Senior Data Engineer, you will design and build data platforms and services while managing our data infrastructure in cloud environments that fuels strategic business decisions across Lifesight products.The estimated salary for this role is...