Data Ingestion Specialist

7 days ago

Bengaluru, Karnataka, India beBeeBackend Full time ₹ 80,00,000 - ₹ 1,40,00,000
Backend Engineer

We are seeking a skilled Backend Engineer to join our team.

The ideal candidate will have experience in writing clean, maintainable code and be able to explain technical concepts to both technical and non-technical stakeholders.

This is an exciting opportunity for a talented engineer to take on new challenges and contribute to the growth of our company.

About the Role
  • Develop scalable data collection pipelines: Power EQL Global's products with real-time financial data.
  • Implement automated web data extraction solutions: Leverage Python libraries like Selenium, BeautifulSoup, or Scrapy.
  • Collaborate with cross-functional teams: Align technical decisions with business goals.
  • Monitor and troubleshoot data pipelines: Ensure smooth and timely data delivery.
  • Communicate technical solutions: Work closely with non-technical stakeholders.
Requirements
  • 2+ years of backend engineering experience, focused on Python.
  • Proven ability to write clean code.
  • Ability to explain technical concepts.
  • Experience merging data from different sources.
  • Experience in automated web data extraction.
Preferred Skills
  • AWS services (Lambda, EC2, ECS, S3).
  • ETL processes, large-scale data pipeline management.
  • Docker for backend services and web data extraction scripts.
  • Proxy services.
Desired Qualities
  • Understanding of equity market mechanics.
  • Self-driven and proactive.
  • Strong problem-solving skills.
  • Clear communicator.
  • Pasionate about delivering high-quality data.

  • Databricks Ingestion Specialist

    6 days ago

    Bengaluru, Karnataka, India beBeeIngestion Full time ₹ 18,00,000 - ₹ 20,00,000

    Job Title:Databricks Ingestion SpecialistWe are seeking an experienced Databricks ingestion specialist with expertise in CI/CD and Kubernetes to design, develop, and optimize data ingestion pipelines.The ideal candidate will have hands-on experience with data pipelines, automation, and infrastructure management to support scalable and efficient ingestion...

  • Data Ingestion Specialist

    1 day ago

    Bengaluru, Karnataka, India beBeeDataExpert Full time ₹ 80,00,000 - ₹ 1,50,00,000

    Job DescriptionData Pipeline Management and ValidationBuild and manage ingestion workflows using Spark, Hive, Trino, and Kafka.Validate data ingestion, debug pipeline outputs, and support delta loads.Create and schedule Airflow DAGs for recurring ingestion processes.Automation and Scripting ExpertiseUtilize Python and Bash (or PowerShell) to automate...

  • Senior Data Ingestion Specialist

    2 days ago

    Bengaluru, Karnataka, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 24,00,000

    Join Our Data Engineering TeamWe are seeking a skilled Associate Software Engineer II to join our data engineering team. As a key member of our team, you will play a crucial role in developing and deploying scalable data ingestion mechanisms for generative AI-powered solutions.This is an exciting opportunity to work with cutting-edge technology and...

  • Data Engineering Specialist

    1 day ago

    Bengaluru, Karnataka, India beBeeDataEngineer Full time ₹ 1,04,000 - ₹ 1,30,878

    Job Title: Data Engineering SpecialistWe are seeking a highly skilled Data Engineering Specialist to join our team. This role will be responsible for designing, building, and maintaining large-scale data processing systems.Key Responsibilities:Data Ingestion: Develop and implement data ingestion pipelines using Azure Databricks (ADB) and Azure Data Factory...

  • Data Integration Specialist

    6 days ago

    Bengaluru, Karnataka, India beBeePentaho Full time ₹ 9,00,000 - ₹ 12,00,000

    Pentaho Data Integration SpecialistAs a key member of our team, you will be responsible for designing, developing, and implementing end-to-end Business Intelligence (BI) solutions using Pentaho Data Integration.Key Responsibilities:Data Ingestion and Processing: Develop expertise in ETL processes and data transformation using Pentaho Data Integration...

  • Data Quality Assurance Specialist

    4 days ago

    Bengaluru, Karnataka, India beBeeDataQuality Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Data Quality Assurance SpecialistOverview We are seeking an experienced Data Quality Assurance Specialist to join our team. In this role, you will be responsible for developing and executing test strategies focused on data pipelines, including ingestion, transformation, storage, and retrieval.Key Responsibilities: 1. Develop and execute test plans...

  • Data Governance Specialist

    4 days ago

    Bengaluru, Karnataka, India beBeeDataGovernance Full time ₹ 15,00,000 - ₹ 25,00,000

    Job DescriptionWe are seeking a skilled Data Governance Specialist to join our team. As a Data Governance Specialist, you will be responsible for managing and maintaining metadata across our organization.Key responsibilities include:Metadata ingestion: Collecting and storing metadata from various sources into Collibra Data Intelligence PlatformData lineage...

  • Data Transformation Specialist

    2 days ago

    Bengaluru, Karnataka, India beBeeDataTransformation Full time ₹ 15,00,000 - ₹ 18,00,000

    Job Title: Data Transformation SpecialistDescription:We are seeking a skilled Data Transformation Specialist to join our team. In this role, you will be responsible for designing and executing test cases to validate Databricks tables across various layers.You will have the opportunity to work on complex data transformations, ingestion, and processing logic,...

  • AWS Data Engineering Specialist

    4 days ago

    Bengaluru, Karnataka, India beBeeDataEngineering Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job Title:AWS Data Engineering SpecialistJob Description:We are seeking a highly skilled AWS Data Engineer to design, build and optimize large-scale data pipelines and analytics platforms. The ideal candidate will have strong hands-on expertise in AWS Glue, Athena, Redshift, PySpark, and SQL, with a solid understanding of data engineering and data...

  • Data Infrastructure Specialist

    3 days ago

    Bengaluru, Karnataka, India beBeeDataInfrastructure Full time ₹ 16,00,000 - ₹ 20,00,000

    Job Title: Data Infrastructure SpecialistAs a seasoned data infrastructure specialist, you will play a pivotal role in developing and implementing robust ETL/ELT processes that ingests, transform and integrate data from multiple sources into our enterprise data platform.Key Responsibilities:Design and build scalable and secure data pipelines utilizing AWS...