Data Ingestion Engineer

15 hours ago

Bengaluru, Karnataka, India beBeeBackend Full time ₹ 15,00,000 - ₹ 25,00,000

About our Data Team:

We're building a data-driven platform for the finance sector.

Role:

You'll help create and maintain data ingestion systems that process financial documents, supporting real-time data solutions.

Responsibilities:

  • Design scalable data collection pipelines
  • Implement automated web data extraction solutions
  • Collaborate with cross-functional teams
  • Monitor and troubleshoot data pipelines
  • Communicate technical concepts to stakeholders

Required Technical Skills:

  • 2+ years of experience as a backend engineer, focused on Python
  • Ability to write clean code
  • Experience merging data from different sources
  • Automated web data extraction skills

Preferred Technical Skills:

  • AWS services experience (Lambda, EC2, ECS, S3)
  • ETL processes experience
  • Docker experience
  • Proxy services experience

Desired Qualities:

  • Understanding of market mechanics
  • Self-driven, proactive attitude
  • Strong problem-solving skills
  • Clear communication
  • Possession of core values

What We Offer:

  • Competitive compensation
  • Stock option plan
  • Equipment of choice
  • Wellness allowance
  • Flexible work setup

  • Data Ingestion Specialist

    4 days ago

    Bengaluru, Karnataka, India beBeeDataExpert Full time ₹ 80,00,000 - ₹ 1,50,00,000

    Job DescriptionData Pipeline Management and ValidationBuild and manage ingestion workflows using Spark, Hive, Trino, and Kafka.Validate data ingestion, debug pipeline outputs, and support delta loads.Create and schedule Airflow DAGs for recurring ingestion processes.Automation and Scripting ExpertiseUtilize Python and Bash (or PowerShell) to automate...

  • Databricks Ingestion Specialist

    1 week ago

    Bengaluru, Karnataka, India beBeeIngestion Full time ₹ 18,00,000 - ₹ 20,00,000

    Job Title:Databricks Ingestion SpecialistWe are seeking an experienced Databricks ingestion specialist with expertise in CI/CD and Kubernetes to design, develop, and optimize data ingestion pipelines.The ideal candidate will have hands-on experience with data pipelines, automation, and infrastructure management to support scalable and efficient ingestion...

  • Senior Data Ingestion Specialist

    5 days ago

    Bengaluru, Karnataka, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 24,00,000

    Join Our Data Engineering TeamWe are seeking a skilled Associate Software Engineer II to join our data engineering team. As a key member of our team, you will play a crucial role in developing and deploying scalable data ingestion mechanisms for generative AI-powered solutions.This is an exciting opportunity to work with cutting-edge technology and...

  • Data Engineer

    3 days ago

    Bengaluru, Karnataka, India krtrimaIQ Cognitive Solutions Full time US$ 1,00,000 - US$ 1,50,000 per year

    Job Title: AWS Data EngineerLocation: Bengaluru | HybridExperience: Minimum 4+ yearsCompany : krtrimaIQ Cognitive SolutionsRole OverviewWe are seeking an experienced AWS Data Engineer with strong expertise in building, deploying, and optimizing data pipelines on AWS. The ideal candidate will have 4+ years of experience in data engineering with hands-on...

  • Data Engineer- NAB

    3 days ago

    Bengaluru, Karnataka, India Capco Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Job TitleJD for Sr. Data Engineer (/ETL Developer)Job SummaryWe are looking for a talented Data Engineer cum Database Developer with a strong background in the banking sector. The ideal candidate will have experience with SQL Server, AWS PostgreSQL, AWS Glue, and ETL tools, along with expertise in data ingestion frameworks and Control-M schedulingKey...

  • Industrial Data Ingestion Expert

    16 hours ago

    Bengaluru, Karnataka, India beBeeProduct Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Senior Product Manager OpportunityThis is a key position that involves shaping the strategy and execution for industrial data ingestion into CDF extractors.The ideal candidate will have extensive knowledge of industrial software, data integration, and related fields. They will be instrumental in defining the product vision and roadmap for CDF extractors,...

  • Data Engineering Expert

    4 days ago

    Bengaluru, Karnataka, India beBeeDataEngineering Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Data Engineering ExpertJob Title:Data Engineering ExpertRole Overview:We are seeking a Data Engineering Expert to design and implement high-performance data ingestion and transformation pipelines using Azure Databricks and Apache Spark.

  • Data Engineer

    2 days ago

    Bengaluru, Karnataka, India Success Consultancy Services Full time US$ 90,000 - US$ 1,20,000 per year

    • Design, develop, and maintain ETL pipelines to ingest, clean, and transform large volumes of structured and unstructured data.• Work closely with data scientists and analysts to support advanced analytics, machine learning models Required Candidate profile• Bachelor's degree in Computer Science, Engineering, Mathematics, or a related field.•...

  • Digital Engineering Sr. Engineer

    4 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Req ID 268395NTT DATA Services strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a Digital Engineering Sr Engineer to join our team in Bangalore Karnxc4x81taka IN-KA India IN Role...

  • Leading Data Engineer

    4 days ago

    Bengaluru, Karnataka, India beBeeData Full time ₹ 1,04,000 - ₹ 1,30,878

    Job DescriptionSenior Engineer: Data Ingestion and AnalyticsDevelop and deliver elements of engineering solutions to accomplish business goals. Develop and maintain stable and scalable data ingestion workflows, integrating into existing workflows.Design and code data ingestion pipelines for large-scale datasets.Collaborate with team members and stakeholders...