Data Ingestion Specialist

2 weeks ago

Pune, Maharashtra, India beBeeData Full time ₹ 25,00,000 - ₹ 35,00,000
Transform Your Career with Data Ingestion Expertise

As a seasoned professional, you have the opportunity to advance your career by leveraging your technical skills in designing, testing, and implementing data ingestion pipelines. Our organization seeks an individual with hands-on experience in tools such as GCP Data Fusion, CDAP, or similar technologies.

Key Responsibilities:
  • Design, build, test, and deploy performant and effective cloud data ingest pipelines via API / SFTP / etc. into GCP Warehouse.
  • Develop, test, and deploy GCP Data Fusion custom plugins.
  • Build automated tests to validate ETL pipelines.
  • Handle incremental and full data loading strategies for structured and semi-structured data with medium-to-high volume, velocity, variety.
  • Perform data enrichment, standardization, cleanse, aggregation in Datafusion ensuring data integrity, consistency, and compliance with business and overall organizational standards, data governance, and sovereignty.
  • Develop procedures and scripts for data migration, back-population, and feed-to-warehouse initialization.
  • Carry out Data Ops required activities ensuring pipelines health, performance, and data in-time delivery for consumers.
Required Skills and Qualifications:
  • Proven hands-on experience in designing, testing, and implementing data ingestion pipelines on GCP Data Fusion, CDAP, or similar tools.
  • Modern world data contract best practices understanding with proven experience for independently directing, negotiating, and documenting best-in-class data contracts.
  • Good Java knowledge: experience in Java development.
  • Proficiency in working with Continuous Integration (CI), Continuous Delivery (CD), and continuous testing tools, ideally for cloud-based data solutions.
  • Experience in working in Agile environment and toolset.
  • Strong problem-solving and analytical skills.
  • Enthusiastic willingness to learn and develop technical and soft skills as needs require rapidly and independently.
  • Strong organizational and multi-tasking skills.
  • Good team player who embraces teamwork and mutual support.

You will achieve more when you join our organization.

  • Data Ingestion Specialist

    1 week ago

    Pune, Maharashtra, India beBeeDataIngestion Full time US$ 1,20,000 - US$ 1,80,000

    Job TitleA Data Ingestion Specialist is required to integrate multiple data sources into Databricks.Key Responsibilities:Design, develop and optimize data ingestion pipelines for integrating multiple sources into Databricks.Implement and maintain Continuous Integration/Continuous Deployment (CI/CD) pipelines for data workflows.Deploy and manage containerized...

  • Expert in Real-Time Data Ingestion

    4 weeks ago

    Pune, Maharashtra, India beBeeDataIngestion Full time

    Real-Time Data Ingestion Expert ">We are looking for a highly skilled and adaptable professional to join our team as a Real-Time Data Ingestion Expert. This role involves designing, building, and maintaining scalable systems that stream high-quality, trusted data from Kafka to Snowflake via Snowpipe Streaming. ">The ideal candidate will have a strong...

  • Real-Time Data Ingestion Platform Developer

    2 weeks ago

    Pune, Maharashtra, India beBeeSoftware Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    **Job Overview**We are seeking a highly skilled Staff Software Engineer to contribute to the development of our real-time data ingestion platform.This role involves designing, building, and maintaining scalable systems that stream high-quality, trusted data from Kafka to Snowflake via Snowpipe Streaming. The ideal candidate will have a strong understanding...

  • Software Development Specialist Advisor

    1 week ago

    Pune, Maharashtra, India NTT DATA Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Req ID: 336185NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Software Development Specialist Advisor to join our team in Pune, Mahārāshtra (IN-MH), India (IN). Job...

  • Data Architect Specialist

    2 weeks ago

    Pune, Maharashtra, India beBeeData Full time ₹ 12,00,000 - ₹ 25,00,000

    Data Architect SpecialistAs a skilled Data Architect Specialist, you will be responsible for designing and implementing scalable data pipelines to support business growth.The ideal candidate will have experience in ETL/ELT data pipeline design, SQL scripting, and Python programming. Familiarity with cloud services such as AWS Lambda, DMS, Glue, Snowflake,...

  • Data Pipeline Engineer

    7 days ago

    Pune, Maharashtra, India beBeeData Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Big Data Specialist - Data Pipeline EngineerAs a Big Data Specialist - Data Pipeline Engineer, you will be responsible for designing, building, and maintaining robust data pipelines to efficiently curate and ingest data.Our ideal candidate will have strong SQL skills, experience with Fabric, and proficiency in programming languages such as Python (PySpark)....

  • Expert Data Developer

    2 weeks ago

    Pune, Maharashtra, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Unlock Your Potential as a Data ExpertJob DescriptionAs a Consultant Specialist ETL Engineer, you will develop and support new feeds ingestion, understand existing frameworks, and implement changes in Data Ingestion/Juniper within stipulated timelines.Develop and support new feeds ingestion/understand existing framework and do the development as per business...

  • Urgent Search Gcp, Api, Data Ingestion Patterns,solution Analyst

    2 weeks ago

    Pune, Maharashtra, India HSBC Full time

    Job descriptionSome careers shine brighter than othersIf youre looking for a career that will help you stand out join HSBC and fulfil your potential Whether you want a career that could take you to the top or simply take you in an exciting new direction HSBC offers opportunities support and rewards that will take you furtherHSBC is one of the largest...

  • Data Insights Specialist

    2 weeks ago

    Pune, Maharashtra, India beBeeData Full time ₹ 7,00,000 - ₹ 11,00,000

    Data Insights SpecialistWe are seeking a detail-oriented Data Insights Specialist to support our cloud-based data solutions. The successful candidate will be responsible for data ingestion, transformation, and analysis, ensuring data quality and providing ongoing support for our solutions across multiple markets.The role involves managing the maintenance of...

  • Data Engineer

    5 days ago

    Pune, Maharashtra, India Data Axle Full time ₹ 15,00,000 - ₹ 28,00,000 per year

    About Data Axle:Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology platform and leveraging proprietary...