Data Ingestion Specialist

1 week ago

Bengaluru Delhi NCR Pune, India beBeeData Full time ₹ 15,00,000 - ₹ 22,00,000
Job Title: Data Ingestion Specialist

About the Role:
This is a fantastic opportunity to work with our team in developing innovative data solutions. Our ideal candidate will have experience in designing and implementing data-ingestion frameworks, real-time processing solutions, and data processing and transformation frameworks.

Mandatory Skills and Qualifications:
- Design and develop scalable data-ingestion frameworks, real-time processing solutions, and data processing and transformation frameworks leveraging open source tools and data processing frameworks.
- Hands-on experience with technologies such as Apache Nifi, PostgresSQL, DBT, GCP.
- Experience in GCP Cloud Composer, Big Query, DataProc.
- Strong understanding of system support and ability to offer operational support as part of a support rotation with other team members.
- Operationalize open-source data-analytic tools for enterprise use.
- Ensure data governance policies are followed by implementing or validating data lineage, quality checks, and data classification.
- Ability to understand and follow the company development lifecycle to develop, deploy and deliver the solutions.

Preferred Experience:
- Design and develop advanced data-ingestion frameworks, real-time processing solutions, and data processing and transformation frameworks.
- Deploy and provide support for application codes and analytical models.
- Create and enhance data solutions that enable seamless integration and flow of data across the data ecosystem.
- Provide business analysis and develop ETL code and scripting to meet all technical specifications and business requirements according to the established designs.
- Develop real-time data ingestion and stream-analytic solutions leveraging technologies such as Kafka, Apache Spark (SQL, Scala, Java), Python and Hadoop Platform.

  • Data Ingestion Specialist

    1 week ago

    Pune, Maharashtra, India beBeeDataIngestion Full time US$ 1,20,000 - US$ 1,80,000

    Job TitleA Data Ingestion Specialist is required to integrate multiple data sources into Databricks.Key Responsibilities:Design, develop and optimize data ingestion pipelines for integrating multiple sources into Databricks.Implement and maintain Continuous Integration/Continuous Deployment (CI/CD) pipelines for data workflows.Deploy and manage containerized...

  • Data Ingestion Specialist

    2 weeks ago

    Bengaluru, Karnataka, India beBeeDataExpert Full time ₹ 80,00,000 - ₹ 1,50,00,000

    Job DescriptionData Pipeline Management and ValidationBuild and manage ingestion workflows using Spark, Hive, Trino, and Kafka.Validate data ingestion, debug pipeline outputs, and support delta loads.Create and schedule Airflow DAGs for recurring ingestion processes.Automation and Scripting ExpertiseUtilize Python and Bash (or PowerShell) to automate...

  • Data Ingestion Specialist

    2 weeks ago

    Pune, Maharashtra, India beBeeData Full time ₹ 25,00,000 - ₹ 35,00,000

    Transform Your Career with Data Ingestion ExpertiseAs a seasoned professional, you have the opportunity to advance your career by leveraging your technical skills in designing, testing, and implementing data ingestion pipelines. Our organization seeks an individual with hands-on experience in tools such as GCP Data Fusion, CDAP, or similar technologies.Key...

  • Ingestion Engineer

    3 weeks ago

    Delhi, Delhi, India Saxon Global Full time

    HiHope you are doing good todayKindly go through the JD and let me know your interest you can reach me at : Ingestion Engineer Opportunity Available for Immediate JoiningLocation - Anywhere from IndiaTIMINGS - 10.00 AM IST to 7.00 PM ISTNeed good comm skills – they will be coordinating with Americans on daily basesWe are seeking an Ingestion Engineer with...

  • Ingestion Engineer

    2 days ago

    Delhi, India Saxon Global Full time

    HiHope you are doing good today!!!Kindly go through the JD and let me know your interest you can reach me at : Ingestion Engineer Opportunity Available for Immediate JoiningLocation - Anywhere from IndiaTIMINGS - 10.00 AM IST to 7.00 PM ISTNeed good comm skills – they will be coordinating with Americans on daily basesWe are seeking an Ingestion Engineer...

  • Data Ingestion Specialist

    6 days ago

    Bengaluru, Karnataka, India beBeeScraping Full time ₹ 90,00,000 - ₹ 1,25,00,000

    Senior Web Scraping Engineer PositionWe're developing a high-throughout product data ingestion pipeline across hundreds of domains. This position entails owning the crawling/extraction layer end-to-end.

  • Senior Data Ingestion Specialist

    2 weeks ago

    Bengaluru, Karnataka, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 24,00,000

    Join Our Data Engineering TeamWe are seeking a skilled Associate Software Engineer II to join our data engineering team. As a key member of our team, you will play a crucial role in developing and deploying scalable data ingestion mechanisms for generative AI-powered solutions.This is an exciting opportunity to work with cutting-edge technology and...

  • Expert in Real-Time Data Ingestion

    4 weeks ago

    Pune, Maharashtra, India beBeeDataIngestion Full time

    Real-Time Data Ingestion Expert ">We are looking for a highly skilled and adaptable professional to join our team as a Real-Time Data Ingestion Expert. This role involves designing, building, and maintaining scalable systems that stream high-quality, trusted data from Kafka to Snowflake via Snowpipe Streaming. ">The ideal candidate will have a strong...

  • Dataiku Architect

    1 week ago

    Pune, India Irisidea TechSolutions Pvt Ltd Full time

    **Designation****: Dataiku Architect **Budget****: As Per Market Standard **Experience**: 5 Years **Primary Skills**: Data Storage, Data Ingestion & Integration, Data Processing **Relevant Exp.**: 5 Years **No. of Positions****: 1 **Work Location(s)**: Pune

  • Real-Time Data Ingestion Platform Developer

    2 weeks ago

    Pune, Maharashtra, India beBeeSoftware Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    **Job Overview**We are seeking a highly skilled Staff Software Engineer to contribute to the development of our real-time data ingestion platform.This role involves designing, building, and maintaining scalable systems that stream high-quality, trusted data from Kafka to Snowflake via Snowpipe Streaming. The ideal candidate will have a strong understanding...