Ingestion Engineer

3 weeks ago

Delhi, Delhi, India Saxon Global Full time

HiHope you are doing good todayKindly go through the JD and let me know your interest you can reach me at : Ingestion Engineer Opportunity Available for Immediate JoiningLocation - Anywhere from IndiaTIMINGS - 10.00 AM IST to 7.00 PM ISTNeed good comm skills – they will be coordinating with Americans on daily basesWe are seeking an Ingestion Engineer with expertise in CI/CD and Kubernetes to join our team. This role requires a strong understanding of data ingestion processes, focusing on integrating various data sources into Databricks. The ideal candidate will have hands-on experience with data pipelines, automation, and infrastructure management to support scalable and efficient ingestion workflows.Key Responsibilities:Design, develop, and optimize data ingestion pipelines for integrating multiple sources into Databricks.Implement and maintain CI/CD pipelines for data workflows.Deploy and manage containerized applications using Kubernetes.Ensure data integrity, security, and compliance throughout the ingestion process.Collaborate with Data Engineers and other stakeholders to streamline data ingestion strategies.Troubleshoot and optimize ingestion pipelines for performance and scalability.Required Skills & Qualifications:Proven experience in data ingestion and pipeline development.Hands-on experience with CI/CD tools (GitHub Actions, Jenkins, Azure DevOps, etc.).Strong knowledge of Kubernetes and container orchestration.Experience with Databricks, Spark, and data lake architectures.Proficiency in Python, Scala, or SQL for data processing.Familiarity with cloud platforms such as AWS, Azure, or GCP.Strong problem-solving and analytical skills.Preferred Qualifications:Experience with Infrastructure as Code (Terraform, Helm, etc.).Background in streaming data ingestion (Kafka, Kinesis, etc.).Knowledge of data governance and security best practices.

  • Databricks Engineering Specialist

    1 week ago

    Delhi, Delhi, India beBeeDataIngestion Full time ₹ 18,00,000 - ₹ 25,00,000

    Azure Databricks Engineer PositionWe are seeking an experienced Azure Databricks Engineer to fill a critical role in our organization.Key Responsibilities:Develop and optimize data ingestion pipelines for integrating multiple sources into Databricks.Implement and maintain continuous integration and delivery pipelines for data workflows.Deploy and manage...

  • Data Engineering Architect

    7 days ago

    Delhi, Delhi, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Overview">This position will oversee the design and scalability of our data lake architecture, ensuring seamless performance across real-time and batch workloads.">Responsibilities include architecting cost-optimized pipelines, managing ingestion from transactional sources using AWS DMS, and designing efficient partitioning and compression strategies for...

  • Data Engineering Specialist

    2 weeks ago

    Delhi, Delhi, India beBeeSpecialist Full time ₹ 80,00,000 - ₹ 1,50,00,000

    Data Engineering SpecialistUnlock the Power of Data with Expertise in Big Data SolutionsAs a seasoned data engineering specialist, you will be responsible for designing and implementing scalable data architectures to meet the evolving needs of clients. With expertise in big data tools like PySpark, Hive, and Hadoop, you will develop high-performance data...

  • Associate Data Engineer

    2 weeks ago

    Delhi, Delhi, India Leuwint Technologies Full time

    Associate Data Engineer :We are seeking an experienced Associate Data Engineer with strong expertise in AWS, Databricks, Informatica IDMC, and Tableau to design, build, and optimize scalable data & Qualifications :- 5+ years of experience in data engineering with expertise in AWS, Databricks, and Informatica IDMC.- Design and implement scalable data storage...

  • Advanced Framework Lead Engineer

    7 days ago

    Delhi, Delhi, India beBeeFrameworks Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Advanced Framework Lead EngineerWe are seeking an accomplished lead engineer to create cutting-edge frameworks for alternate data analysis in the investment management domain.The successful candidate will leverage large language model APIs, build scalable orchestration pipelines, and architect cloud or private deployments to power next-generation AI-driven...

  • AI Engineering Expert

    2 weeks ago

    Delhi, Delhi, India beBeeDataDriven Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    We are seeking an experienced Lead Engineer to spearhead the design and implementation of advanced frameworks for alternate data analysis in the investment management domain.The ideal candidate will leverage Large Language Model APIs (GPT, LLaMA, etc.) to build scalable orchestration pipelines and architect cloud/private deployments for next-generation...

  • Accomplished Software Engineer

    2 weeks ago

    Delhi, Delhi, India beBeeDataEngineer Full time ₹ 10,00,000 - ₹ 20,00,000

    About the Role:">We are seeking an accomplished Software Engineer to lead our Data Engineering efforts. The ideal candidate will have expertise in designing and managing data pipelines, as well as a proven track record of delivering scalable solutions for accurate attribution across complex ecosystems.">Key Responsibilities:">Create and maintain data...

  • Data Validation Engineer

    2 weeks ago

    Delhi, Delhi, India VSHR UNNATI LLP Full time

    About the RoleWe are looking for a detail-oriented Data Validation Engineer to ensure the accuracy, quality, and consistency of data across our platforms. The ideal candidate will be proficient in PySpark and have strong experience working with Databricks to build automated validation frameworks that verify ingestion, transformation, and reporting...

  • GenAI Lead Engineer

    2 weeks ago

    Delhi, Delhi, India Vichara Technologies Full time

    We are seeking a highly skilled GenAI Lead Engineer to design and implement advanced frameworks for alternate data analysis in the investment management domain. The candidate will leverage LLM APIs (GPT, LLaMA, etc.) , build scalable orchestration pipelines, and architect cloud/private deployments to power next-generation AI-driven investment insights. This...

  • Urgent GenAI Lead Engineer

    2 weeks ago

    Delhi, Delhi, India Vichara Technologies Full time

    We are seeking a highly skilled GenAI Lead Engineer to design and implement advanced frameworks for alternate data analysis in the investment management domain. The candidate will leverage LLM APIs (GPT, LLaMA, etc.), build scalable orchestration pipelines, and architect cloud/private deployments to power next-generation AI-driven investment insights. This...