Ingestion Engineer

Hi

Hope you are doing good today

Kindly go through the JD and let me know your interest you can reach me at SAI.K@SAXONGLOBAL.COM

Title: Ingestion Engineer Opportunity Available for Immediate Joining

Location - Anywhere from India

TIMINGS - 10.00 AM IST to 7.00 PM IST

Need good comm skills – they will be coordinating with Americans on daily bases

We are seeking an Ingestion Engineer with expertise in CI/CD and Kubernetes to join our team. This role requires a strong understanding of data ingestion processes, focusing on integrating various data sources into Databricks. The ideal candidate will have hands-on experience with data pipelines, automation, and infrastructure management to support scalable and efficient ingestion workflows.

Key Responsibilities:

• Design, develop, and optimize data ingestion pipelines for integrating multiple sources into Databricks.
• Implement and maintain CI/CD pipelines for data workflows.
• Deploy and manage containerized applications using Kubernetes.
• Ensure data integrity, security, and compliance throughout the ingestion process.
• Collaborate with Data Engineers and other stakeholders to streamline data ingestion strategies.
• Troubleshoot and optimize ingestion pipelines for performance and scalability.

Required Skills & Qualifications:

• Proven experience in data ingestion and pipeline development.
• Hands-on experience with CI/CD tools (GitHub Actions, Jenkins, Azure DevOps, etc.).
• Strong knowledge of Kubernetes and container orchestration.
• Experience with Databricks, Spark, and data lake architectures.
• Proficiency in Python, Scala, or SQL for data processing.
• Familiarity with cloud platforms such as AWS, Azure, or GCP.
• Strong problem-solving and analytical skills.
• Preferred Qualifications:
• Experience with Infrastructure as Code (Terraform, Helm, etc.).
• Background in streaming data ingestion (Kafka, Kinesis, etc.).
• Knowledge of data governance and security best practices.