Ingestion Engineer

2 weeks ago

Tiruppur, Tamil Nadu, India Saxon Global Full time

Hi

Hope you are doing good today

Kindly go through the JD and let me know your interest you can reach me at SAI.K@SAXONGLOBAL.COM

Title: Ingestion Engineer Opportunity Available for Immediate Joining

Location - Anywhere from India

TIMINGS - 10.00 AM IST to 7.00 PM IST

Need good comm skills – they will be coordinating with Americans on daily bases

We are seeking an Ingestion Engineer with expertise in CI/CD and Kubernetes to join our team. This role requires a strong understanding of data ingestion processes, focusing on integrating various data sources into Databricks. The ideal candidate will have hands-on experience with data pipelines, automation, and infrastructure management to support scalable and efficient ingestion workflows.

Key Responsibilities:

  • Design, develop, and optimize data ingestion pipelines for integrating multiple sources into Databricks.
  • Implement and maintain CI/CD pipelines for data workflows.
  • Deploy and manage containerized applications using Kubernetes.
  • Ensure data integrity, security, and compliance throughout the ingestion process.
  • Collaborate with Data Engineers and other stakeholders to streamline data ingestion strategies.
  • Troubleshoot and optimize ingestion pipelines for performance and scalability.

Required Skills & Qualifications:

  • Proven experience in data ingestion and pipeline development.
  • Hands-on experience with CI/CD tools (GitHub Actions, Jenkins, Azure DevOps, etc.).
  • Strong knowledge of Kubernetes and container orchestration.
  • Experience with Databricks, Spark, and data lake architectures.
  • Proficiency in Python, Scala, or SQL for data processing.
  • Familiarity with cloud platforms such as AWS, Azure, or GCP.
  • Strong problem-solving and analytical skills.
  • Preferred Qualifications:
  • Experience with Infrastructure as Code (Terraform, Helm, etc.).
  • Background in streaming data ingestion (Kafka, Kinesis, etc.).
  • Knowledge of data governance and security best practices.

  • Data Ingestion Specialist

    2 weeks ago

    Tiruppur, Tamil Nadu, India beBeeIngestion Full time ₹ 15,00,000 - ₹ 20,00,000

    Key Player in Data IngestionWe are seeking a highly skilled data ingestion expert to play a pivotal role in our organisation.The ideal candidate will have extensive expertise in CI/CD and Kubernetes, with a strong understanding of data ingestion processes. They will focus on integrating various data sources into Databricks and designing, developing, and...

  • GCP Data Engineer

    6 days ago

    Tiruppur, Tamil Nadu, India TekDoors Inc. Full time

    Job Title: GCP Data EngineerLocation: Bangalore, Karnataka, IndiaContract Type: Full TimeMust-Have Skills:• Strong in SQL Database writing queries , GCP and GCP expertise, specifically BigQuery for real-time analytics.• Preferred tech stack includes: Processing & Analysis: Dataflow, Cloud Composer, Apache Airflow.• Data Storage: BigQuery, Cloud...

  • Data Engineering Architect

    2 days ago

    Tiruppur, Tamil Nadu, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Cloud Data Engineering ExpertJoin us in shaping the future of data engineering. We are seeking an experienced Cloud Data Engineering Expert to lead the design, development, and optimization of our cloud-native data engineering frameworks.This role involves working closely with cross-functional teams to deliver scalable, secure, and reliable data pipelines...

  • Databricks Integration Specialist

    2 weeks ago

    Tiruppur, Tamil Nadu, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Databricks Integration SpecialistKey Responsibilities:The primary function of this role is to develop and implement efficient data ingestion pipelines in Databricks, ensuring seamless integration with multiple sources.Design and optimize data ingestion pipelines for integrating various data sources into Databricks.Implement and maintain Continuous...

  • Senior Data Engineer

    6 days ago

    Tiruppur, Tamil Nadu, India beBeeDataEngineer Full time ₹ 1,80,00,000 - ₹ 2,50,00,000

    About the RoleWe are seeking an experienced Data Engineer to join our team. The successful candidate will be responsible for designing, developing and maintaining scalable ETL pipelines using Python to support data ingestion, transformation and integration from multiple sources.The role requires strong analytical and problem-solving skills with a keen...

  • Data Engineer

    4 days ago

    Tiruppur, Tamil Nadu, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    The role of a Data Engineer is pivotal in driving business transformation through the strategic use of data.Job DescriptionWe are seeking an experienced and skilled professional to design, build, and maintain robust data pipelines that can efficiently ingest and curate data. The ideal candidate will have strong SQL skills, experience with Azure cloud...

  • Chief Data Architectural Engineer

    2 days ago

    Tiruppur, Tamil Nadu, India beBeeDataEngineering Full time ₹ 10,00,000 - ₹ 20,00,000

    ">Job OverviewWe are seeking an experienced Data Engineering Lead with a strong foundation in data pipelines, data validation, and AI-enhanced quality frameworks. This role is responsible for building and maintaining high-quality data ingestion and validation processes from multiple upstream systems, while laying the foundation for AI-driven anomaly...

  • Expert Data Engineer

    2 weeks ago

    Tiruppur, Tamil Nadu, India beBeeDataEngineering Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Title: Data Engineering ExpertWe are seeking a highly skilled professional to develop and maintain complex data engineering projects.Key Responsibilities:Develop Extract, Transform, Load (ETL) pipelines using custom frameworks.Implement client-specific data transformations for integration purposes.Support data ingestion and quality checks during...

  • Data Engineering Specialist

    1 week ago

    Tiruppur, Tamil Nadu, India beBeeDataEngineering Full time ₹ 12,00,000 - ₹ 20,00,000

    Data Engineer RoleWe are seeking a skilled Data Engineer to build, maintain and optimize our data infrastructure.Responsibilities include:Designing and developing ETL/ELT data pipelines to ingest data from various sources into our data warehouse.Hands-on experience with AWS Cloud services including Lambda, DMS, and Glue.Developing and optimizing Snowflake...

  • Big Data Engineering Lead

    6 days ago

    Tiruppur, Tamil Nadu, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job Opportunity:A Senior Big Data Engineer is required to lead data engineering teams and manage cross-team collaboration, ensuring seamless integration with existing systems.Key Responsibilities:Lead data engineering teamsDesign and implement scalable big data pipelines using Apache Spark, Scala, and PythonWork with architects and product managers to ensure...