Ingestion engineer

4 weeks ago

Lucknow, Uttar Pradesh, India Saxon Global Full time

Hi Hope you are doing good todayKindly go through the JD and let me know your interest you can reach me at SAI. COMTitle: Ingestion Engineer Opportunity Available for Immediate Joining Location - Anywhere from India TIMINGS - 10.00 AM IST to 7.00 PM ISTNeed good comm skills – they will be coordinating with Americans on daily basesWe are seeking an Ingestion Engineer with expertise in CI/CD and Kubernetes to join our team. This role requires a strong understanding of data ingestion processes, focusing on integrating various data sources into Databricks. The ideal candidate will have hands-on experience with data pipelines, automation, and infrastructure management to support scalable and efficient ingestion workflows.Key Responsibilities:Design, develop, and optimize data ingestion pipelines for integrating multiple sources into Databricks.Implement and maintain CI/CD pipelines for data workflows.Deploy and manage containerized applications using Kubernetes.Ensure data integrity, security, and compliance throughout the ingestion process.Collaborate with Data Engineers and other stakeholders to streamline data ingestion strategies.Troubleshoot and optimize ingestion pipelines for performance and scalability.Required Skills & Qualifications:Proven experience in data ingestion and pipeline development.Hands-on experience with CI/CD tools (Git Hub Actions, Jenkins, Azure Dev Ops, etc.).Strong knowledge of Kubernetes and container orchestration.Experience with Databricks, Spark, and data lake architectures.Proficiency in Python, Scala, or SQL for data processing.Familiarity with cloud platforms such as AWS, Azure, or GCP.Strong problem-solving and analytical skills.Preferred Qualifications:Experience with Infrastructure as Code (Terraform, Helm, etc.).Background in streaming data ingestion (Kafka, Kinesis, etc.).Knowledge of data governance and security best practices.

  • Senior Cloud Data Engineer

    2 weeks ago

    Lucknow, Uttar Pradesh, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    GreetingsA Data Engineering Role with a Focus on Cloud InfrastructureLocation: Remote Work EnvironmentExperience Required: 4+ YearsContract Duration: 4 MonthsWork Schedule: 11 am to 8 pm ISTMust have skills:1. GCP Services - GCS, PubSub, Dataflow or DataProc, Bigquery, Airflow/Composer, Python(preferred)/Java2. ETL Process Development using GCP Cloud3. Data...

  • Senior Manager of Data Engineering Quality Assurance

    2 weeks ago

    Lucknow, Uttar Pradesh, India beBeeDataEngineering Full time ₹ 18,50,000 - ₹ 23,50,000

    About the RoleLead comprehensive testing strategy and execution for complex data engineering pipelines and product delivery initiatives.Cross-functional coordination is key to success in this position, collaborating with data engineers, software developers, product managers, and DevOps teams.Data Engineering Testing:Create comprehensive test suites for data...

  • Data Engineering Specialist

    2 weeks ago

    Lucknow, Uttar Pradesh, India beBeeAzure Full time ₹ 20,00,000 - ₹ 25,00,000

    Senior Azure Data EngineerWe are seeking a seasoned Data Engineer to join our team, specializing in designing and implementing data solutions on the Azure platform.Design and develop efficient data pipelines using Azure Data Factory, Databricks, and PySpark to process large datasets.Collaborate with cross-functional teams to implement data integration, ETL...

  • Cloud Engineering Solutions Specialist

    2 weeks ago

    Lucknow, Uttar Pradesh, India beBeeCloudEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    Senior Cloud EngineerThis role is focused on delivering high-quality cloud engineering solutions using Google Cloud Platform (GCP) services.Key Responsibilities:Diagnose and troubleshoot complex technical issues in cloud infrastructure.Maintain expertise in TensorFlow, Big Query, and Vertex AI to develop scalable machine learning models.Design and implement...

  • High Throughput Data Extraction Specialist

    2 weeks ago

    Lucknow, Uttar Pradesh, India beBeeWebScraping Full time ₹ 40,00,000 - ₹ 50,00,000

    We're seeking a seasoned Web Scraping Engineer to join our team. As a key member of our data extraction initiative, you will be responsible for designing and implementing a high-throughput product data ingestion pipeline across hundreds of domains.

  • Chief Data Engineering Operations Leader

    2 weeks ago

    Lucknow, Uttar Pradesh, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,02,50,000

    Senior Data Engineering Project ManagerThe ideal candidate will have hands-on experience in managing data engineering, analytics, or AI/ML projects from start to finish.Key Responsibilities:Develop and implement comprehensive project plans, roadmaps, and timelines for data ingestion, transformation, governance, AI/ML models, and analytics deliverables.Lead...

  • Data Engineering Strategist

    2 weeks ago

    Lucknow, Uttar Pradesh, India beBeeDataEngineering Full time ₹ 1,42,41,091 - ₹ 2,51,71,438

    Job Title: Data Engineering StrategistJob Overview:We are seeking an experienced data engineering leader to drive the development and implementation of high-quality data ingestion and validation processes from multiple upstream systems.Key Responsibilities:Lead the design and implementation of scalable data pipelines and validation systems across multiple...

  • Data Engineer

    2 weeks ago

    Lucknow, Uttar Pradesh, India Carnation Infotech Full time ₹ 5,00,000 - ₹ 8,00,000 per year

    Job SummaryAs a Data Engineer , you will be responsible for designing, building, and maintaining the infrastructure and tools that enable the organization to collect, store, and analyze large volumes of data. You will work closely with data scientists, analysts, and other engineers to ensure that our data systems are reliable, efficient, and scalable.Key...

  • Chief Enterprise Data Engineer

    2 weeks ago

    Lucknow, Uttar Pradesh, India beBeeData Full time US$ 80,000 - US$ 1,20,000

    Job Title: Cloud Data ArchitectWe are seeking a highly skilled and experienced Cloud Data Architect to lead the development of scalable cloud-based data platforms.Job Description:Our ideal candidate will have proven expertise in designing and implementing end-to-end data architecture leveraging cloud-based technologies, including Snowflake and Matillion for...

  • Senior Data Engineer

    3 weeks ago

    Lucknow, Uttar Pradesh, India EXL Full time

    About the RoleWe are seeking a highly skilled Data Engineer with deep expertise in Microsoft Azure to design, build, and optimize scalable data pipelines and Lakehouse architectures. You will work closely with cross-functional teams to provide thought leadership deliver robust, secure, and high-performance data solutions that empower analytics and data...