Advanced Data Ingestion Engineer

6 days ago

rajkot, India beBeeDataEngineering Full time

About the OpportunityWe are seeking a highly skilled Data Engineering Specialist – Data Acquisition to join our team. The ideal candidate will have extensive hands-on experience in building and optimizing data ingestion and transformation pipelines using Azure Data Platform, Databricks, Snowflake, and Kafka.You will be responsible for designing, developing, and maintaining robust data acquisition frameworks that support large-scale analytics and operational data systems.Job TitleData Engineering Specialist – Data AcquisitionRequirementsDesign, develop, and maintain data ingestion and transformation pipelines in an Azure-based environment.Work with Kafka for real-time data streaming and message queuing.Build scalable ETL/ELT pipelines using Databricks (PySpark/Scala) and integrate with Snowflake for analytics workloads.Develop and optimize SQL queries and stored procedures for performance and data accuracy.Utilize Azure Data Factory (ADF) to orchestrate workflows and integrate with various data sources.Work with structured and semi-structured data formats such as XML, JSON, Parquet, and CSV.Collaborate with data architects, analysts, and business teams to deliver high-quality, reliable data pipelines.Ensure code quality, version control, and data security best practices are followed.Key ResponsibilitiesEnd-to-end development of data acquisition solutions for operational and analytical systems.Implement data transformation logic using Spark and Python.Optimize performance of large-scale data pipelines in Databricks/Snowflake.Handle real-time and batch data ingestion via Kafka and ADF.Qualifications & CertificationsBachelor's degree in Computer Science, Information Technology, or related field.Microsoft Azure or Snowflake certification (preferred).Strong understanding of modern data engineering best practices.Good to HaveExperience with DevOps tools and CI/CD pipelines for data deployment.Exposure to data modeling and data warehouse design.Familiarity with other streaming platforms or data orchestration tools.

  • Cloud Data Ingestion Specialist

    2 days ago

    rajkot, India beBeeData Full time

    Job OverviewWe are seeking a highly skilled Data Engineer with expertise in Apache NiFi and the Google Cloud Platform (GCP) ecosystem to design and build real-time data ingestion and processing pipelines.The ideal candidate will be responsible for developing and optimizing SQL queries for BigQuery and relational databases, as well as building Python scripts...

  • Advanced Data Pipelines Developer

    6 days ago

    rajkot, India beBeeDataEngineer Full time

    Job Title: Senior Data EngineerAbout the RoleWe are seeking an experienced Senior Data Engineer to design, develop, and optimize data pipelines across on-prem and cloud ecosystems.The ideal candidate will have hands-on expertise in Oracle Data Integrator (ODI) and proficiency in ETL/ELT frameworks, performance tuning, and staging optimization.Key...

  • Advanced Security Solutions Architect

    6 days ago

    rajkot, India beBeeSecurity Full time

    Enterprise Security SpecialistThis is a senior role responsible for designing and implementing advanced security solutions that leverage SIEM, SOAR, and machine learning to enhance threat detection, incident response, and operational efficiency across the enterprise.Develop and manage centralized log analysis and real-time event monitoring systems using...

  • Data Analysis Specialist

    6 days ago

    rajkot, India beBeeDataAnalysis Full time

    Part-Time Data Analyst OpportunityWe are seeking a skilled and motivated part-time data analyst to join our team on an ongoing basis. The ideal candidate will have strong analytical skills, excellent problem-solving abilities, and the ability to work independently.The successful candidate will be responsible for owning analytics and reporting work across...

  • AWS Data Engineer

    1 week ago

    Rajkot, India 9NEXUS Full time

    Job Title: Senior AWS Data Engineer Experience: 6 - 9 Years Location: Remote Job Description We are seeking a Senior AWS Data Engineer to design, build, and optimize large-scale data pipelines and analytics solutions using AWS services and Databricks. The role involves end-to-end data engineering, automation, performance tuning, and collaboration with...

  • Chief Enterprise Data Architect

    4 days ago

    rajkot, India beBeeDataEngineering Full time

    About the RoleEnterprise Data Architects design, build and manage complex data pipelines using industry-leading technologies. They collaborate with clients to craft tailored solutions that meet business objectives.Develop scalable metadata-driven pipelines for ingestion, transformation and delivery.Implement efficient transformations using SQL and stored...

  • Data Engineer

    4 weeks ago

    Rajkot, India Veca Consulting Pvt Ltd Full time

    Role Name: Data EngineerExperience : 3+ YearsLocation : Bangalore(No relocation)Notice Period : 20-30 days(who are currently serving)Mode : HybridType : FulltimeJob Description: As a Data Engineer on our team, you will work on our Hadoop-based data warehouse, contributing to scalable and reliable big data solutions for analytics and business insights. This...

  • Data Support Engineer

    6 days ago

    rajkot, India Kumaran Systems Full time

    Dear Candidate,Greeting,Experience : 8+ YearsWork Model: WFHWork Timings: Starts from 3pmWe're looking for a skilled Data Support Engineer with 8+ years of experience . The ideal candidate will serve as the escalation point for data ingestion, pipeline, and consumption issues while ensuring high system stability through proactive monitoring and root-cause...

  • Cloud Data Engineer Specialist

    6 days ago

    rajkot, India beBeeData Full time

    About Data Engineering RoleLemongrass delivers superior, highly automated Managed Services to Enterprise customers.We are seeking a skilled Cloud Data Engineer with extensive experience in AWS, Azure, and GCP.Key Responsibilities:Develop scalable ETL pipelines using cloud-native tools.Architect data lakes and warehouses on cloud platforms.Optimize data...

  • Senior Data Quality Engineer

    4 days ago

    rajkot, India beBeeDataQuality Full time

    Job DescriptionThis position involves comprehensive testing support, encompassing unit testing, integration testing, system testing, and User Acceptance Testing (UAT) for data pipelines and the overall product.Design, implement, and execute test plans and scripts to ensure data quality, completeness, and correctness across various environments.Key...