Current jobs related to Expert Data Pipeline Specialist - Hubli, Karnataka - beBeeDataEngineer

  • Data Pipeline Specialist

    2 weeks ago

    Hubli, Karnataka, India beBeeDataAnalytics Full time ₹ 15,00,000 - ₹ 25,00,000

    Job DescriptionThe ideal candidate will be responsible for developing and maintaining data pipelines using IBM StreamSets, ensuring seamless integration with hybrid cloud environments and AI tools.

  • Data Migration Specialist

    2 weeks ago

    Hubli, Karnataka, India beBeeMigration Full time ₹ 1,49,90,000 - ₹ 2,15,30,000

    Data Migration SpecialistJob Title: Data Migration SpecialistWe are seeking skilled data migration specialists with expertise in migrating data from various sources to a cloud-based data warehousing platform. The ideal candidate will have hands-on experience with ETL tools, data quality management, and data security.Main Responsibilities:Design and implement...

  • Key Data Engineering Expert

    2 weeks ago

    Hubli, Karnataka, India beBeeDataEngineering Full time ₹ 20,00,000 - ₹ 25,00,000

    Our organization is seeking a highly skilled and experienced Data Engineering expert to assume key responsibilities.The ideal candidate will have:4+ years of hands-on experience with Big Data technologies – including Spark, Hadoop, and Hive;Strong analytical and problem-solving skills, with the ability to think critically;Excellent communication and...

  • Data Pipeline Engineer

    2 weeks ago

    Hubli, Karnataka, India beBeeBackend Full time ₹ 80,00,000 - ₹ 1,20,00,000

    About the RoleWe are seeking a seasoned backend engineer to spearhead the development of event decoders for major DeFi protocols, including Uniswap, Curve, and Balancer. This position requires expertise in Go or Rust programming languages.The ideal candidate will play a key role in transforming raw on-chain data into actionable insights by decoding smart...

  • Senior Slot Game Data Pipeline Specialist

    1 week ago

    Hubli, Karnataka, India beBeeDataEngineer Full time ₹ 8,00,000 - ₹ 15,00,000

    We are seeking a highly skilled Data Engineer to help build and maintain our robust data infrastructure. This individual will design, develop and maintain scalable data pipelines ensuring high-quality, reliable data for player behavior analysis, game performance and optimization.Responsibilities:Develop, maintain and optimize large-scale data pipelines for...

  • Cloud Data Specialist

    2 weeks ago

    Hubli, Karnataka, India beBeeData Full time ₹ 60,00,000 - ₹ 1,00,00,000

    Job Opportunity: Cloud Data SpecialistJob Overview:We are seeking a highly skilled and motivated cloud data specialist with hands-on experience in designing scalable data pipelines and cloud-native data solutions.Main Responsibilities:Design, develop, and optimize robust data ingestion pipelines using Google Cloud Platform services such as Pub/Sub, Dataflow,...

  • Data Engineer Specialist

    2 weeks ago

    Hubli, Karnataka, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Title: Data Engineer SpecialistWe are seeking a highly skilled individual to design, develop, and optimize data pipelines and integration solutions in a cloud-based environment.

  • Data Pipeline Quality Assurance Specialist

    2 weeks ago

    Hubli, Karnataka, India beBeeEtl Full time ₹ 12,00,000 - ₹ 18,00,000

    Job OpportunityWe are seeking a skilled ETL Tester to join our organization. As an ETL Tester, you will be responsible for testing large-scale data pipelines to ensure accuracy, consistency, and throughput in event-driven systems.Key Responsibilities:Test ETL processes and perform data reconciliation across systems.Validate Kafka/Redpanda pipelines...

  • Senior Data Pipeline Engineer

    2 weeks ago

    Hubli, Karnataka, India beBeeDataPipeline Full time ₹ 90,00,000 - ₹ 1,20,00,000

    Greetings from our organizationWe are seeking a highly skilled Data Pipeline Developer to join our team.Job OverviewKey Responsibilities:1. Design, develop, and implement data pipelines using IBM Datastage.2. Collaborate with cross-functional teams to understand business requirements and develop solutions.3. Ensure high-quality deliverables and adhere to...

  • Talend Expert Data Architect

    2 weeks ago

    Hubli, Karnataka, India beBeeTalend Full time ₹ 12,00,000 - ₹ 15,00,000

    Talend ETL Specialist Position We are seeking a highly skilled Talend ETL specialist with strong SAP data integration expertise to spearhead our project's data management initiatives.The ideal candidate will possess in-depth knowledge of Talend ETL, including its application in integrating and transforming SAP master and transactional data. Key...

Expert Data Pipeline Specialist

3 weeks ago

Hubli, Karnataka, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000
Data Engineer Job Opportunity

ThreatXIntel is a cyber security company focused on protecting businesses and organizations from cyber threats.

We offer customized cloud security, web and mobile security testing, and DevSecOps services to meet the specific needs of our clients.

A key requirement for this role is designing, developing, and optimizing data pipelines using AWS Glue, PySpark, and Step Functions.

  • Develop efficient data pipelines with AWS Glue and PySpark.
  • Implement ETL/ELT processes for ingesting, transforming, and delivering data from multiple sources.
  • Manage storage solutions with Amazon S3.
  • Write reusable Python code for data engineering workflows.
  • Use pytest for unit and integration tests to ensure data quality and pipeline reliability.
  • Collaborate on Git/GitHub for version control, code reviews, and CI/CD integration.
  • Create technical documentation for pipelines, workflows, and design decisions.
  • Troubleshoot and resolve issues related to data pipelines and AWS services.
Required Skills
  • 5–10 years of experience in data engineering with at least 5 years in AWS ecosystem.
  • Strong Python skills with expertise in PySpark.
  • Hands-on experience with AWS Glue, Step Functions, and S3.
  • Proficiency in pytest for test automation.
  • Solid understanding of Git/GitHub workflows.
  • Effective communication skills with a focus on documentation and knowledge sharing.