Senior Data Engineer

1 week ago


tiruppur, India beBeeDataEngineering Full time

Data Engineering Manager – Web CrawlingWe are seeking a seasoned Technical Lead to oversee the development and optimization of web crawling systems and pipeline architecture.Lead and mentor data engineering teams to ensure high-quality delivery and adherence to best practices.Architect, implement and optimize scalable data pipelines that support high-volume data ingestion, transformation and storage.Build and maintain robust web scraping systems using modern frameworks, handling IP rotation, throttling and dynamic content extraction.Establish pipeline orchestration using Airflow, Celery or similar distributed processing technologies.The ideal candidate will have:Bachelor's or master's degree in Computer Science or related field.7–12 years of relevant experience in data engineering, pipeline design or large-scale web crawling systems.Strong expertise in Python, SQL and modern data processing practices.Experience working with workflow automation tools and scalable crawler architecture.This role offers opportunities for growth, professional development and collaboration with talented engineers.


  • Senior data engineer

    4 weeks ago


    Tiruppur, India MyRemoteTeam Inc Full time

    About Us My Remote Team, Inc is a fast-growing distributed workforce enabler, helping companies scale with top global talent. We empower businesses by providing world-class software engineers, operations support, and infrastructure to help them grow faster and better. Position: Senior Data Engineer (Python Coder) Location: India ( Remote ) Work Commitment:...

  • Senior Data Analyst

    8 hours ago


    tiruppur, India beBeeDataAnalysis Full time

    Job Title: Senior Data AnalystWe are seeking a skilled data analyst to join our team in a remote capacity. The ideal candidate will have a strong background in data analysis and machine learning.The selected candidate will be responsible for building and deploying advanced predictive models, analyzing complex datasets, and delivering actionable insights to...


  • tiruppur, India beBeeDataEngineer Full time

    Unlock the Power of Data EngineeringYour RoleDesign, develop, and execute data validation and regression testing scripts using ETL toolsVerify data extraction, transformation, and loading processes for accuracy and completenessPerform data analysis and verification using SQL queries and data visualization techniquesCreate effective test plans based on data...


  • Tiruppur, India COREDATA CONSULTANCY Full time

    Role DescriptionWe are seeking a Senior Data Engineer with expertise in AWS, Snowflake, DBT, and Terraform. This is 1 year extendable contractual role where you will design, build, and optimize scalable data solutions. Your responsibilities will include creating and maintaining data pipelines, developing data models, implementing ETL processes, and ensuring...


  • tiruppur, India beBeeData Full time

    Cloud Data ArchitectThe ideal candidate will have extensive experience in designing, developing and optimizing data pipelines and ETL/ELT workflows on AWS.Develop scalable, secure and high-performing data platforms supporting both batch and real-time use cases.Design and implement a modern data platform on AWS using technologies like Apache Iceberg, AWS...


  • tiruppur, India beBeeDataEngineer Full time

    Data Engineer RoleWe are seeking a skilled Data Engineer to build data pipelines for enterprise search applications using Azure services. The ideal candidate will have expertise in designing and implementing ETL/ELT pipelines, data warehousing, and big data analytics.


  • tiruppur, India beBeeData Full time

    About This OpportunityWe are seeking a senior data architecture professional to spearhead the development and maintenance of large-scale enterprise data systems in Microsoft Fabric and Azure Data Factory (ADF).Design and build scalable data pipelines that cater to diverse business needs.Develop optimized metadata-driven solutions in Fabric and ADF for...

  • Data Architect

    6 days ago


    tiruppur, India beBeeData Full time

    Senior Data ArchitectThe Role:As a senior data architect, you will play a pivotal role in driving innovation within our microservices architecture. You will be responsible for leading the development and optimization of both data pipelines and back-end services.Key Responsibilities:Design, develop, and deploy data engineering solutions and back-end services...


  • tiruppur, India beBeeSolution Full time

    Senior Solutions ArchitectJob OverviewWe're seeking an experienced, hands-on Solution Architect to lead the design and delivery of enterprise data & analytics solutions.The ideal candidate will possess 12–15 years of experience in data engineering, analytics, or data architecture roles with progressive ownership. They should be proficient in building and...


  • Tiruppur, India ThreatXIntel Full time

    Company DescriptionThreatXIntel is a startup cybersecurity company focused on delivering advanced and tailored solutions to protect businesses and organizations from cyber threats. Our expertise spans cloud security, web and mobile security testing, DevSecOps, and cloud security assessment. We are committed to providing affordable and custom solutions that...