Senior Data Engineer
1 week ago
Data Engineering Manager – Web CrawlingWe are seeking a seasoned Technical Lead to oversee the development and optimization of web crawling systems and pipeline architecture.Lead and mentor data engineering teams to ensure high-quality delivery and adherence to best practices.Architect, implement and optimize scalable data pipelines that support high-volume data ingestion, transformation and storage.Build and maintain robust web scraping systems using modern frameworks, handling IP rotation, throttling and dynamic content extraction.Establish pipeline orchestration using Airflow, Celery or similar distributed processing technologies.The ideal candidate will have:Bachelor's or master's degree in Computer Science or related field.7–12 years of relevant experience in data engineering, pipeline design or large-scale web crawling systems.Strong expertise in Python, SQL and modern data processing practices.Experience working with workflow automation tools and scalable crawler architecture.This role offers opportunities for growth, professional development and collaboration with talented engineers.
-
Senior data engineer
4 weeks ago
Tiruppur, India MyRemoteTeam Inc Full timeAbout Us My Remote Team, Inc is a fast-growing distributed workforce enabler, helping companies scale with top global talent. We empower businesses by providing world-class software engineers, operations support, and infrastructure to help them grow faster and better. Position: Senior Data Engineer (Python Coder) Location: India ( Remote ) Work Commitment:...
-
Senior Data Analyst
8 hours ago
tiruppur, India beBeeDataAnalysis Full timeJob Title: Senior Data AnalystWe are seeking a skilled data analyst to join our team in a remote capacity. The ideal candidate will have a strong background in data analysis and machine learning.The selected candidate will be responsible for building and deploying advanced predictive models, analyzing complex datasets, and delivering actionable insights to...
-
Senior Data Engineer
1 week ago
tiruppur, India beBeeDataEngineer Full timeUnlock the Power of Data EngineeringYour RoleDesign, develop, and execute data validation and regression testing scripts using ETL toolsVerify data extraction, transformation, and loading processes for accuracy and completenessPerform data analysis and verification using SQL queries and data visualization techniquesCreate effective test plans based on data...
-
Tiruppur, India COREDATA CONSULTANCY Full timeRole DescriptionWe are seeking a Senior Data Engineer with expertise in AWS, Snowflake, DBT, and Terraform. This is 1 year extendable contractual role where you will design, build, and optimize scalable data solutions. Your responsibilities will include creating and maintaining data pipelines, developing data models, implementing ETL processes, and ensuring...
-
Senior Cloud Data Architect
1 week ago
tiruppur, India beBeeData Full timeCloud Data ArchitectThe ideal candidate will have extensive experience in designing, developing and optimizing data pipelines and ETL/ELT workflows on AWS.Develop scalable, secure and high-performing data platforms supporting both batch and real-time use cases.Design and implement a modern data platform on AWS using technologies like Apache Iceberg, AWS...
-
Senior Data Engineering Specialist
1 week ago
tiruppur, India beBeeDataEngineer Full timeData Engineer RoleWe are seeking a skilled Data Engineer to build data pipelines for enterprise search applications using Azure services. The ideal candidate will have expertise in designing and implementing ETL/ELT pipelines, data warehousing, and big data analytics.
-
Senior Enterprise Data Architect
6 days ago
tiruppur, India beBeeData Full timeAbout This OpportunityWe are seeking a senior data architecture professional to spearhead the development and maintenance of large-scale enterprise data systems in Microsoft Fabric and Azure Data Factory (ADF).Design and build scalable data pipelines that cater to diverse business needs.Develop optimized metadata-driven solutions in Fabric and ADF for...
-
Data Architect
6 days ago
tiruppur, India beBeeData Full timeSenior Data ArchitectThe Role:As a senior data architect, you will play a pivotal role in driving innovation within our microservices architecture. You will be responsible for leading the development and optimization of both data pipelines and back-end services.Key Responsibilities:Design, develop, and deploy data engineering solutions and back-end services...
-
Data Engineering Leader
1 week ago
tiruppur, India beBeeSolution Full timeSenior Solutions ArchitectJob OverviewWe're seeking an experienced, hands-on Solution Architect to lead the design and delivery of enterprise data & analytics solutions.The ideal candidate will possess 12–15 years of experience in data engineering, analytics, or data architecture roles with progressive ownership. They should be proficient in building and...
-
Freelance Senior Data Engineer
2 weeks ago
Tiruppur, India ThreatXIntel Full timeCompany DescriptionThreatXIntel is a startup cybersecurity company focused on delivering advanced and tailored solutions to protect businesses and organizations from cyber threats. Our expertise spans cloud security, web and mobile security testing, DevSecOps, and cloud security assessment. We are committed to providing affordable and custom solutions that...