Data Engineering Lead
2 days ago
Lead Data Engineering and Web Crawling TeamsYou will lead and mentor data engineering and web crawling teams to ensure high-quality delivery and adherence to best practices.Main Responsibilities:Architect, implement, and optimize scalable data pipelines that support high-volume data ingestion, transformation, and storage.Build and maintain robust crawling systems using modern frameworks, handling IP rotation, throttling, and dynamic content extraction.Establish pipeline orchestration using Airflow, Celery, or similar distributed processing technologies.Define and enforce data quality, validation, and security measures across all data flows and pipelines.Collaborate with product, engineering, and analytics teams to translate data requirements into scalable technical solutions.Develop monitoring, logging, and performance metrics to ensure high availability and reliability of data systems.Oversee cloud-based deployments, cost optimization, and infrastructure improvements on AWS/GCP/Azure.Integrate AI agents or LLM-based automation for tasks such as error resolution, data validation, enrichment, and adaptive crawling.Required Skills and Qualifications:Experience in leading data engineering and web crawling teams.Strong expertise in designing and implementing scalable data pipelines.Familiarity with modern frameworks for building robust crawling systems.Knowledge of pipeline orchestration technologies like Airflow, Celery, or similar.Understanding of data quality, validation, and security measures.Ability to collaborate with cross-functional teams.Skills in developing monitoring, logging, and performance metrics.Experience with cloud-based deployments and infrastructure improvements.Familiarity with AI agents or LLM-based automation.Benefits:Opportunity to work on complex data engineering projects.Chance to lead a team of experienced engineers.Collaborative and dynamic work environment.Professional growth and development opportunities.
-
Lead Data Engineer
5 days ago
Salem, India VXI Global Solutions Full timeJob Description:We are seeking talented and motivated Data Engineers to join our dynamic team and contribute to our mission of harnessing the power of data to drive growth and success.As a Data Engineer at VXI Global Solutions, you will play a critical role in designing, implementing, and maintaining our data infrastructure to support our customer experience...
-
Azure data lead engineer
2 weeks ago
Salem, India Persistent Systems Full timeAbout Position: We are looking for Lead Azure Data engineer who have experience in Azure data bricks, Data factory, to join our development team. Role: Azure Data Lead Engineer Location: Pune/ Bangalore Experience: 8 to 10 years Job Type: Full Time Employment What You'll Do: Design and implement complex, scalable data pipelines for ingestion, processing, and...
-
Lead Data Engineer
2 days ago
salem, India beBeeDataEngineer Full timeAbout Data Engineering Opportunities Data engineers play a vital role in organizations by developing and maintaining data acquisition frameworks that fuel analytics workloads, drive business decisions, and power digital transformation initiatives. This senior-level position demands expertise in designing, developing, and optimizing robust data ingestion and...
-
Strategic Data Platform Lead
2 days ago
salem, India beBeeData Full timeJob DescriptionWe are seeking a highly skilled and experienced Solutions Architect – Data to lead the design and delivery of end-to-end data platform architectures. The ideal candidate will have extensive experience in cloud-based data engineering, architecture, and delivery leadership roles, with a strong focus on data governance, security, and...
-
Lead Data Scientist
3 weeks ago
Salem, India Persistent Systems Full timeAbout Position: As the Lead Data Scientist, you will spearhead our advanced research efforts and drive innovation across generative AI, model fine-tuning, and agentic AI systems.Role: Lead Data Scientist Location: PuneExperience: 10+ Years Job Type: Full Time EmploymentWhat You'll Do: Define and execute the organization's AI research roadmap, identifying...
-
Data Engineer
7 days ago
Salem, India Staffingine LLC Full timeData Engineer India, Remote Full Time /Contract # of Positions - 3 Job Summary The Data Engineer will be responsible for designing, developing, and optimizing scalable data pipelines and cloud-based data solutions. This role requires strong Python programming skills, expertise in ETL/ELT processes, and deep hands-on experience with AWS cloud services such as...
-
AI Engineering Lead
1 day ago
salem, India beBeeEngineering Full timeLead LLM RoleThe ideal candidate will possess a strong background in Machine Learning Engineering and be well-versed in leading cross-functional teams.In this role, you'll drive the full lifecycle of AI development — from research and large-scale model training to production deployment.Drive the full lifecycle of AI development projects, including...
-
Data Governance Lead Position
1 day ago
salem, India beBeeGovernance Full timeLead Data Governance Specialist Job Description As a Lead Data Governance Specialist, you will be responsible for driving enterprise-level data governance initiatives across multiple business domains. Your key objective will be to establish robust governance frameworks, facilitate business workshops, and collaborate with technology teams to operationalize...
-
Data Engineer
2 weeks ago
Salem, India NexionPro Services Full timeJob Title: Data Engineer Experience: 5–10 Years Location: Bangalore (ONLY) Mandatory Skills: SQL, ETL, PySpark, Python Key Responsibilities Design, develop, and maintain scalable ETL/ELT pipelines to ingest and transform large datasets from diverse sources. Build and optimize PySpark-based data processing workflows for batch and real-time data use cases....
-
Lead Data Analyst
1 day ago
salem, India beBeeDataAnalysis Full timeLead Data Analyst RoleThis is a high-impact position that enables our team to make data-driven decisions, foster innovation, and drive business growth.
