Data Engineering Leader

5 days ago


visakhapatnam, India beBeeDataEngineering Full time

Data Engineering LeadershipJob Description:We are seeking an experienced data engineering leader to oversee the development and implementation of scalable data pipelines, focusing on web crawling technology.The ideal candidate will design, implement, and optimize robust crawling systems using modern frameworks and establish pipeline orchestration using distributed processing technologies.Strong expertise in Python, SQL, and modern data processing practices is required, along with experience working with Airflow, Celery, or similar workflow automation tools.A solid understanding of proxy systems, anti-bot techniques, and scalable crawler architecture is essential for success in this role.The successful candidate will have hands-on experience with cloud data platforms (AWS/GCP/Azure) and AI/LLM frameworks (Crawl4ai, LangChain, LlamaIndex, AutoGen, OpenAI).About Us:Bachelor's or master's degree in engineering, Computer Science, or a related field.Strong analytical, architectural, and leadership skills are necessary for effective team management and collaboration with product, engineering, and analytics teams.This role offersA challenging and dynamic work environment with opportunities for growth and professional development.The chance to work on cutting-edge projects and contribute to the advancement of data engineering and web crawling technologies.A collaborative team atmosphere with a strong focus on innovation and excellence.



  • visakhapatnam, India beBeeSolutions Full time

    Senior Solutions Architect RoleWe are seeking an experienced Senior Solutions Architect to lead the design and delivery of enterprise data and analytics solutions. The successful candidate will have a strong background in data engineering, analytics, or architecture, with progressive ownership of end-to-end data architectures.The role involves owning...


  • visakhapatnam, India beBeeAutomation Full time

    Job Title: Enterprise Automation LeaderWe are seeking an experienced Enterprise Automation Leader to join our team. As a key member of our organization, you will be responsible for leading the design, development, and implementation of quality engineering practices for financial technology solutions.The ideal candidate will have a strong background in test...

  • Data engineer

    7 days ago


    visakhapatnam, India Tata Consultancy Services Full time

    Greetings from TCSTCS has been a great pioneer in feeding the fire of Techies like you. We are a global leader in the technology arena and there's nothing that can stop us from growing together.Your role is of key importance, as it lays down the foundation for the entire project.Make sure you have a valid EP number before the interview. To create an EP...


  • Visakhapatnam, India Capgemini Engineering Full time

    Test Automation EngineerLocation: BangaloreExperience: 4-9 YearsChoosing Capgemini means choosing a place where you’ll be empowered to shape your career, supported by a collaborative global community, and inspired to reimagine what’s possible. Join us in helping leading engineering organizations like ASML unlock the value of technology and drive...


  • Visakhapatnam, India Capgemini Engineering Full time

    Test Automation EngineerLocation: BangaloreExperience: 4-9 YearsChoosing Capgemini means choosing a place where you’ll be empowered to shape your career, supported by a collaborative global community, and inspired to reimagine what’s possible. Join us in helping leading engineering organizations like ASML unlock the value of technology and drive...


  • visakhapatnam, India beBeeFrontendEngineering Full time

    Director of Frontend EngineeringAs a key leader in our organization, you will spearhead the Web Fabric initiative—defining architecture, scaling teams, and ensuring seamless user experiences across all products.You will oversee 10+ frontend engineers and managers, aligning with Data Engineering and ML/API teams to deliver end-to-end reliability and...


  • visakhapatnam, India beBeeTechnical Full time

    Technical ArchitectKey aspects of the job involve developing and implementing backend services, frontend experiences, and data flows.Design and build clean APIs, UIs, and supporting infrastructure.Develop and maintain frontend SDKs (Next.js/React) for other teams to use.Manage features end-to-end from spec to production rollout.Core...


  • visakhapatnam, India beBeeMechanical Full time

    Lead Mechanical Engineer for Sustainable DevelopmentsAs a lead mechanical engineer, you will play a crucial role in shaping the future of sustainable living. Our organization is committed to delivering innovative and cost-effective solutions for various development projects.Mission-driven engineering:Cutting-edge technology: Collaborate with software...


  • visakhapatnam, India beBeeMachineLearning Full time

    Job Title: Senior Data Science LeaderWe are seeking a seasoned Senior Machine Learning Engineer to lead the development of advanced machine learning models and systems. This role involves designing, building, and deploying production-ready ML models, collaborating with cross-functional teams, writing high-quality code, maintaining ML infrastructure, and...

  • Data engineer

    1 week ago


    Visakhapatnam, India Staffingine LLC Full time

    Data Engineer India, Remote Full Time /Contract # of Positions - 3 Job Summary The Data Engineer will be responsible for designing, developing, and optimizing scalable data pipelines and cloud-based data solutions. This role requires strong Python programming skills, expertise in ETL/ELT processes, and deep hands-on experience with AWS cloud services such as...