Principal Web Data Architect

1 week ago

Guntur, Andhra Pradesh, India beBeeDataScraping Full time ₹ 50,00,000 - ₹ 1,00,00,000
Job Title: Lead Data Scraping Engineer

We are seeking a highly skilled and experienced Lead Data Scraping Engineer to join our team. The ideal candidate will have a minimum of 4 years of hands-on experience in IT scraping, with at least 2 years leading a team of 5+ developers.

This role requires deep technical knowledge in advanced scraping techniques, reverse engineering, automation, and leadership skills to drive the team towards success.

Key Responsibilities:

  • Design and develop scalable data scraping solutions using tools like Scrapy and Python libraries.
  • Lead and mentor a team of 5+ developers, managing project timelines and deliverables.
  • Implement advanced blocking and captcha-solving techniques to bypass scraping restrictions.
  • Conduct source code reverse engineering and automate web and app interactions.
  • Manage proxies, IP rotation, and SSL unpinning to ensure effective scraping.
  • Maintain and improve API integrations and data pipelines.
  • Ensure code quality through effective version control, error handling, and documentation.
  • Collaborate with cross-functional teams for project planning and execution.
  • Monitor performance and provide solutions under high-pressure environments.

Required Skills and Qualifications:

  • Data Scraping: Minimum 4 years in IT scraping industry
  • Leadership: Minimum 2 years leading a team of 5+ developers

Benefits:

  • Opportunity to work on cutting-edge projects
  • Collaborative and dynamic work environment
  • Professional growth and development opportunities

Others:

  • Experience with Linux is preferred
  • Knowledge of Appium, Fiddler, Burp Suite is also beneficial

  • Principal Data Scientist/Architect

    2 weeks ago

    Guntur, Andhra Pradesh, India beBeeDataScientist Full time ₹ 22,21,080 - ₹ 30,14,600

    Are you a visionary leader in data science and architecture? We are seeking an experienced Principal Data Scientist/Architect to define our data strategy, drive innovation in AI/ML, and build scalable data solutions that impact our business.Key Responsibilities:Strategic Leadership: Champion our data science vision and align it with business objectives.Data...

  • Data Architect

    6 days ago

    Guntur, Andhra Pradesh, India beBeeData Full time ₹ 40,00,000 - ₹ 60,00,000

    Unlock the Power of DataWe're a leader in unified commerce platforms, delivering software solutions for the food and beverage industry. Our flagship product has achieved remarkable success over the past decade, empowering thousands of businesses across 40+ countries.As passionate developers, designers, and product experts, we continuously...

  • Chief Data Architect

    1 week ago

    Guntur, Andhra Pradesh, India beBeeDataEngineering Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    As a highly skilled Senior Data Engineer, you will be responsible for laying the foundation of our project.We are looking for an expert in software architecture and solution design with extensive experience in microservices, distributed systems, and cloud-native architectures.The ideal candidate will have deep technical knowledge of data engineering...

  • Data Architect

    4 days ago

    Guntur, Andhra Pradesh, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Title: Senior Data Architect">We are seeking a highly experienced data architect to design, develop and maintain scalable ETL pipelines using Azure Data Factory.The ideal candidate will have strong hands-on experience in cloud-based analytics and the ability to process, transform and load large datasets into AWS Datalake or other data stores.You will...

  • Senior Cloud Data Architect

    1 week ago

    Guntur, Andhra Pradesh, India beBeeData Full time ₹ 18,00,000 - ₹ 24,00,000

    About This RoleAs a Senior Cloud Data Architect, you will lead a team of experienced engineers to design and implement scalable, secure data architectures in the cloud. Your expertise in cloud-native data intensive applications, combined with your experience in leading cross-functional teams, will be invaluable assets to our organization.Key...

  • Principal Data Architect

    1 week ago

    Guntur, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 23,00,000

    Job Role – Data EngineerWe are seeking an experienced Data Engineer to play a critical role in designing, developing, and maintaining our data pipelines and infrastructure.As a key member of the team, you will work closely with data scientists, analysts, and other stakeholders to ensure data is accurate, timely, and accessible. Your contributions will...

  • Principal Data Architect

    2 weeks ago

    Guntur, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 90,00,000 - ₹ 1,20,00,000

    Job OverviewData engineers play a vital role in the success of our organization. They design, build, test, and maintain infrastructure for large-scale data processing and analysis.The ideal candidate will have experience in data engineering with a focus on big data technologies such as Azure Data Factory, Apache Kafka, and MS Synapse.Data Pipeline...

  • Principal Data Architect

    3 days ago

    Guntur, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 10,00,000 - ₹ 18,00,000

    Job DescriptionWe are looking for an experienced data engineer with extensive experience in TSQL (stored procedures, functions, triggers, ad hoc queries), SSRS (design/development, subscriptions, query performance tuning and BAU support), ETL, Azure data storage, Azure data factor and pipelines, Azure Synapse and data warehousing and some exposure to Power...

  • Data Architect

    2 weeks ago

    Guntur, Andhra Pradesh, India beBeeData Full time ₹ 1,20,00,000 - ₹ 2,50,00,000

    Job Description:We are seeking an experienced Data Architect to lead the design and implementation of our data architecture. This individual will be responsible for creating and maintaining a scalable, secure, and reliable data infrastructure that meets the needs of our business. Key Responsibilities:Develop and maintain large-scale data pipelines using...

  • Chief Data Architect

    2 days ago

    Guntur, Andhra Pradesh, India beBeeDataInnovator Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Our organization seeks a skilled Data Innovator to join their team. This role involves designing and developing high-quality data features, working independently to deliver projects on time.As a Data Innovator, you will be responsible for creating innovative solutions using marketing suites and building upon our existing BNL Data Warehouse offerings.The...