Scalable Data Solutions Engineer

2 days ago

Kanpur, Uttar Pradesh, India beBeeDataExtraction Full time ₹ 1,50,00,000 - ₹ 2,00,00,000
Job Title: Data Extraction Specialist

The ideal candidate will have deep technical knowledge in advanced web scraping techniques, reverse engineering, automation and leadership skills to drive the team towards success.

Key Responsibilities:

  • Design and develop scalable data extraction solutions using tools like Scrapy and Python libraries.
  • Lead and mentor a team of 5+ developers, managing project timelines and deliverables.
  • Implement advanced blocking and captcha-solving techniques to bypass extraction restrictions.
  • Conduct source code reverse engineering and automate web interactions.
  • Manage proxies, IP rotation and SSL unpinning to ensure effective extraction.
  • Maintain and improve API integrations and data pipelines.
  • Ensure code quality through effective version control, error handling and documentation.
  • Collaborate with cross-functional teams for project planning and execution.
  • Monitor performance and provide solutions under high-pressure environments.

Required Skills and Experience:

  • Minimum 4 years in IT industry
  • Minimum 2 years leading a team of 5+ developers

Technical Proficiency:

  • Advanced Python
  • Captcha solving and blocking handling
  • Source reverse engineering
  • Proxy management & IP rotation
  • App automation, SSL Unpin, Frida
  • API Management, Version Control Systems
  • Error Handling, SQL, MongoDB, Pandas

Leadership Skills:

  • Basic project management
  • Moderate documentation
  • Team handling
  • Pressure management
  • Flexibility and adaptability
  • High accountability

  • Data Analytics Expert

    1 week ago

    Kanpur, Uttar Pradesh, India beBeeDataExpert Full time ₹ 90,00,000 - ₹ 1,20,00,000

    Job Title:Data Analytics Expert - Scalable SolutionsAward-winning data analytics expert with 5-10 years of experience in designing and developing scalable data solutions using AtScale and GCP services.

  • Scalable Machine Learning Solutions Developer

    1 week ago

    Kanpur, Uttar Pradesh, India beBeeMachineLearning Full time ₹ 15,00,000 - ₹ 20,10,000

    Scalable Machine Learning Solutions DeveloperThis is an exciting opportunity to design, build, and deploy machine learning models that power a cutting-edge food safety platform.Key Responsibilities:Develop scalable machine learning solutions for real-world applications in the biotech industryCollaborate with data scientists, engineers, and domain experts to...

  • Data Engineer

    2 days ago

    Kanpur, Uttar Pradesh, India iXceed Solutions Full time

    Role - Data EngineerLocation - Chennai (Hybrid)Type - PermanentJob Description:Key Responsibilities:Lead the design, development, and deployment of scalable data pipelines and ETL processes using Scala and Apache Spark (Databricks).Develop and maintain data processing workflows using PySpark and Python.Collaborate with data scientists, analysts, and business...

  • AI Architect

    1 week ago

    Kanpur, Uttar Pradesh, India beBeeGenerative Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Title: Python Lead/Architect – Generative AIExperience: 8-12 YearsWe are seeking a highly skilled and experienced Python architect with a strong foundation in backend engineering and recent production experience in Generative AI. The ideal candidate will have 8–10 years of core Python development experience, along with 2–2.5 years of focused...

  • Data Engineering Solutions Lead

    17 hours ago

    Kanpur, Uttar Pradesh, India beBeeEngineering Full time ₹ 1,24,65,100 - ₹ 2,09,43,900

    IoT Data Solutions ArchitectWe are seeking a specialist with 5 to 7 years of experience in AWS IoT data engineering and strong Python skills to design and implement scalable IoT data architectures.The ideal candidate will have hands-on experience in data transformation and data ingestion using GCP BQ Dataflow Airflow, and Python programming skills.About the...

  • Senior Data Solutions Specialist

    1 week ago

    Kanpur, Uttar Pradesh, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    We are a boutique consulting firm specializing in data and AI, with deep expertise in the Databricks ecosystem.Our team helps clients build scalable data platforms and AI solutions that drive real business impact.The ideal candidate will have 5+ years of experience working with Databricks, including platform architecture, data engineering, and data...

  • Building Scalable Data Infrastructure

    4 days ago

    Kanpur, Uttar Pradesh, India beBeeData Full time ₹ 1,20,54,000 - ₹ 2,42,08,000

    Cloud Data ArchitectThis is a role where you will be responsible for designing and executing large and complex distributed data systems.The team handles over 5 million unique topics and uses cutting-edge Machine Learning and AI technologies on a large Hadoop cluster. You will work with tech stack that includes Java, Elastic Search/Solr, Kafka, Spark, Machine...

  • Expert GCP Data Engineering Solutions Specialist

    6 days ago

    Kanpur, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 25,00,000 - ₹ 35,00,000

    Senior Data Engineer RoleWe are seeking a skilled and experienced data engineer to join our dynamic team.The ideal candidate will have expertise in designing, developing, and maintaining scalable data pipelines on Google Cloud Platform (GCP).This role involves collaborating with cross-functional teams to understand data requirements and translating them into...

  • Innovative AI Engineer

    4 days ago

    Kanpur, Uttar Pradesh, India beBeeArtificialIntelligence Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: AI / GenAI EngineerWe are seeking a highly skilled AI/GenAI engineer to contribute to the design, development, and deployment of cutting-edge AI solutions. This role involves building scalable models, supporting automation initiatives, and collaborating with cross-functional teams to deliver impactful AI capabilities across the organization.We...

  • Senior Data Solutions Architect | Scalable Analytics Platforms | Healthcare Revenue Cycle Management

    16 minutes ago

    Kanpur, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    GeekTrust seeks a seasoned Senior/Principal Data Engineer to join their team.Key Responsibilities:Design and lead the development of self-service data platforms for reporting and analytics.Build scalable data solutions using Databricks, SQL, Python, Spark, and Delta Lake on Azure.Ensure best practices for ETL/ELT and data quality.Collaborate with teams to...