Senior Data Solutions Developer

4 days ago

Kolkata, West Bengal, India beBeeScraping Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

We are seeking a highly skilled and experienced developer to join our team as a Senior Data Solutions Developer. This role requires deep technical knowledge in advanced data scraping techniques, leadership skills to drive the team towards success, and a proven track record of delivering scalable solutions.

  • This is a challenging position that demands expertise in designing and developing data scraping solutions using tools like Scrapy and Python libraries.
  • The ideal candidate will have at least 4 years of hands-on experience in IT scraping, with a minimum of 2 years leading a team of developers.

Key Responsibilities

  • Develop and maintain scalable data pipelines using Python and relevant libraries.
  • Lead and mentor a team of developers to ensure timely project delivery and high-quality results.
  • Implement advanced blocking and captcha-solving techniques to bypass restrictions on web scraping.
  • Conduct source code reverse engineering and automate interactions with web applications.
  • Manage proxies and IP rotation to ensure effective data extraction.
  • Maintain and improve API integrations and data quality.
  • Evaluate and recommend new technologies to enhance data scraping capabilities.

Required Skills and Experience

  • Minimum 4 years of experience in IT scraping industry.
  • Minimum 2 years of experience leading a team of developers.

Technical Proficiency

  • Advanced Python programming.
  • Captcha solving and blocking handling.
  • Source reverse engineering.
  • Proxy management and IP rotation.
  • App automation and SSL Unpinning.
  • Error handling and SQL querying.

Leadership Skills

  • Basic project management.
  • Moderate documentation.
  • Team handling and pressure management.

Preferred (Good to Have)

  • Experience with Linux operating systems.
  • Knowledge of Appium and Fiddler tools.

Job Requirements

  • Degree in Computer Science or related field.
  • Excellent problem-solving skills.
  • Able to work in a fast-paced environment.

Benefits

  • Competitive salary and benefits package.
  • Opportunities for professional growth and development.
  • Collaborative and dynamic work environment.

  • Senior Software Developer for Data Solutions

    6 days ago

    Kolkata, West Bengal, India beBeeSoftware Full time ₹ 90,00,000 - ₹ 1,20,00,000

    Job Title: Senior Software Developer for Data SolutionsYou have the opportunity to join a dynamic team that focuses on leveraging advanced technologies and techniques to design and develop robust data solutions for clients. Our team plays a crucial role in transforming raw data into actionable insights, enabling informed decision-making, and driving business...

  • Data Solutions Architect

    4 days ago

    Kolkata, West Bengal, India beBeeDataEngineer Full time ₹ 14,62,500 - ₹ 19,30,000

    Job Title: Data Solutions ArchitectJob Description:We are seeking an experienced Senior Data Engineer to lead the development of large-scale data processing systems.As a Senior Data Engineer, you will design, develop, and maintain complex data pipelines using Airflow.You will work closely with cross-functional teams to identify business requirements and...

  • Senior Data Solutions Engineer

    17 hours ago

    Kolkata, West Bengal, India beBeeDataEngineering Full time ₹ 1,04,000 - ₹ 1,30,878

    Job Title:Senior Data Solutions EngineerJob Summary:We are seeking a highly skilled and experienced Senior Data Solutions Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, implementing, and maintaining large-scale data systems that meet the evolving needs of our organization.Key...

  • Data Solutions Developer

    3 days ago

    Kolkata, West Bengal, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Title">Design and Maintain Data SolutionsWe are seeking a skilled Data Engineer to design, develop, and maintain data solutions that facilitate data generation, collection, and processing.Required Skills and QualificationsProficiency in TOSCA TestsuiteStrong understanding of data modeling and database design principlesExperience with ETL tools and data...

  • Senior Data Solutions Engineer

    2 days ago

    Kolkata, West Bengal, India beBeeData Full time US$ 1,20,000 - US$ 2,00,000

    Job Title: Senior ETL Developer">Experience Level Required: 6+ years of experience in development and maintenance of data engineering projects.Key Responsibilities:Development and maintenance of data engineering projects.Utilization of data transformation, loading, and unloading techniques to process large volumes of data.Collaboration with cross-functional...

  • Senior Big Data Solutions Architect

    5 days ago

    Kolkata, West Bengal, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    **Job Title:** Senior Data EngineerWe are seeking an experienced Senior Data Engineer to join our team.Bachelor's or Master's degree in Computer Science, Information Technology, or related field5+ years of experience in data analytics and engineeringProficiency in big data tools: Hadoop, Spark, Kafka, Hive, and relational SQL and NoSQL databasesExperience...

  • Senior AI/ML Solutions Developer

    1 week ago

    Kolkata, West Bengal, India beBeeAIENGINEER Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    About the RoleThis is a high-level position for a seasoned AI/ML expert with extensive experience in developing and implementing advanced solutions. We are seeking a candidate who can design, implement, and deploy machine learning models that address real-world business challenges.We need someone who is passionate about artificial intelligence, machine...

  • Data Management Solutions Developer

    1 week ago

    Kolkata, West Bengal, India beBeeDataIntegration Full time ₹ 1,00,00,000 - ₹ 1,20,00,000

    Job Title: Supplier360 DeveloperWe are seeking a skilled developer to design, configure, and support data management solutions within Informatica Intelligent Data Management Cloud (IDMC).Key Responsibilities:Design and implement scalable data integration solutions.Build and configure data entities, hierarchies, and workflows in Supplier360.Configure and...

  • Senior Data Architect

    2 weeks ago

    Kolkata, West Bengal, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Senior Data Engineer (Banking Domain)We are seeking a highly skilled Senior Data Engineer to join our mission-critical banking project.This is an excellent opportunity to work on cutting-edge data pipelines, streaming platforms, and cloud-based infrastructures—building scalable, high-performance solutions for a leading financial services environment.The...

  • Strategic Data Solutions Architect

    1 week ago

    Kolkata, West Bengal, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Senior Data Engineers play a pivotal role in designing and optimizing data solutions that power analytics, reporting, and Member 360 initiatives.This key position is ideal for seasoned professionals with deep expertise in ETL development, data modeling, and financial data domains, particularly within credit unions and banking systems.Candidates will be...