Senior Data Architect

3 days ago

Ajmer, Rajasthan, India beBeeDataExtraction Full time ₹ 15,00,000 - ₹ 20,00,000

Job Overview:

We are seeking an experienced Data Extraction Specialist to lead our data scraping efforts. This role requires a highly skilled professional with extensive experience in IT data extraction, web scraping, and team management.

Responsibilities:

  • Design and develop scalable data extraction solutions using tools like Scrapy and Python libraries.
  • Lead and mentor a team of developers, overseeing project timelines and deliverables.
  • Implement advanced blocking and captcha-solving techniques to bypass data extraction restrictions.
  • Conduct source code reverse engineering and automate web interactions.
  • Manage proxies, IP rotation, and SSL unpinning to ensure effective data extraction.
  • Maintain and improve API integrations and data pipelines.
  • Ensure code quality through effective version control, error handling, and documentation.
  • Collaborate with cross-functional teams for project planning and execution.
  • Monitor performance and provide solutions under high-pressure environments.

Requirements:

  • Experience in IT data extraction industry: Minimum 4 years
  • Leadership skills: Minimum 2 years leading a team of developers
  • Scraping tools proficiency: Scrapy, Threading, requests, web automation
  • Technical skills:
    • Advanced Python programming
    • Captcha solving and blocking handling
    • Source reverse engineering
    • Proxy management & IP rotation
    • App automation, SSL Unpin, Frida
    • API Management, Version Control Systems
    • Error Handling, SQL, MongoDB, Pandas
  • Leadership skills:
    • Project management
    • Documentation
    • Team handling
    • Pressure management
    • Flexibility and adaptability
    • Accountability
  • Preferred (Good to Have):
    • Linux experience
    • Knowledge of Appium, Fiddler, Burp Suite

  • Senior Data Architect

    1 day ago

    Ajmer, Rajasthan, India beBeeData Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Experienced Data ArchitectThe position of Senior Software Engineer/Technical Specialist is available in a remote setting. The ideal candidate should have at least 5 years of experience in developing and optimizing ETL/ELT pipelines using Azure Data Factory (ADF), Databricks, and Synapse Analytics.

  • Senior Data Architect

    1 day ago

    Ajmer, Rajasthan, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Senior Data ArchitectWe are seeking a skilled Senior Data Architect to design and implement scalable data pipelines, drive business decisions with data insights, and collaborate with cross-functional teams.Job Description:As a senior member of our team, you will be responsible for:Collaborating with data scientists to develop predictive models and drive...

  • Senior Data Architect

    5 days ago

    Ajmer, Rajasthan, India beBeeData Full time US$ 80,000 - US$ 1,50,000

    Big Data ArchitectOverview:We seek an experienced Big Data Architect to guide clients through their data modernization journey.Our team works with ambitious companies creating innovative products in new markets. We embed ourselves within our clients' development and data teams as senior engineers, bringing leading-edge technologies, creative thinking, and...

  • Senior Cybersecurity Architect

    1 day ago

    Ajmer, Rajasthan, India beBeeSecurity Full time ₹ 1,50,00,000 - ₹ 2,30,00,000

    Job Title:Senior Cybersecurity ArchitectOverviewThe Senior Cybersecurity Architect will lead the development and implementation of a robust security framework to safeguard our organization's digital assets.Key Responsibilities

  • Senior Data Architect

    3 days ago

    Ajmer, Rajasthan, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    A job opening for a talented Data Architect exists to design, build, and optimize scalable data pipelines using Snowflake, AWS, and DBT.Key Responsibilities:Develop ETL/ELT pipelines using AWS Glue, Lambda, and DBT for seamless data integration, transformation, and analytics.Create and optimize data models in Snowflake for scalability and performance.Write...

  • Data engineer Architect

    2 weeks ago

    Ajmer, Rajasthan, India InfoSpeed Services, Inc. Full time

    Hi All, We are hiring Azure Data architect with the below primary skills to one of my primary clients. Job Title: Data engineer Architect remote

  • Cloud Data Architect

    2 days ago

    Ajmer, Rajasthan, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 25,00,000

    Unlock Data Potential as a Cloud Data ArchitectWe are seeking an experienced data professional to lead our cloud-based data infrastructure. As a cloud data architect, you will design, build, and maintain complete end-to-end data pipelines on the Azure platform.Key Responsibilities:Design and implement scalable data solutions using Azure services such as...

  • Senior Data Solutions Architect

    1 day ago

    Ajmer, Rajasthan, India beBeeDataEngineer Full time ₹ 50,00,000 - ₹ 60,00,000

    Job DescriptionCvent is a leading meetings, events, and hospitality technology provider with over 4,800 employees and ~22,000 customers worldwide. Our DNA is our people, and we foster intrapreneurship to encourage individuals to think and act like entrepreneurs. We value diverse perspectives and celebrate differences.Role OverviewWe are seeking an IT...

  • Chief Data Architect

    14 hours ago

    Ajmer, Rajasthan, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    About Our Job OpportunityAs a Senior Technical Consultant, you will play a key role in bridging strategy and technology to drive business success.The Role:You will work closely with sales teams to understand client needs and develop technically sound solutions using modern AI and data tools. You will architect solution blueprints combining AI/ML models,...

  • Chief Data Solutions Architect

    1 day ago

    Ajmer, Rajasthan, India beBeeData Full time ₹ 90,00,000 - ₹ 1,54,00,000

    Job Title: Senior Data ArchitectLeverage your expertise in data architecture and management to design, implement, and optimise a robust data warehousing platform for the pharmaceutical industry. The goal is to ensure seamless integration of diverse data sources, maintain high standards of data quality, and governance, and enable advanced analytics through...