Senior Python Developer

1 week ago


Ahmedabad, India CJ Konsultants Full time

Position: Python DeveloperLocation: Remote (India)Salary: 80-90k pmExperience: 4+ yearsJob Description: We’re looking for a Python Developer with solid hands-on experience in job and web data scraping, AI-enabled data processing, and building scalable ETL pipelines. You’ll design, implement, and operate scraping and enrichment systems that feed recruitment and analytics products. Familiarity with Aspen/Webspidermount and Kadoa is a plus. QA-minded engineers who care about data accuracy and observability will thrive in this role.Key Responsibilities: Design, develop, and maintain AI-powered web and job-scraping pipelines.Extract structured and unstructured data from job boards, company sites, APIs, and other sources.Build and operate ETL processes to clean, normalize, enrich, and load data into analytics stores.Ensure data accuracy, completeness, and consistency via automated validation and QA checks.Implement and maintain monitoring, alerting, and observability for scraper health and data quality.Optimize scraping and pipeline performance for reliability and scale (rate-limiting, retries, distributed workers).Integrate scraped and enriched data with internal systems, analytics platforms, and downstream consumers.Collaborate with product, data science, and QA teams to meet business and compliance requirements.Stay current with AI, scraping techniques, legal/ethical scraping best practices, and anti-bot mitigations.Required Skills:· Proficient in Python with production experience (3–5 years).· Strong SQL skills; experience with PostgreSQL and data modeling.· Hands-on with Python scraping and data libraries: BeautifulSoup, Scrapy, Selenium, Pandas.· Practical experience with unit and integration testing in Python (for example, pytest).· Knowledge of concurrency in Python: multiprocessing and multithreading patterns.· Experience building robust data pipelines, working with APIs, rate limits, pagination, and proxying.· Proven experience building data scrapers and AI-assisted scraping/enrichment workflows.· Familiarity with data QA processes, validation frameworks, and creating automated data checks.· Excellent debugging skills and experience with logging, metrics, and alerting for production jobs.· Strong problem-solving, communication skills, and ability to work independently and in teams.Customer- and user-oriented mindset.Preferred Skills:· Experience with Aspen / Webspidermount and Kadoa platforms.· Hands-on experience with machine learning or AI-driven data processing and enrichment.· Familiarity with recruitment data, job-board ecosystems, and common job taxonomies (titles, skills, locations).· Experience with distributed task queues (e.g., Celery, RQ) or orchestration (Airflow, Prefect).· Experience with cloud platforms (AWS/GCP) and containerization (Docker, Kubernetes).· Knowledge of legal/compliance aspects of web scraping and data privacy.What we offer:· Challenging problems at the intersection of data engineering, AI, and recruitment analytics.· Collaborative, fast-paced engineering culture that values quality and ownership.· Opportunity to influence data architecture and product direction.



  • Ahmedabad, Gujarat, India Sufalam Technologies Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    Company DescriptionSufalam Technologies, based in Ahmedabad, India, is an IT services and solutions company that integrates and optimizes complex technologies and data to improve business outcomes. With a blend of business experience and deep technological expertise, Sufalam helps clients achieve their strategic objectives via custom application development,...


  • Ahmedabad, Gujarat, India Angel and Genie Full time ₹ 3,60,000 - ₹ 7,20,000 per year

    Job Description Senior Python Developer – Web Scraping & Automation – Ahmedabad – 2 yrs Exp – 45 K PM Job Category: IT & Software Job Type: Full Time Job Location: Ahmedabad Salary: 45K PM Years of Experience: 2 yrs Job Title: Senior Python Developer – Web Scraping & Automation Location: Ahmedabad Job Type: Full-time Working...


  • Ahmedabad, Gujarat, India MagikKraft Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    Company DescriptionAt MagikKraft, we are revolutionizing the construction industry by redefining how projects are monitored, managed, and delivered — making them faster, smarter, and safer. By leveraging AI, drones, 360° imagery, and digital twins, we bring Transparency, Speed, and Quality (TSQ) to every stage of construction. Our platform offers...


  • Ahmedabad, Gujarat, India DataSeeders Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Company DescriptionDataSeeders is a leader in providing secure, accurate, and scalable data solutions that transform raw web data into actionable insights for smarter business decisions. We partner with various organizations, from startups to large enterprises, to harness the power of public web data and advanced analytics. Our custom data solutions cater to...


  • Ahmedabad, India Actowiz Solutions Full time

    Job Title: Senior Python Developer – Web Scraping & AutomationCompany: Actowiz SolutionsLocation: AhmedabadJob Type: Full-timeWorking Days: 5 Days a WeekAbout UsActowiz Solutions is a leading provider of data extraction, web scraping, and automation solutions. We empower businesses with actionable insights by delivering clean, structured, and scalable data...


  • Ahmedabad, India Actowiz Solutions Full time

    Job Title: Senior Python Developer – Web Scraping & AutomationCompany: Actowiz SolutionsLocation: AhmedabadJob Type: Full-timeWorking Days: 5 Days a WeekAbout UsActowiz Solutions is a leading provider of data extraction, web scraping, and automation solutions. We empower businesses with actionable insights by delivering clean, structured, and scalable data...


  • Ahmedabad, India Actowiz Solutions Full time

    Job Title: Senior Python Developer – Web Scraping & AutomationCompany: Actowiz SolutionsLocation: AhmedabadJob Type: Full-timeWorking Days: 5 Days a WeekAbout UsActowiz Solutions is a leading provider of data extraction, web scraping, and automation solutions. We empower businesses with actionable insights by delivering clean, structured, and scalable data...


  • Ahmedabad, India Actowiz Solutions Full time

    Job Title: Senior Python Developer – Web Scraping & AutomationCompany: Actowiz SolutionsLocation: AhmedabadJob Type: Full-timeWorking Days: 5 Days a WeekAbout UsActowiz Solutions is a leading provider of data extraction, web scraping, and automation solutions. We empower businesses with actionable insights by delivering clean, structured, and scalable data...


  • Ahmedabad, India Actowiz Solutions Full time

    Job Title: Senior Python Developer – Web Scraping & AutomationCompany: Actowiz SolutionsLocation: AhmedabadJob Type: Full-timeWorking Days: 5 Days a WeekAbout UsActowiz Solutions is a leading provider of data extraction, web scraping, and automation solutions. We empower businesses with actionable insights by delivering clean, structured, and scalable...


  • Ahmedabad, Gujarat, India Vrinsoft Technology Pvt. Ltd. Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Company DescriptionVrinsoft Technology Pvt. Ltd., a leading mobile app development company in India, has been committed to client success for over 15 years. With a proficient team of over 200 professionals, Vrinsoft delivers innovative and reliable solutions in AI/ML, Digital Transformation, Flutter, React, and Custom Apps to clients globally. Serving...