Senior Data Engineering Lead

7 days ago

Chennai, Tamil Nadu, India beBeeDataScientist Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

Job Title

">
  • Develop high-performance data scraping solutions using Scrapy and Python libraries.
  • Lead a team of developers, managing project timelines and deliverables.
  • Implement blocking and captcha-solving techniques to overcome scraping restrictions.
  • Conduct source code reverse engineering and automate web interactions.
  • Manage proxies and IP rotation for effective scraping.
  • Maintain and improve API integrations and data pipelines.
  • Ensure code quality through version control, error handling, and documentation.
  • Collaborate with cross-functional teams for project planning.
  • Monitor performance in high-pressure environments.

Requirements

">
  • Data Scraping: 4+ years experience in IT industry.
  • Leadership: 2+ years leading a team of developers.
  • Scraping Tools: Scrapy, Threading, requests, web automation.
  • Technical Skills">
    • Advanced Python programming.
    • Captcha solving and blocking handling.
    • Source code analysis.
    • Proxy management and IP rotation.
    • App automation, SSL unpinning.
    • API Management, Version Control Systems.
    • Error Handling, SQL, MongoDB, Pandas.
  • Leadership Qualities">
    • Basic project management skills.
    • Moderate documentation skills.
    • Team handling.
    • Pressure management.
    • Flexibility and adaptability.
    • High accountability.

Preferred (Good to Have)

">
  • Linux operating system experience.
  • Knowledge of Appium, Fiddler, Burp Suite.

  • Senior Data Engineer

    24 hours ago

    Chennai, Tamil Nadu, India Eucloid Data Solutions Full time US$ 1,50,000 - US$ 2,00,000 per year

    About The Role:Eucloid is looking for a senior Data Engineer with hands-on expertise in Databricks to join our Data Platform team supporting various business applications. The ideal candidate will support development of data infrastructure on Databricks for our clients by participating in activities which may include starting from up- stream and down-stream...

  • data engineering lead

    7 days ago

    Chennai, Tamil Nadu, India Randstad Full time

    At least 5 years' experience as a Senior or Lead Data Engineer Proven and demonstratable experience of Python, AWS, and SQL/ Oracle Bachelor's honours degree preferably in computer science, or engineering field, or demonstrable technical experience in a related engineering discipline At least 3 years of ETL experience using flat files to transposed...

  • Senior Devops Engineer

    3 days ago

    Chennai, Tamil Nadu, India kripya engineering Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Senior Devops EngineerPosted on: June 28, 2025Experience: 5-10 YrsFull TimeChennaiHiring a Senior DevOps Engineer to lead CI/CD, IaC automation, and Kubernetes-based cloud deployments with a focus on scalability and reliability.

  • Digital Engineering Senior Engineer

    5 days ago

    Chennai, Tamil Nadu, India NTT DATA Full time

    Req ID 305565NTT DATA strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a Digital Engineering Senior Engineer to join our team in Chennai Tamil Nxc4x81du IN-TN India IN Job Duties ...

  • Big Data Engineering Lead

    1 day ago

    Chennai, Tamil Nadu, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Senior Big Data EngineerWe are seeking a highly skilled Senior Big Data Engineer to lead our data engineering team and drive the development of scalable, secure, and high-performance big data solutions.Experience in leading distributed teams across multiple geographies and time zones is essential.Strong technical expertise in Scala, Python, Apache Spark...

  • Eucloid - Senior/Lead Data Engineer - Python

    2 weeks ago

    Chennai, Tamil Nadu, India Eucloid Data Solutions Pvt Ltd Full time

    Job Description : Eucloid is looking for a Lead Data Engineer to join our Data Platform team supporting various business applications. The ideal candidate will support development of data infrastructure for our clients by participating in activities which may include starting from up- stream and down-stream technology selection to designing and building of...

  • Senior Artificial Intelligence Engineer

    3 days ago

    Chennai, Tamil Nadu, India Eucloid Data Solutions Full time US$ 1,50,000 - US$ 2,00,000 per year

    About The Role: Senior Artificial Intelligence Engineer - Gen AIWe are looking for a high-energy tech-savvy individual for the role of Senior AI Engineer- GenAI at Eucloid. The candidate will solve complex problems, picking up new technologies and working at the cutting edge of innovation.The candidate is expected to lead following work-streams:Develop and...

  • Data Engineer

    3 days ago

    Chennai, Tamil Nadu, India NTT DATA Full time US$ 80,000 - US$ 1,20,000 per year

    Req ID: 336026NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer - Azure to join our team in Chennai, Tamil Nādu (IN-TN), India (IN). "Job Duties: Key Responsibilities:...

  • Data Engineer

    4 weeks ago

    Chennai, Tamil Nadu, India Quantrail Data Full time

    Location: Chennai, India (On-site)Duration: 3 monthsStipend: UnpaidEligibility: 2025 graduates onlyConversion: Opportunity for a full-time role based on performance Note: Please apply only if you are serious about joining us. This is a learning-focused internship, and we expect interns to be committed to upskilling themselves and contributing to real-world...

  • Senior Engineer

    3 days ago

    Chennai, Tamil Nadu, India Metis Engineering Services Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    Senior Engineer :Lead installation, commissioning, troubleshooting, and maintenance of industrial machinery/automation. Expertise in PLCs, controls, hydraulics, protocols, and C/C++. Drive reliability, safety, and team success.