Current jobs related to Lead Data Engineering Specialist - Pune, Maharashtra - beBeeData
-
Data Engineer
2 weeks ago
Pune, Maharashtra, India Data Axle Full time ₹ 15,00,000 - ₹ 28,00,000 per yearAbout Data Axle:Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology platform and leveraging proprietary...
-
Azure Data Engineer
2 weeks ago
Pune, Maharashtra, India Capgemini Engineering Full time ₹ 15,00,000 - ₹ 28,00,000 per yearAt Capgemini Engineering, the world leader in engineering services, we bring together a global team of engineers, scientists, and architects to help the world's most innovative companies unleash their potential. From autonomous cars to life-saving robots, our digital and software technology experts think outside the box as they provide unique R&D and...
-
Data Engineering Lead
1 day ago
Pune, Maharashtra, India Ascentt Full time ₹ 12,00,000 - ₹ 36,00,000 per yearJob Title: Data Engineering LeadJob Summary:We are seeking an experienced Data Engineering Lead to oversee and guide our organization's data engineering function. The ideal candidate will combine deep technical expertise in big data and data engineering with strong leadership skills to drive innovation, best practices, and excellence across our data...
-
Data Engineering Specialist
2 weeks ago
Pune, Maharashtra, India beBeeEngineering Full time ₹ 15,00,000 - ₹ 25,00,000Job Description:We are seeking a highly skilled Data Engineering Specialist to join our team.The ideal candidate will have experience in designing, developing, and maintaining scalable data pipelines using cloud-based technologies such as Snowflake, Airflow, and PySpark.Skill Set:AWSSnowflakeKafkaAirflowGithubPySparkMain Responsibilities:To design, develop,...
-
Snowflake Data Engineer Lead Position
2 weeks ago
Pune, Maharashtra, India beBeeSnowflake Full time ₹ 18,42,500 - ₹ 23,17,500Senior Data Engineer - Snowflake SpecialistWe are seeking an experienced Senior Data Engineer to lead our Snowflake team. The successful candidate will be responsible for designing and developing scalable data pipelines, data models, and transformations using Snowflake.Main Responsibilities:Design, develop, and maintain complex Snowflake databases and data...
-
Lead Data Engineer
2 weeks ago
Pune, Maharashtra, India North Hires Full time ₹ 1,04,000 - ₹ 1,30,878 per yearCompany DescriptionNorth Hires is a premier consulting firm specializing in Custom Software Development, Recruitment, Sourcing, and Executive Search services. Our mission is to empower businesses by providing them with the finest human capital. We strive to be the go-to consulting partner for companies seeking exceptional talent, fostering growth,...
-
10/09/2025 Digital Engineering Lead Engineer
2 weeks ago
Pune, Maharashtra, India NTT DATA Full timeReq ID 277728NTT DATA Services strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a Digital Engineering Lead Engineer to join our team in Pune Mah xc4 x81r xc4 x81shtra IN-MH India IN Roles ...
-
Lead Data Engineer
2 weeks ago
Pune, Maharashtra, India Arting Digital Private Limited Full time ₹ 1,04,000 - ₹ 1,30,878 per yearPosting title: Lead Data Engineer (Databricks)Experience: 7+ YearsLocation: Pune/ AhmedabadWork mode: HybridPrimary skills: Databricks, Data Modelling/ Data Lakehouse, Gen AI, SQL, Python/Scala, Azure Data Factory (ADF)/AWS Glue, Docker, Team LeadQualification: Any Technical DegreeRoles & Responsibilities:Lead the design, development, and optimization of...
-
Lead Data Engineer
1 day ago
Pune, Maharashtra, India Mastercard Full time ₹ 15,00,000 - ₹ 20,00,000 per yearJob Title:Lead Data Engineer Overview:OverviewWe are the global technology company behind the world's fastest payments processing network. We are a vehicle for commerce, a connection to financial systems for the previously excluded, a technology innovation lab, and the home of Priceless. We ensure every employee has the opportunity to be a part of something...
-
Lead Data Engineer
2 weeks ago
Pune, Maharashtra, India Arting Digital Private Limited Full time ₹ 15,00,000 - ₹ 28,00,000 per yearPosition: Lead Data EngineerExperience: 7–10 yearsLocation: Pune / AhmedabadMode: HybridKey SkillsData Engineering, SQL, Python, Snowflake, dbt, Apache AirflowCloud Platforms: AWS / Azure / GCPCI/CD, Git, Infrastructure as Code (Terraform)Team Leadership & Stakeholder CollaborationResponsibilitiesDesign, build, and optimize scalable data pipelines...

Lead Data Engineering Specialist
3 weeks ago
Job Title: Lead Data Scraping Engineer
We are seeking an experienced data scraping professional to drive the success of our team.
The ideal candidate will have a minimum of 4 years of hands-on experience in IT scraping, with at least 2 years leading a team of 5+ developers.
This role requires deep technical knowledge in advanced scraping techniques, reverse engineering, automation, and leadership skills.
Key Responsibilities:
• Design and develop scalable data scraping solutions using tools like Scrapy and Python libraries.
• Lead and mentor a team of 5+ developers, managing project timelines and deliverables.
• Implement advanced blocking and captcha-solving techniques to bypass scraping restrictions.
• Conduct source code reverse engineering and automate web and app interactions.
• Manage proxies, IP rotation, and SSL unpinning to ensure effective scraping.
• Maintain and improve API integrations and data pipelines.
• Ensure code quality through effective version control, error handling, and documentation.
Required Skills and Experience:
- Data Scraping: Minimum 4 years in IT scraping industry
- Leadership: Minimum 2 years leading a team of 5+ developers
- Scraping Tools: Scrapy, Threading, requests, web automation
- Technical Proficiency:
- Advanced Python
- Captcha solving and blocking handling
- Source reverse engineering
- Proxy management & IP rotation
- App automation, SSL Unpin, Frida
- API Management, Version Control Systems
- Error Handling, SQL, MongoDB, Pandas
- Leadership Skills:
- Basic project management
- Moderate documentation
- Team handling
- Pressure management
- Flexibility and adaptability
- High accountability
Preferred (Good to Have):
- Experience with Linux
- Knowledge of Appium, Fiddler, Burp Suite