Data Acquisition Engineer
3 days ago
Description :
We are seeking a highly skilled and passionate Data Engineer Acquisition to join our growing Data Operations Team
If you enjoy building intelligent data pipelines, solving complex crawling challenges, and working with large-scale datasets, this role is perfect for you.
Role Overview :
- Design, develop & maintain large-scale web scraping pipelines
- Build scalable & resilient data extraction systems
- Work with anti-bot techniques, proxy management & dynamic parsing
- Ensure high-quality, high-integrity acquired data across regions
- Continuously optimize scraping workflows for performance & reliability
Key Responsibilities :
- Build & maintain crawlers and parsers using cutting-edge tools
- Automate scraping workflows for accurate platform data collection
- Implement proxy handling, CAPTCHA bypass & headless browser automation
- Leverage Python, HTML, JavaScript for data extraction
- Optimize pipelines for speed, resilience & efficiency
- Debug website structural changes & fix blockers
- Ensure the data remains accurate, clean & consistent
- Collaborate with cross-functional teams to improve data quality
- Work with JSON, XML & SQL-based data stores
Skills & Experience Needed :
- Minimum 3 years of programming experience
- Strong Python expertise
- Experience in HTML, JavaScript, DOM
- Hands-on experience with web scraping tools/frameworks :
- Scrapy
- Selenium
- Playwright
- BeautifulSoup
- Knowledge of distributed crawling & job scheduling
- Familiarity with headless browsers & proxy rotation techniques
- Experience handling CAPTCHA challenges
- SQL & cloud storage experience
- Good to have : Spark, Kafka
Good To Have :
- Experience in asynchronous scraping
- Cloud platforms (AWS / GCP / Azure)
- CI/CD & automation pipeline exposure
- Python design patterns
Soft Skills :
- Strong problem-solving & analytical ability
- Excellent communication & documentation
- Team player & proactive mindset
- Ability to adapt to changing web structures
Why Join Us?
- Opportunity to work on sophisticated data acquisition projects
- Exposure to global-scale platforms & distributed systems
- Career growth in fast-evolving data engineering space
- Collaborative, learning-oriented environment
-
Data Entry Operator
3 days ago
Bengaluru, Karnataka, India Design Engineer Full time ₹ 2,64,000 per yearWe are seeking a dedicated and detail-oriented Data Entry Operator (DEO) to support R&D projects. The role involves accurate data entry, documentation, and maintenance of research records in secure systems. The DEO will assist scientists, engineers, and administrative staff by ensuring timely and error-free handling of project information.Key...
-
Senior Data Acquisition
21 hours ago
Bengaluru, Karnataka, India Talent Leads Consultants Full time ₹ 12,00,000 - ₹ 36,00,000 per yearJob Description: KEY RESPONSIBILITIES• Architect and design a distributed DAQ system coordinating with mission andSystems Engineering teams.• Develop hardware and firmware for DAUs, including signal conditioning,sensor interfaces, and digital data handling.• Design and implement a Data Acquisition System to synchronize, aggregate,and process high-speed...
-
Data Engineer
1 week ago
Bengaluru, Karnataka, India NTT DATA Full time ₹ 15,00,000 - ₹ 25,00,000 per yearDesign and implement tailored data solutions to meet customer needs and use cases, spanning from streaming to data lakes, analytics, and beyond within a dynamically evolving technical stack. Provide thought leadership by recommending the most appropriate technologies and solutions for a given use case, covering the entire spectrum from the application layer...
-
Sr. Data Engineer Data Science
1 week ago
Bengaluru, Karnataka, India NTT DATA Full time ₹ 12,00,000 - ₹ 24,00,000 per yearReq ID: 342869NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Sr. Data Engineer Data Science to join our team in Bangalore, Karnātaka (IN-KA), India (IN). ...
-
Data Engineer
1 week ago
Bengaluru, Karnataka, India NTT DATA, Inc. Full time ₹ 1,04,000 - ₹ 1,30,878 per yearReq ID:321800We are currently seeking a Data Engineer (Talend &Pyspark) to join our team in Bangalore, Karntaka (IN-KA), India (IN)."Job Duties: Key Responsibilities: Design and implement tailored data solutions to meet customer needs and use cases, spanning from streaming to data lakes, analytics, and beyond within a dynamically evolving technical...
-
Data Engineer
1 week ago
Bengaluru, Karnataka, India NTT DATA, Inc. Full time ₹ 15,00,000 - ₹ 25,00,000 per yearKey Responsibilities:Design and implement tailored data solutions to meet customer needs and use cases, spanning from streaming to data lakes, analytics, and beyond within a dynamically evolving technical stack.Provide thought leadership by recommending the most appropriate technologies and solutions for a given use case, covering the entire spectrum from...
-
Technical Lead- Data Engineer
3 days ago
Bengaluru, Karnataka, India Astar Data Full time ₹ 12,00,000 - ₹ 36,00,000 per yearKindly find the Job Description Below.Job Title:Technical Lead- Data EngineerLocation: BangaloreYears of Experience: 8+ years of experienceSigmoidworks with a variety of clients from start-ups to fortune 500 companies. We are looking for a detailed oriented self-starter to assist our engineering and analytics teams in various roles as a Software...
-
Data & AI Engineer Lead
3 days ago
Bengaluru, Karnataka, India NTT DATA Full time ₹ 12,00,000 - ₹ 36,00,000 per yearFramework Design & Architecture Architect a metadata-driven, Python/Spark-based framework for automated data validation across high-volume production datasets. Define DQ rule templates for completeness, integrity, conformity, accuracy, and timeliness. Establish data quality thresholds, escalation protocols, and exception workflows. Automation & Integration...
-
Data Engineer
2 weeks ago
Bengaluru, Karnataka, India NTT DATA Full time ₹ 5,00,000 - ₹ 15,00,000 per yearReq ID: 343998NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer - Sr ETL Developer (Architect) to join our team in Bangalore, Karnātaka (IN-KA), India (IN). "Job...
-
Data Engineer
2 weeks ago
Bengaluru, Karnataka, India NTT DATA Full time ₹ 4,00,000 - ₹ 8,00,000 per yearReq ID: 344005NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer - ETL Developer to join our team in Bangalore, Karnātaka (IN-KA), India (IN). "Job Duties: Design,...