
▷ (15h Left) Data Engineer
8 hours ago
We are looking for a skilled Web Crawling Engineer with strong expertise in Python and hands-on experience building scalable crawlers and scrapers The ideal candidate should have deep knowledge of crawling frameworks anti-blocking techniques and proxy management along with experience solving challenges like captchas and rate-limiting Key Responsibilities Design develop and maintain scalable and efficient web crawlers for data extraction Work with Scrapy Requests and other Python libraries to implement crawling solutions Handle anti-scraping measures including IP blocks rate limits and captchas Implement and manage proxy rotation and session management strategies Ensure high-quality and structured data extraction cleaning and storage Monitor crawler performance troubleshoot issues and optimize for reliability and efficiency Collaborate with the data engineering team to integrate crawled data into pipelines Stay updated with the latest tools techniques and best practices in web crawling Required Skills Qualifications Strong programming skills in Python Proven experience with Scrapy Requests BeautifulSoup Selenium if required Hands-on experience solving blocking issues handling Good understanding of proxy usage rotation and fingerprinting avoidance techniques Knowledge of HTTP cookies headers sessions and request response cycles Experience with databases SQL NoSQL for storing crawled data Strong debugging problem-solving and analytical skills Good to Have Experience with cloud environments AWS GCP Azure Knowledge of data pipelines and ETL processes Education Experience Bachelor s degree in Computer Science Information Technology or equivalent practical experience 3 years of experience in web crawling or related fields
-
15h Left: Digital Engineering Sr. Engineer
2 weeks ago
Hyderabad, Telangana, India NTT DATA Full timeReq ID 320609NTT DATA strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a Digital Engineering Sr Engineer to join our team in Hyderabad Telangana IN-TG India IN Job Requirements 4-6 Yrs ...
-
(15h Left) Data Engineer
5 days ago
Hyderabad, India ValueLabs Full timeJob Title: Data Engineer Experience: 6+ yrs Location: Hyderabad Primary skill- Data Engineer, AWS Glue, Lambda, ETL, Python, Airflow ,Snowflake Job Description: We are seeking a Data Engineer responsible for building, maintaining, and optimizing the infrastructure that enables data collection, storage, processing, and analysis. Responsibilities- *...
-
[15h Left] Data Engineer
9 hours ago
Hyderabad, India Kresta Softech Private Limited Full timeData Engineer – Snowflake 📍 Location: Hyderabad / Pune 💼 Employment Type: Permanent - On-site 👥 Openings: 4 ⏳ Joining: Immediate joiners preferred (LWD before 15th October acceptable) End Client: CDK Global About TAO Digital Solutions: At TAO Digital Solutions, we empower businesses to become customer-centric and embrace cutting-edge...
-
Software Engineer
8 hours ago
Hyderabad, Telangana, India Microsoft Full timeThe Commerce Ecosystems C E org enables one of Microsoft s most business-critical needs building the platform to enable commerce across Microsoft Given Microsoft s global presence in over 240 markets close to 150 million transactions a day and billions of dollars in revenue commerce platform needs to be true internet scale and have state of the art...
-
Senior Taxonomy Data Engineer
1 week ago
Hyderabad / Secunderabad, Telangana, India beBeeData Full time ₹ 15,00,000 - ₹ 28,00,000**Job Summary**As a Taxonomy Engineer, you will be responsible for designing, developing, and maintaining taxonomies to support our business operations. You will work closely with cross-functional teams to understand data requirements and design solutions that meet business needs. **Responsibilities:**Design and develop taxonomies to support our business...
-
15h Left! Software Engineer
5 days ago
Hyderabad, Telangana, India Infor Full timeDescription Requirements We are seeking a dedicated and enthusiastic Software Engineer to join our innovative team developing the Infor Mongoose platform Mongoose is Infor s rapid application development platform enabling our application teams to build business applications rapidly As part of our highly energetic team you will contribute to the design...
-
15h Left Senior Data Engineer
2 weeks ago
Hyderabad, Telangana, India Amgen Inc Full timeJob DescriptionJob Title: Senior Data EngineerWhat You Will DoLet's do this. Let's change the world. In this vital role, you will be responsible for designing, developing, and optimizing data pipelines, data integration frameworks, and metadata-driven architectures that enable seamless data access and analytics. This role prefers deep expertise in big data...
-
Lead Data Engineer 15h Left
6 days ago
Hyderabad, Telangana, India Inspire Brands Hyderabad Support Center Full timeAbout Inspire Brands Hyderabad Support Center Inspire Brands is disrupting the restaurant industry through digital transformation and operational efficiencies The company s technology hub Inspire Brands Hyderabad Support Center India will lead technology innovation and product development for the organization and its portfolio of distinct brands The...
-
▷ 15h Left: Data Engineer, SCOT Data Engineering
8 hours ago
Hyderabad, India Amazon Full timeHave you ever wondered how Amazon shipped your order so fast? Wondered where it came from or how much it cost us? To help describe some of our challenges, we created a short video about Supply Chain Optimization at Amazon - http://bit.ly/amazon-scot We are seeking a Data Engineer to join our team. Amazon has a culture of data-driven decision-making and...
-
Data Analyst
5 days ago
Hyderabad, Telangana, India Talent Smart Full timeClient MNC Exp 5 Years Role Full Time Job Location Hyderabad Mode WFO Must to have SAS Good to have Phyton Maps data fields from source systems to the data model ensuring data consistency and integrity Analyze customer data to identify trends and patterns providing actionable insights Gather clean and preprocess customer data from...