▷ (15h Left) Data Engineer
3 weeks ago
We are looking for a skilled Web Crawling Engineer with strong expertise in Python and hands-on experience building scalable crawlers and scrapers The ideal candidate should have deep knowledge of crawling frameworks anti-blocking techniques and proxy management along with experience solving challenges like captchas and rate-limiting Key Responsibilities Design develop and maintain scalable and efficient web crawlers for data extraction Work with Scrapy Requests and other Python libraries to implement crawling solutions Handle anti-scraping measures including IP blocks rate limits and captchas Implement and manage proxy rotation and session management strategies Ensure high-quality and structured data extraction cleaning and storage Monitor crawler performance troubleshoot issues and optimize for reliability and efficiency Collaborate with the data engineering team to integrate crawled data into pipelines Stay updated with the latest tools techniques and best practices in web crawling Required Skills Qualifications Strong programming skills in Python Proven experience with Scrapy Requests BeautifulSoup Selenium if required Hands-on experience solving blocking issues handling Good understanding of proxy usage rotation and fingerprinting avoidance techniques Knowledge of HTTP cookies headers sessions and request response cycles Experience with databases SQL NoSQL for storing crawled data Strong debugging problem-solving and analytical skills Good to Have Experience with cloud environments AWS GCP Azure Knowledge of data pipelines and ETL processes Education Experience Bachelor s degree in Computer Science Information Technology or equivalent practical experience 3 years of experience in web crawling or related fields
-
(15h Left) Lead Data Engineer
3 weeks ago
Hyderabad, Telangana, India Land O'Lakes Full timeAbout Land O LakesLand OLakes Inc is a 100-year-old farmer owned cooperative originally formed with the purpose of working together to create new market opportunities for dairy producers Our journey began in 1921 when 320 dairy farmers met in St Paul Minnesota to form the Minnesota Cooperative Creameries Association Their idea was simple join...
-
15h Left: Data Engineer
1 week ago
Hyderabad, India Divami Full timeLocation: Hyderabad -Onsite Experience: 3–5 years Company: Divami Design Labs About Divami: At Divami Design Labs , we are passionate about crafting world-class UX/UI solutions for global clients. Being a bootstrapped and growing company , every team member plays a critical role in shaping our journey. We are now building our data capabilities to empower...
-
Azure Data Engineer
2 weeks ago
Hyderabad, Telangana, India Enable Data Incorporated Full timeEnable Data Incorporated is currently seeking a skilled and experienced Azure Data Engineer to join our dynamic team As a leading provider of advanced application data and cloud engineering services Enable Data has developed deep expertise across various industries We work closely with our customers to leverage modern solutions and technologies to drive...
-
(15h Left) Data Engineer
4 weeks ago
Hyderabad, India ValueLabs Full timeJob Title: Data Engineer Experience: 6+ yrs Location: Hyderabad Primary skill- Data Engineer, AWS Glue, Lambda, ETL, Python, Airflow ,Snowflake Job Description: We are seeking a Data Engineer responsible for building, maintaining, and optimizing the infrastructure that enables data collection, storage, processing, and analysis. Responsibilities- *...
-
[15h Left] Data Engineer
3 weeks ago
Hyderabad, India Kresta Softech Private Limited Full timeData Engineer – Snowflake 📍 Location: Hyderabad / Pune 💼 Employment Type: Permanent - On-site 👥 Openings: 4 ⏳ Joining: Immediate joiners preferred (LWD before 15th October acceptable) End Client: CDK Global About TAO Digital Solutions: At TAO Digital Solutions, we empower businesses to become customer-centric and embrace cutting-edge...
-
15h Left: Data Engineer
1 week ago
Hyderabad, India Kanerika Inc Full timeAbout the Role We are seeking a skilled Data Engineer with strong experience in Databricks, Microsoft Fabric, or Snowflake , along with Power BI expertise , to design, build, and optimize scalable data pipelines and analytics solutions. You will also play a key role in enabling effective data visualization and reporting for business stakeholders. Key...
-
▷ [15h Left] Data Engineer
2 weeks ago
Hyderabad, India QualiZeal Full timeJob Overview: We are seeking an experienced ETL Developer with 10+ years of expertise in SQL development and database architecture. The ideal candidate should have strong experience in ETL processes, data modeling, and performance optimization, handling large-scale data transactions (5–10 million records). Proficiency in SSIS, data warehousing, and...
-
Ai Data Scientist
3 days ago
Hyderabad, Telangana, India NTT DATA Full timeReq ID 327884 NTT DATA strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a AI Data Scientist - Digital Engineering Sr Engineer to join our team in Hyderabad Telangana IN-TG India IN ARTIFICIAL...
-
▷ 15h Left: Data Science Ic2
3 weeks ago
Hyderabad, Telangana, India Microsoft Full timeMicrosoft s Cloud business is expanding and the Cloud Supply Chain CSCP organization is responsible for enabling the hardware infrastructure underlying this growth including AI CSCP s vision is to empower customers to achieve more by delivering Cloud and AI capabilities at scale Our mission is to deliver the world s computer with an industry-leading...
-
Data Engineer Advisor
3 weeks ago
Hyderabad, Telangana, India NTT DATA Full timeReq ID 329271 NTT DATA strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a Data Engineer Advisor to join our team in Hyderabad Telangana IN-TG India IN Position Overview ...
