Data Engineer
2 weeks ago
Note: It's a Data Scrapping / Web Scrapping based role for Bangalore & Gurugram location. Mandatory Skills: Python and any scrapping framework (Scrapy, Selenium, Playwright, or BeautifulSoup) . Role: Data Acquisition Engineer Location: Bangalore / Gurgaon Experience: 3-5 years An ideal candidate has minimum 3 years of hands-on programming experience in Python, HTML and JavaScript. Candidate has demonstrable knowledge in web development or web scraping and is comfortable working with JSON/XML files to extract data . As a Data Engineer focused on web crawling and platform data acquisition, ●You will design, develop, and maintain large-scale web scraping pipelines to extract valuable platform data. ●You will be responsible for implementing scalable and resilient data extraction solutions, ensuring seamless data retrieval while working with proxy management, anti-bot bypass techniques, and data parsing. ●Optimizing scraping workflows for performance, reliability, and efficiency will be a key part of your role. ●Additionally, you will ensure that all extracted data maintains high quality and integrity. Our expectations from the right candidate: ●Strong experience in Python and web scraping frameworks such as Scrapy, Selenium, Playwright, or BeautifulSoup . ●Knowledge of distributed web crawling architectures and job scheduling. ●Familiarity with headless browsers, C APTCHA-solving techniques, and proxy management to handle dynamic web challenges . ●Experience with data storage solutions, including SQL, and cloud storage. ●Understanding of big data technologies like Spark and Kafka (a plus). ●Strong debugging skills to adapt to website structure changes and blockers.
-
Senior DevOps Engineer
4 days ago
bangalore, India Crest Data Full timeCompany Overview:Crest Data is the global leading provider of Data Analytics, Security, DevOps, Cloud Solutions, Software integrations, Analytics, and security-based technological services. With a clientele that includes several Fortune 500 corporations and some of the innovative Silicon Valley Startups.Company URL: http://www.crestdata.aiJob Location -...
-
Senior DevOps Engineer
4 days ago
bangalore, India Crest Data Full timeCompany Overview: Crest Data is the global leading provider of Data Analytics, Security, DevOps, Cloud Solutions, Software integrations, Analytics, and security-based technological services. With a clientele that includes several Fortune 500 corporations and some of the innovative Silicon Valley Startups. Company URL : Job Location - Ahmedabad Job...
-
Senior DevOps Engineer
3 days ago
bangalore, India Crest Data Full timeCompany Overview: Crest Data is the global leading provider of Data Analytics, Security, DevOps, Cloud Solutions, Software integrations, Analytics, and security-based technological services. With a clientele that includes several Fortune 500 corporations and some of the innovative Silicon Valley Startups. Company URL : Job Location - Ahmedabad Job...
-
Senior DevOps Engineer
2 days ago
bangalore, India Crest Data Full timeCompany Overview: Crest Data is the global leading provider of Data Analytics, Security, DevOps, Cloud Solutions, Software integrations, Analytics, and security-based technological services. With a clientele that includes several Fortune 500 corporations and some of the innovative Silicon Valley Startups. Company URL : Job Location - Ahmedabad Job...
-
Technical specialist
4 weeks ago
Bangalore, India NTT DATA, Inc. Full timeSenior L3+ Network Security Engineer (Fortinet SASE) Job Type: Full-time Experience: 6+ years in network security implementation We are seeking a Senior L3+ Network Security Engineer with 6+ years of hands-on implementation experience in Fortinet SASE/Cybersecurity. The ideal candidate will be responsible for designing, deploying, optimizing, and...
-
Data Engineer
4 days ago
bangalore, India Recro Full timeKey Responsibilities include: Data Pipeline Engineering: Design, build, and maintain ingestion, transformation, and storage pipelines using Azure Data Factory, Synapse Analytics, and Data Lake. AI Data Enablement: Collaborate with AI Consultants to prepare and manage datasets for supervised, unsupervised, and synthetic learning workflows. POC Support:...
-
Data Engineer
4 days ago
bangalore, India Recro Full timeKey Responsibilities include:Data Pipeline Engineering: Design, build, and maintain ingestion, transformation, and storage pipelines using Azure Data Factory, Synapse Analytics, and Data Lake.AI Data Enablement: Collaborate with AI Consultants to prepare and manage datasets for supervised, unsupervised, and synthetic learning workflows.POC Support: Implement...
-
Data Engineer
2 weeks ago
bangalore, India BrothersTech Full timeTitle : Data Engineer Location : Remote (Night Shift - Flexible) Contract Duration: 6 months Must have excellent English written and verbal communication skills. The ideal candidate should be experienced in data engineering on Snowflake Azure -ADF, Microsoft MDS, SQL, Data Pipelines with a focus on developing, maintaining the Data Analytics solutions. Job...
-
Data Engineer
4 days ago
bangalore, India Acuity Knowledge Partners Full timeAcuity Knowledge Partners is hiring multiple 'Data Engineers' for its Data and Technology Services Team for Bengaluru (hybrid). "The position requires advanced proficiency in Python and SQL (covering both core programming and data manipulation), hands-on experience with cloud-native platform - Azure, and strong knowledge of Databricks (including core data...
-
Data Engineer
2 days ago
bangalore, India Acuity Knowledge Partners Full timeAcuity Knowledge Partners is hiring multiple 'Senior Data Engineers' for its Data and Technology Services Team at Bengaluru (hybrid). "The position requires advanced proficiency in Python and SQL (covering both core programming and data manipulation), hands-on experience with cloud-native platform - Azure, and strong knowledge of Databricks (including core...
