Data Engineer
1 day ago
Note: It's a Data Scrapping / Web Scrapping based role for Bangalore & Gurugram location. Mandatory Skills: Python and any scrapping framework (Scrapy, Selenium, Playwright, or BeautifulSoup) . Role: Data Acquisition Engineer Location: Bangalore / Gurgaon Experience: 3-5 years An ideal candidate has minimum 3 years of hands-on programming experience in Python, HTML and JavaScript. Candidate has demonstrable knowledge in web development or web scraping and is comfortable working with JSON/XML files to extract data . As a Data Engineer focused on web crawling and platform data acquisition, ●You will design, develop, and maintain large-scale web scraping pipelines to extract valuable platform data. ●You will be responsible for implementing scalable and resilient data extraction solutions, ensuring seamless data retrieval while working with proxy management, anti-bot bypass techniques, and data parsing. ●Optimizing scraping workflows for performance, reliability, and efficiency will be a key part of your role. ●Additionally, you will ensure that all extracted data maintains high quality and integrity. Our expectations from the right candidate: ●Strong experience in Python and web scraping frameworks such as Scrapy, Selenium, Playwright, or BeautifulSoup . ●Knowledge of distributed web crawling architectures and job scheduling. ●Familiarity with headless browsers, C APTCHA-solving techniques, and proxy management to handle dynamic web challenges . ●Experience with data storage solutions, including SQL, and cloud storage. ●Understanding of big data technologies like Spark and Kafka (a plus). ●Strong debugging skills to adapt to website structure changes and blockers.
-
Lead Data Engineer
2 weeks ago
bangalore, India Eucloid Data Solutions Full timeEucloid is looking for a Lead Data Engineer to join our Data Platform team supporting various business applications. The ideal candidate will support development of data infrastructure on Databricks for our clients by participating in activities which may include starting from up- stream and down-stream technology selection to designing and building of...
-
Lead Data Engineer
2 weeks ago
bangalore, India Eucloid Data Solutions Full timeEucloid is looking for a Lead Data Engineer to join our Data Platform team supporting various business applications. The ideal candidate will support development of data infrastructure on Databricks for our clients by participating in activities which may include starting from up- stream and down-stream technology selection to designing and building of...
-
Data Engineer
1 day ago
bangalore district, India Vista Applied Solutions Group Inc Full timeJob Summary: Client is looking for Data Engineer and this is hybrid position in Bengaluru. Responsibilities: Data Engineering expertise is required with specific experience in data modeling using Google BigQuery as well as more advanced SQL capabilities. Minimum 5-10 years Data Engineering background, with specific Google BigQuery skills are mandatory....
-
Data Engineer
2 weeks ago
bangalore district, India Acqueon Full timeAbout the Job We are building a Customer Data Platform (CDP) designed to unlock the full potential of customer experience (CX) across our products and services. This role offers the opportunity to design and scale a platform that unifies customer data from multiple sources, ensures data quality and governance, and provides a single source of truth for...
-
Data Engineer
1 day ago
bangalore district, India Hithonix Solutions Private Limited Full timeAbout Hithonix Solutions Pvt Ltd: Hithonix Solutions Pvt Ltd is a forward-looking technology company committed to delivering innovative software solutions that drive business success for our clients. Founded on the principles of quality, integrity, and excellence, we operate in a collaborative environment where creativity, learning, and growth are...
-
Data Engineer
1 day ago
bangalore district, India Synechron Full timeWe have immediate opportunity for AWS Data Engineer. Job Role: AWS Data Engineer Job Location: Bangalore and Pune Experience- 4-12Years About Company: At Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity and innovative technology to deliver industry-leading digital solutions....
-
Data Engineer
24 hours ago
bangalore district, India ACL Digital Full time🚀 We’re Hiring: Data Engineers – Bangalore 🚀 Are you passionate about building your career in Data Engineering? We’re looking for talented Data Engineers with 4+ years of experience to join our Bangalore team! Location: Bangalore Experience: 4+ Years Interview Mode: Face-to-Face ONLY JD: · Technical Skills and Platforms: Python, Hadoop, HIVE,...
-
Data Engineer
2 weeks ago
bangalore district, India Mastek Full timeData Engineer – NiFi / Cloudera / Iceberg / Snowflake / Databricks Overview We are seeking a Data Engineer with strong Apache NiFi expertise to design and implement pipelines that move and transform data from Cloudera (HDFS/Hive/Impala) into Apache Iceberg tables, with downstream integration into Snowflake and Databricks. The ideal candidate will have...
-
Data Engineer
1 day ago
bangalore district, India Talent Corner HR Services Pvt Ltd Full timeONLY BANGALORE CANDIDATES APPLY Position: AWS Data Engineer Experience: 5- 12 Years Skills must have: Python, AWS, SQL, Data Warehousing is a Must Location: JP Nagar, Bangalore Salary: Industry standards Work Mode: WFO, 3 days WFH per month Interview Mode: Direct F2F Interview (Manager + HR Round at same day) Duration of the interview: 1:30 Minutes Skills...
-
Data Engineer
1 day ago
bangalore district, India Cantordust Solutions LLC Full timeLocation: Preferred: Bangalore (On-site); Alternatives: Mumbai, Kathmandu (On-site) Type: Contract work, with potential for conversion to full time . Duration: September - December 2025 Start Date : Immediate Who We Are We are recent MIT graduates experienced in digital transformation and AI, with expertise in various sectors including consulting, energy,...
