Data Engineer
3 weeks ago
Note: It's a Data Scrapping / Web Scrapping based role for Bangalore & Gurugram location. Mandatory Skills: Python and any scrapping framework (Scrapy, Selenium, Playwright, or BeautifulSoup) . Role: Data Acquisition Engineer Location: Bangalore / Gurgaon Experience: 3-5 years An ideal candidate has minimum 3 years of hands-on programming experience in Python, HTML and JavaScript. Candidate has demonstrable knowledge in web development or web scraping and is comfortable working with JSON/XML files to extract data . As a Data Engineer focused on web crawling and platform data acquisition, ●You will design, develop, and maintain large-scale web scraping pipelines to extract valuable platform data. ●You will be responsible for implementing scalable and resilient data extraction solutions, ensuring seamless data retrieval while working with proxy management, anti-bot bypass techniques, and data parsing. ●Optimizing scraping workflows for performance, reliability, and efficiency will be a key part of your role. ●Additionally, you will ensure that all extracted data maintains high quality and integrity. Our expectations from the right candidate: ●Strong experience in Python and web scraping frameworks such as Scrapy, Selenium, Playwright, or BeautifulSoup . ●Knowledge of distributed web crawling architectures and job scheduling. ●Familiarity with headless browsers, C APTCHA-solving techniques, and proxy management to handle dynamic web challenges . ●Experience with data storage solutions, including SQL, and cloud storage. ●Understanding of big data technologies like Spark and Kafka (a plus). ●Strong debugging skills to adapt to website structure changes and blockers.
-
Data Engineer
3 weeks ago
Bangalore Division, India Hithonix Solutions Private Limited Full timeAbout Hithonix Solutions Pvt Ltd: Hithonix Solutions Pvt Ltd is a forward-looking technology company committed to delivering innovative software solutions that drive business success for our clients. Founded on the principles of quality, integrity, and excellence, we operate in a collaborative environment where creativity, learning, and growth are...
-
Data Engineer
2 weeks ago
Bangalore Division, India Aezion, Inc Full timeSr. Data Engineer Location: Bangalore /Coimbatore Job Type: Full-Time Required Skills and Qualifications: 8+ years of experience in Data Engineering and Analytics, with at least 2+ years in a leadership role. Proven experience managing global teams, both onsite and offshore. Strong hands-on technical background in Big Data, streaming Platforms, Databricks,...
-
Data Engineer
2 weeks ago
Bangalore Division, India LTIMindtree Full timeJob Description We are seeking a skilled Data Engineer with hands-on experience in Google Cloud Platform (GCP) , specifically BigQuery , Dataflow , Airflow , and Python . The ideal candidate will be responsible for developing scalable data pipelines, transforming and ingesting large-scale data, and ensuring data quality and security across workflows. Roles...
-
Data Engineer
1 week ago
Bangalore Division, India ACL Digital Full timeHello connections! We have urgent openings for AWS Data Engineer. Job Description: We are seeking an experienced Data Engineer to join our team and contribute to the building, development, and support of ETL/ELT pipelines in a cloud-based environment. The ideal candidate will have a strong background in designing, deploying, and maintaining data pipelines...
-
Data Engineer
2 weeks ago
Bangalore Division, India ACL Digital Full timeHi all, We are hiring for Data Engineer with one of our renowned client with pan India location. Looking for candidates with 5 to 7 years of experience Relevant 5+ years into Data Engineering GCP Cloud Data bricks, Unity catalog, Python/Pyspark Terra form scripts
-
Data Engineer
2 weeks ago
Bangalore Division, India Networth Corp Full timeResponsibilities: Working along with architects for planning, designing, integrating, and implementing complex solutions in Azure Cloud computing services End to end development lifecycle of complex large-scale and multi-user applications Implement Azure Cloud data warehouses, Azure and No-SQL databases and hybrid data scenarios Big Data ETL considering...
-
Data Engineer
3 weeks ago
Bangalore Division, India Talent Corner HR Services Pvt Ltd Full timeONLY BANGALORE CANDIDATES APPLY Position: AWS Data Engineer Experience: 5- 12 Years Skills must have: Python, AWS, SQL, Data Warehousing is a Must Location: JP Nagar, Bangalore Salary: Industry standards Work Mode: WFO, 3 days WFH per month Interview Mode: Direct F2F Interview (Manager + HR Round at same day) Duration of the interview: 1:30 Minutes Skills...
-
Data Engineer
2 weeks ago
Bangalore Division, India Cantordust Solutions LLC Full timeLocation: Preferred: Bangalore (On-site); Alternatives: Mumbai, Kathmandu (On-site) Type: Contract work, with potential for conversion to full time . Duration: September - December 2025 Start Date : Immediate Who We Are We are recent MIT graduates experienced in digital transformation and AI, with expertise in various sectors including consulting, energy,...
-
Data Engineer
2 weeks ago
Bangalore Division, India Alp Consulting Ltd. Full timeDear Candidate Please find the below JD for your reference: Hands-on experience with AWS or similar cloud platform building data engineering solutions for analytics and science. (3+ years) Must have experience building complex data pipelines – batch and/or real time event-based processing (3+ years) Strong experience in designing, building, and maintaining...
-
Senior Data Engineer
3 weeks ago
Bangalore Division, India Zeta Full timeAbout Zeta Zeta is a Next-Gen Banking Tech company that empowers banks and fintechs to launch banking products for the future. It was founded by and Ramki Gaddipati in 2015. Our flagship processing platform - Zeta Tachyon - is the industry’s first modern, cloud-native, and fully API-enabled stack that brings together issuance, processing, lending, core...
