Data Engineer
2 weeks ago
Company Profile:Solytics Partners is a Global Analytics firm, recognized with multiple industry awards for innovation and excellence. Our team comprises experts with deep knowledge in risk, analytics, AI/ML, AML/FCC, and fraud. By converging this expertise with cutting edge technologies like AI, Machine Learning, Generative AI, and Large Language Models (LLMs), we deliver powerful automated platforms and incisive point solutions. Our offerings enable clients to streamline and future-proof their risk, AML, and analytics processes, comply seamlessly with global regulations, and safeguard financial systems. Whether it’s solving complex challenges or driving operational efficiency, Solytics Partners is committed to empowering organizations with transformative tools to stay ahead in an evolving regulatory landscape.Job Title: Data Engineer (Web Scraping)Experience: 5 – 10 years of relevant experienceLocation & Timings: Pune – Work from office & Timing - 11:00 AM – 8:00 PMEducation Qualification: Masters or bachelor's in computer science or IT or in other relevant discipline from a reputed institute.Role Type: Permanent / Full TimeJob Description: We are seeking an experienced Data Engineering & Automation Lead to design, automate, and optimize large-scale data processing and web scraping pipelines. The role involves leading a team to build and maintain high-performance ETL workflows using Apache Airflow, Apache Spark, and AWS services, while integrating AI/NLP solutions powered by OpenAI GPT and other GenAI models for intelligent data extraction and analytics.Responsibilities:Design, automate, and maintain ETL and data processing pipelines using Apache Airflow and Apache Spark.Build, monitor, and optimize web scraping and data extraction workflows for global compliance and risk data sources.Lead and manage web scraping and data engineering teams, ensuring delivery excellence, code quality, and scalability.Create, design, and document automation workflows and secure data-sharing systems using AWS (Lambda, S3, API Gateway, SQS).Implement AI and NLP integrations using OpenAI GPT and GenAI models for intelligent data extraction, tagging, and analytical automation.Analyze large-scale datasets to identify quality gaps, improve accuracy, and optimize indexing and retrieval performance.Collaborate with Backend, DevOps, and Frontend teams for data modeling, monitoring, and visualization.Work closely with clients to gather and translate business requirements into scalable automation and analytics solutions.Author HLD/LLD documentation, mentor junior engineers, and continuously improve automation processes and data workflows.Required Skills:Programming: Python, SQL, JavaScriptData Engineering & Automation: Apache Airflow, Apache Spark, Web Scraping (Scrapy, Selenium), Pandas, NumPyDatabases & Storage: Elasticsearch, MongoDB, MySQLCloud & Backend: AWS (Lambda, S3, EC2, CloudWatch, SQS, SNS, EKS), Docker, Django, FlaskAI/ML & NLP : OpenAI GPT APIs, NER, Sentiment Analysis, Embeddings, Information ExtractionMonitoring & Tools: Grafana, Git, Postman, Jupyter, VS Code Good to HaveStrong understanding of Large Language Models (LLMs) and Generative AI for building intelligent data extraction and analytics agents.Familiarity with risk and compliance domains, including Sanctions, PEP (Politically Exposed Persons), and AMS (Adverse Media Screening) data and processes.Soft Skills:Leadership & Team MentoringProblem-Solving & Analytical ThinkingClear Technical CommunicationCross-functional Collaboration
-
Data Engineer
2 weeks ago
Pune, Maharashtra, India Jash Data Sciences Full time ₹ 15,00,000 - ₹ 25,00,000 per yearDo you love solving real-world data problems with the latest and best techniques? And having fun while solving them in a team Then come join our high-energy team of passionate data people. Jash Data Sciences is the right place for you.We are a cutting-edge Data Sciences and Data Engineering startup based in Pune, India.We believe in continuous learning and...
-
Senior Data Engineer
1 week ago
Pune, India Data Axle Full timeJob Description About Data Axle: Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology platform and...
-
Tech Lead Data Engineer
2 weeks ago
Pune, Maharashtra, India Data Axle Full time ₹ 15,00,000 - ₹ 30,00,000 per yearAbout Data Axle:Data Axle Inc. has been an industry leader in data, marketing solutions, sales, and research for over 50 years in the USA. Data Axle now as an established strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology platform and...
-
Business Consulting-Data Engineer with Power BI
2 weeks ago
Pune, Maharashtra, India NTT DATA Full timeReq ID: 345385NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Business Consulting-Data Engineer with Power BI to join our team in Pune, Mahārāshtra (IN-MH), India (IN).Job...
-
Data Engineer Senior Consultant
4 weeks ago
Pune, India NTT Data Full timeJob Description NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer Senior Consultant to join our team in Pune, Mahrshtra (IN-MH), India (IN). Location: | Experience: 5+...
-
Urgent Search! Associate Data Engineer
4 weeks ago
Pune, Maharashtra, India Data Axle Full timeAbout Data Axle Data Axle Inc has been an industry leader in data marketing solutions sales and research for over 45 years in the US Data Axle has set up a strategic global centre of excellence in Pune This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology platform and leveraging...
-
Data Scientist
2 weeks ago
Pune, Maharashtra, India Data Axle Full time ₹ 12,00,000 - ₹ 36,00,000 per yearAbout Data Axle:Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for over 45 years in the USA. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology platform and by leveraging...
-
Data Scientist
2 weeks ago
Pune, Maharashtra, India Data Axle Full time ₹ 12,00,000 - ₹ 36,00,000 per yearAbout Data Axle:Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for over 45 years in the USA. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology platform and by...
-
Data Scientist
2 weeks ago
Pune, Maharashtra, India Data Dynamics Full time**Objectives of this role**: - Collaborate with product design and engineering teams to develop an understanding of needs. - Research and devise innovative statistical models for data analysis. - Build innovative models and integrate them in our product. - Communicate findings to all stakeholders. - Keep current with technical and industry...
-
Senior Data Scientist
1 week ago
Pune, India Data Axle Full timeJob Description About Data Axle: Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the USA. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology platform and...
