Data Engineer
3 days ago
Alternative Path is seeking skilled software developers to collaborate on client projects with an asset management firm. In this role, you will collaborate with individuals across various company departments to shape and innovate new products and features for our platform, enhancing existing ones. You will have a large degree of independence and trust, but you won't be isolated; the support of the Engineering team leads, the Product team leads, and every other technology team member is behind you. This is an opportunity to join a team-first meritocracy and help grow an entrepreneurial group inside Alternative Path. You will be asked to contribute, given ownership, and will be expected to make your voice heard.Role Summary:Performing Web Scraping using various scraping techniques and then utilizing Python’s Pandas library for data cleaning and manipulation. Then ingesting the data into a Database/Warehouse, and scheduling the scrapers using Airflow or other toolsRole OverviewThe Web Scraping Team at Alternative Path is seeking a creative and detail-oriented developer to contribute to client projects. The team develops essential applications, datasets, and alerts for various teams within the client's organization, supporting their daily investment decisions. The mission is to maintain operational excellence by delivering high-quality proprietary datasets, timely notifications, and exceptional service. We are seeking someone who is self-motivated, self-sufficient, with a passion for tinkering and a love for automation.In your role, you will:➢ Collaborate with analysts to understand and anticipate requirements.➢ Design, implement, and maintain Web scrapers for a wide variety of alternative datasets.➢ Perform Data Cleaning, Exploration, Transformation etc. of scraped data.➢ Collaborate with cross-functional teams to understand data requirements and implement efficient data processing workflows.➢ Author QC checks to validate data availability and integrity.➢ Maintain alerting systems and investigate time-sensitive data incidents to ensure smooth day-to-day operations.➢ Design and implement products and tools to enhance the Web scraping Platform.QualificationsMust have➢ Bachelor's/master’s degree in computer science or in any related field➢ 3-5 years of software development experience➢ Strong Python and SQL/Database skills➢ Strong expertise in using the Pandas library (Python) is a must➢ Experience with web technologies (HTML/JS, APIs, etc.)➢ Proven work experience in working with large data sets for Data cleaning, Data transformation, Data manipulation, and Data replacements.➢ Excellent verbal and written communication skills➢ Aptitude for designing infrastructure, data products, and tools for Data ScientistsPreferred➢ Familiarity with scraping and common scraping tools (Selenium, scrapy, Fiddler, Postman, xpath) ➢ Experience containerizing workloads with Docker (Kubernetes a plus)➢ Experience with build automation (Jenkins, Gitlab CI/CD) ➢ Experience with AWS technologies like S3, RDS, SNS, SQS, Lambda, etc.
-
Data Engineer
4 weeks ago
Prayagraj, India Bookipi Full timeThe Role We’re seeking an experienced and versatile Data Engineer with technical skills in data structuring, warehousing, data retrieval, visualisation and presentation. You will work alongside our developers and independently in a central position in the company. You are responsible for taking ownership of data structuring, reporting, visualisation,...
-
Data Engineer
4 weeks ago
Prayagraj, India Bookipi Full timeThe Role We’re seeking an experienced and versatile Data Engineer with technical skills in data structuring, warehousing, data retrieval, visualisation and presentation. You will work alongside our developers and independently in a central position in the company. You are responsible for taking ownership of data structuring, reporting, visualisation,...
-
Lead Data Engineer
3 weeks ago
Prayagraj, India MindBrain Full timeJob Title: Lead Data Engineer Location: RemoteExperience: 7+About the Role: We are looking for a hands-on Lead Data Engineer to help optimize and maintain our ETL pipelines and data infrastructure. You’ll work with analysts, engineers, and leadership to ensure reliable, scalable, and efficient data workflows that support reporting, analytics, and AI use...
-
Senior Data Engineer
4 weeks ago
Prayagraj, India Professional Search Group Full timeJob Description PSG are proud to be partnering with a large-scale mining services organisation that plays a critical role in keeping goods and services moving across Australia. With a rapidly growing customer base and a focus on innovation, they are investing heavily in their data capabilities to drive smarter decisions, optimise operations, and...
-
Senior Data Engineer
4 weeks ago
Prayagraj, India Professional Search Group Full timeJob Description PSG are proud to be partnering with a large-scale mining services organisation that plays a critical role in keeping goods and services moving across Australia. With a rapidly growing customer base and a focus on innovation, they are investing heavily in their data capabilities to drive smarter decisions, optimise operations, and...
-
Senior Data Engineer
4 weeks ago
Prayagraj, India Telstra Health Full timeAt Telstra Health we combine technology and innovation to bring big, scalable solutions to life so our healthcare heroes can continue making patients happier and healthier. We believe health tech has the power to revolutionise how healthcare is delivered - it's the ultimate game-changer, unlocking a whole new level of delivering modern care. ...
-
Senior Data Engineer
4 weeks ago
Prayagraj, India Telstra Health Full timeAt Telstra Health we combine technology and innovation to bring big, scalable solutions to life so our healthcare heroes can continue making patients happier and healthier. We believe health tech has the power to revolutionise how healthcare is delivered - it's the ultimate game-changer, unlocking a whole new level of delivering modern care. ...
-
Data Scientists
4 weeks ago
Prayagraj, India Enterprise Minds, Inc Full time🚀 We’re Hiring: Lead Data Scientists / Data Visualization Experts (Python) & Data Engineers📍 Location: Remote | 🌐 Work from Anywhere💼 Experience Level: Lead / Senior (Production-Level Expertise Required)About the ProjectWe are working on an exciting initiative to build a cutting-edge dataset of visualizations for LLM training. This involves...
-
Data Engineer
4 weeks ago
Prayagraj, India Infinite Consulting Full timeJob Description Lead Data Engineers 12 months contract with 2x6 months ext. options! Hybrid work arrangement Australian Citizens with current Baseline Clearance Infinite Consulting is seeking Lead Data Engineers for our esteemed Federal Government Client. This is a July start for a 12 month initial contract – 2x6 months further...
-
6 Lead Data Engineers
4 weeks ago
Prayagraj, India Infinite Consulting Full timeJob Description Lead Data Engineers 12 months contract with 2x6 months ext. options! Hybrid work arrangement Australian Citizens with current Baseline Clearance Infinite Consulting is seeking Lead Data Engineers for our esteemed Federal Government Client. This is a July start for a 12 month initial contract – 2x6 months further extensions...
