Data Engineer

3 days ago

Kollam, India Alternative Path Full time

Alternative Path is seeking skilled software developers to collaborate on client projects with an asset management firm. In this role, you will collaborate with individuals across various company departments to shape and innovate new products and features for our platform, enhancing existing ones. You will have a large degree of independence and trust, but you won't be isolated; the support of the Engineering team leads, the Product team leads, and every other technology team member is behind you. This is an opportunity to join a team-first meritocracy and help grow an entrepreneurial group inside Alternative Path. You will be asked to contribute, given ownership, and will be expected to make your voice heard.Role Summary: Performing Web Scraping using various scraping techniques and then utilizing Python’s Pandas library for data cleaning and manipulation. Then ingesting the data into a Database/Warehouse, and scheduling the scrapers using Airflow or other tools Role Overview The Web Scraping Team at Alternative Path is seeking a creative and detail-oriented developer to contribute to client projects. The team develops essential applications, datasets, and alerts for various teams within the client's organization, supporting their daily investment decisions. The mission is to maintain operational excellence by delivering high-quality proprietary datasets, timely notifications, and exceptional service. We are seeking someone who is self-motivated, self-sufficient, with a passion for tinkering and a love for automation.In your role, you will: ➢ Collaborate with analysts to understand and anticipate requirements. ➢ Design, implement, and maintain Web scrapers for a wide variety of alternative datasets. ➢ Perform Data Cleaning, Exploration, Transformation etc. of scraped data. ➢ Collaborate with cross-functional teams to understand data requirements and implement efficient data processing workflows. ➢ Author QC checks to validate data availability and integrity. ➢ Maintain alerting systems and investigate time-sensitive data incidents to ensure smooth day-to-day operations. ➢ Design and implement products and tools to enhance the Web scraping Platform.Qualifications Must have ➢ Bachelor's/master’s degree in computer science or in any related field ➢ 3-5 years of software development experience ➢ Strong Python and SQL/Database skills ➢ Strong expertise in using the Pandas library (Python) is a must ➢ Experience with web technologies (HTML/JS, APIs, etc.) ➢ Proven work experience in working with large data sets for Data cleaning, Data transformation, Data manipulation, and Data replacements. ➢ Excellent verbal and written communication skills ➢ Aptitude for designing infrastructure, data products, and tools for Data ScientistsPreferred ➢ Familiarity with scraping and common scraping tools (Selenium, scrapy, Fiddler, Postman, xpath) ➢ Experience containerizing workloads with Docker (Kubernetes a plus) ➢ Experience with build automation (Jenkins, Gitlab CI/CD) ➢ Experience with AWS technologies like S3, RDS, SNS, SQS, Lambda, etc.

  • Data Engineer

    2 weeks ago

    Kollam, India Magma Consultancy Full time

    Location: RemoteType: Part-time (20–25 hours per week)About the RoleWe are seeking a skilled Data Engineer to support our growing data operations on a part-time basis. The ideal candidate has hands-on experience in building, optimizing, and maintaining data pipelines and architectures. You’ll work closely with analysts, developers, and business teams...

  • Data Engineer

    2 weeks ago

    Kollam, India Digivance Solutions Full time

    Position: Data EngineerExperience: 5–10 YearsLocation: Chennai, Bengaluru, Pune, Hyderabad, Mumbai, Delhi NCR(candidates will be required to work at any of these locations in hybrid mode)Key ResponsibilitiesCollaborate with business and technology stakeholders to understand current and future data requirements.Design, build, and maintain reliable,...

  • Data Engineer

    2 weeks ago

    Kollam, India Digivance Solutions Full time

    Position: Data EngineerExperience: 5–10 YearsLocation: Chennai, Bengaluru, Pune, Hyderabad, Mumbai, Delhi NCR(candidates will be required to work at any of these locations in hybrid mode)Key ResponsibilitiesCollaborate with business and technology stakeholders to understand current and future data requirements.Design, build, and maintain reliable,...

  • Databricks Data Engineer

    2 weeks ago

    Kollam, India Insight Global Full time

    Insight Global is seeking a Databricks Data Engineer in India with with 3–5 years of experience to support data engineering initiatives in the pharmaceutical domain. The ideal candidate will have hands-on expertise in Databricks, SQL, and Python, and a strong understanding of pharma/life sciences data. This role involves building and optimizing data...

  • Data Engineer

    7 days ago

    Kollam, India Taiyō.AI Full time

    About UsTaiyo.AI is the world's first infrastructure intelligence platform. We are building the largest universaland industry standard database of opportunities (tenders, projects, news) and threats (economy,climate, geopolitics, finance, logistics, etc.) for real assets. Taiyo.AI has been instrumental in shapinghow infrastructure companies (infra investors,...

  • Data product engineer

    7 days ago

    Kollam, India Excelloit Consultancy Services Full time

    Data Product Engineer – Full Stack (2 Openings)???? Location Preference: Nagpur | Pune | Indore | Jabalpur | Raipur | Mumbai???? Experience: 4–6 years (Engineer) | 6+ years (Senior Engineer)???? ???? Work Mode: RemoteSalary: Max 22 LPA to Max 28 LPA ???? Key Responsibilities???? Full Stack DevelopmentDesign and develop end-to-end web applications using...

  • Python API + Data Engineer

    3 days ago

    Kollam, India Digitrix Software LLP Full time

    Experience : 5 to 8 yearsJob description:Python API + Data EngineerWe are looking for aself-motivated Python Data Engineerwith strong skills inbackend/API development and large-scale data processing , who can work independently and thrive in a fast-paced, agile environment.Key ResponsibilitiesDesign, develop, and optimizedata pipelinesusingPySpark, AWS Glue,...

  • Data integration reliability and devops engineer

    2 weeks ago

    Kollam, India RapidBrains Full time

    Job Title: Data Integration Reliability & Dev Ops Engineer Experience: 7–10 Years Location: Remote Contract Duration: Long Term Work Time: Normal IST (with 2–3 hours overlap as per client need)We are seeking a highly skilled Data Integration Reliability & Dev Ops Engineer to join our team. This role focuses on maintaining the operational reliability and...

  • Software Engineer, Data and Information Systems

    2 days ago

    Kollam, Kerala, India Amrita University Full time ₹ 8,00,000 - ₹ 12,00,000 per year

    The Amrita AHEAD, Amrita Vishwa Vidyapeetham AHEAD – Online Campus is inviting applications from qualified candidates for the post of a Software Engineer, Data and Information Systems.For details contact : Job Title Software Engineer, Data and Information SystemsLocation Kollam, KeralaRequired Number 2Qualification CS DomainJob DescriptionThe role involves...

  • Big data developer

    2 weeks ago

    Kollam, India BayOne Solutions Full time

    Job Description:We are seeking a highly skilled Full Stack Big Data Engineer to join our team. The ideal candidate will have strong expertise in big data technologies, cloud platforms, microservices, and system design, with the ability to build scalable and efficient data-driven applications. This role requires hands-on experience across data engineering,...