Data Engineer

4 weeks ago

Kollam, India Alternative Path Full time

Alternative Path is seeking skilled software developers to collaborate on client projects with an asset management firm. In this role, you will collaborate with individuals across various company departments to shape and innovate new products and features for our platform, enhancing existing ones. You will have a large degree of independence and trust, but you won't be isolated; the support of the Engineering team leads, the Product team leads, and every other technology team member is behind you. This is an opportunity to join a team-first meritocracy and help grow an entrepreneurial group inside Alternative Path. You will be asked to contribute, given ownership, and will be expected to make your voice heard.Role Summary: Performing Web Scraping using various scraping techniques and then utilizing Python’s Pandas library for data cleaning and manipulation. Then ingesting the data into a Database/Warehouse, and scheduling the scrapers using Airflow or other tools Role Overview The Web Scraping Team at Alternative Path is seeking a creative and detail-oriented developer to contribute to client projects. The team develops essential applications, datasets, and alerts for various teams within the client's organization, supporting their daily investment decisions. The mission is to maintain operational excellence by delivering high-quality proprietary datasets, timely notifications, and exceptional service. We are seeking someone who is self-motivated, self-sufficient, with a passion for tinkering and a love for automation.In your role, you will: ➢ Collaborate with analysts to understand and anticipate requirements. ➢ Design, implement, and maintain Web scrapers for a wide variety of alternative datasets. ➢ Perform Data Cleaning, Exploration, Transformation etc. of scraped data. ➢ Collaborate with cross-functional teams to understand data requirements and implement efficient data processing workflows. ➢ Author QC checks to validate data availability and integrity. ➢ Maintain alerting systems and investigate time-sensitive data incidents to ensure smooth day-to-day operations. ➢ Design and implement products and tools to enhance the Web scraping Platform.Qualifications Must have ➢ Bachelor's/master’s degree in computer science or in any related field ➢ 3-5 years of software development experience ➢ Strong Python and SQL/Database skills ➢ Strong expertise in using the Pandas library (Python) is a must ➢ Experience with web technologies (HTML/JS, APIs, etc.) ➢ Proven work experience in working with large data sets for Data cleaning, Data transformation, Data manipulation, and Data replacements. ➢ Excellent verbal and written communication skills ➢ Aptitude for designing infrastructure, data products, and tools for Data ScientistsPreferred ➢ Familiarity with scraping and common scraping tools (Selenium, scrapy, Fiddler, Postman, xpath) ➢ Experience containerizing workloads with Docker (Kubernetes a plus) ➢ Experience with build automation (Jenkins, Gitlab CI/CD) ➢ Experience with AWS technologies like S3, RDS, SNS, SQS, Lambda, etc.

  • Senior data engineer

    2 days ago

    Kollam, India Pacific Data Integrators Full time

    Role: Senior Data Engineer Location: Remote Job Type: Full-time Shift time: Open to work in EST shift (5 PM to 2 AM IST) Key Responsibilities Lead the design, development, and implementation of complex data integration solutions using Informatica Intelligent Data Management Cloud (IDMC). Develop, document, unit test, and maintain high-quality ETL...

  • Data Engineer

    1 week ago

    Kollam, India Aceolution Full time

    Job Title: Data Engineer – Python Expert(Freelance Role)Location: Remote / HybridEmployment Type: Contract/ FreelanceRole Summary We are looking for a seasoned Senior Data Engineer to architect, build, and own the data pipelines that power our large language model (LLM) development. As a senior Individual Contributor (IC), you will be the team's expert on...

  • Data Engineer

    2 weeks ago

    Kollam, India Digitalzone Full time

    About the RoleAs a Data Engineer, you will design, build, and optimize data pipelines and real-time systems that power AI-driven decisioning and analytics.ResponsibilitiesDevelop and maintain scalable ETL/ELT pipelines using Python, Airflow, and dbt Build and optimize real-time streaming pipelines using Kafka, RabbitMQ, Spark and event-driven microservices...

  • Senior data engineer

    2 days ago

    Kollam, India Veraxion Full time

    We’re Hiring: Senior Data Engineer (Azure) We are looking for a Senior Data Engineer who can design, build, and scale modern data platforms that power analytics, decision-making, and AI across the organization. If you love solving complex data problems, architecting scalable pipelines, and working with cutting-edge Azure technologies — this role is for...

  • Senior Data Engineer

    1 week ago

    Kollam, India Tata Consultancy Services Full time

    Role**: Senior Data EngineerRequired Technical Skill Set: Senior Data EngineerDesired Experience Range: 7 - 12 yrsNotice Period: Immediate to 90Days onlyLocation of Requirement: BangaloreWe are currently planning to do a Virtual InterviewJob Description:Primary Skills (Java, Python, etc.)Python, Scala/Java, Spark, SQL, Snowflake, BDD, Databricks, AWS Key...

  • Sr.azure data engineer

    2 days ago

    Kollam, India Persistent Systems Full time

    About Position: We are looking for Sr Azure Data engineer who have experience in Azure data bricks, Data factory, to join our development team. Role: Sr. Azure Data Engineer Location: Pune/Bangalore Experience: 5 to 8 years Job Type: Full Time Employment What You'll Do: Design and implement complex, scalable data pipelines for ingestion, processing, and...

  • Data engineer

    1 week ago

    Kollam, India Quantiphi Full time

    Role: Associate Architect - Data Experience Level: 6.5 to 12 Years Work location: Mumbai, Bangalore, Trivandrum Role & Responsibilities: 6+ years of experience in building and managing Data Lakes, Data Warehouse, Data Integration, Data Migration and Business Intelligence/Artificial Intelligence solutions on GCP Cloud. Ability to understand business...

  • Data Engineer

    2 weeks ago

    Kollam, India Add Min Web World Full time

    Job Title: Data Engineer (Qlik Experience)Location: Mohali (On-site)Experience: Minimum 2 YearWorking Days: 5 Days a WeekJob Description:We are looking for a dedicated Data Engineer who has hands-on experience working with Qlik and other data tools. The ideal candidate should have a strong understanding of data processing, integration, and reporting, along...

  • Data Engineer

    4 weeks ago

    Kollam, India Taiyō.AI Full time

    About UsTaiyo.AI is the world's first infrastructure intelligence platform. We are building the largest universaland industry standard database of opportunities (tenders, projects, news) and threats (economy,climate, geopolitics, finance, logistics, etc.) for real assets. Taiyo.AI has been instrumental in shapinghow infrastructure companies (infra investors,...

  • Highly Experienced Data Engineer Wanted

    3 days ago

    kollam, India beBeeDataEngineer Full time

    Job Overview:A data engineer is required to design, implement and maintain large scale data warehouse systems using Amazon Redshift. The successful candidate will work closely with cross-functional teams to gather requirements, identify opportunities for growth and implement data solutions that drive business value.Key ResponsibilitiesDesign and...