Data Engineer

2 days ago

India Alternative Path Full time
Alternative Path is seeking skilled software developers to collaborate on client projects with an asset management firm. In this role, you will collaborate with individuals across various company departments to shape and innovate new products and features for our platform, enhancing existing ones. You will have a large degree of independence and trust, but you won't be isolated; the support of the Engineering team leads, the Product team leads, and every other technology team member is behind you. This is an opportunity to join a team-first meritocracy and help grow an entrepreneurial group inside Alternative Path. You will be asked to contribute, given ownership, and will be expected to make your voice heard.

Role Summary:

Performing Web Scraping using various scraping techniques and then utilizing Python's Pandas library for data cleaning and manipulation. Then ingesting the data into a Database/Warehouse, and scheduling the scrapers using Airflow or other tools

Role Overview

The Web Scraping Team at Alternative Path is seeking a creative and detail-oriented developer to contribute to client projects. The team develops essential applications, datasets, and alerts for various teams within the client's organization, supporting their daily investment decisions. The mission is to maintain operational excellence by delivering high-quality proprietary datasets, timely notifications, and exceptional service. We are seeking someone who is self-motivated, self-sufficient, with a passion for tinkering and a love for automation.

In your role, you will:

➢ Collaborate with analysts to understand and anticipate requirements.

➢ Design, implement, and maintain Web scrapers for a wide variety of alternative datasets.

➢ Perform Data Cleaning, Exploration, Transformation etc. of scraped data.

➢ Collaborate with cross-functional teams to understand data requirements and implement efficient data processing workflows.

➢ Author QC checks to validate data availability and integrity.

➢ Maintain alerting systems and investigate time-sensitive data incidents to ensure smooth day-to-day operations.

➢ Design and implement products and tools to enhance the Web scraping Platform.

Qualifications

Must have

➢ Bachelor's/master's degree in computer science or in any related field

➢ 2-4 years of software development experience

➢ Strong Python and SQL/Database skills

➢ Strong expertise in using the Pandas library (Python) is a must

➢ Experience with web technologies (HTML/JS, APIs, etc.)

➢ Proven work experience in working with large data sets for Data cleaning, Data transformation, Data manipulation, and Data replacements.

➢ Excellent verbal and written communication skills

➢ Aptitude for designing infrastructure, data products, and tools for Data Scientists

Preferred

➢ Familiarity with scraping and common scraping tools (Selenium, scrapy, Fiddler, Postman, xpath) ➢ Experience containerizing workloads with Docker (Kubernetes a plus)

➢ Experience with build automation (Jenkins, Gitlab CI/CD) ➢ Experience with AWS technologies like S3, RDS, SNS, SQS, Lambda, etc.

  • Senior Data Engineer

    3 weeks ago

    India Aptus Data Labs Full time

    Job Title: Senior Data EngineerLocation: RemoteExperience: 4+Employment Type: Full-TimeNotice- Looking for immediate joiners or who can join within 15-20 days.About the RoleAptus Data Labs is looking for a talented and proactive Senior Data Engineer to help build the backbone of our enterprise data and AI initiatives. You'll work on modern data lake...

  • Data Analyst

    3 days ago

    India Quant-data Full time

    We're Hiring: Data Analyst (Credit Analytics | Remote | Full-Time) Leverage financial and credit data to power AI-driven lending solutions We are seeking a skilled Data Analyst (Credit Analytics) with 4+ years of experience to join our AI-driven lending platform team . In this role, you will analyze financial, customer, and transaction datasets ,...

  • AI Security Engineer

    24 hours ago

    India NTT Data Full time

    Job DescriptionNTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a AI Security Engineer - Shared Security Services Engineering to join our team in Banaglore, Karntaka (IN-KA), India...

  • Data Engineer

    4 weeks ago

    India NP Group Full time

    Data Engineer - Python, Pyspark & Typescript Fully Remote Long Term Contract Rate: $20 - $25 per hour ($3,000 - $4,000 per month)We have an immediate requirement for an experienced Data Engineer to join the global engineering team for a International Enterprise Organisation.You will bring Data Engineering expertise onto greenfield multi year project...

  • Data Engineer

    1 day ago

    India NP Group Full time

    Data Engineer - Palantir Foundry, Workshop, Pyspark & Typescript Fully Remote 6 month full time contract Rate: $15.00 per hour We have an immediate requirement for an experienced Data Engineer to join the global engineering team for a International Enterprise Organisation.You will bring Data Engineering expertise onto greenfield multi year project...

  • Data Engineer

    4 weeks ago

    India NP Group Full time

    Data Engineer - Python, Pyspark & Palantir FoundryFully Remote 6 month full time contractRate: $13.00 - $15.00 per hourWe have an immediate requirement for an experienced Data Engineer to join the global engineering team for a International Enterprise Organisation.You will bring Data Engineering expertise onto greenfield multi year project initiative.You...

  • Data Engineer

    4 weeks ago

    India NP Group Full time

    Data Engineer - Python, Pyspark & TypescriptFully Remote Long Term Contract Rate: $14 - $17 per hour We have an immediate requirement for an experienced Data Engineer to join the global engineering team for a International Enterprise Organisation.You will bring Data Engineering expertise onto greenfield multi year project initiative.You should offer at least...

  • Data Engineer

    2 hours ago

    India Insight Global Full time

    100% Remote Data EngineerRequired Skills & Experience5+ years of experience as a Data EngineerExpertise in Python, Pyspark and SQLHands-on Python/PySpark coding experienceStrong Big Data experience, GCP preferredTelemetry experienceStreaming experience with analytics and data processingBusiness analytics experience and working directly with business partners...

  • Data Engineer

    4 days ago

    India Insight Global Full time

    100% Remote Data EngineerRequired Skills & Experience5+ years of experience as a Data EngineerExpertise in Python, Pyspark and SQLHands-on Python/PySpark coding experienceStrong Big Data experience, GCP preferredTelemetry experienceStreaming experience with analytics and data processingBusiness analytics experience and working directly with business partners...

  • Data Engineer

    5 days ago

    India R Systems Full time

    Job Title: Data EngineerContract Period: 12 MonthsLocation: Offshore candidates accepted (Singapore Based Company)Work Timing : 6.30 AM to 3.30 PM or 7.00 AM to 4.00 PM (IST - India timing)Experience- Minimum 4+ years as a Data Engineer or similar role.(Please don't apply if less than 4 years exp in Data Engineer)- Proven experience in Python, Spark, and...