Data Engineer

4 days ago

bangalore, India Alternative Path Full time

Alternative Path is seeking skilled software developers to collaborate on client projects with an asset management firm. In this role, you will collaborate with individuals across various company departments to shape and innovate new products and features for our platform, enhancing existing ones. You will have a large degree of independence and trust, but you won't be isolated; the support of the Engineering team leads, the Product team leads, and every other technology team member is behind you. This is an opportunity to join a team-first meritocracy and help grow an entrepreneurial group inside Alternative Path. You will be asked to contribute, given ownership, and will be expected to make your voice heard.


Role Summary:

Performing Web Scraping using various scraping techniques and then utilizing Python’s Pandas library for data cleaning and manipulation. Then ingesting the data into a Database/Warehouse, and scheduling the scrapers using Airflow or other tools

Role Overview

The Web Scraping Team at Alternative Path is seeking a creative and detail-oriented developer to contribute to client projects. The team develops essential applications, datasets, and alerts for various teams within the client's organization, supporting their daily investment decisions. The mission is to maintain operational excellence by delivering high-quality proprietary datasets, timely notifications, and exceptional service. We are seeking someone who is self-motivated, self-sufficient, with a passion for tinkering and a love for automation.


In your role, you will:

➢ Collaborate with analysts to understand and anticipate requirements.

➢ Design, implement, and maintain Web scrapers for a wide variety of alternative datasets.

➢ Perform Data Cleaning, Exploration, Transformation etc. of scraped data.

➢ Collaborate with cross-functional teams to understand data requirements and implement efficient data processing workflows.

➢ Author QC checks to validate data availability and integrity.

➢ Maintain alerting systems and investigate time-sensitive data incidents to ensure smooth day-to-day operations.

➢ Design and implement products and tools to enhance the Web scraping Platform.


Qualifications

Must have

➢ Bachelor's/master’s degree in computer science or in any related field

➢ 2-4 years of software development experience

➢ Strong Python and SQL/Database skills

➢ Strong expertise in using the Pandas library (Python) is a must

➢ Experience with web technologies (HTML/JS, APIs, etc.)

➢ Proven work experience in working with large data sets for Data cleaning, Data transformation, Data manipulation, and Data replacements.

➢ Excellent verbal and written communication skills

➢ Aptitude for designing infrastructure, data products, and tools for Data Scientists


Preferred

➢ Familiarity with scraping and common scraping tools (Selenium, scrapy, Fiddler, Postman, xpath) ➢ Experience containerizing workloads with Docker (Kubernetes a plus)

➢ Experience with build automation (Jenkins, Gitlab CI/CD) ➢ Experience with AWS technologies like S3, RDS, SNS, SQS, Lambda, etc.

  • Data Engineer

    1 day ago

    Bangalore, Karnataka, India NTT DATA Full time

    Req ID 324638NTT DATA strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a Data Engineer to join our team in Bangalore Karnxc4x81taka IN-KA India IN Key Responsibilities Design and implement...

  • Data Senior Engineer

    1 day ago

    HAL Bangalore Airport, India NTT DATA North America Full time

    Req ID: NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Senior Engineer to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Job Duties: 8+ years of experience in a...

  • Data Engineer

    1 day ago

    HAL Bangalore Airport, India NTT DATA North America Full time

    Req ID: NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer (HRIS) to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Job Duties: Key Responsibilities Data...

  • Data Engineer

    1 day ago

    HAL Bangalore Airport, India NTT DATA North America Full time

    Req ID: NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer (HRIS,Tableau and BI) to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Job Duties: Key...

  • Digital Engineering Staff Engineer

    1 day ago

    Bangalore, Karnataka, India NTT DATA Full time

    Req ID 310926NTT DATA strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a Digital Engineering Staff Engineer to join our team in Bangalore Karnxc4x81taka IN-KA India IN Title Business...

  • Data Engineer

    4 days ago

    bangalore, India Bahwan CyberTek Full time

    Job Title: Data Engineer – Google Cloud Platform (GCP) Job Summary We are seeking a skilled and motivated Data Engineer with hands-on experience in building scalable data pipelines and cloud-native data solutions on Google Cloud Platform. The ideal candidate will be proficient in GCP services like Pub/Sub, Dataflow, Cloud Storage, and BigQuery, with a...

  • Data Engineer

    5 days ago

    Bangalore, India Synechron Full time

    Good-day, We have immediate opportunity for Data Engineer. Job Role: Data Engineer Job Location: Synechron ( Bengaluru) Experience- 7 to 12 years Notice : Only immediate joiner . About Company: At Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity...

  • Data Engineer

    4 days ago

    bangalore, India Synechron Full time

    Good-day,We have immediate opportunity for Data Engineer.Job Role: Data EngineerJob Location: Synechron ( Bengaluru)Experience- 7 to 12 yearsNotice : Only immediate joiner .About Company:At Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity and innovative technology to deliver...

  • Data Engineer

    5 days ago

    Bangalore, India Alp Consulting Ltd. Full time

    Role: Data Engineer Location : Bangalore Experience: 3 to 8Years SKILLS & CERTIFICATIONS Strong interest and acumen for solving large-scale data engineering problems. Hands-on technical and functional experience in building large scale data engineering capabilities in diverse big-data environments Strong hands-on expertise in data...

  • Data Engineer

    4 days ago

    bangalore, India Alp Consulting Ltd. Full time

    Role: Data EngineerLocation : BangaloreExperience: 3 to 8YearsSKILLS & CERTIFICATIONSStrong interest and acumen for solving large-scale data engineering problems.Hands-on technical and functional experience in building large scale data engineering capabilities in diverse big-data environmentsStrong hands-on expertise in data engineering:Enterprise grade ETL...