Data Engineer

2 weeks ago

bangalore, India Alternative Path Full time

Alternative Path is seeking skilled software developers to collaborate on client projects with an asset management firm. In this role, you will collaborate with individuals across various company departments to shape and innovate new products and features for our platform, enhancing existing ones. You will have a large degree of independence and trust, but you won't be isolated; the support of the Engineering team leads, the Product team leads, and every other technology team member is behind you. This is an opportunity to join a team-first meritocracy and help grow an entrepreneurial group inside Alternative Path. You will be asked to contribute, given ownership, and will be expected to make your voice heard.Role Summary:Performing Web Scraping using various scraping techniques and then utilizing Python’s Pandas library for data cleaning and manipulation. Then ingesting the data into a Database/Warehouse, and scheduling the scrapers using Airflow or other toolsRole OverviewThe Web Scraping Team at Alternative Path is seeking a creative and detail-oriented developer to contribute to client projects. The team develops essential applications, datasets, and alerts for various teams within the client's organization, supporting their daily investment decisions. The mission is to maintain operational excellence by delivering high-quality proprietary datasets, timely notifications, and exceptional service. We are seeking someone who is self-motivated, self-sufficient, with a passion for tinkering and a love for automation.In your role, you will:➢ Collaborate with analysts to understand and anticipate requirements.➢ Design, implement, and maintain Web scrapers for a wide variety of alternative datasets.➢ Perform Data Cleaning, Exploration, Transformation etc. of scraped data.➢ Collaborate with cross-functional teams to understand data requirements and implement efficient data processing workflows.➢ Author QC checks to validate data availability and integrity.➢ Maintain alerting systems and investigate time-sensitive data incidents to ensure smooth day-to-day operations.➢ Design and implement products and tools to enhance the Web scraping Platform.QualificationsMust have➢ Bachelor's/master’s degree in computer science or in any related field➢ 2-4 years of software development experience➢ Strong Python and SQL/Database skills➢ Strong expertise in using the Pandas library (Python) is a must➢ Experience with web technologies (HTML/JS, APIs, etc.)➢ Proven work experience in working with large data sets for Data cleaning, Data transformation, Data manipulation, and Data replacements.➢ Excellent verbal and written communication skills➢ Aptitude for designing infrastructure, data products, and tools for Data ScientistsPreferred➢ Familiarity with scraping and common scraping tools (Selenium, scrapy, Fiddler, Postman, xpath) ➢ Experience containerizing workloads with Docker (Kubernetes a plus)➢ Experience with build automation (Jenkins, Gitlab CI/CD) ➢ Experience with AWS technologies like S3, RDS, SNS, SQS, Lambda, etc.

  • Lead Data Engineer

    1 week ago

    bangalore, India Eucloid Data Solutions Full time

    Eucloid is looking for a Lead Data Engineer to join our Data Platform team supporting various business applications. The ideal candidate will support development of data infrastructure on Databricks for our clients by participating in activities which may include starting from up- stream and down-stream technology selection to designing and building of...

  • Lead Data Engineer

    1 week ago

    bangalore, India Eucloid Data Solutions Full time

    Eucloid is looking for a Lead Data Engineer to join our Data Platform team supporting various business applications. The ideal candidate will support development of data infrastructure on Databricks for our clients by participating in activities which may include starting from up- stream and down-stream technology selection to designing and building of...

  • Sr. Data Science

    3 weeks ago

    Bangalore, India NTT DATA Full time

    Job Description Req ID: NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Sr. Data Science & AIML, GenAI Lead/Engineer to join our team in Bangalore, Karnātaka (IN-KA), India...

  • Lead Data Architect

    3 weeks ago

    Bangalore, Karnataka, India NTT DATA Full time

    NTT DATA strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a Lead Data Architect to join our team in Bangalore Karnxc4x81taka IN-KA India IN Position Overview We are seeking a highly...

  • Technical specialist

    1 week ago

    Bangalore, India NTT DATA, Inc. Full time

    Senior L3+ Network Security Engineer (Fortinet SASE) Job Type: Full-time Experience: 6+ years in network security implementation We are seeking a Senior L3+ Network Security Engineer with 6+ years of hands-on implementation experience in Fortinet SASE/Cybersecurity. The ideal candidate will be responsible for designing, deploying, optimizing, and...

  • Data engineer

    4 weeks ago

    Bangalore, India Insight Global Full time

    JOB DESCRIPTION Insight Global is seeking a junior Data Engineer to join a large retail client remotely based in India. The Junior Data Engineer will support the identification and implementation of complex data, monitor and troubleshoot data engineering incidents and more. The Junior-level Data Engineer is expected to have 3+ years of experience. As a Data...

  • Data Engineer

    1 week ago

    Bangalore, India Nova Nurture HR Solutions Full time

    About the Job Skills data lakehouse python etl pipelines Data Engineering apache hop Databases NoSQL SQL Location: Bangalore (5 days work from office, HSR Layout) Job Type: Full Time Industry: Agritech Openings: Multiple- junior, mid level etc Python- Mandatory   Overview The Data Engineer/ Senior Data Engineer will design, develop, and maintain scalable...

  • Data Engineer

    7 days ago

    bangalore, India Tytan Technology Inc. Full time

    Please apply directly or send your resume to request@tytantech.com with the subject line: “Application – Data Engineer”We are seeking an experienced Data Engineer with a strong background in building scalable data pipelines, architecting modern data platforms, and driving high-performance data transformations. The ideal candidate will have deep...

  • Data Engineer

    1 week ago

    bangalore, India Response Informatics Full time

    🚀 We’re Hiring | Data Engineering Experts (Hyderabad / Remote)We’re looking for passionate and experienced Data Engineering professionals to join our growing team.If you love building scalable data pipelines, optimizing cloud-based workflows, and leading innovation in data infrastructure — we’d love to meet you!🔹 Open Positions:Data Engineer...

  • Data Engineer

    1 week ago

    bangalore, India AMISEQ Full time

    Data Engineer Bangalore, KA WFO A minimum of 3 years of experience is required. Key ResponsibilitiesDevelop and maintain ETL/ELT pipelines using modern data engineering tools and frameworks7 * 24 On-call support data pipeline health, performance, and SLA complianceDocument data processes, schemas, and best practices SOPImplement data quality checks,...