Data Engineer

3 weeks ago

Bellary, Karnataka, India Alternative Path Full time

Alternative Path is seeking skilled software developers to collaborate on client projects with an asset management firm. In this role, you will collaborate with individuals across various company departments to shape and innovate new products and features for our platform, enhancing existing ones. You will have a large degree of independence and trust, but you won't be isolated; the support of the Engineering team leads, the Product team leads, and every other technology team member is behind you. This is an opportunity to join a team-first meritocracy and help grow an entrepreneurial group inside Alternative Path. You will be asked to contribute, given ownership, and will be expected to make your voice heard.

Role Summary:

Performing Web Scraping using various scraping techniques and then utilizing Python's Pandas library for data cleaning and manipulation. Then ingesting the data into a Database/Warehouse, and scheduling the scrapers using Airflow or other tools

Role Overview

The Web Scraping Team at Alternative Path is seeking a creative and detail-oriented developer to contribute to client projects. The team develops essential applications, datasets, and alerts for various teams within the client's organization, supporting their daily investment decisions. The mission is to maintain operational excellence by delivering high-quality proprietary datasets, timely notifications, and exceptional service. We are seeking someone who is self-motivated, self-sufficient, with a passion for tinkering and a love for automation.

In your role, you will:

➢ Collaborate with analysts to understand and anticipate requirements.

➢ Design, implement, and maintain Web scrapers for a wide variety of alternative datasets.

➢ Perform Data Cleaning, Exploration, Transformation etc. of scraped data.

➢ Collaborate with cross-functional teams to understand data requirements and implement efficient data processing workflows.

➢ Author QC checks to validate data availability and integrity.

➢ Maintain alerting systems and investigate time-sensitive data incidents to ensure smooth day-to-day operations.

➢ Design and implement products and tools to enhance the Web scraping Platform.

Qualifications

Must have

➢ Bachelor's/master's degree in computer science or in any related field

➢ 2-4 years of software development experience

➢ Strong Python and SQL/Database skills

➢ Strong expertise in using the Pandas library (Python) is a must

➢ Experience with web technologies (HTML/JS, APIs, etc.)

➢ Proven work experience in working with large data sets for Data cleaning, Data transformation, Data manipulation, and Data replacements.

➢ Excellent verbal and written communication skills

➢ Aptitude for designing infrastructure, data products, and tools for Data Scientists

Preferred

➢ Familiarity with scraping and common scraping tools (Selenium, scrapy, Fiddler, Postman, xpath) ➢ Experience containerizing workloads with Docker (Kubernetes a plus)

➢ Experience with build automation (Jenkins, Gitlab CI/CD) ➢ Experience with AWS technologies like S3, RDS, SNS, SQS, Lambda, etc.

  • Data Engineer

    2 weeks ago

    Bellary, Karnataka, India beBeeDataEngineer Full time ₹ 18,61,421 - ₹ 28,11,230

    Job DescriptionWe are seeking an experienced Data Engineer to join our team. The successful candidate will be responsible for designing and implementing data processing components, collaborating with architects and data modelers, and leading sessions with data engineers.Design and implement data processing components using advanced SQL queries and...

  • Data Engineer

    3 weeks ago

    Bellary, Karnataka, India Moutups Full time

    Job Title: Data Engineer (Remote)Job Type: Full-TimeAbout the Role: We are looking for a highly motivated and detail-oriented Data Engineer to join our remote team. In this role, you will be responsible for designing, building, and maintaining scalable data pipelines and infrastructure that support real-time and batch data processing. You will collaborate...

  • Data Engineer

    2 weeks ago

    Bellary, Karnataka, India Forage AI Full time

    Experience Level: Software Engineer- 3-5 years of relevant experience in data engineering. About Forage AI: Forage AI is a pioneering AI-powered data extraction and automation company that transforms complex, unstructured web and document data into clean, structured intelligence. Our platform combines web crawling, NLP, LLMs, and agentic AI to deliver highly...

  • Chief Data Engineer

    1 week ago

    Bellary, Karnataka, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 20,00,000

    Job OverviewWe are seeking an experienced data engineer to join our analytics division.The ideal candidate will have a strong background in designing and developing robust data pipelines and ETL processes using data platforms for a centralized data warehouse.Key ResponsibilitiesConceptualize and own the build out of problem-solving data marts for consumption...

  • Data Engineering Specialist

    2 weeks ago

    Bellary, Karnataka, India beBeeDataEngineering Full time ₹ 20,00,000 - ₹ 25,00,000

    Greetings from our companyJob Title: Data Engineering SpecialistRequired Expertise:Azure Databricks and scalable data processingScala, PySpark programming skillsAzure Cloud platform knowledgeFull Software Development Life Cycle experienceAzure DevOps and TerraformDB/SQL and database managementScala or Python development expertiseKey Responsibilities:We are...

  • Data Engineering Professional

    2 weeks ago

    Bellary, Karnataka, India beBeeLeadership Full time ₹ 2,50,00,000 - ₹ 3,50,00,000

    Job Title: Data Engineering Lead We are seeking an experienced data engineering professional to lead our team. The ideal candidate will have extensive experience in managing large-scale data engineering projects, leading cross-functional teams of data engineers, analysts, and scientists to design, develop, and deploy data pipelines and architectures. Key...

  • Cloud Data Engineer

    2 weeks ago

    Bellary, Karnataka, India beBeeDataEngineering Full time ₹ 20,00,000 - ₹ 25,00,000

    Cloud Data Engineering ProfessionalWe are seeking an experienced Cloud Data Engineer to join our team. As a key member of the data engineering team, you will be responsible for designing, building, and maintaining robust data pipelines for processing channel activity data.The ideal candidate will have strong hands-on experience with AWS technologies such as...

  • Data Engineer Position

    2 weeks ago

    Bellary, Karnataka, India beBeeDataEngineer Full time ₹ 1,80,00,000 - ₹ 2,00,00,000

    Job Opportunity - Data EngineerExperience Required:We are seeking an experienced Data Engineer with a strong background in data warehousing and pipeline development.Key Responsibilities:- Design, implement, and optimize data warehouses on the Snowflake platform.- Develop, implement, and optimize end-to-end data pipelines on Snowflake.- Leverage PySpark for...

  • Cloud Data Engineer

    2 weeks ago

    Bellary, Karnataka, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job DescriptionWe are seeking a highly skilled and experienced Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, building, and optimizing scalable data pipelines and architectures on Google Cloud Platform (GCP).The ideal candidate will have hands-on experience with Google Cloud Storage (GCS),...

  • Data Scientist and Engineer

    2 weeks ago

    Bellary, Karnataka, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Data EngineerWe are seeking a highly skilled data engineer to fill this key position.About the RoleThis role involves designing and implementing data models, ETL/ELT processes, and data warehousing concepts.Ingest, transform, and load data into Snowflake using GCP services such as Cloud Dataflow and Cloud Composer.Develop high-quality code in...