Data engineer

4 days ago

Rajkot, India Alternative Path Full time

Alternative Path is seeking skilled software developers to collaborate on client projects with an asset management firm. In this role, you will collaborate with individuals across various company departments to shape and innovate new products and features for our platform, enhancing existing ones. You will have a large degree of independence and trust, but you won't be isolated; the support of the Engineering team leads, the Product team leads, and every other technology team member is behind you. This is an opportunity to join a team-first meritocracy and help grow an entrepreneurial group inside Alternative Path. You will be asked to contribute, given ownership, and will be expected to make your voice heard.Role Summary:Performing Web Scraping using various scraping techniques and then utilizing Python’s Pandas library for data cleaning and manipulation. Then ingesting the data into a Database/Warehouse, and scheduling the scrapers using Airflow or other toolsRole OverviewThe Web Scraping Team at Alternative Path is seeking a creative and detail-oriented developer to contribute to client projects. The team develops essential applications, datasets, and alerts for various teams within the client's organization, supporting their daily investment decisions. The mission is to maintain operational excellence by delivering high-quality proprietary datasets, timely notifications, and exceptional service. We are seeking someone who is self-motivated, self-sufficient, with a passion for tinkering and a love for automation.In your role, you will:➢ Collaborate with analysts to understand and anticipate requirements.➢ Design, implement, and maintain Web scrapers for a wide variety of alternative datasets.➢ Perform Data Cleaning, Exploration, Transformation etc. of scraped data.➢ Collaborate with cross-functional teams to understand data requirements and implement efficient data processing workflows.➢ Author QC checks to validate data availability and integrity.➢ Maintain alerting systems and investigate time-sensitive data incidents to ensure smooth day-to-day operations.➢ Design and implement products and tools to enhance the Web scraping Platform.QualificationsMust have➢ Bachelor's/master’s degree in computer science or in any related field➢ 2-4 years of software development experience➢ Strong Python and SQL/Database skills➢ Strong expertise in using the Pandas library (Python) is a must➢ Experience with web technologies (HTML/JS, APIs, etc.)➢ Proven work experience in working with large data sets for Data cleaning, Data transformation, Data manipulation, and Data replacements.➢ Excellent verbal and written communication skills➢ Aptitude for designing infrastructure, data products, and tools for Data ScientistsPreferred➢ Familiarity with scraping and common scraping tools (Selenium, scrapy, Fiddler, Postman, xpath) ➢ Experience containerizing workloads with Docker (Kubernetes a plus)➢ Experience with build automation (Jenkins, Gitlab CI/CD) ➢ Experience with AWS technologies like S3, RDS, SNS, SQS, Lambda, etc.

  • Senior Software Engineer

    4 weeks ago

    Rajkot, India Crest Data Full time

    Company Overview:Crest Data is a leading provider of data center solutions and engineering/marketing services in the areas of Networking/SDN, Storage, Security, Virtualization, Cloud Computing, and Big Data / Data Analytics. The team has extensive experience in building and deploying various Data Center products from Cisco, VMware, NetApp, Amazon AWS, EMC,...

  • Data Engineer

    2 weeks ago

    Rajkot, India DraconX Full time

    Company Description DraconX specializes in creating intelligent, scalable digital solutions that drive growth and innovation for startups and enterprises. As pioneers in AI business automation and SaaS platforms, we excel in building MVPs, custom software, and automation systems that simplify operations and enhance decision-making. Leveraging expertise in...

  • Data Engineer

    2 weeks ago

    Rajkot, India Veca Consulting Pvt Ltd Full time

    Role Name: Data EngineerExperience : 3+ YearsLocation : Bangalore(No relocation)Notice Period : 20-30 days(who are currently serving)Mode : HybridType : FulltimeJob Description: As a Data Engineer on our team, you will work on our Hadoop-based data warehouse, contributing to scalable and reliable big data solutions for analytics and business insights. This...

  • Data Engineer

    5 days ago

    Rajkot, India People Prime Worldwide Full time

    Job Title: Data EngineerLocation: Hyderabad / Chennai (Hybrid)Experience: 6 –10 Years (STRICTLY)Employment Type: PermanentNotice Period: Immediate Joiners Only (≤15 days)Skills Required: Python, PySpark, AWS / SnowflakeAbout the CompanyOur client is a global leader in IT and business services, operating in 50+ countries . They specialize in ...

  • Data Engineer

    4 days ago

    Rajkot, India People Prime Worldwide Full time

    Job Title: Data EngineerLocation: Hyderabad / Chennai (Hybrid)Experience: 6 –10 Years (STRICTLY)Employment Type: PermanentNotice Period: Immediate Joiners Only (≤15 days)Skills Required: Python, PySpark, AWS / SnowflakeAbout the CompanyOur client is a global leader in IT and business services, operating in 50+ countries . They specialize in ...

  • Cloud Data Engineer

    3 days ago

    rajkot, India beBeeDataEngineering Full time

    Job Title: Cloud Data EngineerWe are seeking a highly skilled and experienced Cloud Data Engineer to join our team. The ideal candidate will have extensive knowledge of cloud-based data engineering principles, architecture, and design patterns.This role will require the successful applicant to be responsible for designing, developing, implementing, and...

  • Principal Data Engineer

    3 weeks ago

    Rajkot, India CodeMyMobile Full time

    Experience Required - 7 to 10 YearsHow to Apply: Are you a Data Engineer who cares about clean engineering, autonomy, and solving real data challenges? If this sounds like you, we’d love to connect! Email your application to careers@codemymobile.com with:Your GitHub links or other professional works.Your resume (PDF or online profile).A Data Engineering...

  • Data quality engineer

    9 hours ago

    Rajkot, India CodeVyasa Full time

    Jole Overview We are seeking a highly skilled and motivated Data Quality Engineer || Remote with 8+ years of experience. If you're passionate about coding, problem-solving, and innovation, we'd love to hear from you! About Us Code Vyasa is a mid-sized product engineering company that works with top-tier product/solutions companies such as Mc Kinsey, Walmart,...

  • Principal data engineer

    3 weeks ago

    Rajkot, India CodeMyMobile Full time

    Experience Required - 7 to 10 Years How to Apply:  Are you a Data Engineer who cares about clean engineering, autonomy, and solving real data challenges? If this sounds like you, we’d love to connect! Email your application to with: Your Git Hub links or other professional works. Your resume (PDF or online profile). A Data Engineering project you are...

  • Data Engineer

    4 weeks ago

    Rajkot, India Azilen Technologies Full time

    Job purpose:Manage and create design schema, SQL query tuning, and code review.Who you are:- Min 3+ years of professional experience in the field of data engineering with knowledge of the data platform and DWH development - Min. 2 years of hands-on experience in SSAS tabular models - Designed Data Ingestion and Orchestration Pipelines with Kafka and Python -...