Data Engineer

6 days ago

Ahmedabad, Gujarat, India Alternative Path Full time

Alternative Path is seeking skilled software developers to collaborate on client projects with an asset management firm. In this role, you will collaborate with individuals across various company departments to shape and innovate new products and features for our platform, enhancing existing ones. You will have a large degree of independence and trust, but you won't be isolated; the support of the Engineering team leads, the Product team leads, and every other technology team member is behind you. This is an opportunity to join a team-first meritocracy and help grow an entrepreneurial group inside Alternative Path. You will be asked to contribute, given ownership, and will be expected to make your voice heard.

Role Summary:

Performing Web Scraping using various scraping techniques and then utilizing Python's Pandas library for data cleaning and manipulation. Then ingesting the data into a Database/Warehouse, and scheduling the scrapers using Airflow or other tools

Role Overview

The Web Scraping Team at Alternative Path is seeking a creative and detail-oriented developer to contribute to client projects. The team develops essential applications, datasets, and alerts for various teams within the client's organization, supporting their daily investment decisions. The mission is to maintain operational excellence by delivering high-quality proprietary datasets, timely notifications, and exceptional service. We are seeking someone who is self-motivated, self-sufficient, with a passion for tinkering and a love for automation.

In your role, you will:

➢ Collaborate with analysts to understand and anticipate requirements.

➢ Design, implement, and maintain Web scrapers for a wide variety of alternative datasets.

➢ Perform Data Cleaning, Exploration, Transformation etc. of scraped data.

➢ Collaborate with cross-functional teams to understand data requirements and implement efficient data processing workflows.

➢ Author QC checks to validate data availability and integrity.

➢ Maintain alerting systems and investigate time-sensitive data incidents to ensure smooth day-to-day operations.

➢ Design and implement products and tools to enhance the Web scraping Platform.

Qualifications

Must have

➢ Bachelor's/master's degree in computer science or in any related field

➢ 2-4 years of software development experience

➢ Strong Python and SQL/Database skills

➢ Strong expertise in using the Pandas library (Python) is a must

➢ Experience with web technologies (HTML/JS, APIs, etc.)

➢ Proven work experience in working with large data sets for Data cleaning, Data transformation, Data manipulation, and Data replacements.

➢ Excellent verbal and written communication skills

➢ Aptitude for designing infrastructure, data products, and tools for Data Scientists

Preferred

➢ Familiarity with scraping and common scraping tools (Selenium, scrapy, Fiddler, Postman, xpath) ➢ Experience containerizing workloads with Docker (Kubernetes a plus)

➢ Experience with build automation (Jenkins, Gitlab CI/CD) ➢ Experience with AWS technologies like S3, RDS, SNS, SQS, Lambda, etc.

  • Data engineer

    3 days ago

    Ahmedabad, Gujarat, India NP Group Full time

    Data Engineer - Python, Pyspark & Palantir FoundryFully Remote 6 month full time contractRate: $13.00 - $15.00 per hourWe have an immediate requirement for an experienced Data Engineer to join the global engineering team for a International Enterprise Organisation.You will bring Data Engineering expertise onto greenfield multi year project initiative.You...

  • Data Engineer

    4 weeks ago

    Ahmedabad, Gujarat, India Innovatics Full time

    Job Profile: Sr. Data Engineer/ Lead Data Engineer Experience: 5+ YearsWho we are: Innovatics is a place where innovation blends with analytics.We, Innovatics, take pride in knowing the notion of bleeding-edge technologies, strategic business moves, and radiant business transformation. We deliver never thought

  • Data Engineer

    4 weeks ago

    Ahmedabad, Gujarat, India DXFactor Full time

    DXFactor is a US-based tech company working with customers across the globe.We are a Great place to work with certified company.We are looking for candidates for Data Engineer (4 to 6 Yrs exp)We have our presence in:USIndia (Ahmedabad, Bangalore)Location: AhmedabadWebsite: www.DXFactor.comDesignation: Data Engineer (Expertise in SnowFlake, AWS & Python)Key...

  • Data Engineer

    4 weeks ago

    Ahmedabad, Gujarat, India Indsafri Full time

    Hiring Now: Senior Data Engineers (Banking Domain – 2 Positions)Location: RemoteExperience: 7+ Years | Banking sector experience preferred Type: Contract About the OpportunityWe're looking for highly skilled Senior Data Engineers to join a mission-critical banking project. This is your chance to work on cutting-edge data pipelines, streaming platforms,...

  • Data Engineering Professional

    13 hours ago

    Ahmedabad, Gujarat, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    About Data Engineers:We are seeking a skilled professional to join our team in the field of data engineering.The successful candidate will have expertise in analyzing and organizing raw data, conducting complex data analysis, and preparing data for prescriptive and predictive modeling.Key Skills: Data Engineer, Python, SQL, SparkRole: Data EngineerRequired...

  • Data Engineer

    3 weeks ago

    Ahmedabad, Gujarat, India Distinction Dev Full time

    Office Location Office No 403-405 Time Square CG Road Ellisbridge Ahmedabad Gujarat-380006 Duration Type of Employment Full Time PermanentExperience Required 2 yrsWork Style HybridIn Office days 3 days a week Hybrid Relocation Candidate must be willing to relocate to Ahmedabad GJ with reasonable notice Ideal Candidate We are seeking a...

  • Data Engineer

    4 weeks ago

    Ahmedabad, Gujarat, India Gala Intelligence Full time

    We're looking for an entrepreneurial, passionate, and driven Data Driven to join Startup Gala Intelligence backed by Navneet Tech Venture.. As we're building our technology platform from scratch, you'll have the unique opportunity to shape our technology vision, architecture, and engineering culture right from the ground up. You'll directly contribute to...

  • Data Engineer

    2 weeks ago

    Ahmedabad, Gujarat, India Gala Intelligence Full time

    We're looking for an entrepreneurial, passionate, and driven Data Driven to join Startup Gala Intelligence backed by Navneet Tech Venture.. As we're building our technology platform from scratch, you'll have the unique opportunity to shape our technology vision, architecture, and engineering culture right from the ground up. You'll directly contribute to...

  • Data Engineering Opportunity

    3 days ago

    Ahmedabad, Gujarat, India beBeeData Full time US$ 62,400 - US$ 76,800

    Data Engineering OpportunityWe are seeking a seasoned Data Engineer to drive innovation on a global engineering project. With at least 5-8 years of experience in Data Engineering, leveraging skills in:Python: Develop and maintain large-scale data pipelines.Pyspark: Design and implement scalable data processing solutions.Palantir Foundry: Architect and deploy...

  • Data Engineer

    2 days ago

    Ahmedabad, Gujarat, India beBeeData Full time ₹ 30,00,000 - ₹ 40,00,000

    Technical Data LeadAs a Technical Data Lead, you will play a crucial role in leading multiple data engagements on Google Cloud Platform (GCP) for data lakes, data engineering, data migration, data warehouse, and business intelligence. The successful candidate will have more than 8 years of experience in technical, solutioning, and analytical roles with a...