Data Engineer

2 hours ago

india, IN Alternative Path Full time

Alternative Path is seeking skilled software developers to collaborate on client projects with an asset management firm. In this role, you will collaborate with individuals across various company departments to shape and innovate new products and features for our platform, enhancing existing ones. You will have a large degree of independence and trust, but you won't be isolated; the support of the Engineering team leads, the Product team leads, and every other technology team member is behind you. This is an opportunity to join a team-first meritocracy and help grow an entrepreneurial group inside Alternative Path. You will be asked to contribute, given ownership, and will be expected to make your voice heard.Role Summary:Performing Web Scraping using various scraping techniques and then utilizing Python’s Pandas library for data cleaning and manipulation. Then ingesting the data into a Database/Warehouse, and scheduling the scrapers using Airflow or other toolsRole OverviewThe Web Scraping Team at Alternative Path is seeking a creative and detail-oriented developer to contribute to client projects. The team develops essential applications, datasets, and alerts for various teams within the client's organization, supporting their daily investment decisions. The mission is to maintain operational excellence by delivering high-quality proprietary datasets, timely notifications, and exceptional service. We are seeking someone who is self-motivated, self-sufficient, with a passion for tinkering and a love for automation.In your role, you will:➢ Collaborate with analysts to understand and anticipate requirements.➢ Design, implement, and maintain Web scrapers for a wide variety of alternative datasets.➢ Perform Data Cleaning, Exploration, Transformation etc. of scraped data.➢ Collaborate with cross-functional teams to understand data requirements and implement efficient data processing workflows.➢ Author QC checks to validate data availability and integrity.➢ Maintain alerting systems and investigate time-sensitive data incidents to ensure smooth day-to-day operations.➢ Design and implement products and tools to enhance the Web scraping Platform.QualificationsMust have➢ Bachelor's/master’s degree in computer science or in any related field➢ 3-5 years of software development experience➢ Strong Python and SQL/Database skills➢ Strong expertise in using the Pandas library (Python) is a must➢ Experience with web technologies (HTML/JS, APIs, etc.)➢ Proven work experience in working with large data sets for Data cleaning, Data transformation, Data manipulation, and Data replacements.➢ Excellent verbal and written communication skills➢ Aptitude for designing infrastructure, data products, and tools for Data ScientistsPreferred➢ Familiarity with scraping and common scraping tools (Selenium, scrapy, Fiddler, Postman, xpath) ➢ Experience containerizing workloads with Docker (Kubernetes a plus)➢ Experience with build automation (Jenkins, Gitlab CI/CD) ➢ Experience with AWS technologies like S3, RDS, SNS, SQS, Lambda, etc.

  • Senior Data Engineer

    2 hours ago

    Gurugram, Haryana, India, IN Pacific Data Integrators Full time

    Role: Senior Data EngineerLocation: RemoteJob Type: Full-timeShift time: Open to work in EST shift (5PM to 2AM IST) Key ResponsibilitiesLead the design, development, and implementation of complex data integration solutions using Informatica Intelligent Data Management Cloud (IDMC).Develop, document, unit test, and maintain high-quality ETL applications that...

  • Data Engineer

    2 hours ago

    india, IN Grantify Full time

    Company Description Grantify is an innovative education platform that connects students and universities through a transparent admissions and tuition-matching ecosystem. By aligning student budgets and academic aspirations with tailored university offers, Grantify facilitates a data-driven pathway to higher education. Our platform aims to simplify the...

  • Data Engineer

    2 hours ago

    india, IN Staffingine LLC Full time

    Data EngineerIndia, RemoteFull Time /Contract# of Positions - 3Job SummaryThe Data Engineer will be responsible for designing, developing, and optimizing scalable data pipelines and cloud-based data solutions. This role requires strong Python programming skills, expertise in ETL/ELT processes, and deep hands-on experience with AWS cloud services such as S3,...

  • Data Engineer

    2 hours ago

    india, IN TerraGiG Full time

    Responsibilities Lead the design, development, and implementation of data solutions using AWS and Snowflake. Collaborate with cross-functional teams to understand business requirements and translate them into technical solutions. Develop and maintain data pipelines, ensuring data quality, integrity, and security. Optimize data storage and retrieval processes...

  • Data Engineer

    2 hours ago

    india, IN IntraEdge Full time

    We are seeking a highly skilled Data Engineer with strong experience in Python, PySpark, Snowflake, and AWS Glue to join our growing data team. You will be responsible for building scalable and reliable data pipelines that drive business insights and operational efficiency. This role requires a deep understanding of data modeling, ETL frameworks, and...

  • Data Engineer

    2 hours ago

    india, IN Vriba Solutions Full time

    Role: Data EngineeringRemoteLooking for 5-10 years of ExpSkill Set:AWS, Snowflake, Kafka, Airflow, GitHub, PySpark, PythonKey Responsibilities:Design, develop, and maintain scalable ETL/ELT pipelinesIngest data from various sources (APIs, databases, files, etc.)Implement both real-time and batch processing solutions based on use case requirementsEnsure data...

  • Data Engineer

    2 hours ago

    india, IN Randstad Enterprise Full time

    Role : Data EngineerLocation : RemoteShift Timing : 2:00 Pm - 11:00 PmExperience : 2- 4 years relevant Experience only ( this is a Junior position with us )Must have skillset :GCP - 2 years minimum working ExperiencePython and Pyspark - 2 yearsSQL - 2 yearsExcellent communicationWorked with global stakeholdersWho we are:Randstad Sourceright’s global talent...

  • Customer Engineer

    2 hours ago

    , India, IN Konecta Full time

    In this role, you will be the technical point of contact for the customer – a trusted partner for their IT leadership – as the primary engineer on the project, working with multifunctional teams both internally and externally. You are a customer-facing data engineer who genuinely loves solving problems and can handle client expectations while working on...

  • Senior Data Engineer

    2 hours ago

    , India, IN Donyati Full time

    Senior Data Engineer Job Title: Senior Data EngineerLocation: Remote/ Willing to TravelJob Type: Full-timeExperience Level: 8+ yearsAbout the Role:We are seeking a highly skilled Senior Data Engineer to join our team in building a modern data platform on AWS. You will play a key role in transitioning from legacy systems to a scalable, cloud-native...

  • Senior Data Engineer

    2 hours ago

    india, IN Intellify Solutions Full time

    Title: Senior Data EngineerLocation: Remote, IndiaTotal years of experience: 10+ years Requirements:● Required: Bachelor’s degree or relevant experience● Required: Prior experience as a software engineer or data engineer in afast-paced, technical, problem-solving environment● Required: Cloud Data Warehouse experience - Snowflake● Required: Expert...