Data Engineer

2 weeks ago

nashik, India Alternative Path Full time

Alternative Path is seeking skilled software developers to collaborate on client projects with an asset management firm. In this role, you will collaborate with individuals across various company departments to shape and innovate new products and features for our platform, enhancing existing ones. You will have a large degree of independence and trust, but you won't be isolated; the support of the Engineering team leads, the Product team leads, and every other technology team member is behind you. This is an opportunity to join a team-first meritocracy and help grow an entrepreneurial group inside Alternative Path. You will be asked to contribute, given ownership, and will be expected to make your voice heard.Role Summary:Performing Web Scraping using various scraping techniques and then utilizing Python's Pandas library for data cleaning and manipulation. Then ingesting the data into a Database/Warehouse, and scheduling the scrapers using Airflow or other toolsRole OverviewThe Web Scraping Team at Alternative Path is seeking a creative and detail-oriented developer to contribute to client projects. The team develops essential applications, datasets, and alerts for various teams within the client's organization, supporting their daily investment decisions. The mission is to maintain operational excellence by delivering high-quality proprietary datasets, timely notifications, and exceptional service. We are seeking someone who is self-motivated, self-sufficient, with a passion for tinkering and a love for automation.In your role, you will:➢ Collaborate with analysts to understand and anticipate requirements.➢ Design, implement, and maintain Web scrapers for a wide variety of alternative datasets.➢ Perform Data Cleaning, Exploration, Transformation etc. of scraped data.➢ Collaborate with cross-functional teams to understand data requirements and implement efficient data processing workflows.➢ Author QC checks to validate data availability and integrity.➢ Maintain alerting systems and investigate time-sensitive data incidents to ensure smooth day-to-day operations.➢ Design and implement products and tools to enhance the Web scraping Platform.QualificationsMust have➢ Bachelor's/master's degree in computer science or in any related field➢ 3-5 years of software development experience➢ Strong Python and SQL/Database skills➢ Strong expertise in using the Pandas library (Python) is a must➢ Experience with web technologies (HTML/JS, APIs, etc.)➢ Proven work experience in working with large data sets for Data cleaning, Data transformation, Data manipulation, and Data replacements.➢ Excellent verbal and written communication skills➢ Aptitude for designing infrastructure, data products, and tools for Data ScientistsPreferred➢ Familiarity with scraping and common scraping tools (Selenium, scrapy, Fiddler, Postman, xpath) ➢ Experience containerizing workloads with Docker (Kubernetes a plus)➢ Experience with build automation (Jenkins, Gitlab CI/CD) ➢ Experience with AWS technologies like S3, RDS, SNS, SQS, Lambda, etc.

  • Data Engineer

    4 weeks ago

    Nashik, India RevX Full time

    Data Engineer About RevXRevX helps app businesses acquire and reengage users via programmatic to retain, monetize, and accelerate revenue. We're all about taking your app businesses to a new growth level. We rely on data science, innovative technology, and AI, and a skilled team, to create and deliver seamless ad experiences to delight your app users....

  • Data engineer

    4 weeks ago

    Nashik, India Veraxion Full time

    We’re looking for a Data Engineer to design, build, and scale modern data platforms on AWS. You’ll work with Python, Spark, DBT, and AWS-native services in an Agile environment to deliver scalable, secure, and high-performance data solutions.What you’ll doDevelop and optimize ETL/ELT pipelines with Python, DBT, and AWS services (Data Ops Live).Build...

  • Gcp data engineer

    4 days ago

    Nashik, India Adastra Full time

    Job Description We are looking for a proactive and solution-oriented GCP Data Engineer to join our team. This role requires hands-on experience in Google Cloud Platform (GCP), especially with Big Query and Airflow, alongside strong SQL and Python skills. The ideal candidate is a self-starter who thrives in solving problems independently, communicates...

  • Data Quality Engineer

    2 weeks ago

    Nashik, India People Prime Worldwide Full time

    About Client: Our Client is a global IT services company headquartered in Southborough, Massachusetts, USA. Founded in 1996, with a revenue of $1.8B, with 35,000+ associates worldwide, specializes in digital engineering, and IT services company helping clients modernize their technology infrastructure, adopt cloud and AI solutions, and accelerate innovation....

  • Data Engineer

    1 week ago

    Nashik, India Reveille Technologies,Inc Full time

    🚀 We’re Hiring – Data Engineer (4+ Yrs Experience) - FTE📍 Location: Chennai (Onsite)🕒 Notice Period: Immediate Joiners OnlyKey Skills:☁️ Primary Cloud Expertise: GCP (preferred) or Azure🧠 SQL – advanced & scenario-based problem solving🐍 Python – strong hands-on experience🔧 GCP Services: Cloud Functions, BigQuery, Airflow,...

  • Senior Data Engineer

    3 weeks ago

    Nashik, India Koantek Full time

    We are seeking an experienced Databricks Full Stack Data Engineer with 5–6 years of industryexperience. The ideal candidate will have a proven track record of working on live projects,preferably within the manufacturing or energy sectors. He/she will play a key role in developingand maintaining scalable data solutions using Databricks and related...

  • AWS Data Engineer

    2 weeks ago

    Nashik, India Tata Consultancy Services Full time

    Greetings from TCS!TCS has always been in the spotlight for being adept in the next big technologies. What we can offer you is a space to explore varied technologies and quench your techie soul.We are hiringAWSData EngineerforKolkata/BangaloreLocation.Role: Data Engineer Required Skill Set: AWS Data engineering ( EC2, S3, RDS), Python, Data analysis, Data...

  • Freelance Data Engineer

    7 days ago

    Nashik, India Leading MNC Full time

    Looking for a Freelance Data Engineer to join a team of rockstar developers. The candidate should have a minimum of 8+ yrs. of experience.There are multiple openings. If you're looking for freelance/ part time opportunity (along with your day job) & a chance to work with the top 0.1% of developers in the industry, this one is for you! You will report into...

  • Data Engineer

    21 hours ago

    Kolkata, Nashik, India Impact Hr Km Solutions Full time

    Job Description Description We are looking for a skilled Data Engineer to join our team in India. The ideal candidate will play a crucial role in building and maintaining our data infrastructure, ensuring that our data is reliable, accessible, and secure. Responsibilities - Design, develop, and maintain scalable data pipelines and ETL processes. -...

  • Data Engineer

    1 week ago

    Nashik, India HISH IT SERVICES Full time

    We have a new urgent GCP Data Engineer opportunity open to support a migration initiative from Teradata to Cerebro (BigQuery). This role requires a hands-on developer who can collaborate closely with our data and reporting teams to ensure smooth repointing and validation of Power BI reports.Request Details:Title: GCP Data EngineerSeniority: Mid to Senior...