Data Engineer

4 hours ago

Nellore, India Alternative Path Full time

Alternative Path is seeking skilled software developers to collaborate on client projects with an asset management firm. In this role, you will collaborate with individuals across various company departments to shape and innovate new products and features for our platform, enhancing existing ones. You will have a large degree of independence and trust, but you won't be isolated; the support of the Engineering team leads, the Product team leads, and every other technology team member is behind you. This is an opportunity to join a team-first meritocracy and help grow an entrepreneurial group inside Alternative Path. You will be asked to contribute, given ownership, and will be expected to make your voice heard.Role Summary:Performing Web Scraping using various scraping techniques and then utilizing Python’s Pandas library for data cleaning and manipulation. Then ingesting the data into a Database/Warehouse, and scheduling the scrapers using Airflow or other toolsRole OverviewThe Web Scraping Team at Alternative Path is seeking a creative and detail-oriented developer to contribute to client projects. The team develops essential applications, datasets, and alerts for various teams within the client's organization, supporting their daily investment decisions. The mission is to maintain operational excellence by delivering high-quality proprietary datasets, timely notifications, and exceptional service. We are seeking someone who is self-motivated, self-sufficient, with a passion for tinkering and a love for automation.In your role, you will:➢ Collaborate with analysts to understand and anticipate requirements.➢ Design, implement, and maintain Web scrapers for a wide variety of alternative datasets.➢ Perform Data Cleaning, Exploration, Transformation etc. of scraped data.➢ Collaborate with cross-functional teams to understand data requirements and implement efficient data processing workflows.➢ Author QC checks to validate data availability and integrity.➢ Maintain alerting systems and investigate time-sensitive data incidents to ensure smooth day-to-day operations.➢ Design and implement products and tools to enhance the Web scraping Platform.QualificationsMust have➢ Bachelor's/master’s degree in computer science or in any related field➢ 3-5 years of software development experience➢ Strong Python and SQL/Database skills➢ Strong expertise in using the Pandas library (Python) is a must➢ Experience with web technologies (HTML/JS, APIs, etc.)➢ Proven work experience in working with large data sets for Data cleaning, Data transformation, Data manipulation, and Data replacements.➢ Excellent verbal and written communication skills➢ Aptitude for designing infrastructure, data products, and tools for Data ScientistsPreferred➢ Familiarity with scraping and common scraping tools (Selenium, scrapy, Fiddler, Postman, xpath) ➢ Experience containerizing workloads with Docker (Kubernetes a plus)➢ Experience with build automation (Jenkins, Gitlab CI/CD) ➢ Experience with AWS technologies like S3, RDS, SNS, SQS, Lambda, etc.

  • Aws data engineer

    2 weeks ago

    Nellore, India Teamware Solutions Full time

    About the Job: Greetings from Teamware Solutions a division of Quantum Leap Consulting Pvt Ltd Job Description: Role: AWS Data Engineer / Senior Associate / Manager Experience: 6-12 Yrs Location : Bangalore / Work Mode: Hybrid Shift : (Flexibility Required) / Notice Period: Immediate to 20 Days preferred Connect for Faster Comm Role Overview : Teamware is...

  • Full Stack Engineer

    2 weeks ago

    Nellore, India Pristine Data AI Full time

    At Pristine Data AI, we’re building an AI-powered sales and marketing platform that connects data, insights, and automation — all in one place.We’re looking for a mid-level Full Stack Engineer who’s passionate about API integrations, scalable architecture, and building seamless connections between systems.Responsibilities : Integrating...

  • Lead Data Engineer

    1 week ago

    nellore, India Searce Inc Full time

    Who we are?Searce means 'a fine sieve' & indicates 'to refine, to analyze, to improve'. It signifies our way of working: To improve to the finest degree of excellence, 'solving for better' every time. Searcians are passionate improvers & solvers who love to question the status quo.The primary purpose of all of us, at Searce, is driving intelligent, impactful...

  • Senior Data Engineer

    3 days ago

    Nellore, India Meril Full time

    🔍 We're Hiring: Senior Data Engineer We are looking for a highly skilled Senior Data Engineer to help build and scale our data pipelines and infrastructure. If you are passionate about modern data architectures, cloud platforms, and high-performance engineering, we want to meet you. 🔧 Key Technical Responsibilities - Design and build scalable ETL/ELT...

  • Senior data engineer

    4 days ago

    Nellore, India DataOrbit AI Full time

    Company Description Data Orbit AI is a leading AI consulting firm dedicated to empowering small and medium investment managers to achieve AI readiness. By uniting strategy, data preparation, technology, and execution, we enable organizations to adopt AI solutions that unlock growth opportunities and operational efficiencies. With expertise in AI strategy,...

  • Data Engineer

    3 weeks ago

    Nellore, India Add Min Web World Full time

    Job Title: Data Engineer (Qlik Experience)Location: Mohali (On-site)Experience: Minimum 2 YearWorking Days: 5 Days a WeekJob Description:We are looking for a dedicated Data Engineer who has hands-on experience working with Qlik and other data tools. The ideal candidate should have a strong understanding of data processing, integration, and reporting, along...

  • Principal Data Engineering Specialist

    1 week ago

    nellore, India beBeeData Full time

    Job OverviewThe role of a Lead Data Engineer involves collaborating with cross-functional teams to design and develop scalable data solutions that empower better decision making.This is an exciting opportunity for individuals passionate about technology and driven to improve business outcomes through data-driven insights.About the Position:Understand...

  • Data Engineer

    2 weeks ago

    nellore, India Tata Consultancy Services Full time

    Greetings from TCSTCS has been a great pioneer in feeding the fire of Techies like you. We are a global leader in the technology arena and there's nothing that can stop us from growing together.Your role is of key importance, as it lays down the foundation for the entire project.Make sure you have a valid EP number before the interview. To create an EP...

  • Senior Data Engineer

    1 week ago

    Nellore, India Armakuni Full time

    We are looking for a Sr Data Engineer who is passionate about managing large volumes of data, eager to learn and take on challenges, and committed to delivering exceptional results. If you are a team player, with a positive attitude and a desire to make a difference, then we want to hear from youRoles and Responsibilities: · Experience working with AWS...

  • Senior Data Engineer

    1 week ago

    Nellore, India Armakuni Full time

    We are looking for a Sr Data Engineer who is passionate about managing large volumes of data, eager to learn and take on challenges, and committed to delivering exceptional results. If you are a team player, with a positive attitude and a desire to make a difference, then we want to hear from youRoles and Responsibilities: · Experience working with AWS...