Senior Data Engineer--PD

6 days ago


Amravati, India Programming.com Full time

Job Description:


Position: Senior Data Engineer

Budget – 17 lpa

Location – Bangalore

Notice period – Immediate joiner

As a Senior Data Engineer at, you will:


► Design, Architect, and Develop solutions leveraging cloud big data technology to ingest, process and analyze large, disparate data sets to exceed business requirements

► Develop systems that ingest, cleanse and normalize diverse datasets, develop data pipelines from various internal and external sources and build structure for previously unstructured data

► Interact with internal colleagues and external professionals to determine requirements, anticipate future needs, and identify areas of opportunity to drive data development

► Develop good understanding of how data will flow & stored through an organization across multiple applications such as CRM, Broker & Sales tools, Finance, HR etc

► Unify, enrich, and analyze variety of data to derive insights and opportunities

► Design & develop data management and data persistence solutions for application use cases leveraging relational, non-relational databases and enhancing our data processing capabilities

► Develop POCs to influence platform architects, product managers and software engineers to validate solution proposals and migrate

► Develop data lake solution to store structured and unstructured data from internal and external sources and provide technical guidance to help migrate colleagues to modern technology platform

► Contribute and adhere to CI/CD processes, development best practices and strengthen the discipline in Data Engineering Org

► Mentor other members in the team and organization and contribute to organizations’ growth.

What we are looking for:


6+ years’ work experience and bachelor’s degree in Information Science, Computer Science, Mathematics, Statistics or a quantitative discipline in science, business, or social science.

► Hands-on engineer who is curious about technology, should be able to quickly adopt to change and one who understands the technologies supporting areas such as Cloud Computing (AWS, Azure(preferred), etc.), Micro Services, Streaming Technologies, Network, Security, etc.

► 3 or more years of active development experience as a data developer using Python-spark, Spark Streaming, Azure SQL Server, Cosmos DB/Mongo DB, Azure Event Hubs, Azure Data Lake Storage, Azure Search etc.

► Design & develop data management and data persistence solutions for application use cases leveraging relational, non-relational databases and enhancing our data processing capabilities

► Build, test and enhance data curation pipelines integration data from wide variety of sources like DBMS, File systems, APIs and streaming systems for various KPIs and metrics development with high data quality and integrity

► Maintain the health and monitoring of assigned data engineering capabilities that span analytic functions by triaging maintenance issues; ensure high availability of the platform; monitor workload demands; work with Infrastructure Engineering teams to maintain the data platform; serve as an SME of one or more application

Team player, Reliable, self-motivated, and self-disciplined individual capable of executing on multiple projects simultaneously within a fast-paced environment working with cross functional teams

► 3+ years of experience working with source code control systems and Continuous Integration/Continuous Deployment tools

Independent and able to manage, prioritize & lead workload


Technical Skills:

Azure, Python-Spark, Spark Streaming, Azure SQL Server, Cosmos DB, Mongo DB, Azure Event Hubs, Azure Data Lake Storage, Data Pipelines, Cloud Computing, Relational Databases, Non-relational Databases, CI/CD.



  • Amravati, India Evernorth Health Services Full time

    About Evernorth:Evernorth Health Services, a division of The Cigna Group (NYSE: CI), creates pharmacy, care, and benefits solutions to improve health and increase vitality. We relentlessly innovate to make the prediction, prevention, and treatment of illness and disease more accessible to millions of people.Data Engineering Senior Analyst Position...

  • Principal Engineer

    6 days ago


    Amravati, India Mulya Technologies Full time

    Principal Engineer - DataLocation: PunePrincipal Engineer - DataEngineering · Pune, Maharashtra (Hybrid)Data and AI are at the core of the platform. We are looking for creative, customer and detail-obsessed data engineers who can contribute to our strong engineering culture. Our big data engine indexes billions of structured / unstructured documents and...


  • Amravati, India RAPIDFORT Full time

    We are looking for a Senior Backend Engineer with 8-10 years of hands-on experience to join our team. The ideal candidate will have an extensive background in Python, MySQL, and distributed computing. Familiarity with Docker and Kubernetes (K8s) is preferred.You will be responsible for designing, implementing, and optimizing backend services that support...

  • Data Engineer

    3 weeks ago


    Amravati, India Calyx Global Full time

    About the CompanyCalyx Global is a ClimateTech startup founded by Donna Lee and Duncan van Bergen, backed by Sequoia, Susquehanna (SIG), New Climate Ventures, and others. We provide ratings and research on the global carbon market, helping businesses choose effective carbon credits for climate and sustainability while mitigating reputational and financial...


  • Amravati, India Petrofac Full time

    Petrofac is a leading international service provider to the energy industry, with a diverse client portfolio including many of the world’s leading energy companies.We design, build, manage and maintain infrastructure for our clients. We recruit, reward, and develop our people based on merit regardless of race, nationality, religion, gender, age, sexual...


  • Amravati, India Envision energy india Full time

    Job Title – EHS - Engineer / Senior EngineerExperience – 8-10 YearsLocation – Various Project Sites across India (in Tamilnadu, Karnataka, Gujarat, MP, Maharastra) Job Purpose - Leading the implementation of EHS practices and requirements at construction site, & exiting sites. Key focus area is risk assessment, implementation of Envision QHSE...


  • Amravati, India Branch International Full time

    Branch OverviewImagine a world where every person has improved access to financial services. People could start new businesses, pay for their children’s education, cover their emergency medical bills – the possibilities to improve life are endless.Branch is a global technology company revolutionizing financial access for millions of underserved banking...


  • Amravati, India Aspire Full time

    About Aspire:Aspire is the leading all-in-one finance operating system for growing businesses in APAC. We are on a mission to reinvent business finance for a new generation of entrepreneurs and business owners, empowering startups and MSMEs to realize their full potential.Founded in 2018, Aspire has raised over USD 300M+ in equity and debt from world-class...


  • Amravati, India WaferWire Cloud Technologies Full time

    About Us: WaferWire Cloud Technologies is a leading provider of innovative cloud solutions. We work with top-tier clients, including eBay and Microsoft Health and Life Sciences, to deliver cutting-edge technology solutions. We value inclusivity and are committed to hiring individuals returning to work after a career break.Job Description: We are seeking an...


  • Amravati, India Blockchain Staffing Ninja Full time

    Role: Senior Product ManagerLocation: RemoteWork Type: Full TimeRequirement: Candidate should be able to join in 30 days or less.Experience: 4 Years in Product Management with 1 Year in a Web3/Blockchain Company Client Overview:Our client company is a dApp solution infrastructure that makes it easy for dApps to onboard and manage users. It provides a...


  • Amravati, India 3Columns Full time

    We are a small, highly specialised Cyber Security consulting firm based in Sydney CBD. We are looking for a Security Consultant with a security focus and 8-10 years of hands-on experience. About the roleWe are looking for Security Consultants who have experience with a wide range of security products. They should understand the emerging threat landscape and...


  • Amravati, India Field Control Analytics Full time

    Field Control Analytics – Senior Back End C# / .NET Core DeveloperThis is an end contributor / individual contributor position.This position is 100% remote and full-time where you work mostly during India Standard Time within an India-based team.We need an efficient, precise, high-quality, consistent, predictable and highly productive back-end API software...


  • Amravati, India Digital Convergence Technologies Inc. Full time

    Specific Duties include the following:Manage a group of Data Engineers in US, India and Nepal and provide technical guidance, mentorship and performance managementCollaborate with engineering managers, tech leads, cross-functional teams and stakeholders across US, India and Nepal to ensure engineering alignment and architectural principalsStay current with...


  • Amravati, India Poddar Diamond Ltd. Full time

    Location: Dahisar, Mumbai, IndiaJob Type: Full-TimeSalary: 35K-45K / monthDescription:We are looking for an experienced Senior Hardware Developer with a strong background in embedded systems, microcontrollers, and IoT development. The ideal candidate should have hands-on experience with Raspberry Pi, Arduino, Fritzing, PCB designing, and Python development....

  • Big Data Developer

    2 weeks ago


    Amravati, India Omind Full time

    About Us:Hello! We are Omind. As a trailblazer in the Experience space, we empower marketers globally to craft a personalized digital experience that is built for their customers, by their customers. We’re re-shaping the growth landscape for large enterprises by combining data across multiple channels, harnessing the power of AI (Artificial Intelligence)...

  • Engineering Manager

    1 week ago


    amravati, India Coinbase Full time

    At Coinbase, our mission is to increase economic freedom around the world, and we couldn’t do this without hiring the best people. We’re a group of hard-working overachievers who are deeply focused on building the future of finance and Web3 for our users across the globe, whether they’re trading, storing, staking or using crypto. Know those people who...


  • Amravati, India OLIVER+ Full time

    As a part of The Brandtech Group, we're at the forefront of leveraging cutting-edge AI technology to revolutionise how we create and deliver work. Our AI solutions enhance efficiency, spark creativity, and drive insightful decision-making, empowering our teams to produce innovative and impactful results. Role: GenAI Senior Adoption Lead Job Level: SNR (8-10...

  • Senior Test Lead

    4 weeks ago


    Amravati, India Integrated Personnel Services Limited Full time

    Job Role: Senior Test LeadLocation: Pune/ChennaiExperience: 12+ yearsMust have:Hands on knowledge of Test Planning, Test Environment setup, Test Data, Test Design and Test ExecutionLed Testing teams of at least 15-20 Testers (Manual and Automation)Create and implement Testing standards, schedule and assign responsibilitiesDefine and report metrics and status...


  • Amravati, India Insight Global Full time

    Shift: Willing to work IST mornings and afternoonsSalary: 20-30 LPA + 8% annual bonus (based upon experience)INT Process: 2 rounds of interviewsINT Times: Mon, Tues, Thurs & Fri between 2pmIST-5pmIST or 9amESTFollow-Up: Weekly Sync Friday’s at 9amNotice Period: 45 day or less (30 days Preferred)Must Haves:8+ years of experience within Azure Cloud...


  • Amravati, India Truelancer.com Full time

    Job Title: Lead Engineer - Java full stack developer and AWSYears of Experience: 5+ YearsLocation: Chennai, Coimbatore (Hybrid – 3 days from office)Should have Good Exposure: Spring Boot, AWS, Rest API and Database concepts, Core Java, Design pattern, Microservice architectureMandatory skills:• Hands-on experience with web development in Java• Hands-on...