Senior Data Engineer

1 day ago

Multiple Locations, India Digihelic Solutions Private Limited Full time ₹ 12,00,000 - ₹ 36,00,000 per year

Description :


We are seeking a highly experienced and technically adept Senior Data Engineer to join our TAVS team in Pune. The ideal candidate will have a minimum of 12 years of relevant experience and a strong background in designing, developing, and optimizing large-scale data pipelines and data warehouse solutions. This role requires deep expertise in PostgreSQL, Databricks/Apache Spark, Python, and Azure services.

Key Responsibilities :

- Data Architecture & Design : Design, implement, and manage robust, scalable, and high-performance data warehouse solutions and data marts, utilizing deep knowledge of PostgreSQL for optimal storage and retrieval.

- Database Management : Oversee all aspects of PostgreSQL database administration, including advanced query optimization, performance tuning, data replication, backup strategies, and ensuring data integrity and security.

- ETL/ELT Development : Develop, construct, test, and maintain data pipelines using Databricks (or another Apache Spark distribution) to ingest, transform, and load large datasets from various sources, ensuring data quality and reliability.

- Programming & Scripting : Write clean, efficient, and well-documented code primarily in Python, leveraging powerful data manipulation libraries like Pandas and NumPy for complex data transformation and analysis tasks.

- Cloud Integration : Utilize and manage Azure services (e.g., Azure Data Lake Storage, Azure Synapse Analytics, Azure Data Factory, Azure Databricks) for data storage, orchestration, processing, and analytical workloads.

- Performance Optimization : Proactively identify and resolve data bottlenecks and performance issues across the data platform, tuning SQL queries and Spark jobs for maximum efficiency.

- Collaboration & Mentorship : Work closely with data scientists, analysts, and business stakeholders to understand data requirements and deliver effective solutions. Mentor junior team members on best practices in data engineering and specific technologies.

Required Qualifications & Skills :

- Data Engineering, Architecture, and Pipeline Development

- 12 Years (Mandatory)

- Database : PostgreSQL (Advanced database design, indexing, partitioning, optimization, and management)

- Extensive Big Data Platform

- Databricks (or any other Apache Spark distribution like EMR, Google Cloud Dataproc)

- Extensive Programming : Python (Advanced proficiency, including Pandas and NumPy for data manipulation)

- Strong Cloud Microsoft Azure (Services for data storage, processing, and analytics e.g., ADLS, ADF, Synapse)

- Solid SQL Complex query writing, stored procedures, and performance tuning

- Expert ETL/ELT

- Designing, developing, and deploying scalable data pipelines

Desired (Good to Have) Skills :

- Experience with other NoSQL databases (e.g., MongoDB, Cassandra).

- Familiarity with CI/CD tools and data governance principles.

- Knowledge of stream processing technologies (e.g., Kafka).

- Certification in Azure Data Engineering (e.g., Azure Data Engineer Associate - DP-203).

  • Senior Data Engineer

    2 weeks ago

    Multiple Locations, India DoctusTech Full time

    Description : Role Overview : We are seeking an experienced Senior Data Engineer with a strong background in data security, privacy, and compliance to join our growing engineering team. This individual will play a critical role in designing, building, and maintaining secure data pipelines, ensuring end-to-end compliance across all data systems. The...

  • Senior Data Engineer

    2 weeks ago

    Multiple Locations, India Sheryl strategic solutions Pvt. LTD . Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Title : Senior Data Engineer - SQL & Microsoft ETL StackLocation : 100% Remote (Must be in India)Duration of Project : 8 months contractAbout the Role : We are hiring a technically proficient Data Engineer for an 8-month, 100% remote contract role (must be based in India). This position requires advanced expertise in SQL and deep operational knowledge of...

  • Lead Data Engineer

    5 days ago

    Multiple Locations, India CAPITALNUMBERS INFOTECH LIMITED Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Senior Data Engineer We are seeking a highly skilled Senior Data Engineer to strengthen and optimize our data infrastructure, which serves as the backbone of our business operations. The ideal candidate will bring deep technical expertise in data engineering, with hands-on experience across PostgreSQL, AWS (Redshift, S3), Apache Airflow, and dbt, and a...

  • Senior Data Engineer

    1 week ago

    Multiple Locations, India Hunarstreet Technologies Pvt. Ltd. Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Shift : 2:00 PM - 11:00 PM ISTExperience : 6 years of hands-on Data Engineering experienceAbout the Role : We are looking for experienced Data Engineers who can design, build, and optimize large-scale data pipelines. This role is for individual contributors who love coding, problem-solving, and working with cutting-edge big data technologies.Key...

  • Senior Data Engineer

    1 week ago

    Multiple Locations, India Eqaim Technology & Services Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    Description : About the Project : We are developing a data-driven platform designed to help companies optimize promotional activities for maximum business impact. The solution collects and validates data, analyzes promotion effectiveness, plans promotional calendars, and integrates seamlessly with existing enterprise systems. By leveraging machine...

  • Senior BI Engineer/Data Architect

    24 hours ago

    Multiple Locations, India HNR Tech Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Description : About the Role : Were looking for an experienced Senior BI Engineer / Data Architect to lead and deliver an end-to-end BI project for one of our clients over a three-month period. This role involves full ownership of the BI architecture and delivery from designing the semantic model and building the Operational Data Store (ODS) to...

  • Senior Data Engineer

    2 weeks ago

    Multiple Locations, India Apidel Technology Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Key Responsibilities : - Design, build, and maintain data pipelines using Azure Data Factory, Databricks, and Data Lake. - Develop efficient, reusable, and scalable ETL/ELT processes in Python, PySpark, and SQL. - Implement and maintain data models, transformations, and integrations for large-scale data platforms. - Ensure data quality,...

  • Senior Data Warehouse Engineer

    3 days ago

    Multiple Locations, India Norstella Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Description : At Norstella, our mission is simple : to help our clients bring life-saving therapies to market quickerand help patients in need. Founded in 2022, but with history going back to 1939, Norstella unites best-in-class brands to help clients navigate the complexities at each step of the drug development life cycle and get the right...

  • Senior Engineer

    23 hours ago

    Multiple Locations, India INTRAEDGE TECHNOLOGIES PRIVATE LIMITED Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Description : Seeking a hands-on Senior Engineer with proven expertise in Artificial Intelligence (AI/ML) and Java development. This role combines deep technical skills with the ability to design, build, and optimize AI-powered enterprise applications. The engineer will be responsible for developing scalable Java-based systems, integrating AI/ML...

  • Data Engineer

    2 days ago

    Multiple Locations, India Dash Hire Full time ₹ 8,00,000 - ₹ 25,00,000 per year

    Description : The Data Engineer will be responsible for designing, developing, and maintaining the data infrastructure for a healthcare organisation. The ideal candidate will have experience in working with healthcare data, including EHR, HIMS, PACS, and RIS. They will also have experience with SQL, Elasticsearch, and data integration tools like Talend....