Senior Data Engineer

16 hours ago

Greater Kolkata Area, India N-iX Full time ₹ 12,00,000 - ₹ 24,00,000 per year

Description

  • About the project: Data solution to gather and transform data from multiple heterogeneous systems across our clients organization into the Azure Data Lakehouse using Databricks and ADF.

Responsibilities

  • Design complex ETL processes of various data sources in the data Lakehouse.
  • Build new and maintain existing data pipelines using Python to improve efficiency and latency.
  • Improve data quality through anomaly detection by building and working with internal tools to measure data and automatically detect changes.
  • Identify, design, and implement internal process improvements, including re-designing infrastructure for greater scalability, optimizing data delivery, and automating manual processes.
  • Perform data modeling and improve our existing data models for analytics.
  • Collaborate with SMEs, architects, analysts, data scientists, and others to build solutions that integrate data from many of our enterprise data sources.
  • Partner with stakeholders, including data, design, product, and executive teams, and assist them with data-related technical issues.

Requirements

  • 3-5 years of commercial experience in building and maintaining complex data pipelines.
  • Proficiency in Python and SQL.
  • Well-versed in the optimization of ETL processes.
  • Solid skills in Bash scripting.
  • Solid knowledge of relational SQL and NoSQL databases: PostgreSQL/Redshift/MongoDB, Snowflake.
  • Knowledge of job scheduling and orchestration tools (Airflow etc.).
  • Good knowledge of cloud services (Azure).
  • Solid expertise in data processing tools for Azure: Elasticsearch, Azure Data Factory, Databricks, Azure Synapse.
  • Decent knowledge of CI/CD (Docker, Jenkins, Terraform, Git).
  • Good understanding of algorithms and data structures.
  • Experience in the schema and dimensional data design.
  • Excellent communication skills, both written and verbal.
  • English level: upper intermediate+.
  • Nice to have:
  • Databricks certification.
  • Microsoft Azure offer :
  • Flexible working format remote, office-based or flexible.
  • A competitive salary and good compensation package.
  • Personalized career growth.
  • Professional development tools (mentorship program, tech talks and trainings, centers of excellence, and more).
  • Active tech communities with regular knowledge sharing.
  • Education reimbursement.
  • Memorable anniversary presents.
  • Corporate events and team buildings.

)

  • Lead Data Engineer

    2 weeks ago

    Greater Kolkata Area, India Eucloid Data Solutions Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Job DescriptionEucloid is looking for a senior/ lead Data Engineer to join our Data Platform team supporting various business applications. The ideal candidate will support development of data infrastructure on Databricks for our clients by participating in activities which may include starting from up- stream and down-stream technology selection to...

  • Senior Data Engineer

    2 weeks ago

    Greater Kolkata Area, India DoctusTech Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    DescriptionRole Overview :We are seeking an experienced Senior Data Engineer with a strong background in data security, privacy, and compliance to join our growing engineering team. This individual will play a critical role in designing, building, and maintaining secure data pipelines, ensuring end-to-end compliance across all data systems.The ideal...

  • Senior Data Engineer

    1 week ago

    Greater Kolkata Area, India Lexmark Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Lexmark is now a proud part of Xerox, bringing together two trusted names and decades of expertise into a bold and shared vision.When you join us, you step into a technology ecosystem where your ideas, skills, and ambition can shape what comes next. Whether you're just starting out or leading at the highest levels, this is a place to grow, stretch, and make...

  • Azure Data Engineer

    3 days ago

    Greater Kolkata Area, India Deqode Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Profile :Senior Data Engineer (Azure)Experience Required :6+ YearsWork Mode :HybridLocation :Gurgaon, Pune, Jaipur, Bangalore, BhopalEmployment Type :Full-timeAbout The RoleWe are seeking an experienced Senior Data Engineer with strong expertise in Microsoft Azure ecosystem to join our data engineering team. The ideal candidate will be responsible for...

  • Senior Data Engineer

    1 week ago

    Greater Kolkata Area, India Meazure Learning Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    EducationAt Meazure Learning, we aim to empower open-minded, inquisitive, and driven people, and we love how each new addition to the team adds to our culture. Here, you can positively impact the careers of millions of test-takers and reshape the education technology landscape by working toward one vision:"To provide life-long learners across the globe the...

  • Senior Data Engineer

    4 weeks ago

    Greater Delhi Area, India Dhurin Full time

    About the Company Dhurin is a fastgrowing data science firm serving financial services industry. We work with banks, NBFCs, fintech and other financial institutions. Our work is in the space of risk, fraud, collections, marketing, sales, and operations through it we directly influence how financial institutions make smarter decisions. Dhurin is ‘the...

  • Senior Data Engineer

    4 weeks ago

    Greater Delhi Area, India Dhurin Full time

    About the Company Dhurin is a fastgrowing data science firm serving financial services industry. We work with banks, NBFCs, fintech and other financial institutions. Our work is in the space of risk, fraud, collections, marketing, sales, and operations through it we directly influence how financial institutions make smarter decisions. Dhurin is ‘the...

  • Senior Data Engineer

    3 weeks ago

    Greater Delhi Area, India Dhurin Full time

    About the CompanyDhurin is a fastgrowing data science firm serving financial services industry. We work with banks, NBFCs, fintech and other financial institutions. Our work is in the space of risk, fraud, collections, marketing, sales, and operations through it we directly influence how financial institutions make smarter decisions. Dhurin is ‘the...

  • Senior Data Engineer

    1 week ago

    Greater Delhi Area, India Dhurin Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    About the CompanyDhurin is a fastgrowing data science firm serving financial services industry. We work with banks, NBFCs, fintech and other financial institutions. Our work is in the space of risk, fraud, collections, marketing, sales, and operations through it we directly influence how financial institutions make smarter decisions. Dhurin is 'the place'...

  • Lead Data Engineer

    2 weeks ago

    Greater Kolkata Area, India Codesmith Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    DescriptionJob Title : Lead Data Consultant / Senior Data EngineerExperience Level : 10+ Years (with deep Azure experience)Employment Type : Full-time / ContractRole OverviewAs a Lead Data Consultant / Senior Data Engineer, you will design, develop, and lead the delivery of enterprise-scale, cloud-native data platforms for our clients, with a particular...