Senior Data Engineer

2 months ago

india NeST Digital Full time
  • Design, develop, and maintain scalable and efficient data pipelines to extract, transform, and load (ETL) data from various sources into data lakes and data warehouses.
  • Design and develop microservices to
  • Collaborate with data scientists, analysts, and cross functional teams to design data models, database schemas and data storage solutions.
  • Implement data integration and data quality processes to ensure the accuracy and reliability of data for analytics and reporting.
  • Optimize data storage, processing, and querying performance for large-scale datasets.
  • Enable advanced analytics and machine learning capabilities on the data platform.
  • Continuously monitor and improve data quality and data governance practices.
  • Stay up to date with the latest data engineering trends, technologies, and best practices.

Requirements:

  • Bachelor’s degree in computer science, Engineering, or a related field.
  • 8+ of proven experience in data engineering, data warehousing, and ETL processes.
  • Proficiency in data engineering tools and technologies such as SQL, Python, Spark, Hadoop, DBT, Airflow, Apache Kafka and Presto.
  • Solid experience with table formats such as Delta Lake or Apache Iceberg
  • Design and development experience with batch and real time streaming infrastructure and workloads.
  • Solid experience with implementing data lineage, data quality and data observability for Big data workflows.
  • Solid experience designing and developing microservices and distributed architecture.
  • Hands-on experience with GCP ecosystem and data lakehouse architectures.
  • Strong experience with implementing Databricks.
  • Strong experience with container technologies such as Docker, Kubernetes.
  • Strong understanding of data modeling, data architecture, and data governance principles.
  • Excellent experience with DataOps principles and test automation.
  • Familiarity with data processing and querying using distributed systems and NoSQL databases.
  • Ability to optimize and tune data processing and storage for performance and cost-efficiency.
  • Excellent problem-solving skills and the ability to work on complex data engineering challenges.
  • Strong communication and collaboration skills to work effectively with cross-functional teams.
  • Previous experience mentoring and guiding junior data engineers is a plus.
  • Relevant certifications in data engineering or cloud technologies are desirable.

Nice to have:

  • Experience working in a Data Mesh architecture.
  • Supply Chain domain experience.

  • Senior Data Engineer

    4 weeks ago

    India Mindteck Full time

    Job Title: Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to join our team at Mindteck. As a Senior Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data systems and architectures.Key Responsibilities:Design and implement data pipelines and architectures to support business...

  • Senior Data Engineer

    3 weeks ago

    India iO Associates - UKEU Full time

    Job Title: Senior Data Engineer Location: Mohali Salary: Negotiable on the current package iO Associates is looking for a Senior Data Engineer in Databricks, Python, Scala, Azure Synapse, and Azure Data Factory to join our dynamic team. Responsibilities include developing and troubleshooting complex data pipelines using Databricks, PySpark, Synapse,...

  • Senior Data Engineer

    3 weeks ago

    india iO Associates - UKEU Full time

    Job Title: Senior Data EngineerLocation: MohaliSalary: Negotiable on the current packageiO Associates is looking for a Senior Data Engineer in Databricks, Python, Scala, Azure Synapse, and Azure Data Factory to join our dynamic team. Responsibilities include developing and troubleshooting complex data pipelines using Databricks, PySpark, Synapse, ADF, ADLS...

  • Senior Data Engineer

    4 weeks ago

    India Apptad Inc. Full time

    Job Title: Senior Python Data EngineerWe are seeking a highly skilled Senior Python Data Engineer to join our team at Apptad Inc. as we continue to drive innovation in data engineering and analytics.Key Responsibilities:Design and implement scalable data architectures to support business intelligence and advanced analytics.Develop and maintain data pipelines...

  • Senior Data Engineer

    4 days ago

    India iO Associates - UKEU Full time

    Job Title: Senior Data Engineer Location: Mohali Salary: up to 30 LPA iO Associates is looking for a Senior Data Engineer in Databricks, Python, Scala, Azure Synapse, and Azure Data Factory to join our dynamic team. Responsibilities include developing and troubleshooting complex data pipelines using Databricks, PySpark, Synapse, ADF, ADLS...

  • Senior Data Engineer

    1 month ago

    india E-Solutions Full time

    Hi All, Hope you are doing well ! Job Title: Senior Data Engineer Experience: 4 - 8 years Location: Chennai Job Type: Full-time (5 days office) Job Description: We are seeking a skilled Senior Data Engineer with over 4+ years of experience to join our dynamic team in Chennai. In this role, you will be responsible for designing, building, and maintaining...

  • Senior Data Engineer

    1 month ago

    india E-Solutions Full time

    Hi All,Hope you are doing well !Job Title: Senior Data EngineerExperience: 4 - 8 yearsLocation: ChennaiJob Type: Full-time (5 days office)Job Description:We are seeking a skilled Senior Data Engineer with over 4+ years of experience to join our dynamic team in Chennai. In this role, you will be responsible for designing, building, and maintaining data...

  • Senior data engineer

    2 days ago

    India Synechron Full time

    Good-day, We have an immediate opportunity for the Senior Data Engineer Job Role: Senior Data Engineer Job Location: Bangalore BCIT Experience- 7 to 10 years Notice : upto 15 Days. About Company: At Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity and...

  • Senior Data Engineer

    3 weeks ago

    India Recmatrix Consulting Full time

    Job Title: Senior Data Engineer Location: Remote within India Employment Type: Contract Experience Level: 6+ years Position Overview: We are seeking a Senior Data Warehouse Engineer to join our Digital Business team. This role involves building and managing data warehouses to support various business functions such as Sales, Marketing, and Content...

  • Senior data engineer

    3 weeks ago

    India Recmatrix Consulting Full time

    Job Title: Senior Data Engineer Location: Remote within India Employment Type: Contract Experience Level: 6+ years Position Overview: We are seeking a Senior Data Warehouse Engineer to join our Digital Business team. This role involves building and managing data warehouses to support various business functions such as Sales, Marketing, and...

  • Senior data engineer

    5 days ago

    India Linuxpect Private Limited Full time

    We are seeking an experienced and skilled Senior Data Engineer with 5 to 10 years of hands-on experience in building and managing data pipelines and big data infrastructure. The ideal candidate will have a strong technical background in data engineering tools, big data ecosystems, and programming languages. This role will focus on designing, implementing,...

  • Senior Data Engineer

    1 month ago

    india ValueLabs Full time

    Dear Aspirants, We at ValueLabs have an Opening for Senior Azure Data Engineer role. Below is the JD for the same. Role: Sr Data Engineer Experience: 5+ Years Preferable Immediate Joiners The Azure Data Engineer is responsible for the design, development, and maintenance of data pipelines, data warehouses, and data lakes for the organization. This role...

  • AWS Data Engineer

    7 days ago

    india ITI Data Full time

    Job Description We are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources....

  • AWS Data Engineer

    2 days ago

    India ITI Data Full time

    Job Description We are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources....

  • AWS Data Engineer

    2 months ago

    India ITI Data Full time

    Job Description We are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources....

  • AWS Data Engineer

    3 months ago

    India ITI Data Full time

    Job DescriptionWe are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources. There...

  • AWS Data Engineer

    3 months ago

    India ITI Data Full time

    Job Description We are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources....

  • Senior Data Engineer

    3 weeks ago

    india Recmatrix Consulting Full time

    Job Title: Senior Data EngineerLocation: Remote within IndiaEmployment Type: ContractExperience Level: 6+ yearsPosition Overview:We are seeking a Senior Data Warehouse Engineer to join our Digital Business team. This role involves building and managing data warehouses to support various business functions such as Sales, Marketing, and Content teams, along...

  • Senior Data Engineer

    5 days ago

    india Varcus infinity Full time

    Job Title: Senior Data Engineer   Location: India (Permanent Work From Home)   Salary: ₹30 - ₹40 LPA (flexible for exceptional candidates based on experience)   Experience Level: Minimum 5 years, with preference for candidates with e-commerce experience   (Note: Candidate must be available to work in PST time zone and able to join within a...

  • Senior Data Engineer

    5 days ago

    India Varcus infinity Full time € 30,00,000 - € 40,00,000

    Job Title: Senior Data Engineer Location: India (Permanent Work From Home) Salary: ₹30 - ₹40 LPA (flexible for exceptional candidates based on experience) Experience Level: Minimum 5 years, with preference for candidates with e-commerce experience (Note: Candidate must be available to work in PST time zone and able to join within a month.) ...