NucleusTeq - Lead Data Engineer - Python/Scala

3 weeks ago


Indore, Madhya Pradesh, India NucleusTeq Consulting Pvt. Ltd. Full time

Lead Data Engineer position is a key engineering role helping us to design, build, and support our future state data platform.

In this role you will be expected to spearhead the design, development, and implementation of our next-generation data architecture, while leading and coaching junior engineers.

This role also requires a combination of technical expertise & strategic thinking as you will be collaborating closely with cross-functional teams, to bridge the gap between business requirements and technical solutions.

Qualification :


- 9+ years of experience as a Data Engineer, with at least 3 years in a lead role.

- Strong proficiency Python, Scala, SQL, or HQL for data manipulation, analysis, and automation of tasks


- Proven experience designing and implementing data architectures on AWS, Azure, or GCP.

- Experience and Comfort working with large scale data sets.

- Petabyte scale, with daily ingress and egress numbers in the 10's of Terabytes


- Expertise in managed cloud services for data storage, ingestion, and processing.

- Will need to articulate the services used for various stages of the data lifecycle.

- Experience with notebook environments and big data engineering tools such as : Databricks, Sage Maker, Google Colab, Jupyter, etc


- Hands on experience with streaming tools such as: Kafka, Flume, Spark Streaming, or Flink


- Expectation is that you support the code and products yourself and your team create


What You'll Do :


- Engineer an innovative, durable, robust, and economically viable data platform enabling business velocity, delightful user experiences, and timely/meaningful analytics


- Design and develop data pipelines to manage how data flows between disparate systems.

- Develop data quality metrics and perform QC tests (system and visual) to verify data integrity.

- Interface with architects, product managers/SMEs and product analysts to understand data needs and support the implementation of the business rules into transformation.

- Document the data blending process along with the specifications and workflow/data lineage.

- Perform continuous integration to ensure that every step of the pipeline is testable and automated


- Perform detailed design (the Physical Data Model and transformations), based on understanding of the Logical Data Model (the business requirements)


- Create design documents for data integration or data reporting projects


- Analyze data integration problems, provide solutions and recommend corrective actions.

Location : Indore

(ref:hirist.tech)

  • Indore, Madhya Pradesh, India NucleusTeq Consulting Pvt. Ltd. Full time

    Lead Data Engineer position - Are you passionate about designing and building state-of-the-art data platforms? We are looking for a Lead Data Engineer to spearhead the design, development, and implementation of our next-generation data architecture. In this role, your expertise will be crucial in bridging the gap between business requirements and technical...


  • Indore, Madhya Pradesh, India NucleusTeq Full time

    We are Hiring for Big Data Engineer at Nucleusteq Experience -5-8 yearsLocation-IndoreRole Requirements :Profound programming language experience in Java/Scala and Python.Knowledge of Hadoop ecosystem and strong hands-on experience on Hive and Spark.Understanding on workflow orchestration tools like oozie, Apache Airflow etc.Experience on working with...

  • Big Data Engineer

    6 days ago


    Indore, Madhya Pradesh, India NucleusTeq Full time

    We are Hiring for Big Data Engineer at Nucleusteq Experience - 5-8 years Locations- Multiple ( Bangalore, Raipur , Indore , ) Role Requirements :-Profound programming language experience in Java/Scala or Python.Knowledge of Hadoop ecosystem and strong hands-on experience on Hive and Spark.Understanding on workflow orchestration tools like oozie, Apache...

  • Data Engineer

    5 days ago


    Indore, Madhya Pradesh, India NucleusTeq Full time

    We are Hiring for Data Engineer at Nucleusteq Roles and Responsibilities -Good Knowledge of Data Structures, Design patterns, and Algorithms.Performance Tuning with knowledge on Optimization of Memory, CPU, Network IO.Knowledge of Data Distribution, Leader Election, and Memory allocation routines.Experience in handling large datasets.Create and maintain...

  • Data Engineer

    5 days ago


    Indore, Madhya Pradesh, India NucleusTeq Full time

    Hi All,We are hiring Big Data Engineers with 4 Plus Years of Experience who have practical experience in Java as well.Data EngineerApply Using LinkedIn message(Share Updated Resume...Urgent Opening)We are Hiring for Data Engineer at Nucleusteq Roles and Responsibilities -Good Knowledge of Data Structures, Design patterns, and Algorithms.Performance Tuning...


  • Indore, Madhya Pradesh, India NucleusTeq Full time

    We are Hiring for Big Data Engineer at Nucleusteq Experience - 7-8 years Locations- Indore Role Requirements :- Profound programming language experience in Python. Knowledge of Hadoop ecosystem and strong hands-on experience on SQL,Hadoop, Hive and Spark. Must have understanding on messaging services and their integrations. Good to have experience in...


  • Indore, Madhya Pradesh, India Nucleusteq Full time

    Nucleusteq brings you the opportunity to create and develop solutions for the future, with the help of cutting edge technology.We are looking to hire Senior Cloud Data Engineer to join our ever-growing family in Indore.As a Senior Cloud Data Engineer, you will spearhead the design, development, and implementation of our next-generation data architecture,...


  • Indore, Madhya Pradesh, India Nucleusteq Full time

    Nucleusteq brings you the opportunity to create and develop solutions for the future, with the help of cutting edge technology.We are looking to hire Senior Cloud Data Engineer to join our ever-growing family in Indore.As a Senior Cloud Data Engineer, you will spearhead the design, development, and implementation of our next-generation data architecture,...


  • Indore, Madhya Pradesh, India NucleusTeq Full time

    :This is a full-time role for a Data Engineer specializing in Docker/Kubernetes & Helm. As a Data Engineer, you will be responsible for designing, developing, and maintaining data infrastructure and analytics solutions. You will work closely with cross-functional teams to analyze data requirements, design efficient data models, implement ETL (Extract...

  • Data Engineer- DBT

    5 days ago


    Indore, Madhya Pradesh, India NucleusTeq Full time

    Roles & Responsibility:1: Enhance existing framework to extract data from new sources.2: Migrate the extraction process to extract about 100 objects from different sources3: Migrate the business transformation logic to dbt for about 100 different flows4: Perform unit and integration testing to make sure the results accurate and help completely sunset...

  • Data Engineer- DBT

    5 days ago


    Indore, Madhya Pradesh, India NucleusTeq Full time

    Roles & Responsibility:1: Enhance existing framework to extract data from new sources.2: Migrate the extraction process to extract about 100 objects from different sources3: Migrate the business transformation logic to dbt for about 100 different flows4: Perform unit and integration testing to make sure the results accurate and help completely sunset...


  • Indore, Madhya Pradesh, India NucleusTeq Full time

    Cloud Data Engineer position is a key engineering role helping us to design, build, and support our future state data platform. In this role you will be expected to spearhead the design, development, and implementation of our next-generation data architecture, while leading and coaching junior engineers. This role also requires a combination of technical...


  • Indore, Madhya Pradesh, India NucleusTeq Full time

    Cloud Data Engineer position is a key engineering role helping us to design, build, and support our future state data platform. In this role you will be expected to spearhead the design, development, and implementation of our next-generation data architecture, while leading and coaching junior engineers. This role also requires a combination of technical...

  • Big Data + AWS

    6 days ago


    Indore, Madhya Pradesh, India NucleusTeq Full time

    We are seeking a talented and experienced Big Data Engineer with expertise in AWS cloud technologies. Responsibilities:Design, develop, and maintain scalable big data solutions on the AWS cloud platform, utilizing services such as Amazon EMR, Amazon Redshift, Amazon Athena, and Amazon S3.Implement data ingestion, storage, processing, and analysis pipelines...


  • Indore, Madhya Pradesh, India NucleusTeq Full time

    Location: Indore, Bangalore, RaipurExperience Required – 6-12 YearsSkills Required:Hands on experience in designing and developing applications using Java, Spring Boot, Spring Batch, Spring Data, JPA, Hibernate, Restful services.Knowledge of working on relational databases and SQL (Postgres, MySQL).Object Oriented Analysis and Design using common design...

  • Graphic Designer

    5 days ago


    Indore, Madhya Pradesh, India NucleusTeq Full time

    Job Title: Junior graphic designer Level: Entry/Mid (2-4 years) Location: India Company: NucleusTeq Job description We are seeking a talented Junior Graphic Designer to join our team, responsible for maintaining and enhancing our global brand identity, with a strong focus on creating compelling and visually appealing materials, including marketing and sales...


  • Indore, Madhya Pradesh, India NucleusTeq Full time

    Location: Indore, Bangalore, Raipur Experience Required – 6-12 Years Skills Required:Hands on experience in designing and developing applications using Java, Spring Boot, Spring Batch, Spring Data, JPA, Hibernate, Restful services.Knowledge of working on relational databases and SQL (Postgres, MySQL).Object Oriented Analysis and Design using common design...

  • Software Engineer

    5 days ago


    Indore, Madhya Pradesh, India The Modern Data Company Full time

    We are looking for a talented and motivated Software Engineer to join our team. The ideal candidate will have a strong foundation in computer science engineering fundamentals and hands-on experience with Java/Scala. Experience with Go is a plus. You will work in a collaborative environment, embracing new technologies and methodologies to deliver high-quality...

  • Lead Java Developer

    5 days ago


    Indore, Madhya Pradesh, India NucleusTeq Full time

    Job DescriptionLead Java DeveloperAs a Lead Java Developer, you will play a pivotal role in leading the development and implementation of cutting-edge software solutions. The ideal candidate will have 7-10 years of experience and expertise in Microservices, Spring Boot, schema design, and design patterns.Key Responsibilities:Lead the design, development, and...


  • Indore, Madhya Pradesh, India NucleusTeq Full time

    Role - DevOps focused Software Engineer Experience - 5+ YearsLocation - Indore Key Responsibilities: Design, develop, and maintain infrastructure as code (IaC) using Terraform and Terragrunt to provision and manage AWS resources efficiently. Implement CI/CD pipelines utilizing GitHub Actions to automate build, test, and deployment processes across multiple...