NucleusTeq - Lead Data Engineer - Python/Scala

1 month ago

Indore, India NucleusTeq Consulting Pvt. Ltd. Full time

Lead Data Engineer position is a key engineering role helping us to design, build, and support our future state data platform.

In this role you will be expected to spearhead the design, development, and implementation of our next-generation data architecture, while leading and coaching junior engineers.

This role also requires a combination of technical expertise & strategic thinking as you will be collaborating closely with cross-functional teams, to bridge the gap between business requirements and technical solutions.

Qualification :


- 9+ years of experience as a Data Engineer, with at least 3 years in a lead role.

- Strong proficiency Python, Scala, SQL, or HQL for data manipulation, analysis, and automation of tasks


- Proven experience designing and implementing data architectures on AWS, Azure, or GCP.

- Experience and Comfort working with large scale data sets.

- Petabyte scale, with daily ingress and egress numbers in the 10's of Terabytes


- Expertise in managed cloud services for data storage, ingestion, and processing.

- Will need to articulate the services used for various stages of the data lifecycle.

- Experience with notebook environments and big data engineering tools such as : Databricks, Sage Maker, Google Colab, Jupyter, etc


- Hands on experience with streaming tools such as: Kafka, Flume, Spark Streaming, or Flink


- Expectation is that you support the code and products yourself and your team create


What You'll Do :


- Engineer an innovative, durable, robust, and economically viable data platform enabling business velocity, delightful user experiences, and timely/meaningful analytics


- Design and develop data pipelines to manage how data flows between disparate systems.

- Develop data quality metrics and perform QC tests (system and visual) to verify data integrity.

- Interface with architects, product managers/SMEs and product analysts to understand data needs and support the implementation of the business rules into transformation.

- Document the data blending process along with the specifications and workflow/data lineage.

- Perform continuous integration to ensure that every step of the pipeline is testable and automated


- Perform detailed design (the Physical Data Model and transformations), based on understanding of the Logical Data Model (the business requirements)


- Create design documents for data integration or data reporting projects


- Analyze data integration problems, provide solutions and recommend corrective actions.

Location : Indore

(ref:hirist.tech)

  • Big Data Engineer

    4 weeks ago

    Hyderabad/Bangalore/Indore, India Nucleusteq Full time

    Job Description : Role Requirements :- Profound programming language experience in Java/Scala and Python.- Knowledge of Hadoop ecosystem and strong hands-on experience on Hive and Spark.- Understanding on Modernisation, Informatica migration- Must have understanding on messaging services and their integrations.- Good to have experience in streaming...

  • Big Data Engineer

    2 months ago

    Hyderabad/Bangalore/Indore, India Nucleusteq Full time

    Job Description : Role Requirements :- Profound programming language experience in Java/Scala and Python.- Knowledge of Hadoop ecosystem and strong hands-on experience on Hive and Spark.- Understanding on Modernisation, Informatica migration- Must have understanding on messaging services and their integrations.- Good to have experience in streaming...

  • NucleusTeq - Lead Data Engineer - Python/Scala

    2 weeks ago

    Indore, Madhya Pradesh, India NucleusTeq Consulting Pvt. Ltd. Full time

    Lead Data Engineer position - Are you passionate about designing and building state-of-the-art data platforms? We are looking for a Lead Data Engineer to spearhead the design, development, and implementation of our next-generation data architecture. In this role, your expertise will be crucial in bridging the gap between business requirements and technical...

  • NucleusTeq - Lead Data Engineer - Python/Scala

    4 weeks ago

    indore, India NucleusTeq Consulting Pvt. Ltd. Full time

    Lead Data Engineer position is a key engineering role helping us to design, build, and support our future state data platform. In this role you will be expected to spearhead the design, development, and implementation of our next-generation data architecture, while leading and coaching junior engineers. This role also requires a combination of technical...

  • NucleusTeq - Lead Data Engineer - Python/Scala

    2 weeks ago

    indore, India NucleusTeq Consulting Pvt. Ltd. Full time

    Lead Data Engineer position is a key engineering role helping us to design, build, and support our future state data platform. In this role you will be expected to spearhead the design, development, and implementation of our next-generation data architecture, while leading and coaching junior engineers. This role also requires a combination of technical...

  • NucleusTeq - Lead Data Engineer - Python/Scala

    4 weeks ago

    Indore, Madhya Pradesh, India NucleusTeq Consulting Pvt. Ltd. Full time

    Lead Data Engineer position is a key engineering role helping us to design, build, and support our future state data platform. In this role you will be expected to spearhead the design, development, and implementation of our next-generation data architecture, while leading and coaching junior engineers. This role also requires a combination of technical...

  • NucleusTeq - Lead Data Engineer - Python/Scala

    1 month ago

    Indore, India NucleusTeq Consulting Pvt. Ltd. Full time

    Lead Data Engineer position is a key engineering role helping us to design, build, and support our future state data platform. In this role you will be expected to spearhead the design, development, and implementation of our next-generation data architecture, while leading and coaching junior engineers. This role also requires a combination of technical...

  • NucleusTeq - Lead Data Engineer - Python/Scala

    4 weeks ago

    Indore, Madhya Pradesh, India NucleusTeq Consulting Pvt. Ltd. Full time

    Lead Data Engineer position is a key engineering role helping us to design, build, and support our future state data platform. In this role you will be expected to spearhead the design, development, and implementation of our next-generation data architecture, while leading and coaching junior engineers. This role also requires a combination of technical...

  • NucleusTeq - Lead Data Engineer - Python/Scala

    4 weeks ago

    Indore, India NucleusTeq Consulting Pvt. Ltd. Full time

    Lead Data Engineer position is a key engineering role helping us to design, build, and support our future state data platform. In this role you will be expected to spearhead the design, development, and implementation of our next-generation data architecture, while leading and coaching junior engineers. This role also requires a combination of technical...

  • Senior Big Data Engineer

    2 weeks ago

    Indore, Madhya Pradesh, India NucleusTeq Full time

    We are Hiring for Big Data Engineer at Nucleusteq Experience -5-8 yearsLocation-IndoreRole Requirements :Profound programming language experience in Java/Scala and Python.Knowledge of Hadoop ecosystem and strong hands-on experience on Hive and Spark.Understanding on workflow orchestration tools like oozie, Apache Airflow etc.Experience on working with...

  • Big Data Engineer

    2 weeks ago

    Indore, Madhya Pradesh, India NucleusTeq Full time

    We are Hiring for Big Data Engineer at Nucleusteq Experience - 5-8 years Locations- Multiple ( Bangalore, Raipur , Indore , ) Role Requirements :-Profound programming language experience in Java/Scala or Python.Knowledge of Hadoop ecosystem and strong hands-on experience on Hive and Spark.Understanding on workflow orchestration tools like oozie, Apache...

  • Data Engineer

    2 weeks ago

    Indore, Madhya Pradesh, India NucleusTeq Full time

    We are Hiring for Data Engineer at Nucleusteq Roles and Responsibilities -Good Knowledge of Data Structures, Design patterns, and Algorithms.Performance Tuning with knowledge on Optimization of Memory, CPU, Network IO.Knowledge of Data Distribution, Leader Election, and Memory allocation routines.Experience in handling large datasets.Create and maintain...

  • Senior Big Data Engineer

    2 weeks ago

    Indore, India NucleusTeq Full time

    We are Hiring for Big Data Engineer at Nucleusteq !!! Experience - 5-8 years Location- Indore  Role Requirements :- Profound programming language experience in Java/Scala and Python.Knowledge of Hadoop ecosystem and strong hands-on experience on Hive and Spark.Understanding on workflow orchestration tools like...

  • Senior Big Data Engineer

    3 days ago

    indore, India NucleusTeq Full time

    We are Hiring for Big Data Engineer at Nucleusteq !!! Experience - 5-8 years Location-  Indore  Role Requirements :- Profound programming language experience in Java/Scala and Python. Knowledge of Hadoop ecosystem and strong hands-on experience on Hive and Spark. Understanding on workflow orchestration tools...

  • Data Engineer

    2 weeks ago

    Indore, Madhya Pradesh, India NucleusTeq Full time

    Hi All,We are hiring Big Data Engineers with 4 Plus Years of Experience who have practical experience in Java as well.Data EngineerApply Using LinkedIn message(Share Updated Resume...Urgent Opening)We are Hiring for Data Engineer at Nucleusteq Roles and Responsibilities -Good Knowledge of Data Structures, Design patterns, and Algorithms.Performance Tuning...

  • Big Data Engineer-Python

    2 weeks ago

    Indore, Madhya Pradesh, India NucleusTeq Full time

    We are Hiring for Big Data Engineer at Nucleusteq Experience - 7-8 years Locations- Indore Role Requirements :- Profound programming language experience in Python. Knowledge of Hadoop ecosystem and strong hands-on experience on SQL,Hadoop, Hive and Spark. Must have understanding on messaging services and their integrations. Good to have experience in...

  • Big Data Engineer-Python

    2 weeks ago

    Indore, India NucleusTeq Full time

    We are Hiring for Big Data Engineer at Nucleusteq !!! Experience - 7-8 years Locations- Indore  Role Requirements :- Profound programming language experience in Python.Knowledge of Hadoop ecosystem and strong hands-on experience on SQL,Hadoop, Hive and Spark.Must have understanding on messaging services and...

  • Big Data Engineer-Python

    2 weeks ago

    indore, India NucleusTeq Full time

    We are Hiring for Big Data Engineer at Nucleusteq !!! Experience -  7-8 years Locations-  Indore  Role Requirements :- Profound programming language experience in Python. Knowledge of Hadoop ecosystem and strong hands-on experience on SQL,Hadoop, Hive and Spark. Must have understanding on messaging services...

  • Data Engineer

    2 weeks ago

    indore, India NucleusTeq Full time

    We are Hiring for Data Engineer at Nucleusteq !!! Roles and Responsibilities - Good Knowledge of Data Structures, Design patterns, and Algorithms. Performance Tuning with knowledge on Optimization of Memory, CPU, Network IO.  Knowledge of Data Distribution, Leader Election, and Memory allocation routines. Experience in handling...

  • Data Engineer

    5 days ago

    Indore, India NucleusTeq Full time

    Hi All,We are hiring Big Data Engineers with 4 Plus Years of Experience who have practical experience in Java as well.Data EngineerApply Using LinkedIn message(Share Updated Resume...Urgent Opening)We are Hiring for Data Engineer at Nucleusteq !!!Roles and Responsibilities -Good Knowledge of Data Structures, Design patterns, and Algorithms.Performance Tuning...