Senior Data Engineer

1 month ago

Delhi, India Mindteck Full time
Senior Data Engineer (Scala)

Details below:

Location: India (WFH)

Mode: Permanent

Must: Immediate - 30 days

2x headcounts in 10+ yrs band (should be flexible for IST and Europe Time Zone)

Salary: INR 24-28 LPA

Interview rounds: 2 or 3

Job Description:

Primarily experts of Spark 3.X, SCALA, Delta lake implementation, streaming solution implementation for IOT in Spark streaming. Kafka expertise.

Any experience with MFG BI, DWH and Datalake implementation would be a bonus.

KEY RESPONSIBILITIES:

Understand the factories , manufacturing process , data availability and avenues for improvement

Brainstorm , together with engineering, manufacturing and quality problems that can be solved using the acquired data in the data lake platform.

Define what data is required to create a solution and work with connectivity engineers , users to collect the data

Create and maintain optimal data pipeline architecture.

Assemble large, complex data sets that meet functional / non-functional business requirements.

Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery for greater scalability

Work on data preparation, data deep dive , help engineering, process and quality to understand the process/ machine behavior more closely using available data

Deploy and monitor the solution

Work with data and analytics experts to strive for greater functionality in our data systems.

Work together with Data Architects and data modeling teams.

SKILLS /COMPETENCIES

Good knowledge of the business vertical with prior experience in solving different use cases in the manufacturing or similar industry

Ability to bring cross industry learning to benefit the use cases aimed at improving manufacturing process

Problem Scoping/definition Skills:

Experience in problem scoping, solving, quantification

Strong analytic skills related to working with unstructured datasets.

Build processes supporting data transformation, data structures, metadata, dependency and workload management.

Working knowledge of message queuing, stream processing, and highly scalable ‘big data’ data stores

Ability to foresee and identify all right data required to solve the problem

Data Wrangling Skills:

Strong skill in data mining, data wrangling techniques for creating the required analytical dataset

Experience building and optimizing ‘big data’ data pipelines, architectures and data sets

Adaptive mindset to improvise on the data challenges and employ techniques to drive desired outcomes

Programming Skills:

Experience with big data tools: Spark,Delta,CDC,NiFi, Kafka, etc

Experience with relational SQL ,NoSQL databases and query languages, including oracle , Hive, sparkQL.

Experience with object-oriented languages: Scala, Java, C++ etc.

Visualization Skills

Know how of any visualization tools such as PowerBI, Tableau

Good storytelling skills to present the data in simple and meaningful manner

Data Engineering Skills

Strong skill in data analysis techniques to generate finding and insights by means of exploratory data analysis

Good understanding of how to transform and connect the data of various types and form

Great numerical and analytical skills

Identify opportunities for data acquisition

Explore ways to enhance data quality and reliability

Build algorithms and prototypes

Reformulating existing frameworks to optimize their functioning.

Good understanding of optimization techniques to make the system performant for requirements.

About Mindteck

Join Us We are a growth-oriented company that needs the valuable contributions from you to join our team.

While others say it, we do it: We Care. We have helped thousands of talented individuals carve out their role and have a healthy work-life balance.

Just like life, you will experience a good mix of challenges and opportunities. But we will be rooting for you along the way.

Apply Today

Presently, Mindteck employs over 1,000 individuals throughout offices in:

- India- UK & Europe- US & Canada- Singapore & Malaysia- Middle East

It also has four development centers (US, Singapore and India (Kolkata, Bangalore)).

The company is listed on the Bombay Stock Exchange (BSE 517344) and is among a select group of global companies appraised at Maturity Level 5, Version 1.3 of the CMMI Institute’s Capability Maturity Model Integration (CMMI)

Mindteck is an Equal Employment Opportunity (EEO). All qualified applicants will receive consideration for employment without regard to race, religion, color, national origin, sex, sexual orientation, gender identity, age, status as a protected veteran, status as a qualified individual with a disability, or any other trait protected by law

  • Data Warehouse Engineer | Data Warehouse Engineer | delhi

    1 month ago

    delhi, India Data Warehouse Engineer Full time

    Experience : 2- 5 YearsPrimary Skills : Strong SQL knowledge, Data warehouse concepts and ETL hands on experience, Azure services like Data Factory, Azure Data Lake, and Good analysis skills.Good to have skills: Power BI, Databricks, Python.

  • Data Warehouse Engineer

    1 month ago

    Delhi, India Data Warehouse Engineer Full time

    Experience : 2- 5 YearsPrimary Skills : Strong SQL knowledge, Data warehouse concepts and ETL hands on experience, Azure services like Data Factory, Azure Data Lake, and Good analysis skills.Good to have skills: Power BI, Databricks, Python.

  • Wavicle Data Solutions | Senior Data Scientist

    3 weeks ago

    delhi, India Wavicle Data Solutions Full time

    Job Title: Senior Data Scientist We are seeking a highly skilled Senior Data Scientist with expertise in Generative AI, machine learning, and advanced data science techniques to join our dynamic team. This role involves collaborating with cross-functional teams to develop and deploy scalable AI solutions, driving innovation and business...

  • Senior Data Engineer

    3 weeks ago

    Delhi, India Rakuten Symphony Full time

    Job Title: Senior Data Engineer Location: Bangalore, IndiaCompany: Rakuten Symphony, IndiaOverviewRakuten Symphony is seeking an experienced and strategic Head/Senior Data Engineer to lead our data engineering initiatives and transform mobile connectivity through innovative data solutions. This senior leadership role requires deep expertise in...

  • Data Engineer

    2 weeks ago

    Delhi, India Pacific Data Integrators Full time

    Job OverviewWe are seeking a skilledData Engineerto join our team. In this role, you will be responsible for managing and optimizing data pipelines, ensuring the seamless movement of data across systems, and supporting data initiatives through strong technical expertise. The ideal candidate will be proficient in SQL and Python, with hands-on experience in MS...

  • Data Engineer

    2 weeks ago

    Delhi, India Pacific Data Integrators Full time

    Job OverviewWe are seeking a skilled Data Engineer to join our team. In this role, you will be responsible for managing and optimizing data pipelines, ensuring the seamless movement of data across systems, and supporting data initiatives through strong technical expertise. The ideal candidate will be proficient in SQL and Python, with hands-on experience...

  • ITI Data | PySpark Data Engineer

    3 weeks ago

    delhi, India ITI Data Full time

    Location : IndiaType : Full-timeExperience : 10 – 13 yearsFunctions : Consulting, Finance, Information Technology, Big Data EngineeringIndustries : Capital Markets, Investment Banking, Alternative Investments, Financial Services, Management Consulting, Information Technology and Services, HealthcareJob DescriptionWe are looking for a PySpark...

  • Pyspark data engineer

    3 weeks ago

    Delhi, India ITI Data Full time

    Location : IndiaType : Full-timeExperience : 10 – 13 yearsFunctions : Consulting, Finance, Information Technology, Big Data EngineeringIndustries : Capital Markets, Investment Banking, Alternative Investments, Financial Services, Management Consulting, Information Technology and Services, HealthcareJob DescriptionWe are looking for a Py Spark...

  • PySpark Data Engineer

    3 weeks ago

    Delhi, India ITI Data Full time

    Location : IndiaType : Full-timeExperience : 10 – 13 yearsFunctions : Consulting, Finance, Information Technology, Big Data EngineeringIndustries : Capital Markets, Investment Banking, Alternative Investments, Financial Services, Management Consulting, Information Technology and Services, HealthcareJob DescriptionWe are looking for a PySpark...

  • Senior Data Engineer

    2 weeks ago

    Delhi, India Trek Health Full time

    Company DescriptionTrek Health is revolutionizing healthcare with its Payer Price Transparency Analytics Platform. Our solutions offer payer-provider price transparency insights and analytics. We take pride in ingesting and processsing multi-terabytes of data every month and provide actionable insights to our customers. The company is backed by $3M seed...

  • Senior Data Engineering Expert

    1 week ago

    Delhi, Delhi, India Huptech HR Solutions Full time

    Job Title: Senior Data Engineering ExpertWe are seeking a highly skilled Senior Data Engineering Expert to join our team at Huptech HR Solutions.

  • Data Platform Engineer

    3 weeks ago

    Delhi, India OSD Data Services Full time

    Data Platform EngineerLocation: RemoteType: InternshipAbout UsAt OSD Data, we’re redefining how businesses leverage their data. Our mission is to empower organizations with a seamless, unified, and scalable data infrastructure that enables smarter decision-making and faster innovation. With a focus on data lakehouse technologies, we’ve built a...

  • Data platform engineer

    3 weeks ago

    Delhi, India OSD Data Services Full time

    Data Platform Engineer Location : RemoteType : InternshipAbout Us At OSD Data, we’re redefining how businesses leverage their data. Our mission is to empower organizations with a seamless, unified, and scalable data infrastructure that enables smarter decision-making and faster innovation. With a focus on data lakehouse technologies, we’ve...

  • Senior Data Engineer

    3 days ago

    Delhi, Delhi, India DigitalTek Solutions Full time

    Company OverviewDigitalTek Solutions is a trusted provider of managed services, staff augmentation, and IT consulting with over a decade of expertise. We specialize in connecting top talent with opportunities in the IT, Engineering, and Digital sectors.About the RoleWe are seeking a highly skilled Senior Data Engineer to design, develop, and maintain...

  • Data Platform Engineer

    3 weeks ago

    Delhi, India OSD Data Services Full time

    Data Platform EngineerLocation : RemoteType : InternshipAbout UsAt OSD Data, we’re redefining how businesses leverage their data. Our mission is to empower organizations with a seamless, unified, and scalable data infrastructure that enables smarter decision-making and faster innovation. With a focus on data lakehouse technologies, we’ve built a...

  • Senior AI and Data Engineer

    3 weeks ago

    Delhi, Delhi, India LTIMindtree Full time

    Job Title: Senior AI and Data EngineerWe are seeking a highly skilled Senior AI and Data Engineer to join our team at LTIMindtree. The successful candidate will have experience in developing and deploying machine learning models, as well as a strong understanding of data engineering principles.About the Role:This is an exciting opportunity for a motivated...

  • Senior Data Engineering Manager

    2 weeks ago

    Delhi, Delhi, India TwinPacs Sdn Bhd Full time

    Job Title: Senior Data Engineering ManagerWe are seeking an experienced Senior Data Engineering Manager to oversee our data engineering efforts and lead a team of talented engineers.About TwinPacs Sdn Bhd:TwinPacs Sdn Bhd is a cutting-edge technology company that needs a highly skilled Senior Data Engineering Manager with a strong background in data...

  • AWS Data Engineer

    4 months ago

    Delhi, India ITI Data Full time

    Job DescriptionWe are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources. There...

  • AWS Data Engineer

    2 months ago

    delhi, India ITI Data Full time

    Job DescriptionWe are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources. There...

  • Aws data engineer

    2 months ago

    Delhi, India ITI Data Full time

    Job DescriptionWe are looking for an AWS Data with primary skills on Py Spark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources....