Senior Data Engineer

3 months ago

Nellore, India Mindteck Full time

Senior Data Engineer (Scala)


Details below:

Location: India (WFH)

Mode: Permanent

Must: Immediate - 30 days

3x headcounts in 10+ yrs band (should be flexible for IST and Europe Time Zone)

Salary: INR 24-28 LPA

Interview rounds: 2 or 3


Job Description:

Primarily experts of Spark 3.X, SCALA, Delta lake implementation, streaming solution implementation for IOT in Spark streaming. Kafka expertise.

Any experience with MFG BI, DWH and Datalake implementation would be a bonus.


KEY RESPONSIBILITIES:

Understand the factories , manufacturing process , data availability and avenues for improvement

Brainstorm , together with engineering, manufacturing and quality problems that can be solved using the acquired data in the data lake platform.

Define what data is required to create a solution and work with connectivity engineers , users to collect the data

Create and maintain optimal data pipeline architecture.

Assemble large, complex data sets that meet functional / non-functional business requirements.

Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery for greater scalability

Work on data preparation, data deep dive , help engineering, process and quality to understand the process/ machine behavior more closely using available data

Deploy and monitor the solution

Work with data and analytics experts to strive for greater functionality in our data systems.

Work together with Data Architects and data modeling teams.


SKILLS /COMPETENCIES

Good knowledge of the business vertical with prior experience in solving different use cases in the manufacturing or similar industry

Ability to bring cross industry learning to benefit the use cases aimed at improving manufacturing process

Problem Scoping/definition Skills:

Experience in problem scoping, solving, quantification

Strong analytic skills related to working with unstructured datasets.

Build processes supporting data transformation, data structures, metadata, dependency and workload management.

Working knowledge of message queuing, stream processing, and highly scalable ‘big data’ data stores

Ability to foresee and identify all right data required to solve the problem

Data Wrangling Skills:

Strong skill in data mining, data wrangling techniques for creating the required analytical dataset

Experience building and optimizing ‘big data’ data pipelines, architectures and data sets

Adaptive mindset to improvise on the data challenges and employ techniques to drive desired outcomes

Programming Skills:

Experience with big data tools: Spark,Delta,CDC,NiFi, Kafka, etc

Experience with relational SQL ,NoSQL databases and query languages, including oracle , Hive, sparkQL.

Experience with object-oriented languages: Scala, Java, C++ etc.

Visualization Skills

Know how of any visualization tools such as PowerBI, Tableau

Good storytelling skills to present the data in simple and meaningful manner

Data Engineering Skills

Strong skill in data analysis techniques to generate finding and insights by means of exploratory data analysis

Good understanding of how to transform and connect the data of various types and form

Great numerical and analytical skills

Identify opportunities for data acquisition

Explore ways to enhance data quality and reliability

Build algorithms and prototypes

Reformulating existing frameworks to optimize their functioning.

Good understanding of optimization techniques to make the system performant for requirements.


About Mindteck

Join Us We are a growth-oriented company that needs the valuable contributions from you to join our team.

While others say it, we do it: We Care. We have helped thousands of talented individuals carve out their role and have a healthy work-life balance.

Just like life, you will experience a good mix of challenges and opportunities. But we will be rooting for you along the way.


Apply Today


Presently, Mindteck employs over 1,000 individuals throughout offices in:

  • India
  • UK & Europe
  • US & Canada
  • Singapore & Malaysia
  • Middle East

It also has four development centers (US, Singapore and India [Kolkata, Bangalore]).

The company is listed on the Bombay Stock Exchange (BSE 517344) and is among a select group of global companies appraised at Maturity Level 5, Version 1.3 of the CMMI Institute’s Capability Maturity Model Integration (CMMI) www.Mindteck.com

Mindteck is an Equal Employment Opportunity (EEO). All qualified applicants will receive consideration for employment without regard to race, religion, color, national origin, sex, sexual orientation, gender identity, age, status as a protected veteran, status as a qualified individual with a disability, or any other trait protected by law

  • Cloud Data Engineer

    5 days ago

    Nellore, India Bison Global Technology Search Full time

    Cloud Data Engineer is required - 100% Remote working IMMEDIATE JOINER REQUIREDCloud Data Engineer is required ASAPWith a strong background in AWS, Azure, and GCP the ideal candidate will have extensive experience with cloud-native ETL tools such as AWS DMS, AWS Glue, Kafka, Azure Data Factory, GCP Dataflow, and other ETL tools like Informatica, SAP Data...

  • Cloud Data Engineer

    2 weeks ago

    Nellore, India Bison Global Technology Search Full time

    Cloud Data Engineer is required - 100% Remote working With a strong background in AWS, Azure, and GCP the ideal candidate will have extensive experience with cloud-native ETL tools such as AWS DMS, AWS Glue, Kafka, Azure Data Factory, GCP Dataflow, and other ETL tools like Informatica, SAP Data Intelligence, etc.You will be responsible for designing,...

  • Cloud Data Engineer

    5 hours ago

    Nellore, India Bison Global Technology Search Full time

    Cloud Data Engineer is required - 100% Remote working IMMEDIATE JOINER REQUIREDCloud Data Engineer is required ASAPWith a strong background in AWS, Azure, and GCP the ideal candidate will have extensive experience with cloud-native ETL tools such as AWS DMS, AWS Glue, Kafka, Azure Data Factory, GCP Dataflow, and other ETL tools like Informatica, SAP Data...

  • Senior Data Engineer

    3 weeks ago

    Nellore, India thinkbridge Full time

    We are seeking a skilled Senior Data Engineer with 4-6 years of experience specializing in modern data platforms such as Snowflake, Azure Data Factory (ADF) OR AWS Redshift to join our dynamic team. The ideal candidate will be responsible for designing, developing, and maintaining scalable data pipelines, ensuring the efficient flow of data across the...

  • Senior Machine Learning Engineer

    3 days ago

    Nellore, Andhra Pradesh, India exphilnerd Full time

    About exphilnerdWe are a pioneering company in the Nordics, dedicated to developing innovative solutions for machine learning and computational linguistics.Our mission is to build a smart mentor for students, leveraging cutting-edge technologies to drive growth and excellence in our technical efforts.Job SummaryThis role is an exciting opportunity for a...

  • Senior AI Engineer

    2 weeks ago

    Nellore, Andhra Pradesh, India Hyqoo Full time

    We are seeking a highly skilled Senior AI Engineer with expertise in cloud computing and natural language processing to join our team at Hyqoo. This role offers a unique opportunity to design, develop, and deploy cutting-edge AI solutions using the latest technologies and frameworks.Job SummaryThe successful candidate will have 4+ years of hands-on...

  • Senior Data Scientist

    4 weeks ago

    Nellore, India algoleap Full time

    Algoleap is one of the fastest growing digital engineering services company based out of Hyderabad working with many fortune 1000 customers in transforming their digital landscape. At Algoleap, we believe that a truly innovative and successful workplace is one where diversity, equity, and inclusion thrive. We are dedicated to building a team that celebrates...

  • Senior Software Test Engineer

    1 month ago

    Nellore, India Recro Full time

    Role – Senior Test EngineerMode:- Full TimeMust have skills : Agile Methodology, STLC , API testing ,Test management tool like Q-test , HP-ALM, JIRA, ZephyrGood if these skills : ETL, Kafka , Mongo DB or Sql, azure data lakesExp - 4 - 7yearsLocation: Bangalore/Hyderabad/NoidaNOTE: Candidates should be available for one round of F2F interview in...

  • Senior AI Software Engineer

    2 weeks ago

    Nellore, Andhra Pradesh, India Hyqoo Full time

    Job DescriptionWe are seeking a highly skilled Senior AI Software Engineer to join our team at Hyqoo. The ideal candidate will have experience in designing, developing, and implementing AI solutions using GenAI capabilities to automate tasks, generate content, and enhance existing applications.The successful candidate will design, develop, and deploy AI and...

  • Fluidech | Senior DevSecOps Engineer

    3 weeks ago

    Nellore, India Fluidech Full time

    Job Title: Senior DevSecOps Engineer (with Terraform experience)Company Profile:Fluidech is a technology consulting and managed services firm specializing in cloud and on-premise infrastructure, automation (DevOps and RPA), and cybersecurity. Our name, 'Fluidech,' reflects our approach—blending 'fluid' with 'technology' to highlight our adaptable and...

  • Senior Audio Driver Engineer for Semiconductor Innovation

    3 weeks ago

    Nellore, Andhra Pradesh, India Mulya Technologies Full time

    Job Title: Senior Audio Driver EngineerWe are seeking a highly skilled Senior Audio Driver Engineer to join our team at Mulya Technologies. This is an excellent opportunity for experienced professionals to work on cutting-edge audio driver development for semiconductor products.About the Role:Design, develop, and maintain efficient and reliable windows/linux...

  • Cloud Data Engineer

    4 weeks ago

    Nellore, Andhra Pradesh, India Birlasoft Full time

    About BirlasoftWe are a powerhouse where domain expertise, enterprise solutions, and digital technologies converge to redefine business processes. Our consultative and design thinking approach drives societal progress by enabling our customers to run businesses with unmatched efficiency and innovation.As part of the CK Birla Group, a multibillion-dollar...

  • PySpark Data Architect Lead

    4 days ago

    Nellore, Andhra Pradesh, India Edstem Technologies Full time

    Job Description:We are seeking a highly skilled Pyspark Data Architect Lead to join our team at Edstem Technologies. As a key member of our data engineering team, you will be responsible for designing and implementing scalable, robust, and efficient data pipelines to enable data-driven decision making.The ideal candidate will have a strong background in data...

  • Senior Architectural Project Manager

    3 weeks ago

    Nellore, Andhra Pradesh, India Yogayatan Group Full time

    Company Overview:Yogayatan Group is a leading architectural firm seeking an experienced Senior Architectural Project Manager to oversee multiple high-quality projects. This role requires strong leadership, design expertise, and excellent communication skills.About the Role:We are offering a competitive salary of ₹30 lakhs - ₹50 lakhs per annum for this...

  • Full Stack Engineer

    4 weeks ago

    Nellore, India Community Hub Full time

    Community Hub creates software products that foster stronger, more sustainable, and more resilient connections among people and the natural systems upon which we depend. Our award-winning communications platform uses sophisticated data acquisition and visualization applications to simplify complexity and share the wisdom of community-focused solutions....

  • Senior Automation Solutions Architect

    2 weeks ago

    Nellore, Andhra Pradesh, India Collabera Digital Full time

    Job Title: Senior Automation Solutions ArchitectLocation: Remote, IndiaAbout the Role:We are seeking an experienced Automation Developer to join our team as a Senior Automation Solutions Architect. In this role, you will design and develop process automation solutions using UiPath and Blue Prism.Key Responsibilities:Design and implement robust, secure, and...

  • Highly Skilled PySpark Data Architect

    4 days ago

    Nellore, Andhra Pradesh, India Edstem Technologies Full time

    At Edstem Technologies, we are seeking a highly skilled Pyspark Data Architect to join our team. This role is ideal for an experienced data professional who can design and build scalable, efficient data pipelines.Role OverviewThe successful candidate will work collaboratively with the Data Science and Analytics teams to build robust data architectures that...

  • Data Scientist

    2 months ago

    Nellore, India Tata Consultancy Services Full time

    Role-Data ScientistExp-6-8 yearsLocation-PAN IndiaMust-Have**(Ideally should not be more than 3-5) Strong knowledge in NLP, Gen AI, Deep learning, big data processingStrong experience with SQL and pythonGood-to-HaveSNResponsibility of / Expectations from the Role 3+ years’ experience with SQL and pythonStrong knowledge of machine learning algorithms,...

  • Credit Data Scientist

    4 weeks ago

    Nellore, India Discoveries Quintessential Full time

    Job Title: Credit Data Scientist & AnalyticsLocation: Jakarta, IndonesiaAbout the RoleJoin an innovative team driving growth by building credit models for groundbreaking products in Southeast Asia. This role involves developing advanced solutions, collaborating across teams, and solving complex problems to create cutting-edge credit products. Ideal for...

  • Senior Network Voice Systems Engineer

    3 weeks ago

    Nellore, Andhra Pradesh, India Tata Consultancy Services Full time

    About the Job">Tata Consultancy Services is seeking a highly skilled Senior Network Voice Systems Engineer to join our team. As a key member of our network engineering group, you will be responsible for designing and implementing SBC related network changes, resolving complex issues, and ensuring seamless integration with SIP-based service load balance and...