Senior Data Engineer

2 months ago


Trivandrum, India NeoITO Full time
We are seeking an experienced

Data Engineer

with 3+ years of hands-on experience in designing, building, and maintaining scalable data infrastructure. The ideal candidate will have deep expertise in the

Python stack

and be skilled in building robust data pipelines, working with large datasets, and optimizing data architectures to support advanced analytics and business needs.

Experience with

Databricks

and

Cloud-based data platforms

is highly desirable.

If you’re passionate about data engineering, automation, and continuous improvement, we’d love to hear from you

Key Responsibilities:

Design, develop, and maintain scalable

ETL pipelines

to ingest, clean, and transform large datasets for analytics and business applications.Implement data integration solutions using

Python

and frameworks such as

Pandas ,

NumPy , and

Django

or

Flask

for API development.Build and optimize databases, working with both relational databases (e.g.,

MSSQL ,

MySQL ) and NoSQL databases (e.g.,

MongoDB ) to manage structured and unstructured data.Develop automation scripts using

Python

and

Selenium

for data extraction and workflow automation.Collaborate with data scientists, analysts, and other stakeholders to ensure the data infrastructure supports business and analytical needs.Design and develop scalable

data processing workflows using Databricks

to transform and analyse large datasets efficiently.Ensure data quality by developing and performing unit testing, implementing data validation processes, and optimizing performance.Work with cloud platforms ( AWS ,

Azure ,

GCP ) and

Databricks

for managing data storage and processing solutions as needed.Monitor, troubleshoot, and optimize data pipelines to ensure high availability and performance.Employ best practices in software development (version control, code reviews, Agile methodologies) to ensure code reliability and scalability.Stay up-to-date with the latest industry trends in data engineering and actively suggest improvements to existing processes and infrastructure.

Required Skills and Qualifications:

Professional experience as a

Data Engineer

or in a similar role.Proficient in

Python , with experience in libraries such as

Pandas ,

NumPy , and other data manipulation tools.Strong experience with

ETL processes : design, implementation, and optimization of data pipelines.Expertise in working with relational databases ( MSSQL ,

MySQL ) and NoSQL databases ( MongoDB ).Hands-on experience with

Databricks

for scalable data processing and analytics.Solid experience in API development using frameworks like

Django

or

Flask .Hands-on experience with

data automation tools

such as

Selenium .In-depth knowledge of

Object-Oriented Programming (OOP)

and software design principles.Experience with version control systems like

Git

for collaborative development.Strong problem-solving skills and attention to detail, ensuring data accuracy and reliability.Familiarity with

cloud data platforms

( AWS ,

GCP , or

Azure ) for data storage and processing.

Join us in building a data-driven future by enabling efficient, scalable, and automated data pipelines, empowering our organization to make informed business decisions with speed and accuracy


  • Data Engineer

    1 month ago


    Trivandrum, India Alp Consulting Ltd. Full time

    Job Summary:As a Senior DBT/Azure Data Engineer, you will play a pivotal role in designing, implementing, and optimizing data transformation pipelines within the Azure cloud environment or GCP Cloud environment using DBT (Data Build Tool). Your extensive experience in Azure services and data warehousing will enable you to deliver robust and scalable data...

  • Data engineer

    1 month ago


    Trivandrum, India Alp Consulting Ltd. Full time

    Job Summary:As a Senior DBT/Azure Data Engineer, you will play a pivotal role in designing, implementing, and optimizing data transformation pipelines within the Azure cloud environment or GCP Cloud environment using DBT (Data Build Tool). Your extensive experience in Azure services and data warehousing will enable you to deliver robust and scalable data...

  • Senior Data Engineer

    2 months ago


    Trivandrum, India NeoITO Full time

    We are seeking an experienced Data Engineer with 3+ years of hands-on experience in designing, building, and maintaining scalable data infrastructure. The ideal candidate will have deep expertise in the Python stack and be skilled in building robust data pipelines, working with large datasets, and optimizing data architectures to support advanced analytics...

  • Senior data engineer

    3 weeks ago


    Trivandrum, India Quantiphi Full time

    Company Profile Quantiphi is an award-winning AI-first digital transformation engineering company driven by the desire to solve transformational problems at the heart of the business. We are passionate about our customers and obsessed with problem-solving. Quantiphi solves our clients’ toughest and most complex business problems by combining deep...

  • Senior Data Engineer

    4 weeks ago


    Trivandrum, India Quantiphi Full time

    Company Profile Quantiphi is an award-winning AI-first digital transformation engineering company driven by the desire to solve transformational problems at the heart of the business. We are passionate about our customers and obsessed with problem-solving. Quantiphi solves our clients’ toughest and most complex business problems by combining deep...


  • Trivandrum, India Waybeo Software Solutions Pvt Ltd Full time

    We are seeking a highly skilled Senior Software Engineer in PHP to join our dynamic development team. As a Senior Software Engineer in PHP, you will be a key player in the design, development, and maintenance of scalable and efficient web applications. You'll collaborate with cross-functional teams to architect robust systems, write high-quality code, and...

  • DATA PKT Aviation

    3 weeks ago


    Trivandrum, India DATA PKT Aviation (DPPL) Full time

    Job descriptionSenior Lead :If you are highly energetic and looking forward to an aspirational career, come and join us. In this role you will be responsible for project execution and quality control. The level of detail and deliverable requirements will vary depending on client requirements. Moreover, you should be detail-oriented, be a team player, and...


  • Trivandrum, India Terumo Blood And Cell Technologies Full time

    JOB SUMMARY We are looking for a highly skilled and experienced Senior Embedded Systems Engineer to join our dynamic team. In this role, he/ she will: Be responsible for Designing, developing, and maintaining embedded systems and software for medical devices. Work closely with cross-functional teams to ensure the successful integration of hardware and...


  • Trivandrum, India Terumo Blood and Cell Technologies Full time

    JOB SUMMARY We are looking for a highly skilled and experienced Senior Embedded Systems Engineer to join our dynamic team. In this role, he/ she will: Be responsible for Designing, developing, and maintaining embedded systems and software for medical devices. Work closely with cross-functional teams to ensure the successful integration of hardware and...


  • Trivandrum, India Terumo Blood and Cell Technologies Full time

    JOB SUMMARYWe are looking for a highly skilled and experienced Senior Embedded Systems Engineer to join our dynamic team. In this role, he/ she will: Be responsible for Designing, developing, and maintaining embedded systems and software for medical devices. Work closely with cross-functional teams to ensure the successful integration of hardware and...


  • Trivandrum, India Zyoin Group Full time

    Location: Trivandrum Position: Senior Software Engineer Experience: 3-8 years Workplace type: WFO Email ID for CV sharing: Job Description: Develop and maintain desktop applications using C# and. NET (Version: 6 - 8) with a strong focus on the WPF - MVVM framework. Design and implement both front-end and back-end components of...


  • Trivandrum, India NeoITO Full time

    We are seeking a highly skilled Senior Machine Learning Consul with expertise in integrating Language Learning Models (LLMs) into our service offerings. As a service-oriented company, we are committed to providing our clients with cutting-edge AI solutions that leverage the latest advancements in natural language processing. The ideal candidate will lead the...


  • Trivandrum, India NeoITO Full time

    We are seeking a highly skilled Senior Machine Learning Consul with expertise in integrating Language Learning Models (LLMs) into our service offerings. As a service-oriented company, we are committed to providing our clients with cutting-edge AI solutions that leverage the latest advancements in natural language processing. The ideal candidate will lead the...


  • Trivandrum, India NeoITO Full time

    Neo ITO is a leading technology service provider dedicated to delivering innovative AI solutions to our clients. We specialize in harnessing the power of artificial intelligence and machine learning to solve complex business challenges and drive digital transformation across industries. Experience- 5-8 Years Work mode- Hybrid/Remote Position...


  • Trivandrum, India Zyoin Group Full time

    Location: TrivandrumPosition: Senior Software Engineer Experience: 3-8 yearsWorkplace type: WFOEmail ID for CV sharing: shivani.sahu@zyoin.comJob Description:Develop and maintain desktop applications using C# and .NET (Version: 6 - 8) with a strong focus on the WPF - MVVM framework.Design and implement both front-end and back-end components of...


  • Trivandrum, India NeoITO Full time

    NeoITO is a leading technology service provider dedicated to delivering innovative AI solutions to our clients. We specialize in harnessing the power of artificial intelligence and machine learning to solve complex business challenges and drive digital transformation across industries. Experience- 5-8 Years Work mode- Hybrid/Remote Position...


  • Trivandrum, India NeoITO Full time

    NeoITO is a leading technology service provider dedicated to delivering innovative AI solutions to our clients. We specialize in harnessing the power of artificial intelligence and machine learning to solve complex business challenges and drive digital transformation across industries. Experience- 5-8 Years Work mode- Hybrid/Remote Position Overview: We...


  • Trivandrum, India NeoITO Full time

    NeoITO is a leading technology service provider dedicated to delivering innovative AI solutions to our clients. We specialize in harnessing the power of artificial intelligence and machine learning to solve complex business challenges and drive digital transformation across industries.Experience- 5-8 YearsWork mode- Hybrid/RemotePosition Overview:We are...


  • Trivandrum, India NeoITO Full time

    NeoITO is a leading technology service provider dedicated to delivering innovative AI solutions to our clients. We specialize in harnessing the power of artificial intelligence and machine learning to solve complex business challenges and drive digital transformation across industries. Experience- 5-8 Years Work mode- Hybrid/Remote Position...


  • Trivandrum, India NeoITO Full time

    We are seeking a highly skilled Senior Machine Learning Consul with expertise in integrating Language Learning Models (LLMs) into our service offerings. As a service-oriented company, we are committed to providing our clients with cutting-edge AI solutions that leverage the latest advancements in natural language processing. The ideal candidate will lead the...