Senior Data Engineer

2 months ago

Thiruvananthapuram, India NeoITO Full time

We are seeking an experienced Data Engineer with 3+ years of hands-on experience in designing, building, and maintaining scalable data infrastructure. The ideal candidate will have deep expertise in the Python stack and be skilled in building robust data pipelines, working with large datasets, and optimizing data architectures to support advanced analytics and business needs.


Experience with Databricks and Cloud-based data platforms is highly desirable.


If you’re passionate about data engineering, automation, and continuous improvement, we’d love to hear from you


Key Responsibilities:


  • Design, develop, and maintain scalable ETL pipelines to ingest, clean, and transform large datasets for analytics and business applications.
  • Implement data integration solutions using Python and frameworks such as Pandas , NumPy , and Django or Flask for API development.
  • Build and optimize databases, working with both relational databases (e.g., MSSQL , MySQL ) and NoSQL databases (e.g., MongoDB ) to manage structured and unstructured data.
  • Develop automation scripts using Python and Selenium for data extraction and workflow automation.
  • Collaborate with data scientists, analysts, and other stakeholders to ensure the data infrastructure supports business and analytical needs.
  • Design and develop scalable data processing workflows using Databricks to transform and analyse large datasets efficiently.
  • Ensure data quality by developing and performing unit testing, implementing data validation processes, and optimizing performance.
  • Work with cloud platforms (AWS , Azure , GCP ) and Databricks for managing data storage and processing solutions as needed.
  • Monitor, troubleshoot, and optimize data pipelines to ensure high availability and performance.
  • Employ best practices in software development (version control, code reviews, Agile methodologies) to ensure code reliability and scalability.
  • Stay up-to-date with the latest industry trends in data engineering and actively suggest improvements to existing processes and infrastructure.


Required Skills and Qualifications:


  • Professional experience as a Data Engineer or in a similar role.
  • Proficient in Python , with experience in libraries such as Pandas , NumPy , and other data manipulation tools.
  • Strong experience with ETL processes : design, implementation, and optimization of data pipelines.
  • Expertise in working with relational databases (MSSQL , MySQL ) and NoSQL databases (MongoDB ).
  • Hands-on experience with Databricks for scalable data processing and analytics.
  • Solid experience in API development using frameworks like Django or Flask .
  • Hands-on experience with data automation tools such as Selenium .
  • In-depth knowledge of Object-Oriented Programming (OOP) and software design principles.
  • Experience with version control systems like Git for collaborative development.
  • Strong problem-solving skills and attention to detail, ensuring data accuracy and reliability.
  • Familiarity with cloud data platforms (AWS , GCP , or Azure ) for data storage and processing.


Join us in building a data-driven future by enabling efficient, scalable, and automated data pipelines, empowering our organization to make informed business decisions with speed and accuracy

  • Senior Data Engineer

    3 weeks ago

    Thiruvananthapuram, India Trek Health Full time

    Company DescriptionTrek Health is revolutionizing healthcare with its Payer Price Transparency Analytics Platform. Our solutions offer payer-provider price transparency insights and analytics. We take pride in ingesting and processsing multi-terabytes of data every month and provide actionable insights to our customers. The company is backed by $3M seed...

  • Senior Data Engineer

    3 weeks ago

    Thiruvananthapuram, Kerala, India Quantiphi Full time

    Quantiphi is an award-winning AI-first digital transformation engineering company driven by the desire to solve complex business problems. We are passionate about our customers and obsessed with problem-solving. Our team solves clients' toughest challenges by combining deep industry experience, disciplined cloud and data-engineering practices, and...

  • Data Engineer

    2 months ago

    Thiruvananthapuram, India Alp Consulting Ltd. Full time

    Job Summary: As a Senior DBT/Azure Data Engineer, you will play a pivotal role in designing, implementing, and optimizing data transformation pipelines within the Azure cloud environment or GCP Cloud environment using DBT (Data Build Tool). Your extensive experience in Azure services and data warehousing will enable you to deliver robust and scalable data...

  • Data Engineer

    2 months ago

    Thiruvananthapuram, India Alp Consulting Ltd. Full time

    Job Summary: As a Senior DBT/Azure Data Engineer, you will play a pivotal role in designing, implementing, and optimizing data transformation pipelines within the Azure cloud environment or GCP Cloud environment using DBT (Data Build Tool). Your extensive experience in Azure services and data warehousing will enable you to deliver robust and scalable data...

  • Data Engineer

    2 months ago

    Thiruvananthapuram, India Alp Consulting Ltd. Full time

    Job Summary: As a Senior DBT/Azure Data Engineer, you will play a pivotal role in designing, implementing, and optimizing data transformation pipelines within the Azure cloud environment or GCP Cloud environment using DBT (Data Build Tool). Your extensive experience in Azure services and data warehousing will enable you to deliver robust and scalable data...

  • Data Engineer

    2 months ago

    Thiruvananthapuram, India Alp Consulting Ltd. Full time

    Job Summary: As a Senior DBT/Azure Data Engineer, you will play a pivotal role in designing, implementing, and optimizing data transformation pipelines within the Azure cloud environment or GCP Cloud environment using DBT (Data Build Tool). Your extensive experience in Azure services and data warehousing will enable you to deliver robust and scalable data...

  • Senior Data Engineer

    2 months ago

    Thiruvananthapuram, India NeoITO Full time

    We are seeking an experienced Data Engineer with 3+ years of hands-on experience in designing, building, and maintaining scalable data infrastructure. The ideal candidate will have deep expertise in the Python stack and be skilled in building robust data pipelines, working with large datasets, and optimizing data architectures to support advanced...

  • Senior data engineer

    2 months ago

    Thiruvananthapuram, India NeoITO Full time

    We are seeking an experienced Data Engineer with 3+ years of hands-on experience in designing, building, and maintaining scalable data infrastructure. The ideal candidate will have deep expertise in the Python stack and be skilled in building robust data pipelines, working with large datasets, and optimizing data architectures to support advanced...

  • Senior Data Engineer

    2 months ago

    Thiruvananthapuram, India NeoITO Full time

    We are seeking an experienced Data Engineer with 3+ years of hands-on experience in designing, building, and maintaining scalable data infrastructure. The ideal candidate will have deep expertise in the Python stack and be skilled in building robust data pipelines, working with large datasets, and optimizing data architectures to support advanced analytics...

  • Senior Data Engineer

    2 months ago

    Thiruvananthapuram, India NeoITO Full time

    We are seeking an experienced Data Engineer with 3+ years of hands-on experience in designing, building, and maintaining scalable data infrastructure. The ideal candidate will have deep expertise in the Python stack and be skilled in building robust data pipelines, working with large datasets, and optimizing data architectures to support advanced analytics...

  • Senior Data Engineer

    3 months ago

    thiruvananthapuram, India NeoITO Full time

    We are seeking an experienced Data Engineer with 3+ years of hands-on experience in designing, building, and maintaining scalable data infrastructure. The ideal candidate will have deep expertise in the Python stack and be skilled in building robust data pipelines, working with large datasets, and optimizing data architectures to support advanced analytics...

  • Senior Data Pipeline Developer

    3 weeks ago

    Thiruvananthapuram, Kerala, India Ospyn Technologies Pvt Ltd Full time

    Senior Data Pipeline Developer Job Summary:Ospyn Technologies Pvt Ltd is seeking an experienced Senior Data Pipeline Developer to join our team. The successful candidate will be responsible for designing, developing, and maintaining scalable data pipelines to support data-driven initiatives.Key Responsibilities:Design, develop, and maintain scalable data...

  • Senior data engineer

    4 weeks ago

    Thiruvananthapuram, India Quantiphi Full time

    Company ProfileQuantiphi is an award-winning AI-first digital transformation engineering company driven by the desire to solve transformational problems at the heart of the business. We are passionate about our customers and obsessed with problem-solving. Quantiphi solves our clients’ toughest and most complex business problems by combining deep industry...

  • Transformational Data Engineer

    2 days ago

    Thiruvananthapuram, Kerala, India Quantiphi Full time

    Company OverviewQuantiphi is a pioneering AI-first digital transformation engineering company driven by innovation and excellence. We are passionate about delivering cutting-edge solutions that address complex business challenges at the heart of the industry.About UsWe have been driving 2.5x growth year-over-year since our inception in 2013. Our headquarters...

  • Senior Data Scientist Position

    3 weeks ago

    Thiruvananthapuram, Kerala, India Quantiphi Full time

    Job DescriptionA Senior Data Engineer position has become available at Quantiphi. The ideal candidate will design and implement data solutions using Snowflake as a key platform, optimizing performance and cost.Key responsibilities include writing SQL queries, stored procedures and functions in any of the SQL supported databases, and developing Big Data...

  • Senior Data Scientist

    4 weeks ago

    Thiruvananthapuram, Kerala, India Ellow Full time

    About the Role:Eallow is seeking a highly experienced Senior Machine Learning Engineer with more than 7 years of experience in AI/ML and strong expertise in Google Cloud Platform (GCP) services.As a core member of our team, you will design and implement scalable machine learning solutions in the Health Care Sector while working closely with stakeholders to...

  • Senior Big Data Architect

    3 weeks ago

    Thiruvananthapuram, Kerala, India Quantiphi Full time

    About the JobThe Senior Data Engineer role requires a highly skilled professional with expertise in designing and implementing data pipelines using Snowflake. The ideal candidate will have experience in working on large-scale systems in production environments, with strong leadership qualities to mentor and guide junior team members.The job involves...

  • Quantiphi | Senior Data Engineer

    4 weeks ago

    thiruvananthapuram, India Quantiphi Full time

    Company ProfileQuantiphi is an award-winning AI-first digital transformation engineering company driven by the desire to solve transformational problems at the heart of the business. We are passionate about our customers and obsessed with problem-solving. Quantiphi solves our clients’ toughest and most complex business problems by combining deep industry...

  • Alp Consulting Ltd. | Data Engineer | thiruvananthapuram

    2 months ago

    thiruvananthapuram, India Alp Consulting Ltd. Full time

    Job Summary: As a Senior DBT/Azure Data Engineer, you will play a pivotal role in designing, implementing, and optimizing data transformation pipelines within the Azure cloud environment or GCP Cloud environment using DBT (Data Build Tool). Your extensive experience in Azure services and data warehousing will enable you to deliver robust and scalable data...

  • Quantiphi | Senior Data Engineer

    4 weeks ago

    thiruvananthapuram, India Quantiphi Full time

    Company Profile Quantiphi is an award-winning AI-first digital transformation engineering company driven by the desire to solve transformational problems at the heart of the business. We are passionate about our customers and obsessed with problem-solving. Quantiphi solves our clients’ toughest and most complex business problems by combining deep...