Senior Data Engineer

1 month ago

Thiruvananthapuram, India NeoITO Full time

We are seeking an experienced Data Engineer with 3+ years of hands-on experience in designing, building, and maintaining scalable data infrastructure. The ideal candidate will have deep expertise in the Python stack and be skilled in building robust data pipelines, working with large datasets, and optimizing data architectures to support advanced analytics and business needs.


Experience with Databricks and Cloud-based data platforms is highly desirable.


If you’re passionate about data engineering, automation, and continuous improvement, we’d love to hear from you


Key Responsibilities:


  • Design, develop, and maintain scalable ETL pipelines to ingest, clean, and transform large datasets for analytics and business applications.
  • Implement data integration solutions using Python and frameworks such as Pandas , NumPy , and Django or Flask for API development.
  • Build and optimize databases, working with both relational databases (e.g., MSSQL , MySQL ) and NoSQL databases (e.g., MongoDB ) to manage structured and unstructured data.
  • Develop automation scripts using Python and Selenium for data extraction and workflow automation.
  • Collaborate with data scientists, analysts, and other stakeholders to ensure the data infrastructure supports business and analytical needs.
  • Design and develop scalable data processing workflows using Databricks to transform and analyse large datasets efficiently.
  • Ensure data quality by developing and performing unit testing, implementing data validation processes, and optimizing performance.
  • Work with cloud platforms (AWS , Azure , GCP ) and Databricks for managing data storage and processing solutions as needed.
  • Monitor, troubleshoot, and optimize data pipelines to ensure high availability and performance.
  • Employ best practices in software development (version control, code reviews, Agile methodologies) to ensure code reliability and scalability.
  • Stay up-to-date with the latest industry trends in data engineering and actively suggest improvements to existing processes and infrastructure.


Required Skills and Qualifications:


  • Professional experience as a Data Engineer or in a similar role.
  • Proficient in Python , with experience in libraries such as Pandas , NumPy , and other data manipulation tools.
  • Strong experience with ETL processes : design, implementation, and optimization of data pipelines.
  • Expertise in working with relational databases (MSSQL , MySQL ) and NoSQL databases (MongoDB ).
  • Hands-on experience with Databricks for scalable data processing and analytics.
  • Solid experience in API development using frameworks like Django or Flask .
  • Hands-on experience with data automation tools such as Selenium .
  • In-depth knowledge of Object-Oriented Programming (OOP) and software design principles.
  • Experience with version control systems like Git for collaborative development.
  • Strong problem-solving skills and attention to detail, ensuring data accuracy and reliability.
  • Familiarity with cloud data platforms (AWS , GCP , or Azure ) for data storage and processing.


Join us in building a data-driven future by enabling efficient, scalable, and automated data pipelines, empowering our organization to make informed business decisions with speed and accuracy

  • Senior Data Engineer

    4 weeks ago

    Thiruvananthapuram, Kerala, India Techvantage Analytics Full time

    Job DescriptionAt Techvantage Analytics, we are seeking a highly skilled Senior Data Engineer to join our team. The ideal candidate will have expertise in designing, implementing, and maintaining data solutions on the Microsoft Azure Data platform and SQL Server.The Senior Data Engineer will be responsible for collaborating with various stakeholders,...

  • Data Engineer

    5 days ago

    Thiruvananthapuram, India Alp Consulting Ltd. Full time

    Job Summary: As a Senior DBT/Azure Data Engineer, you will play a pivotal role in designing, implementing, and optimizing data transformation pipelines within the Azure cloud environment or GCP Cloud environment using DBT (Data Build Tool). Your extensive experience in Azure services and data warehousing will enable you to deliver robust and scalable data...

  • Data Engineer

    5 days ago

    Thiruvananthapuram, India Alp Consulting Ltd. Full time

    Job Summary: As a Senior DBT/Azure Data Engineer, you will play a pivotal role in designing, implementing, and optimizing data transformation pipelines within the Azure cloud environment or GCP Cloud environment using DBT (Data Build Tool). Your extensive experience in Azure services and data warehousing will enable you to deliver robust and scalable data...

  • Data Engineer

    5 days ago

    Thiruvananthapuram, India Alp Consulting Ltd. Full time

    Job Summary: As a Senior DBT/Azure Data Engineer, you will play a pivotal role in designing, implementing, and optimizing data transformation pipelines within the Azure cloud environment or GCP Cloud environment using DBT (Data Build Tool). Your extensive experience in Azure services and data warehousing will enable you to deliver robust and scalable data...

  • Data Engineer

    4 days ago

    Thiruvananthapuram, India Alp Consulting Ltd. Full time

    Job Summary: As a Senior DBT/Azure Data Engineer, you will play a pivotal role in designing, implementing, and optimizing data transformation pipelines within the Azure cloud environment or GCP Cloud environment using DBT (Data Build Tool). Your extensive experience in Azure services and data warehousing will enable you to deliver robust and scalable data...

  • Senior Data Lead

    4 weeks ago

    Thiruvananthapuram, Kerala, India Scipy Technologies Full time

    We are seeking a Senior Data Lead to spearhead our data analytics team at Scipy Technologies. As a key member of our team, you will leverage your expertise in data science to drive business growth through data-driven insights. Your role will involve leading the development of predictive models and machine learning algorithms, designing and implementing data...

  • Senior Data Engineer

    1 month ago

    Thiruvananthapuram, India NeoITO Full time

    We are seeking an experienced Data Engineer with 3+ years of hands-on experience in designing, building, and maintaining scalable data infrastructure. The ideal candidate will have deep expertise in the Python stack and be skilled in building robust data pipelines, working with large datasets, and optimizing data architectures to support advanced...

  • Senior data engineer

    1 month ago

    Thiruvananthapuram, India NeoITO Full time

    We are seeking an experienced Data Engineer with 3+ years of hands-on experience in designing, building, and maintaining scalable data infrastructure. The ideal candidate will have deep expertise in the Python stack and be skilled in building robust data pipelines, working with large datasets, and optimizing data architectures to support advanced...

  • Senior Data Engineer

    3 weeks ago

    thiruvananthapuram, India NeoITO Full time

    We are seeking an experienced Data Engineer with 3+ years of hands-on experience in designing, building, and maintaining scalable data infrastructure. The ideal candidate will have deep expertise in the Python stack and be skilled in building robust data pipelines, working with large datasets, and optimizing data architectures to support advanced analytics...

  • Senior Data Analyst

    3 weeks ago

    Thiruvananthapuram, Kerala, India Scipy Technologies Full time

    We are looking for a Senior Data Scientist to lead our data analytics team at Scipy Technologies. In this role, you will apply your expertise in data science to solve challenging problems in the healthcare sector.You will work on projects that involve predictive modeling, data mining, and algorithm development, with a focus on improving patient outcomes and...

  • Senior Data Engineer

    1 month ago

    Thiruvananthapuram, India NeoITO Full time

    We are seeking an experienced Data Engineer with 3+ years of hands-on experience in designing, building, and maintaining scalable data infrastructure. The ideal candidate will have deep expertise in the Python stack and be skilled in building robust data pipelines, working with large datasets, and optimizing data architectures to support advanced analytics...

  • Senior Data Engineer

    1 month ago

    Thiruvananthapuram, India NeoITO Full time

    We are seeking an experienced Data Engineer with 3+ years of hands-on experience in designing, building, and maintaining scalable data infrastructure. The ideal candidate will have deep expertise in the Python stack and be skilled in building robust data pipelines, working with large datasets, and optimizing data architectures to support advanced analytics...

  • Senior Data Engineer

    1 month ago

    thiruvananthapuram, India NeoITO Full time

    We are seeking an experienced Data Engineer with 3+ years of hands-on experience in designing, building, and maintaining scalable data infrastructure. The ideal candidate will have deep expertise in the Python stack and be skilled in building robust data pipelines, working with large datasets, and optimizing data architectures to support advanced analytics...

  • Databricks Senior Data Engineer

    3 weeks ago

    Thiruvananthapuram, India Luxoft Full time

    Project descriptionWe are hiring for projects in the Middle East. The team comprises front-end and back-end developers, data analysts and data scientists, architects, analysts, and project managers. You will work with modern technologies and be an integral part of continuing to evolve our high-performing platforms. If you are serious about being a part of...

  • Senior Software Engineer

    4 weeks ago

    Thiruvananthapuram, Kerala, India QBurst Full time

    Job Title: Senior Software EngineerAbout the Role:We are seeking a skilled Senior Software Engineer to join our team at QBurst. As a Senior Software Engineer, you will be responsible for designing and developing cloud-based applications using Java and microservices architecture.Key Responsibilities:Design and develop RESTful APIs with a focus on scalability,...

  • Senior Cybersecurity Engineer

    1 month ago

    Thiruvananthapuram, Kerala, India Guidehouse Full time

    Job Summary:Guidehouse is seeking a highly skilled Senior Cybersecurity Engineer to join our team. As a Senior Cybersecurity Engineer, you will be responsible for designing and implementing secure cloud solutions using AWS. You will work closely with our team to identify and mitigate security risks, ensuring the confidentiality, integrity, and availability...

  • Senior Data Engineer

    5 days ago

    Thiruvananthapuram, India Zeno Health Full time

    Job Description:We are seeking a highly skilled Lead Data Engineer with a strong background in Python, SQL, and modern big data technologies. The ideal candidate will have a proven track record in designing and implementing scalable data pipelines, managing ETL processes, and leveraging diverse data storage and processing frameworks, including relational and...

  • Alp Consulting Ltd. | Data Engineer | thiruvananthapuram

    4 days ago

    thiruvananthapuram, India Alp Consulting Ltd. Full time

    Job Summary: As a Senior DBT/Azure Data Engineer, you will play a pivotal role in designing, implementing, and optimizing data transformation pipelines within the Azure cloud environment or GCP Cloud environment using DBT (Data Build Tool). Your extensive experience in Azure services and data warehousing will enable you to deliver robust and scalable data...

  • Alp Consulting Ltd. | Data Engineer | thiruvananthapuram

    4 days ago

    thiruvananthapuram, India Alp Consulting Ltd. Full time

    Job Summary: As a Senior DBT/Azure Data Engineer, you will play a pivotal role in designing, implementing, and optimizing data transformation pipelines within the Azure cloud environment or GCP Cloud environment using DBT (Data Build Tool). Your extensive experience in Azure services and data warehousing will enable you to deliver robust and scalable data...

  • Senior Software Engineer

    3 months ago

    Thiruvananthapuram, India Waybeo Software Solutions Pvt Ltd Full time

    We are looking to hire a dynamic Senior Software Engineer in PHP to manage our back-end services and ensure a seamless interchange of data between the server and our users. As a Senior Software Engineer, you will be responsible for developing and coding all server-side logic. You will also be required to maintain the central database and respond to requests...