Current jobs related to Big Data Engineer - Kochi - NOV

  • Data Engineer/Sr. Data Engineer

    3 weeks ago

    Kochi, India Invokhr Full time

    Position: Senior Data Engineer / Data Engineer Desired Experience: 3-8 years You will act as a key member of the Data consulting team, working directly with the partners and senior stakeholders of the clients designing and implementing big data and analytics solutions. Communication and organisation skills are keys for this position, along with a...

  • Data Engineer

    3 months ago

    Kochi, India Invokhr Full time

    Position: Data Engineer Desired Experience: 3-8 years Salary: Best-in-industry You will act as a key member of the Data consulting team, working directly with the partners and senior stakeholders of the clients designing and implementing big data and analytics solutions. Communication and organisation skills are keys for this position, along with a...

  • Sr. Data Engineer

    1 week ago

    Kochi, India Invokhr Full time

    Position: Senior Data Engineer / Data Engineer Desired Experience:6-9 You will act as a key member of the Data consulting team, working directly with the partners and senior stakeholders of the clients designing and implementing big data and analytics solutions. Communication and organisation skills are keys for this position, along with a problem-solution...

  • Azure Databricks Data engineer

    4 weeks ago

    Kochi, India Quess Corp Limited Full time

    Hiring Azure Databricks Data engineer [ 4 - 12 Years]Company Name:- Quess Corp Ltd.Location: Hyderabad/Bangalore/Any location - HybridNotice: Immediate - 15 days is considerable.Interview rounds: 2 VirtualJD:Roke 1: [ 4 - 7 years]Job Summary: As a Azure Databricks Data engineer, you will lead and implement advanced data analytics and engineering solutions...

  • Data Scientist

    3 months ago

    Kochi, India Prevalent AI Full time

    **Company Profile: **Prevalent AI (PAI) is a Security Data Science Company, founded in the UK, by experts recognized globally, for solving companies understand, deploy and support the most advanced security solutions, by developing a security architecture based on a deep understanding of Data Science, Security Tradecraft and Big Data Technologies. PAI’s...

  • Senior Manager

    2 days ago

    kochi, India Litmus7 Full time

    A leader with the ability to package business solutions with clear ROI, articulate and educate benefits to customers around solutions and execute it effectively. Manage P&L of the Data , AI and Automation practice. Lead the Data , AI and Automation team and accountable for the functioning of the entire team comprising of Architects, Technical Leads and...

  • Senior Manager

    1 month ago

    Kochi, India Litmus7 Full time

    A leader with the ability to package business solutions with clear ROI, articulate and educate benefits to customers around solutions and execute it effectively.Manage P&L of the Data , AI and Automation practice.Lead the Data , AI and Automation team and accountable for the functioning of the entire team comprising of Architects, Technical Leads and...

  • Senior Manager

    1 month ago

    Kochi, India Litmus7 Full time

    A leader with the ability to package business solutions with clear ROI, articulate and educate benefits to customers around solutions and execute it effectively.Manage P&L of the Data , AI and Automation practice.Lead the Data , AI and Automation team and accountable for the functioning of the entire team comprising of Architects, Technical Leads and...

  • Senior Manager

    1 month ago

    Kochi, India Litmus7 Full time

    A leader with the ability to package business solutions with clear ROI, articulate and educate benefits to customers around solutions and execute it effectively.Manage P&L of the Data , AI and Automation practice.Lead the Data , AI and Automation team and accountable for the functioning of the entire team comprising of Architects, Technical Leads and...

  • Senior Manager

    1 month ago

    Kochi, India Litmus7 Full time

    A leader with the ability to package business solutions with clear ROI, articulate and educate benefits to customers around solutions and execute it effectively. Manage P&L of the Data , AI and Automation practice. Lead the Data , AI and Automation team and accountable for the functioning of the entire team comprising of Architects, Technical Leads and...

  • Senior Manager

    3 days ago

    kochi, India Litmus7 Full time

    A leader with the ability to package business solutions with clear ROI, articulate and educate benefits to customers around solutions and execute it effectively.Manage P&L of the Data , AI and Automation practice.Lead the Data , AI and Automation team and accountable for the functioning of the entire team comprising of Architects, Technical Leads and...

  • DBiz.ai - Technical Lead - Data Engineering

    4 weeks ago

    Kochi, India DBiz.ai Full time

    Join our innovative team at Dbiz.AI, where we leverage cutting-edge technology to drive our business forward. We are looking for a talented and experienced full stack engineers who have a taste for data, at the Tech Lead level who is passionate about big data and analytics built on AWS cloud technology.Key Responsibilities : Technical Leadership : - Lead and...

  • Technical Lead – Data Engineering | Python + AWS

    3 weeks ago

    kochi, India DBiz.ai Full time

    Join our innovative team at Dbiz.AI , where we leverage cutting-edge technology to drive our business forward. We are looking for a talented and experienced full stack engineers who have a taste for data, at the Tech Lead level who is passionate about big data and analytics built on AWS cloud technology.Key Responsibilities:Technical Leadership: Lead...

  • Technical Lead – Data Engineering | Python + AWS

    3 weeks ago

    Kochi, India DBiz.ai Full time

    Join our innovative team atDbiz.AI , where we leverage cutting-edge technology to drive our business forward. We are looking for atalentedandexperienced full stack engineerswho have a taste for data, at theTech Leadlevel who is passionate about big data and analytics built on AWS cloud technology.Key Responsibilities:Technical Leadership:Lead and mentor a...

  • Data Scientist

    4 months ago

    Kochi, India IBM Full time

    Introduction As a Data Scientist at IBM, you will help transform our clients’ data into tangible business value by analyzing information, communicating outcomes and collaborating on product development. Work with Best in Class open source and visual tools, along with the most flexible and scalable deployment options. Whether it’s investigating patient...

  • Data Engineer

    6 days ago

    Kochi, India Maxillian Analytics Full time

    We are seeking a seasoned Data Engineer to join our vibrant team. As a pivotal member of our data engineering team, you will play a crucial role in designing, implementing, and optimizing data pipelines, ensuring seamless integration with cloud platforms. The ideal candidate will possess a strong command of Python, data engineering principles, and a proven...

  • Data Engineer

    7 days ago

    Kochi, India Maxillian Analytics Full time

    We are seeking a seasoned Data Engineer to join our vibrant team. As a pivotal member of our data engineering team, you will play a crucial role in designing, implementing, and optimizing data pipelines, ensuring seamless integration with cloud platforms. The ideal candidate will possess a strong command of Python, data engineering principles, and a proven...

  • Data Engineer

    7 days ago

    Kochi, India Maxillian Analytics Full time

    We are seeking a seasoned Data Engineer to join our vibrant team. As a pivotal member of our data engineering team, you will play a crucial role in designing, implementing, and optimizing data pipelines, ensuring seamless integration with cloud platforms. The ideal candidate will possess a strong command of Python, data engineering principles, and a proven...

  • Data Engineer

    4 days ago

    kochi, India Maxillian Analytics Full time

    We are seeking a seasoned Data Engineer to join our vibrant team. As a pivotal member of our data engineering team, you will play a crucial role in designing, implementing, and optimizing data pipelines, ensuring seamless integration with cloud platforms. The ideal candidate will possess a strong command of Python, data engineering principles, and a proven...

  • Data Engineer

    7 days ago

    kochi, India Maxillian Analytics Full time

    We are seeking a seasoned Data Engineer to join our vibrant team. As a pivotal member of our data engineering team, you will play a crucial role in designing, implementing, and optimizing data pipelines, ensuring seamless integration with cloud platforms. The ideal candidate will possess a strong command of Python, data engineering principles, and a proven...

Big Data Engineer

3 months ago

Kochi, India NOV Full time

Purpose of the Position:

This role is part of the Digital Technology Services team at NOV, a corporate group dedicated to a wide array of data and analytics projects. As a member of this team, you will have the opportunity to work with diverse technologies and collaborate with various departments. This is a highly independent position, demanding strong communication skills and the capability to drive projects forward autonomously. The ideal person for this position loves working with data and strives to optimize large scale data pipelines in support of analytics workloads. The ideal person should excel at solving complex, multi-dimensional data problems and love working as part of a global team.


Key Responsibilities:

  1. Lead and manage assigned projects, providing guidance and support to others on team you are supporting.
  2. Designing and implementing highly performant data ingestion pipelines from multiple sources
  3. Evaluate and choose appropriate data engineering tools and technologies where necessary.
  4. Optimize data infrastructure and pipelines for maximum efficiency.
  5. Working with event based / streaming technologies to ingest and process data
  6. Build large scale data migration scripts to migrate big data from native files in OSI PI and Timescale database into Databricks Data Lake
  7. Develop automated CICD pipelines for optimally deploying data pipelines and data science workloads.
  8. Contribute to development and maintain various streamlit applications
  9. Collaborate closely and independently with data scientists to provide data for analytics and machine learning.
  10. Implement best practices for data engineering and promote a culture of continuous improvement.


Qualifications and Skills:

  1. Strategic thinking, excellent communication skills and the ability to align data engineering with business goals.
  2. Advanced understanding with spark and/or Databricks(preferred), including spark cluster tuning.
  3. Great understanding of distributed systems and partitioning.
  4. Knowledge in Databricks and AWS data analytics tooling.
  5. Knowledge of Data Science life cycle
  6. Advanced knowledge in SQL and other languages such as Python, Scala, R or Java
  7. Experience with developing streamlit in Python applications.
  8. Visualization/reporting tools such as Tableau, Spotfire, Grafana, etc.
  9. Understanding of CI/CD practices and technologies. GitHub and GitHub Actions(preferred), Jenkins, TeamCity, Udeploy, etc.


Optional but Beneficial Skills:

  • Knowledge of Terraform
  • Snowflake
  • Some experience in building ML/AI models (worked with packages such as scikit learn, tensorflow, openai, etc.)
  • Kafka
  • Matillion


Work Environment and Conditions:

  • Flexible and ambition to learn new skills quickly
  • Ability to work independently
  • Ability to mentor others

This job description is intended to provide a general overview of the responsibilities and requirements of the position. Specific duties and expectations may vary depending on the organization and its specific needs.