Senior Data Engineer

5 days ago

India Net Zero Insights Full time

Senior Data Engineer (Manager)

About Net Zero Insights

Net Zero Insights is a leading provider of market intelligence for the Net-Zero Economy, offering comprehensive insights, data, and research to climate innovation professionals worldwide. Our cutting-edge Net0 Platform provides access to thousands of startups/SMEs, deals, investors, market reports, and more, enabling users to discover new innovations, trends, and opportunities in the rapidly evolving world of climate technology. Learn more at:

At Net Zero Insights, our data infrastructure undergoes rapid daily growth due to the substantial volume of valuable information we gather. To sustain the seamless operation of this expanding database, we are actively searching for a highly skilled Python expert to join our team as a team leader. The successful candidate will manage our team of two data engineers, organize and assign tasks on Jira, and ensure a clean and efficient workflow.

Candidates must have experience in both programming and team management, as well as strong communication skills, which are crucial for this role. 

Your responsibilities

  • Team Management : Manage a team of two data engineers, ensuring effective communication and collaboration. Organize and assign tasks on Jira to maintain a clean and efficient workflow.

  • Task Management : Efficiently set up and organize Jira to manage and track tasks within the team.

  • Software Development : Write, test, and maintain Python code to create and enhance software applications, backend systems, APIs, and data processing pipelines.

  • Documentation : Maintain up-to-date and clear documentation for all processes, code, and systems to ensure easy knowledge transfer and system understanding.

  • Database Management : Design and interact with databases using Python libraries and tools to store and retrieve data efficiently.

  • Data Processing : Implement data processing algorithms and workflows in Python to manipulate, clean, and analyze data from various sources.

  • Automation : Develop Python scripts and tools to automate repetitive tasks and improve overall efficiency in the company's processes.

  • Integration and APIs : Work with external APIs to integrate third-party services into the company's applications or extract data from external sources (such as ChatGPT)

  • Code Optimization and Performance : Identify and improve areas of code that require optimization for better performance and scalability.

  • Testing and Debugging : Write unit tests and debug code to ensure the reliability and quality of software applications.

Requirements

  • Team Management : 2-3 years of proven experience in team management and leadership, particularly as a team leader.

  • Professional Experience : 4-6 years of professional experience with Python, preferably in a company similar to ours (e.g., Beauhurst, Crunchbase).

  • Jira : Advanced knowledge in Jira for task management and organization.

  • GenAI : Advanced knowledge of the latest GenAI technologies (e.g., ChatGPT)

  • SQL Server : Advanced knowledge of SQL Server.

  • Cloud Infrastructure : Indeterminate knowledge of cloud infrastructure, including AWS and Azure.

  • Bitbucket : Advanced knowledge of Bitbucket.

  • Communication Skills : EXCELLENT communication skills - this requirement is a MUST

  • Management and Organizational Skills : Excellent management and organizational skills - this requirement is crucial.

  • Python Servers : Ability to set up Python servers.

  • Language Proficiency : Advanced proficiency in both written and spoken English is required.

Compensation and benefits

  • Competitive salary
  • Stock options
  • Days off: to be determined based on the candidate's years of experience
  • Paid Sick Days: 30 days.
  • Team-building activities.
  • Employee perks.

  • Senior Data Integration Engineer | Senior Data Integration Engineer | india

    3 hours ago

    india Senior Data Integration Engineer Full time

    Must Have Skills/Skill Requirement:Design and architect integration solutions to connect various enterprise applications, systems, and databases.Develop and implement integration workflows, APIs, and data pipelines to enable smooth communication and data exchange between different applications.Utilize Azure Integration Services such as Azure Logic Apps,...

  • Senior Data Engineer

    1 month ago

    India iO Associates - UKEU Full time

    Job Title: Senior Data Engineer Location: Mohali Salary: Negotiable on the current package iO Associates is looking for a Senior Data Engineer in Databricks, Python, Scala, Azure Synapse, and Azure Data Factory to join our dynamic team. Responsibilities include developing and troubleshooting complex data pipelines using Databricks, PySpark, Synapse,...

  • Lead data engineer

    6 days ago

    India Wavicle Data Solutions Full time

    Job Description: We are seeking a highly experienced Lead Data Engineer with over 8 years of expertise in data engineering. As a Lead Data Engineer, you will play a pivotal role in architecting and implementing data solutions. Your proficiency in Python, Py Spark, AWS, Databricks, SQL, and leadership skills will be crucial for success. Key...

  • Senior Data Engineer

    3 weeks ago

    India iO Associates - UKEU Full time

    Job Title: Senior Data Engineer Location: Mohali Salary: up to 30 LPA iO Associates is looking for a Senior Data Engineer in Databricks, Python, Scala, Azure Synapse, and Azure Data Factory to join our dynamic team. Responsibilities include developing and troubleshooting complex data pipelines using Databricks, PySpark, Synapse, ADF, ADLS...

  • Lead Data Engineer

    2 weeks ago

    India Wavicle Data Solutions Full time

    Job Description:We are seeking a highly experienced Lead Data Engineer with over 8 years of expertise in data engineering.As a Lead Data Engineer, you will play a pivotal role in architecting and implementing data solutions.Your proficiency in Python, PySpark, AWS, Databricks, SQL, and leadership skills will be crucial for success.Key Responsibilities:Lead...

  • Lead Data Engineer

    2 weeks ago

    India Wavicle Data Solutions Full time

    Job Description: We are seeking a highly experienced Lead Data Engineer with over 8 years of expertise in data engineering. As a Lead Data Engineer, you will play a pivotal role in architecting and implementing data solutions. Your proficiency in Python, PySpark, AWS, Databricks, SQL, and leadership skills will be crucial for success. Key...

  • Senior data engineer

    2 weeks ago

    India Synechron Full time

    Good-day, We have an immediate opportunity for the Senior Data Engineer Job Role: Senior Data Engineer Job Location: Bangalore BCIT Experience- 7 to 10 years Notice : upto 15 Days. About Company: At Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity and...

  • Senior data engineer

    1 month ago

    India Recmatrix Consulting Full time

    Job Title: Senior Data Engineer Location: Remote within India Employment Type: Contract Experience Level: 6+ years Position Overview: We are seeking a Senior Data Warehouse Engineer to join our Digital Business team. This role involves building and managing data warehouses to support various business functions such as Sales, Marketing, and...

  • Aws data engineer

    2 days ago

    India ITI Data Full time

    Job Description We are looking for an AWS Data with primary skills on Py Spark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources....

  • Senior data engineer

    3 weeks ago

    India Linuxpect Private Limited Full time

    We are seeking an experienced and skilled Senior Data Engineer with 5 to 10 years of hands-on experience in building and managing data pipelines and big data infrastructure. The ideal candidate will have a strong technical background in data engineering tools, big data ecosystems, and programming languages. This role will focus on designing, implementing,...

  • Senior Data Engineer

    2 months ago

    india ValueLabs Full time

    Dear Aspirants, We at ValueLabs have an Opening for Senior Azure Data Engineer role. Below is the JD for the same. Role: Sr Data Engineer Experience: 5+ Years Preferable Immediate Joiners The Azure Data Engineer is responsible for the design, development, and maintenance of data pipelines, data warehouses, and data lakes for the organization. This role...

  • AWS Data Engineer

    3 weeks ago

    india ITI Data Full time

    Job Description We are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources....

  • AWS Data Engineer

    3 months ago

    India ITI Data Full time

    Job Description We are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources....

  • AWS Data Engineer

    3 months ago

    India ITI Data Full time

    Job DescriptionWe are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources. There...

  • AWS Data Engineer

    2 weeks ago

    India ITI Data Full time

    Job Description We are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources....

  • AWS Data Engineer

    3 months ago

    India ITI Data Full time

    Job Description We are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources....

  • Senior Data Engineer

    3 weeks ago

    india Varcus infinity Full time

    Job Title: Senior Data Engineer   Location: India (Permanent Work From Home)   Salary: ₹30 - ₹40 LPA (flexible for exceptional candidates based on experience)   Experience Level: Minimum 5 years, with preference for candidates with e-commerce experience   (Note: Candidate must be available to work in PST time zone and able to join within a...

  • Senior Data Engineer

    3 weeks ago

    India Varcus infinity Full time € 30,00,000 - € 40,00,000

    Job Title: Senior Data Engineer Location: India (Permanent Work From Home) Salary: ₹30 - ₹40 LPA (flexible for exceptional candidates based on experience) Experience Level: Minimum 5 years, with preference for candidates with e-commerce experience (Note: Candidate must be available to work in PST time zone and able to join within a month.) ...

  • Senior data infrastructure engineer

    3 weeks ago

    India SourceBae Full time

    Job Role Senior Data Infrastructure Engineer Experience 5+ years Location: Remote Duration:3 - 6 months Job Description Title: Senior Data Infrastructure Engineer About the role As a Senior Data Infrastructure engineer, you will be working with Data Engineering, Analyst and Operations teams to build and maintain a secure, scalable and...

  • Senior Data Engineer

    3 weeks ago

    india Synechron Full time

    Good-day,We have an immediate opportunity for the Senior Data Engineer Job Role: Senior Data EngineerJob Location: Bangalore BCITExperience- 7 to 10 yearsNotice : upto 15 Days .About Company:At Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity and innovative technology to...