Senior Data Engineer

4 weeks ago

Delhi, India Net Zero Insights Full time
Senior Data Engineer (Manager)

About Net Zero Insights

Net Zero Insights is a leading provider of market intelligence for the Net-Zero Economy, offering comprehensive insights, data, and research to climate innovation professionals worldwide. Our cutting-edge Net0 Platform provides access to thousands of startups/SMEs, deals, investors, market reports, and more, enabling users to discover new innovations, trends, and opportunities in the rapidly evolving world of climate technology. Learn more at: Net Zero Insights, our data infrastructure undergoes rapid daily growth due to the substantial volume of valuable information we gather. To sustain the seamless operation of this expanding database, we are actively searching for a highly skilled Python expert to join our team as a team leader. The successful candidate will manage our team of two data engineers, organize and assign tasks on Jira, and ensure a clean and efficient workflow.

Candidates must have experience in both programming and team management, as well as strong communication skills, which are crucial for this role.

Your responsibilities

- Team Management: Manage a team of two data engineers, ensuring effective communication and collaboration. Organize and assign tasks on Jira to maintain a clean and efficient workflow.

- Task Management: Efficiently set up and organize Jira to manage and track tasks within the team.

- Software Development: Write, test, and maintain Python code to create and enhance software applications, backend systems, APIs, and data processing pipelines.

- Documentation: Maintain up-to-date and clear documentation for all processes, code, and systems to ensure easy knowledge transfer and system understanding.

- Database Management: Design and interact with databases using Python libraries and tools to store and retrieve data efficiently.

- Data Processing: Implement data processing algorithms and workflows in Python to manipulate, clean, and analyze data from various sources.

- Automation: Develop Python scripts and tools to automate repetitive tasks and improve overall efficiency in the company's processes.

- Integration and APIs: Work with external APIs to integrate third-party services into the company's applications or extract data from external sources (such as ChatGPT)

- Code Optimization and Performance: Identify and improve areas of code that require optimization for better performance and scalability.

- Testing and Debugging: Write unit tests and debug code to ensure the reliability and quality of software applications.

Requirements

- Team Management: 2-3 years of proven experience in team management and leadership, particularly as a team leader.

- Professional Experience: 4-6 years of professional experience with Python, preferably in a company similar to ours (e.g., Beauhurst, Crunchbase).

- Jira: Advanced knowledge in Jira for task management and organization.

- GenAI: Advanced knowledge of the latest GenAI technologies (e.g., ChatGPT)

- SQL Server: Advanced knowledge of SQL Server.

- Cloud Infrastructure: Indeterminate knowledge of cloud infrastructure, including AWS and Azure.

- Bitbucket: Advanced knowledge of Bitbucket.

- Communication Skills: EXCELLENT communication skills - this requirement is a MUST

- Management and Organizational Skills: Excellent management and organizational skills - this requirement is crucial.

- Python Servers: Ability to set up Python servers.

- Language Proficiency: Advanced proficiency in both written and spoken English is required.

Compensation and benefits

- Competitive salary- Stock options- Days off: to be determined based on the candidate's years of experience- Paid Sick Days: 30 days.- Team-building activities.- Employee perks.

  • Senior Data Integration Engineer | Senior Data Integration Engineer | delhi

    3 weeks ago

    delhi, India Senior Data Integration Engineer Full time

    Must Have Skills/Skill Requirement:Design and architect integration solutions to connect various enterprise applications, systems, and databases.Develop and implement integration workflows, APIs, and data pipelines to enable smooth communication and data exchange between different applications.Utilize Azure Integration Services such as Azure Logic Apps,...

  • Senior Data Integration Engineer

    3 weeks ago

    Delhi, India Senior Data Integration Engineer Full time

    Must Have Skills/Skill Requirement:Design and architect integration solutions to connect various enterprise applications, systems, and databases.Develop and implement integration workflows, APIs, and data pipelines to enable smooth communication and data exchange between different applications.Utilize Azure Integration Services such as Azure Logic Apps,...

  • Senior Data Integration Engineer

    3 weeks ago

    Delhi, India Senior Data Integration Engineer Full time

    Must Have Skills/Skill Requirement:- Design and architect integration solutions to connect various enterprise applications, systems, and databases.- Develop and implement integration workflows, APIs, and data pipelines to enable smooth communication and data exchange between different applications.- Utilize Azure Integration Services such as Azure Logic...

  • Senior data integration engineer

    3 weeks ago

    Delhi, India Senior Data Integration Engineer Full time

    Must Have Skills/Skill Requirement:Design and architect integration solutions to connect various enterprise applications, systems, and databases.Develop and implement integration workflows, APIs, and data pipelines to enable smooth communication and data exchange between different applications.Utilize Azure Integration Services such as Azure Logic Apps,...

  • Data Warehouse Engineer | Data Warehouse Engineer | delhi

    3 weeks ago

    delhi, India Data Warehouse Engineer Full time

    Experience : 2- 5 YearsPrimary Skills : Strong SQL knowledge, Data warehouse concepts and ETL hands on experience, Azure services like Data Factory, Azure Data Lake, and Good analysis skills.Good to have skills: Power BI, Databricks, Python.

  • Data Warehouse Engineer

    3 weeks ago

    Delhi, India Data Warehouse Engineer Full time

    Experience : 2- 5 YearsPrimary Skills : Strong SQL knowledge, Data warehouse concepts and ETL hands on experience, Azure services like Data Factory, Azure Data Lake, and Good analysis skills.Good to have skills: Power BI, Databricks, Python.

  • Wavicle Data Solutions | Senior Data Scientist

    2 weeks ago

    delhi, India Wavicle Data Solutions Full time

    Job Title: Senior Data Scientist We are seeking a highly skilled Senior Data Scientist with expertise in Generative AI, machine learning, and advanced data science techniques to join our dynamic team. This role involves collaborating with cross-functional teams to develop and deploy scalable AI solutions, driving innovation and business...

  • Senior Data Engineer

    2 weeks ago

    Delhi, India Rakuten Symphony Full time

    Job Title: Senior Data Engineer Location: Bangalore, IndiaCompany: Rakuten Symphony, IndiaOverviewRakuten Symphony is seeking an experienced and strategic Head/Senior Data Engineer to lead our data engineering initiatives and transform mobile connectivity through innovative data solutions. This senior leadership role requires deep expertise in...

  • Data Engineer

    5 days ago

    Delhi, India Pacific Data Integrators Full time

    Job OverviewWe are seeking a skilled Data Engineer to join our team. In this role, you will be responsible for managing and optimizing data pipelines, ensuring the seamless movement of data across systems, and supporting data initiatives through strong technical expertise. The ideal candidate will be proficient in SQL and Python, with hands-on experience...

  • Data Engineer

    4 days ago

    Delhi, India Pacific Data Integrators Full time

    Job OverviewWe are seeking a skilledData Engineerto join our team. In this role, you will be responsible for managing and optimizing data pipelines, ensuring the seamless movement of data across systems, and supporting data initiatives through strong technical expertise. The ideal candidate will be proficient in SQL and Python, with hands-on experience in MS...

  • ITI Data | PySpark Data Engineer

    1 week ago

    delhi, India ITI Data Full time

    Location : IndiaType : Full-timeExperience : 10 – 13 yearsFunctions : Consulting, Finance, Information Technology, Big Data EngineeringIndustries : Capital Markets, Investment Banking, Alternative Investments, Financial Services, Management Consulting, Information Technology and Services, HealthcareJob DescriptionWe are looking for a PySpark...

  • PySpark Data Engineer

    1 week ago

    Delhi, India ITI Data Full time

    Location : IndiaType : Full-timeExperience : 10 – 13 yearsFunctions : Consulting, Finance, Information Technology, Big Data EngineeringIndustries : Capital Markets, Investment Banking, Alternative Investments, Financial Services, Management Consulting, Information Technology and Services, HealthcareJob DescriptionWe are looking for a PySpark...

  • Pyspark data engineer

    1 week ago

    Delhi, India ITI Data Full time

    Location : IndiaType : Full-timeExperience : 10 – 13 yearsFunctions : Consulting, Finance, Information Technology, Big Data EngineeringIndustries : Capital Markets, Investment Banking, Alternative Investments, Financial Services, Management Consulting, Information Technology and Services, HealthcareJob DescriptionWe are looking for a Py Spark...

  • Senior Data Engineer

    1 month ago

    delhi, India iO Associates - UKEU Full time

    Job Title: Senior Data EngineerLocation: MohaliSalary: up to 30 LPAiO Associates is looking for a Senior Data Engineer in Databricks, Python, Scala, Azure Synapse, and Azure Data Factory to join our dynamic team. Responsibilities include developing and troubleshooting complex data pipelines using Databricks, PySpark, Synapse, ADF, ADLS Gen2, and Azure...

  • Senior Data Engineer

    5 days ago

    Delhi, India Trek Health Full time

    Company DescriptionTrek Health is revolutionizing healthcare with its Payer Price Transparency Analytics Platform. Our solutions offer payer-provider price transparency insights and analytics. We take pride in ingesting and processsing multi-terabytes of data every month and provide actionable insights to our customers. The company is backed by $3M seed...

  • Lead data engineer

    1 month ago

    Delhi, India Wavicle Data Solutions Full time

    Job Description:We are seeking a highly experienced Lead Data Engineer with over 8 years of expertise in data engineering.As a Lead Data Engineer, you will play a pivotal role in architecting and implementing data solutions.Your proficiency in Python, Py Spark, AWS, Databricks, SQL, and leadership skills will be crucial for success.Key Responsibilities:Lead...

  • Data Platform Engineer

    2 weeks ago

    Delhi, India OSD Data Services Full time

    Data Platform EngineerLocation: RemoteType: InternshipAbout UsAt OSD Data, we’re redefining how businesses leverage their data. Our mission is to empower organizations with a seamless, unified, and scalable data infrastructure that enables smarter decision-making and faster innovation. With a focus on data lakehouse technologies, we’ve built a...

  • Data platform engineer

    2 weeks ago

    Delhi, India OSD Data Services Full time

    Data Platform Engineer Location : RemoteType : InternshipAbout Us At OSD Data, we’re redefining how businesses leverage their data. Our mission is to empower organizations with a seamless, unified, and scalable data infrastructure that enables smarter decision-making and faster innovation. With a focus on data lakehouse technologies, we’ve...

  • Data Platform Engineer

    2 weeks ago

    Delhi, India OSD Data Services Full time

    Data Platform EngineerLocation : RemoteType : InternshipAbout UsAt OSD Data, we’re redefining how businesses leverage their data. Our mission is to empower organizations with a seamless, unified, and scalable data infrastructure that enables smarter decision-making and faster innovation. With a focus on data lakehouse technologies, we’ve built a...

  • AWS Data Engineer

    1 month ago

    delhi, India ITI Data Full time

    Job Description We are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources....