Senior Data Engineer

3 weeks ago

Mumbai, India A.P. Moller - Maersk Full time

Maersk Line Fleet Management and Technology is responsible for Ship Management of Maersk Line owned container vessels. As a part of the Energy Transition Transparency and Enablement team you will be responsible for developing the strong enterprise architecture, building effective data pipelines based on ADLS/MIDAS and providing end-to-end support on energy transition projects. In this position, you will play an important role in developing, maintaining and improving complex algorithms from multiple systems / databases for emissions across the Maersk business. You will be working in dynamic work environment with shifting priorities between Operational and Project related work.

Experience: 8+ Years of data engineering

Location: Mumbai

Key Responsibilities

As a Senior Data Engineer, your assignments and projects will typically include:

- Develop algorithms / scripts for emission and fuel consumption performance and optimization for Maersk business.
- Maintenance of existing emission and bunker performance monitoring algorithms / scripts including debugging and improvements.
- Support existing in-house applications and develop new applications to support Maersk’s strategic cost savings target.
- Manage data from multiple systems including Azure systems to enable and facilitate subject matter expertise to deliver Projects.
- Driving deep dive analysis into decarbonization and emission related data
- Bringing forward innovative ideas on how the performance data in our systems along with other Maersk’s systems can support optimization of our fleet.
- Handle ad-hoc data requests from various stakeholders.
- Assist and participate in exploring programming languages such as Python and R for handling big data sets received from Star Connect – Maersk’s auto-logging performance system.
- Ensure strong stakeholder management with Energy Transition team and other departments across Maersk through regular meetings/conference calls.

Who we are looking for

- We are looking for a candidate with 8+ years of data engineering experience, ideally in an analytics intensive environment with working experience using Big data solutions on MS Azure cloud, MIDAS/Pipedream, BI tools (Spark / PySpark / Spark SQL / Scala).
- Experience of delivering end-to-end data solutions, Strong knowledge of Python, SQL / NoSQL databases.
- Experience developing batch / real-time processing solutions by using Azure Data Factory, Azure Databricks and Azure Data Lake source.
- Experience with MIDAS/Pipedream would be preferable:
- Event-driven integrations across applications and services.
- Workflow automation for data ingestion, transformation, product development and deployment.
- Experience in working with code versioning tools with ADO GIT repositories, CI/CD pipelines.
- Inclination towards deep dive analysis and adding value with critical insights.
- Exposure to Data science related programming environments like R and Python.
- As a person, you are independent, systematic and detail oriented, with a positive and proactive mind-set towards new tasks, but also comfortable with tasks of a repeatable nature. You are open and willing to take on new learnings, which are outside your comfort zone. You must be an enthusiastic and motivated team player, who understands that a strong team performance achieves the highest goals. You have effective English communication and stakeholder management skills.

  • Senior Data Engineer

    3 weeks ago

    Mumbai, India eClerx Full time

    Job Title: Senior Data Engineering Lead (Databricks)Next Step:If this role excites you and matches your expertise, kindly fill out the Google Form with the required details so we can reach out to you and make the process seamless: Overview:We are seeking a highly experienced Senior Data Engineering Lead with a strong focus on Databricks and cloud-based...

  • Senior data engineer

    1 week ago

    Mumbai, India EClerx Full time

    Job Title: Senior Data Engineering Lead (Databricks)Next Step:If this role excites you and matches your expertise, kindly fill out the Google Form with the required details so we can reach out to you and make the process seamless:Wwc GUHf7rti Fa ARole Overview:We are seeking a highly experienced Senior Data Engineering Lead with a strong focus on Databricks...

  • Senior data engineer

    1 week ago

    Mumbai, India EClerx Full time

    Job Title: Senior Data Engineering Lead (Databricks)Next Step:If this role excites you and matches your expertise, kindly fill out the Google Form with the required details so we can reach out to you and make the process seamless:Wwc GUHf7rti Fa ARole Overview:We are seeking a highly experienced Senior Data Engineering Lead with a strong focus on Databricks...

  • Senior Data Engineer

    1 week ago

    mumbai, India eClerx Full time

    Job Title: Senior Data Engineering Lead (Databricks)📌 Next Step:If this role excites you and matches your expertise, kindly fill out the Google Form with the required details so we can reach out to you and make the process seamless:https://forms.gle/Z6qWwcGUHf7rtiFaARole Overview:We are seeking a highly experienced Senior Data Engineering Lead with a...

  • Senior Data Engineer

    7 days ago

    Mumbai, India eClerx Full time

    Job Title: Senior Data Engineering Lead (Databricks)Next Step:If this role excites you and matches your expertise, kindly fill out the Google Form with the required details so we can reach out to you and make the process seamless: Overview:We are seeking a highly experienced Senior Data Engineering Lead with a strong focus on Databricks and cloud-based...

  • Senior data engineer

    3 weeks ago

    Mumbai, India EClerx Full time

    Job Title: Senior Data Engineering Lead (Databricks) Next Step: If this role excites you and matches your expertise, kindly fill out the Google Form with the required details so we can reach out to you and make the process seamless: Role Overview: We are seeking a highly experienced Senior Data Engineering Lead with a strong focus on Databricks and...

  • Senior Data Engineer

    1 week ago

    Mumbai, India eClerx Full time

    Job Title: Senior Data Engineering Lead (Databricks) Next Step: If this role excites you and matches your expertise, kindly fill out the Google Form with the required details so we can reach out to you and make the process seamless: Role Overview: We are seeking a highly experienced Senior Data Engineering Lead with a strong focus on Databricks and...

  • Senior Data Engineer

    1 week ago

    Mumbai, India eClerx Full time

    Job Title: Senior Data Engineering Lead (Databricks)Next Step:If this role excites you and matches your expertise, kindly fill out the Google Form with the required details so we can reach out to you and make the process seamless: Overview:We are seeking a highly experienced Senior Data Engineering Lead with a strong focus on Databricks and cloud-based data...

  • Senior Data Engineer

    6 days ago

    Mumbai, India eClerx Full time

    Job Title: Senior Data Engineering Lead (Databricks) Next Step: If this role excites you and matches your expertise, kindly fill out the Google Form with the required details so we can reach out to you and make the process seamless: Role Overview: We are seeking a highly experienced Senior Data Engineering Lead with a strong focus on Databricks and...

  • Senior Data Engineer

    2 weeks ago

    Mumbai, Maharashtra, India Oracle Financial Services Software Ltd Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Senior Consultant - Databricks Senior Data Engineer – Databricks (Azure/AWS) Role Overview: We are looking for a hands-on Senior Data Engineer experienced in migrating and building large-scale data pipelines on Databricks using Azure or AWS platforms. The role will focus on implementing batch and streaming pipelines, applying the bronze-silver-gold...