Data Engineer

4 weeks ago

Chennai, Tamil Nadu, India Petrofac Full time

Petrofac: A Leading International Service Provider

We are a leading international service provider to the energy industry, with a diverse client portfolio including many of the world's leading energy companies.

Our team designs, builds, manages, and maintains infrastructure for our clients. We recruit, reward, and develop our people based on merit, regardless of race, nationality, religion, gender, age, sexual orientation, marital status, or disability.

We value our people and treat everyone who works for or with Petrofac fairly and without discrimination.

Job Title: Data Engineer

Key Responsibilities:

Architecting and defining data flows for big data/data lake use cases.

Excellent knowledge on implementing full life cycle of data management principles such as Data Governance, Architecture, Modelling, Storage, Security, Master data, and Quality.

Act as a coach and provide consultancy services and advice to data engineers by offering technical guidance, and ensuring architecture principles, design standards and operational requirements are met.

Participate in the Technical Design Authority forums.

Collaborates with analytics and business stakeholders to improve data models that feed BI tools, increasing data accessibility, and fostering data-driven decision making across the organization.

Work with team of data engineers to deliver the tasks and achieving weekly and monthly goals, also to guide the team to follow the best practices and improve the deliverables.

Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability.

Responsible for estimating the cluster size, core size, monitoring, and troubleshooting of the data bricks cluster and analysis server to produce optimal capacity for computing data ingestion.

Deliver master data cleansing and improvement efforts; including automated and cost-effective solutions for processing, cleansing, and verifying the integrity of data used for analysis.

Expertise in securing the big data environment including encryption, tunnelling, access control, secure isolation.

Guide and build highly efficient OLAP cubes using data modelling techniques to cater all the required business cases and mitigate the limitation of Power BI in analysis service.

Deploy and maintain highly efficient CI/CD devops pipelines across multiple environments such as dev, stg and production.

Strictly follow scrum based agile approach of development to work based on allocated stories.

Comprehensive knowledge on data extraction, Transformation and loading data from various sources like Oracle, Hadoop HDFS, Flat files, JSON, Avro, Parquet and ORC.

Experience defining, implementing, and maintaining a global data platform

Experience building robust and impactful data visualisation solutions and gaining adoption

Extensive work experience onboarding various data sources using real-time, batch load or scheduled loads. The sources can be in cloud, on premise, SQL DB, NO SQL DB or API-based.

Expertise in extracting the data through JSON, ODATA, REST API, WEBSERVICES, XML.

Expertise in data ingestion platforms such as Apache Sqoop, Apache Flume, Amazon kinesis, Fluent, Logstash etc.

Hands on experience in using Databricks, Pig, SCALA, HIVE, Azure Data Factory, Python, R

Operational experience with Big Data Technologies and Engines including Presto, Spark, Hive and Hadoop Environments

Experience in various databases including Azure SQL DB, Oracle, MySQL, Cosmos DB, MongoDB

Experience supporting and working with cross-functional teams in a dynamic environment.

Essential Qualification & Skills:

  • Bachelor's degree (masters' preferred) in Computer Science, Engineering, or any other technology related field
  • 10+ years of experience in data analytics platform and hands-on experience on ETL and ELT transformations with strong SQL programming knowledge.
  • 5+ years of hands-on experience on big data engineering, distributed storage and processing massive data into data lake using Scala or Python.
  • Proficient knowledge on Hadoop and Spark eco systems like HDFS, Hive, Sqoop, Oozie, Spark core, streaming.
  • Experience with programming languages such as Scala, Java, Python and Shell scripting
  • Proven Experience in pulling data through REST API, ODATA, XML,Web services.
  • Experience with Azure product offerings and data platform.
  • Experience in data modelling (data marts, snowflake/Star, Normalization, SCD2).
  • Architect and defining the data flows and building highly efficient, scalable data pipelines.
  • To work in tandem with the Enterprise and Domain Architects to understand the business goals and vision, and to contribute to the Enterprise Roadmaps.
  • Strong troubleshooting skills, problem solving skills of any issues stopping business progress.
  • Coordinate with multiple business stake holders to understand the requirement and deliver.
  • Conducting a continuous audit of data management system performance, refine whenever required, and report immediately any breach or loopholes to the stakeholders.
  • Allocate task to various team members, track the status and provide the report on activities to management.
  • Understand the physical and logic plan of execution and optimize the performance of data pipelines.
  • Extensive background in data mining and statistical analysis.
  • Able to understand various data structures and common methods in data transformation.
  • Ability to work with ETL tools with strong knowledge on ETL concepts.
  • Strong focus on delivering outcomes.
  • Data management: modelling, normalization, cleaning, and maintenance
  • Understand Data architectures, Data warehousing principles and be able to participate in the design and development of conventional data warehouse solutions.

  • Data Engineer

    3 weeks ago

    Chennai, Tamil Nadu, India NTT DATA Full time

    Job SummaryWe are seeking a highly skilled and experienced Data Engineer to join our team in Chennai, Tamil Nādu, India. The ideal candidate will have expertise in designing, implementing, and supporting Cloud Data Management and Advanced Analytics platforms.Main ResponsibilitiesDesign and implement Cloud Data Management and Advanced Analytics...

  • Chief Data Science Engineer

    1 week ago

    Chennai, Tamil Nadu, India NTT DATA Full time

    Job SummaryWe are seeking an experienced Chief Data Science Engineer to join our team at NTT DATA. As a key member of our organization, you will be responsible for designing and implementing machine learning systems, researching and developing ML algorithms and tools, and selecting appropriate data sets.About the RoleYou will work closely with...

  • Senior Data Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India Wavicle Data Solutions Full time

    We are seeking an Experienced AWS Data Architect with a strong background in designing, building, and maintaining scalable data pipelines and solutions on AWS. The ideal candidate will have a deep understanding of AWS services, data engineering best practices, and cloud architecture.Key Responsibilities:Design, develop, and maintain robust ETL pipelines on...

  • Cybersecurity Engineer for NTT DATA

    1 week ago

    Chennai, Tamil Nadu, India NTT DATA Full time

    Company OverviewNTT DATA is a $30+ billion trusted global innovator of business and technology services. We serve 75% of the Fortune Global 100 and are committed to helping clients innovate, optimize and transform for long-term success.We invest over $3.6 billion each year in R&D to help organizations and society move confidently and sustainably into the...

  • Data Engineer

    3 weeks ago

    Chennai, Tamil Nadu, India NTT DATA Services Full time

    Role SummaryWe are seeking a highly skilled Cloud Data Management Engineer to join our team at NTT DATA Services. This role will focus on designing, implementing, and supporting Cloud Data Management and Advanced Analytics platforms. The ideal candidate will have extensive experience in AWS DevOps Engineering, including EC2, S3, ECS, Lambda, and...

  • Cybersecurity Engineer

    3 weeks ago

    Chennai, Tamil Nadu, India NTT DATA Full time

    Job DescriptionMake a difference with NTT DATANTT DATA is a leading provider of digital and AI infrastructure, committed to helping clients innovate and transform for long-term success.Your day at NTT DATAThe Security Managed Services Engineer is responsible for providing proactive support to clients to ensure their Firewall infrastructure remains...

  • Data Architect

    2 weeks ago

    Chennai, Tamil Nadu, India NTT DATA Full time

    Job Title: Data ArchitectJob Summary:We are seeking a skilled Data Architect to design and implement cloud data management and advanced analytics platforms. This role will work closely with data services, data analysts, and data scientists to build secure, scalable, fault-tolerant, and high-performing cloud-based architectures.Key Responsibilities:Design and...

  • AWS Data Engineer

    4 weeks ago

    Chennai, Tamil Nadu, India Wavicle Data Solutions Full time

    We are seeking an experienced Senior AWS Data Engineer to lead our data infrastructure team. The ideal candidate will have a strong background in designing, building, and maintaining scalable data pipelines and solutions on AWS. You will work closely with data scientists, analysts, and cross-functional teams to optimize and manage our data infrastructure....

  • Data Center Operations Specialist

    3 weeks ago

    Chennai, Tamil Nadu, India NTT DATA Full time

    Job DescriptionMake an Impact at NTT DATANTT DATA is a global innovator of business and technology services. We serve 75% of the Fortune Global 100 and are committed to helping clients innovate, optimize, and transform for long-term success.Your RoleThe role of Critical Facilities Operations and Maintenance Engineer is a seasoned subject matter expert...

  • Technical Specialist

    3 weeks ago

    Chennai, Tamil Nadu, India NTT DATA Full time

    About the RoleNTT DATA is seeking a skilled and experienced MS Engineer (L3) to join our team. As a MS Engineer (L3), you will be responsible for providing technical support to clients and ensuring a high level of service delivery.Key ResponsibilitiesProvide technical support to clients and resolve complex technical issues.Manage tickets and conduct advanced...

  • Data Center Operations Specialist

    2 weeks ago

    Chennai, Tamil Nadu, India NTT DATA Full time

    Job Title: Critical Facilities Operations and Maintenance EngineerAbout the RoleThis seasoned subject matter expert is responsible for working with all major systems within a facility or building, such as electrical and HVAC systems, and performs regular maintenance on all systems. The role designs, plans, installs, and/or maintains mechanical, electrical,...

  • Data Architect with AWS Expertise

    3 weeks ago

    Chennai, Tamil Nadu, India Wavicle Data Solutions Full time

    Job SummaryWe are seeking an experienced Senior AWS Data Engineer to lead our data engineering team at Wavicle Data Solutions. The ideal candidate will have a strong background in designing, building, and maintaining scalable data pipelines and solutions on AWS.Key ResponsibilitiesDesign and develop robust ETL pipelines on AWS using services like Glue,...

  • Principal Digital Engineering Architect

    2 weeks ago

    Chennai, Tamil Nadu, India NTT DATA Full time

    Job Summary Principal Digital Engineering ArchitectNTT DATA is seeking a Principal Digital Engineering Architect to lead the design and development of cutting-edge digital solutions. The ideal candidate will have a strong background in machine learning and software engineering, with experience in designing and implementing scalable data-driven systems.Key...

  • Security Engineer

    1 month ago

    Chennai, Tamil Nadu, India NTT DATA Full time

    About the RoleWe are seeking a highly skilled Security Managed Services Engineer to join our team at NTT DATA. As a key member of our security team, you will be responsible for providing proactive technical support to our clients, ensuring the security and integrity of their infrastructure.Key ResponsibilitiesProactively identify and resolve technical...

  • Senior Software Engineering Lead

    4 weeks ago

    Chennai, Tamil Nadu, India Crayon Data Full time

    Role: Senior Software Engineering LeadCrayon Data, a leading provider of AI-led revenue acceleration solutions, is seeking a seasoned Senior Software Engineering Lead to drive the development of our flagship platform, maya.ai. As a key member of our engineering team, you will be responsible for leading the design and implementation of scalable, flexible, and...

  • Senior Engineering Leader

    4 weeks ago

    Chennai, Tamil Nadu, India Crayon Data Full time

    Job Title: Senior Engineering LeaderAbout the Role:We are seeking a highly skilled Senior Engineering Leader to join our team at Crayon Data. As a key member of our engineering team, you will be responsible for leading complex initiatives with long-term, strategic value.Key Responsibilities:Lead complex initiatives with long-term, strategic valueOwned...

  • Senior Engineering Director

    4 weeks ago

    Chennai, Tamil Nadu, India Crayon Data Full time

    About the RoleCrayon Data is a leading provider of AI-led revenue acceleration solutions, headquartered in Singapore with a local presence in India and the UAE. We are seeking a highly skilled Senior Engineering Director to lead our engineering team and drive the development of our flagship platform.The ideal candidate will have a strong background in cloud...

  • Network Services Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India NTT DATA Full time

    Job DescriptionNTT DATA is seeking a skilled Network Services Engineer to join our team. As a Network Services Engineer, you will be responsible for providing managed services to clients, ensuring the smooth operation of their IT infrastructure and systems.The primary objective of this role is to proactively review client requests or tickets and apply...

  • Technical Lead

    3 weeks ago

    Chennai, Tamil Nadu, India Crayon Data Full time

    Crayon Data Engineering Manager Role OverviewCrayon Data is a leading provider of AI-led revenue acceleration solutions, headquartered in Singapore with a local presence in India and the UAE. We're seeking an experienced Engineering Manager to lead our software development team in delivering high-quality, scalable, and secure platforms.Key...

  • Data Centre Operations Manager

    3 weeks ago

    Chennai, Tamil Nadu, India NTT DATA Full time

    Job DescriptionMake a lasting impact with NTT DATAAs a trusted global innovator of business and technology services, we are committed to helping clients innovate, optimize and transform for long-term success.Your day at NTT DATAThe Data Centre Operations Manager, Critical Facilities Operations and Maintenance is a management role, ensuring the day-to-day...