Data Engineer: Data Platforms

3 weeks ago

Coimbatore, Tamil Nadu, India IBM Full time

Introduction

In this role, you'll work in one of IBM's Client Innovation Centers, where deep technical expertise is delivered to public and private sector clients globally. The center provides locally based skills and technical expertise for driving innovation and new technology adoption.

Joining IBM Consulting entails building long-term relationships and collaborating closely with clients worldwide.

You'll collaborate with visionaries from various industries to enhance the hybrid cloud and AI journey for leading companies globally. Your capability to drive impactful change for clients is supported by our strategic partner ecosystem and robust technology platforms, including Software and Red Hat.

Curiosity and a continuous pursuit of knowledge are essential in IBM Consulting. In this role, you'll be empowered to challenge the status quo, explore ideas beyond your role, and devise creative solutions that deliver groundbreaking results for a diverse client network. Our culture focuses on evolution, empathy, and long-term career growth in an environment that values your unique skills and experience.

Your Role and Responsibilities

As a Big Data Engineer, your tasks will involve developing, maintaining, evaluating, and testing big data solutions. You will engage in data engineering activities, such as creating pipelines/workflows and implementing solutions to meet client needs.

Your main responsibilities include:

  • Designing, building, optimizing, and supporting data models and ETL processes based on client requirements
  • Creating, deploying, and managing data infrastructure to meet the needs of a growing data-driven organization
  • Coordinating data access and security to facilitate data scientist and analysts' seamless data access

Required Technical and Professional Expertise

  • Experience in Pysprk code development for AWS Glue jobs and EMR
  • Working on scalable distributed data systems using the Hadoop ecosystem in AWS EMR and MapR distribution
  • Developing Python and pyspark programs for data analysis
  • Proficiency in developing Custom Framework using Python for rule generation
  • Creating Hadoop streaming Jobs with python for integrating python API supported applications
  • Extracting data from HBase using Python and designing solutions implemented with Pyspark
  • Utilizing Apache Spark DataFrames/RDD's for business transformations and Hive Context objects for read/write operations
  • Transitioning Hive queries to Spark SQL to enhance batch processing efficiency

Preferred Technical and Professional Expertise

  • Knowledge of Devops
  • Experience in building scalable end-to-end data ingestion and processing solutions
  • Proficiency in object-oriented and/or functional programming languages like Python, Java, and Scala

About Business Unit

IBM Consulting is IBM's consulting and professional services business, offering leading capabilities in business and technology transformation. With deep expertise across various industries, we provide strategy, technology, and operations services to innovative companies worldwide. Our focus is on driving our clients' businesses forward through collaboration and responsible use of technology.

This position requires full COVID-19 vaccination before the start date, and proof of vaccination status will be mandatory. Any exemption requests will be evaluated individually based on submitted proof by the candidate.

Your Life @ IBM

At IBM, we believe in continuous learning and development, courage to experiment, and ongoing support in an inclusive environment where everyone can grow. Our team members are growth-oriented, open to feedback, and constantly evolving to drive exceptional outcomes for our customers.

Are you ready to be part of IBM's journey?

About IBM

IBM values the power of intelligence, reason, and science to enhance business and society. Join us in applying an open hybrid cloud and AI strategy to benefit our clients worldwide. With a rich history of innovation, IBM is a global technology and consulting leader, driving progress through responsible technology use.

Location Statement

When applying, choose roles aligning with your expertise and limit applications to a maximum of three roles annually for the best candidate experience. For location requirements, consult with the recruiter after submitting your application.

Being You @ IBM

IBM is dedicated to fostering a diverse and inclusive environment and is an equal-opportunity employer. We welcome applicants from all backgrounds and are committed to fair employment practices and compliance with regulations.

  • Data Platform Support Engineer

    5 days ago

    Coimbatore, Tamil Nadu, India AES Technologies Full time

    Team/ Competency - Production Support Core Skillsets - Service Delivery, Batch scheduling and monitoring, ETL Development, SQL High Level Job Scope - Production Support Job Description Big Data Support Engineer Skillset • Up to 9 years of IT experience & 5+ Years on Hadoop and K8s Eco Systems • Last 3 years of relevant experience in...

  • Senior Data Engineer

    5 days ago

    Coimbatore, Tamil Nadu, India BlueByte Technologies Full time

    Job Title : Sr. DATA EngineerLocation : CoimbatorePosition Type : Full-Time / 6 months contract to hireKey Responsibilities :Do you love building the infrastructure that fuels data-driven decision making? Are you passionate about wrangling raw data into a usable format? If so, then we want to hear from youWe are searching for a Mid-Level Data Engineer to...

  • Business Support Associate

    5 days ago

    Coimbatore, Tamil Nadu, India NTT DATA Full time

    Job DescriptionUnderstand, Gather and Prepare the requirements for Business.Works under supervision with internal and external teams to understand customer requirementsAbility to elaborate on the details of a projectCollaborate with Automation Engineers, Data Analysts and Business Intelligence Analyst to execute deliverables.Must possess technical writing,...

  • Data Modeler/Engineer

    5 days ago

    Coimbatore, Tamil Nadu, India QBrainX Full time

    Job Title : Data Modeler / Data Engineer - Data modeling Exp level : 12 years Job Location : Coimbatore (Work from Office from Day 1) Salary is not a constraint for the right candidate. Immediate joiners preferred or Someone who can join us within 15 to 30 days of time. Job Description : The data modeler designs, implements, and documents data architecture...

  • Lead Data Engineer

    5 days ago

    Coimbatore, Tamil Nadu, India Presidio Full time

    SEIZE THE OPPORTUNITY TO BE A PART OF SOMETHING GREATPresidio is on the leading edge of a technology-driven movement to transform the way business is done, for our customers and our customers' customers. Joining Presidio means immersing yourself in a culture of self-starters, collaborators and innovators who make real, lasting change in the marketplace via...

  • Business Support Associate

    5 days ago

    Coimbatore, Tamil Nadu, India NTT DATA Full time

    Job Description Understand, Gather and Prepare the requirements for Business. Works under supervision with internal and external teams to understand customer requirements Ability to elaborate on the details of a project Collaborate with Automation Engineers, Data Analysts and Business Intelligence Analyst to execute deliverables. Must possess technical...

  • Business Support Associate

    5 days ago

    Coimbatore, Tamil Nadu, India NTT DATA Full time

    Job Description Understand, Gather and Prepare the requirements for Business. Works under supervision with internal and external teams to understand customer requirementsAbility to elaborate on the details of a project Collaborate with Automation Engineers, Data Analysts and Business Intelligence Analyst to execute deliverables.Must possess technical...

  • Data Engineer

    5 days ago

    Coimbatore, Tamil Nadu, India CGVAK Software AND Exports Limited Full time

    Overview:TheDatabricks Spark Developer plays a crucial role in harnessing thepower of data using Databricks and Spark to develop and maintainefficient data pipelines. They are responsible for implementingscalable and reliable solutions that enable datadrivendecisionmaking within the organization.KeyResponsibilities:Designing andimplementing robust ETL...

  • Data Engineer

    5 days ago

    Coimbatore, Tamil Nadu, India Skyleaf Full time

    Role : Data Engineer Experience : 6 -9 Years Location : Gurgaon, Bangalore, Hyderabad & Coimbatore Work Mode : Hybrid Notice Period : Immediate to 30 days(Max) Shift Timings : 6:30 AM to 4:00 PM Mandate Skills : Bachelor's degree in Computer Science, Engineering, or related field. 6+ years of Python experience 6+ years of SQL experience (No-SQL experience...

  • Senior Data Engineer

    3 weeks ago

    Coimbatore, Tamil Nadu, India BlueByte Technologies Full time

    Job Title : Sr. DATA EngineerLocation : CoimbatorePosition Type : Full-Time / 6 months contract to hireKey Responsibilities :Do you love building the infrastructure that fuels data-driven decision making? Are you passionate about wrangling raw data into a usable format? If so, then we want to hear from you!We are searching for a Mid-Level Data Engineer to...

  • Senior Data Engineer

    2 months ago

    Coimbatore, Tamil Nadu, India BlueByte Technologies Full time

    Job Title : Sr. DATA EngineerLocation : CoimbatorePosition Type : Full-Time / 6 months contract to hireKey Responsibilities :Do you love building the infrastructure that fuels data-driven decision making? Are you passionate about wrangling raw data into a usable format? If so, then we want to hear from you!We are searching for a Mid-Level Data Engineer to...

  • Wavicle Data Solutions

    5 days ago

    Coimbatore, Tamil Nadu, India Wavicle data solutions Full time

    RPA Solutions Architect Position at Our CompanyWe're on the lookout for a skilled RPA Solutions Architect with a solid background in Robotic Process Automation (RPA). The ideal candidate should have a profound knowledge of RPA technologies, especially Blue Prism and other major RPA tools, along with expertise in implementing RPA solutions in cloud...

  • Business Support Associate

    5 days ago

    Coimbatore, Tamil Nadu, India NTT DATA Services Full time

    Understand, Gather and Prepare the requirements for Business.Works under supervision with internal and external teams to understand customer requirementsAbility to elaborate on the details of a projectCollaborate with Automation Engineers, Data Analysts and Business Intelligence Analyst to execute deliverables.Must possess technical writing, decision making,...

  • Data Annotator

    5 days ago

    Coimbatore, Tamil Nadu, India expert global solutions Pvt. Ltd Full time

    Company DescriptionAt Expert Global, we integrate different technologies seamlessly to create solutions in order to maximize our client's business benefits. This makes us a trusted partner in the domains of Mobility, Special Purpose Machinery, Oil & Gas, Industrial Equipment & Marine.We facilitate engineering & digitization in various asset-intensive and...

  • Data Engineer

    5 days ago

    Coimbatore, Tamil Nadu, India Hexaware Technologies Full time

    Dear Candidate, I hope this email finds you well. We are thrilled to announce an exciting opportunity for talented professionals like yourself to join our team as an Azure Data Engineer/Architect.We are hosting an Open Walk-in Drive in Coimbatore, Tamil Nadu on 15th June [Saturday], 2024, and we believe your skills in Databricks, Data Factory, SQL, and...

  • Data Engineer

    5 days ago

    Coimbatore, Tamil Nadu, India Hexaware Technologies Full time

    Dear Candidate, I hope this email finds you well. We are thrilled to announce an exciting opportunity for talented professionals like yourself to join our team as an Azure Data Engineer/Architect. We are hosting an Open Walk-in Drive in Coimbatore, Tamil Nadu on 15th June (Saturday), 2024 , and we believe your skills in Databricks, Data Factory, SQL, and...

  • Data Engineer

    5 days ago

    Coimbatore, Tamil Nadu, India Hexaware Technologies Full time

    Dear Candidate,I hope this email finds you well. We are thrilled to announce an exciting opportunity for talented professionals like yourself to join our team as an Azure Data Engineer/Architect.We are hosting an interview Drive in Coimbatore, Tamil Nadu on 15th June [Saturday], 2024, and we believe your skills in Databricks, Data Factory, SQL, and Pyspark...

  • Senior Data Engineer

    5 days ago

    Coimbatore, Tamil Nadu, India PureSearch Full time

    Job Title: Senior Data EngineerWe are on the lookout for an experienced Senior Data Engineer with 3 to 5 years of solid background to be part of our client's team. The role involves managing, optimizing, and building data pipelines and infrastructure for efficient and high-quality data processing.About the Company:Enter a valuable segment about the company...

  • Data Engineer

    5 days ago

    Coimbatore, Tamil Nadu, India Nference Full time

    Overview: We are seeking a Data Pipeline Engineer to join our team, focusing on the development and maintenance of high-performance data pipelines in distributed systems.The ideal candidate will have a strong background in Python and shell scripting, with a solid understanding of system configurations and monitoring.Key Responsibilities: Design, develop, and...

  • Business Support Associate

    5 days ago

    Coimbatore, Tamil Nadu, India NTT DATA Services Full time

    Understand, Gather and Prepare the requirements for Business. Works under supervision with internal and external teams to understand customer requirements Ability to elaborate on the details of a project Collaborate with Automation Engineers, Data Analysts and Business Intelligence Analyst to execute deliverables. Must possess technical writing, decision...