Senior Data Engineering Specialist

2 weeks ago


Chennai, Tamil Nadu, India Intellistaff Services Pvt. Ltd Full time

We are seeking a highly skilled Data Engineer to join our team at Intellistaff Services Pvt. Ltd. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining scalable data pipelines using PySpark to process large volumes of data from various sources.

Key Responsibilities:

1. Data Pipeline Development

Design, develop, and maintain efficient and scalable data pipelines using PySpark to process large volumes of data from various sources.

2. Data Integration

Integrate data from multiple data sources and formats, ensuring high data quality and reliability.

3. Optimization

Optimize and tune data processing jobs for performance and cost-efficiency.

4. Collaboration

Work closely with data scientists, analysts, and other stakeholders to understand data requirements and deliver high-quality data solutions.

5. ETL Processes

Develop and maintain ETL processes to extract, transform, and load data into data warehouses and data lakes.

6. Data Quality

Implement data validation and monitoring processes to ensure data accuracy and consistency.

7. Documentation

Document data engineering processes, workflows, and best practices.

8. Troubleshooting

Identify, troubleshoot, and resolve data-related issues promptly.

Required Qualifications:

Experience: 3+ years of experience in data engineering or a related field.

Education: Bachelors degree in Computer Science, Information Technology, Engineering, or a related field.

Technical Skills: Proficiency in PySpark and Python. Strong knowledge of big data technologies such as Hadoop, Hive, and Spark. Experience with cloud platforms (e.g., AWS, Azure, GCP) and their data services. Familiarity with data warehousing solutions (e.g., Amazon Redshift, Google BigQuery, Snowflake). Knowledge of relational and NoSQL databases (e.g., MySQL, MongoDB, Cassandra). Data Processing: Experience with ETL/ELT processes and data pipeline orchestration tools (e.g., Apache Airflow, Apache NiFi). Problem-Solving: Strong analytical and problem-solving skills. Communication: Excellent verbal and written communication skills, with the ability to explain complex technical concepts to non-technical stakeholders.



  • Chennai, Tamil Nadu, India NTT DATA Full time

    Job SummaryWe are seeking a highly skilled Senior Integration Specialist to join our team at NTT DATA. As a key member of our integration team, you will be responsible for ensuring seamless integration of hardware and software assets, while maintaining compliance with industry standards.Key Responsibilities:Develop and implement effective integration...


  • Chennai, Tamil Nadu, India Capgemini Engineering Full time

    At Capgemini Engineering, we are seeking a highly skilled Senior Data Communications Engineer to join our team.Located in Chennai/Bengaluru/Hyderabad, this role offers a competitive salary range of ₹12,00,000 to ₹30,00,000 per annum, depending on experience.Job Description:We are looking for an expert in datacom protocol standards, with a strong...


  • Chennai, Tamil Nadu, India NTT DATA Full time

    Job OverviewNTT DATA is a leading technology services provider, renowned for its technical excellence and innovation. As a Senior IT Support Specialist, you will play a critical role in delivering exceptional technical support to our clients.


  • Chennai, Tamil Nadu, India NTT DATA Services Full time

    Job OverviewWe are seeking a highly skilled Senior Integration Specialist to join our team in Chennai, Tamil Nādu, India.About the RoleThe Senior Integration Specialist will be responsible for designing, developing, and implementing integration solutions using AWS Glue and AWS Aurora. This role requires a minimum of 5 years of experience in integration,...


  • Chennai, Tamil Nadu, India NTT DATA Full time

    Job OpportunityReq ID: 298627 NTT DATA is a $30 billion trusted global innovator of business and technology services. We strive to hire exceptional individuals who want to grow with us.We are currently seeking a Senior Integration Specialist to join our team in Chennai, Tamil Nādu (IN-TN), India (IN).About the RoleThe Senior Integration Specialist will be...


  • Chennai, Tamil Nadu, India Peak Hire Solutions Full time

    We are seeking a skilled Senior Data Engineering Specialist to lead the design, development, and maintenance of robust data pipelines that extract, transform, and load data from various applications into our cloud-based data platform. The ideal candidate will have a strong foundation in data engineering principles, a deep understanding of cloud technologies,...


  • Chennai, Tamil Nadu, India Cynosure Corporate Solutions Full time

    Job SummaryCynosure Corporate Solutions is seeking a highly skilled Senior Data Engineering Specialist to join our team. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining large-scale data processing systems using big data technologies like Azure, AWS, or GCP.Key ResponsibilitiesDesign and develop...


  • Chennai, Tamil Nadu, India NTT DATA Full time

    Job Title: Senior Specialist in Governance and Risk ManagementWe are seeking a skilled Senior Specialist in Governance and Risk Management to join our team at NTT DATA. As a Senior Specialist, you will be responsible for designing, developing, and testing audit functionalities with IBM OpenPages software. Your strong experience in defining architectures,...


  • Chennai, Tamil Nadu, India Colan Infotech Private Limited Full time

    We are seeking an experienced Senior Data Engineering Specialist to join our team at Colan Infotech Private Limited. The ideal candidate will have a strong background in data engineering and experience working with cloud-based technologies.The primary responsibility of this role is to design, develop, and maintain scalable data pipelines using Pyspark /...


  • Chennai, Tamil Nadu, India NTT DATA Services Full time

    Job Title: Senior Containerization SpecialistJob Summary: We are seeking a Senior Containerization Specialist to join our team in Chennai, Tamil Nādu, India.Key Responsibilities:Design and implement containerized systems using Kubernetes and OpenShift.Experience with container orchestration frameworks such as Docker, Kubernetes, and OpenShift.Develop and...


  • Chennai, Tamil Nadu, India NTT DATA Full time

    Job Title: Configuration Analysis Senior SpecialistAbout the Role:We are seeking a highly skilled Configuration Analysis Senior Specialist to join our team at NTT DATA. As a key member of our team, you will be responsible for analyzing and configuring complex systems to meet the needs of our clients.Key Responsibilities:Perform in-depth analysis of system...


  • Chennai, Tamil Nadu, India NTT DATA Full time

    Job Title: Senior Network Security Specialist - Firewall and Network SupportJob Summary:We are seeking a highly skilled Senior Network Security Specialist to join our team. As a Senior Network Security Specialist, you will be responsible for gathering scope, designing, implementing, and testing data center infrastructure and B2B connectivity for our...


  • Chennai, Tamil Nadu, India NTT DATA Full time

    Job OverviewNTT DATA Services is seeking a skilled Data Visualization Specialist to join our team in Chennai, Tamil Nādu, India. As a Data Visualization Specialist, you will be responsible for designing and developing data visualizations using Amazon Quicksight to present complex data in a clear and understandable format.Key ResponsibilitiesDesign and...


  • Chennai, Tamil Nadu, India NTT DATA Full time

    Job DescriptionNTT DATA Services is seeking a skilled Data Visualization Specialist to join our team in Chennai, Tamil Nādu, India. As a Data Visualization Specialist, you will be responsible for designing and developing data visualizations using Amazon Quicksight to present complex data in a clear and understandable format.Key Responsibilities:Design and...


  • Chennai, Tamil Nadu, India NTT DATA Full time

    Job Title: Senior Systems Integration SpecialistJob Summary:We are seeking a highly skilled Senior Systems Integration Specialist to join our team in Chennai, Tamil Nadu, India. The successful candidate will be responsible for designing and implementing large-scale complex security ecosystems, deploying and designing security-related updates to applications,...


  • Chennai, Tamil Nadu, India NTT DATA Services Full time

    Job Title: Senior Software Development SpecialistWe are seeking a skilled Senior Software Development Specialist to join our team in Chennai, Tamil Nādu, India. As a key member of our Digital Customer Experience Solutions Team, you will be responsible for setting up and automating CRM campaigns through multiple channels.Key Responsibilities:Establish...

  • Senior Data Engineer

    3 weeks ago


    Chennai, Tamil Nadu, India Blackstraw Full time

    Job Title: Senior Data Engineer - AI Solutions SpecialistWe are seeking a highly skilled Senior Data Engineer to join our team at Blackstraw.ai. As a Senior Data Engineer, you will be responsible for designing and implementing data pipelines that support our AI and machine learning solutions.Key Responsibilities:Design and implement data pipelines using...


  • Chennai, Tamil Nadu, India NTT DATA Services Full time

    Job Title: Senior Systems Integration SpecialistAbout the Role:We are seeking a highly skilled Senior Systems Integration Specialist to join our team at NTT DATA Services. As a key member of our team, you will be responsible for designing, developing, and implementing test automation frameworks to ensure the quality and reliability of our systems.Key...


  • Chennai, Tamil Nadu, India NTT DATA Full time

    About the Role:At NTT DATA, we're seeking a highly skilled Senior Cybersecurity Specialist to join our team. As a key member of our Security Managed Services team, you will be responsible for providing proactive monitoring, identification, investigation, and resolution of technical incidents and problems related to our clients' security infrastructures and...


  • Chennai, Tamil Nadu, India NTT DATA Services Full time

    About the Role:We are seeking a highly skilled Senior Specialist to join our team at NTT DATA Services. As a Senior Specialist for OpenPages GRC Solution Development, you will be responsible for designing, developing, and testing audit functionalities with IBM OpenPages software.Key Responsibilities:Design and develop audit functionalities with IBM OpenPages...