data engineering expert jobs in Chennai

Responsibilities: Ingest data from various internal and external sources into AWS Redshift and S3 buckets using methods such as DMS, Zero-ETL, Kinesis, Glue, Lambda, Lake Formation, Cross

Job Family: IT Architecture/Cloud (India) Travel Required: Up to 10% Clearance Required: None The Data Engineer will build, maintain, and support data pipelines and transformations that enable reliable analytics, reporting, and AI solutions across the enterprise data platform. The role will focus on data ingestion, Bronze/Silver/Gold transformations, data...

Overview Data Engineer4–6 years experience / Chennai We are looking for a skilled Data Engineer to design, build, and maintain scalable data pipelines and platforms. You will work closely with data scientists, analysts, and business stakeholders to ensure reliable, high-quality data across our...

The purpose of this job is to develop and engineer Cryptography and PKI Systems, support middleware integrations using C#.net alongside existing team members fulfilling corporate requirements, policies and standards. Take part in defining cryptographic standards, architectures, and governance, develop large scale enterprise security solutions using...

We are seeking an experienced Data Architect with a deep understanding of data modeling, AWS, AWS Analytics services, and Snowflake. The Data Architect will be responsible for designing robust data models, creating cloud-based data solutions, and ensuring seamless data flow across the organization. Exposure to the pharmaceutical industry is a plus,...

Job Description Ciklum is looking for a Senior Data Engineer to join our team full-time in India. We are a custom product engineering company that supports both multinational organizations and scaling startups to solve their most complex business challenges. With a global team of over 4,000 highly skilled developers, consultants, analysts and product...

About Us Sahaj Software is an artisanal software engineering firm built on the values of trust, respect, curiosity, and craftsmanship, and delivering purpose-built solutions to drive data-led transformation for organisations. Our emphasis is on craft as we create purpose-built solution, leveraging Data Engineering, Platform Engineering and Data Science with...

Job Description: Role: Azure Data Engineer Work Mode: Onsite/Full-time Location:  Sholinganallur - Chennai   Year of Experience: 5 - 10 Years No of Positions: 1 Notice Period: Immediate  Budget: 8 - 12 LPA Good To Have Skills: Good Communication Must Have Skills: Databricks (Strong), Azure Data Engineering, PySpark, Python,...

Wipro Limited (NYSE: WIT, BSE: 507685, NSE: WIPRO) is a leading technology services and consulting company focused on building innovative solutions that address clients’ most complex digital transformation needs. Leveraging our holistic portfolio of capabilities in consulting, design, engineering, and operations, we help clients realize their...

Key Responsibilities: Assist in collecting, cleaning, preprocessing, and analyzing structured and unstructured datasets. Support the development, training, testing, and evaluation of machine learning models. Perform exploratory data analysis (EDA) to identify patterns, trends, and insights. Write Python scripts for data processing, analysis, and...

Minimum of 5 years of experience in data engineering. At least 3 years of experience in Machine Learning engineering. Strong skills in developing and deploying: Data pipelines on cloud platforms like Azure, AWS, or Google Cloud. Machine Learning models for real-world use cases. APIs and microservices for data products. Expertise in DevOps practices, CI/CD,...

Unnesting of JSON files in Google BigQuery Google Cloud Run (using container services, python) Hands on experience in GCP services like composer, cloud function, cloud run Experience in developing CI/CD pipelines. Experience in DBT scripts, docker files and knowledge on datavault is a plus. Strong technical knowledge and hands on experience of python or java...

Analyse existing software solutions for training and deployment and identify limitations. Design, develop, test, and deploy software solutions that address the above limitations and enable deployment in a heterogeneous cluster. Collaborate with a global team in developing such solutions. Minimum Qualifications Bachelor's degree in engineering with 2-5...

Introduction A career in IBM Consulting is built on long-term client relationships and close collaboration worldwide. You'll work with leading companies across industries, helping them shape their hybrid cloud and AI journeys. With support from our strategic partners, robust IBM technology, and Red Hat, you'll have the tools to drive meaningful change and...

Job Description: BIG Data Engineer   Exp – 6 Yrs to 10 Yrs     Salary Grid – Up to 25 lpa   Job Code - TechM160753   Work Location: Hyderabad / Chennai   Hybrid – Work from Office – 3 Days a week/ 12 days a month    Key Skills – Pyspark, Spark, Python, Hive, SQL   Job Descriptions: -  6+ Year experience as Data Engineer with...

Description🚀 Senior Data Engineer – MinderaAt Mindera, we build high-performing, scalable technology solutions that help businesses innovate and grow. We bring together engineering expertise, collaboration, and a passion for technology to deliver impactful solutions.We are looking for an experienced Data Engineer with strong hands-on expertise in...

Job Description: Experience required: Skill set: Google Cloud Platform, Big Query, Java, Python Programming Language, Airflow, Data flow, Apache Beam. 5 years of experience in software design and development with 4 years of experience in the data engineering field is preferred. 2 years of Hands-on experience in GCP cloud data implementation...

Project Role : Data Platform Engineer Project Role Description : Assists with the data platform blueprint and design, encompassing the relevant data platform components. Collaborates with the Integration Architects and Data Architects to ensure cohesive integration between systems and data models. Must have skills : Data Engineering Good to have skills :...

Job Description Purpose of the role To build and maintain the systems that collect, store, process, and analyse data, such as data pipelines, data warehouses and data lakes to ensure that all data is accurate, accessible, and secure. Accountabilities • Build and maintenance of data architectures pipelines that enable the transfer and processing of...

Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Snowflake Data Warehouse Good to have skills :...