senior data engineer

What you bring in: 6+ years of hands-on experience in data engineering and large-scale distributed systems Proven expertise in building and maintaining complex ETL/ELT pipelines Deep knowledge of orchestration frameworks (e g , Airflow), and workflow optimization Strong cloud infrastructure experience (GCP preferred; AWS or Azure also relevant) Expert-level...

Role & responsibilities: looking experience in Pharma industry side particularly Require a Senior Data Engineer This role involves designing, building, and optimizing scalable data platforms using AWS and Databricks. The engineer will collaborate with data scientists, analysts, and business stakeholders to support analytics, machine learning, and regulatory...

Key Responsibilities: Data Pipeline Development: Build and optimize large-scale data pipelines, architectures, and datasets for efficient data processing and analytics. Infrastructure Scalability: Enhance and automate infrastructure to support data scalability, performance, and reliable delivery across systems. Real-time & Batch Processing: Design and...

Pro Arch is seeking a Senior Data Engineer  with 3-5 years of experience to join our Data & Analytics practice. In this role, you will design and deliver scalable data solutions, optimize performance, and enable advanced analytics across cloud platforms. You will work with large-scale datasets, modern cloud-native technologies, and collaborate with...

Key Responsibilities: Design and implement ELT processes for diverse data sources, including RDBMS, NoSQL databases, and data warehouses Develop and maintain scalable data pipelines for batch and stream processing using JVM-based languages and frameworks Collaborate with cross-functional teams to integrate diverse data sources into the data ecosystem...

We are seeking a highly experienced Senior Data Engineer with 8 years of experience in implementing Azure Data Factory, including knowledge of Databricks. You will be responsible for working on pipelines, data ingestion frameworks, and data transformation frameworks within the Azure platform. This role requires expertise in Big Data, Cloud technologies,...

Key Responsibilities Design, develop, and optimize data pipelines and ETL processes using modern data engineering tools and technologies Apply domain expertise in operations, supply chain, and manufacturing to deliver tailored data solutions Process and analyze large-scale operational datasets using frameworks like Apache Spark Implement data...

Responsibilities Strong Skill in Big Query, GCP Cloud Data Fusion (for ETL/ELT) and PowerBI. Need to have strong skill in Data Pipelines Able to work with Power BI and Power BI Reporting Design and implement the data engineering framework and data pipelines using Databricks and Azure Data Factory. Document the high-level design components of the...

Role & responsibilities Design, develop, and optimize scalable data pipelines for ETL/ELT processes. Develop and maintain Python-based data processing scripts and automation tools. Write and optimize complex SQL queries (preferably in Snowflake) for data transformation and analytics. Experience with Jenkins or other CI/CD tools. Experience developing with...

4-5 years of experience in Data Engineering projects (Med to Small Data Lake / Data Warehousing preferred). 3+ years of experience in Python (Must Have) / Kafka programming (Preferred) / PySpark (Nice to Have) / 2+ years of working experience with AWS Services like S3 (Must Have), Lambda (Must Have), Redshift (Preferred), Glue (Nice to Have), Data Brew (Nice...

Key Responsibilities Design and develop high-performance, scalable data pipelines using PySpark, SQL, and cloud platforms. Optimize distributed data processing for improved efficiency and reliability. Implement best practices in data modeling, architecture, and governance. Ensure data integrity, security, and compliance within cloud environments....

Key Deliverables : Build scalable data pipelines integrating Oracle and SQL Server data. Automate data ingestion and processing for AI/ML workflows. Optimize data storage, compute performance, and security compliance. Collaborate with AI/ML teams for model-ready data provisioning. Role Responsibilities : Identify and automate repetitive manual data...

Key Deliverables : Build scalable data pipelines integrating Oracle and SQL Server data. Automate data ingestion and processing for AI/ML workflows. Optimize data storage, compute performance, and security compliance. Collaborate with AI/ML teams for model-ready data provisioning. Role Responsibilities : Identify and automate repetitive manual data...

Key Deliverables : Build scalable data pipelines integrating Oracle and SQL Server data. Automate data ingestion and processing for AI/ML workflows. Optimize data storage, compute performance, and security compliance. Collaborate with AI/ML teams for model-ready data provisioning. Role Responsibilities : Identify and automate repetitive manual data...

Your Role such as intelligent assistants, autonomous infrastructure, anomaly detection, recommendation systems, and more. Contribute to and/or lead initiatives to fine-tune and optimize LLMs (e.g., LLaMA, Mistral, GPT) using Nutanix-specific datasets. Work on RAG pipelines, embeddings, vector DBs, prompt engineering, and responsible AI guardrails....

This job is with Cornerstone OnDemand, an inclusive employer and a member of myGwork – the largest global platform for the LGBTQ business community. Please do not contact the recruiter directly. We are seeking a talented Senior Data Engineer in India. The right candidate has strong communication skills, passion for solving business problems with data and...

This job is with S&P Global, an inclusive employer and a member of myGwork – the largest global platform for the LGBTQ business community. Please do not contact the recruiter directly. About the Role: Grade Level (for internal use): 10 S&P Global Energy The Role: Senior Data Engineer The Team: The Data Engineering team expands and optimizes our data...

Project Description: Design, develop, and maintain AWS-based data integration solutions that transform and connect data from relational databases into enterprise Knowledge Graphs using Amazon Neptune. The role requires strong expertise in SQL, Python, and semantic data modeling to deliver scalable, high-quality data pipelines and graph-based data solutions...

Description : Job Description : Senior Data Engineer - SMC Global Securities About the Role : We're seeking a Senior Data Engineer to join our team at SMC Global Securities. In this role, you will be crucial in building and maintaining the data infrastructure that powers our financial services and trading platforms. You will work with a diverse tech stack...

Hiring for a next-generation technology company building sovereign, secure, and scalable digital platforms across AI, Web3.0, cloud, and health-tech.Hands-on Senior Data Engineer to build and maintain scalable data pipelines, lake house architecture, and analytics infrastructure. Work with modern open-source technologies to enable data-driven insights and...