cloud data engineering

Job DescriptionSenior Data Engineer – Data Pipelines & Cloud Databases\nLocation: Pune | Experience: 4+ years | Type: Full-Time\nRole Overview\nDesign, build, manage enterprise data pipelines on Azure and Databricks. Own schema design, API development, and data infrastructure for analytics and intelligence products.\nKey Responsibilities\n\nData Pipeline...

Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Databricks Unified Data Analytics Platform Good...

Job DescriptionAbout the Company We are looking for experienced Security Champion who has security first mindset and lead security initiatives within a product, engineering, DevOps, platform teams and IT department and acts as the bridge between the company leadership and delivery teams. The role focuses on integrating security into day-to-day engineering...

Data Engineer: PySpark+AWS Glue 4-8 years in Data Engineering with hands-on expertise in Snowflake, AWS Glue, AWS (S3/Lambda/CloudWatch), Python, PySpark, and SQL. Strong experience in ETL/ELT, Data Warehousing, Data Pipelines, Performance Tuning, and Cloud Data Platforms. Exposure to AI/ML or GenAI solutions is a plus Knowledge of Oracle Application...

Requirements What You Will Do Analyze Business Requirements. Analyze the Data Model and perform GAP analysis with Business Requirements and Power BI. Design and model Power BI schema. Transform data in Power BI, SQL, or Microsoft Fabric. Create DAX formulas, reports, and dashboards. Strong experience with Power BI or Microsoft Fabric. Able to write DAX...

Responsibilities: Ingest data from various internal and external sources into AWS Redshift and S3 buckets using methods such as DMS, Zero-ETL, Kinesis, Glue, Lambda, Lake Formation, Cross

We are seeking a skilled Data Engineer to join our dynamic team. The Data Engineer will be responsible for designing, developing, and maintaining our data pipelines, integrations, and data warehouse infrastructure. The successful candidate will work closely with data scientists, analysts, and business stakeholders to ensure that our data is accurate, secure,...

Key Responsibilities: Design, build, and maintain batch and real-time data pipelines for time-series healthcare data. Collaborate with cross-functional teams to understand data requirements and translate them into engineering solutions. Manage and optimize data ingestion, processing, and storage using modern data engineering tools. Develop and maintain data...

Work collaboratively with application development, data protection, information security, and risk management teams to understand and implement data security and management solutions. Continuously improve security observability telemetry services based on input from a diverse network of internal and external stakeholders, and technology teams as well as the...

Key Responsibilities Design, develop, and optimize data pipelines and ETL processes using modern data engineering tools and technologies Apply domain expertise in operations, supply chain, and manufacturing to deliver tailored data solutions Process and analyze large-scale operational datasets using frameworks like Apache Spark Implement data...

Job description Working alongside Oliver Wyman consulting teams and partners, engaging directly with clients to understand their business challenges Exploring large-scale data and designing, developing, and maintaining data/software pipelines, and ETL processes for internal and external stakeholders Explaining, refining, and developing the necessary...

Collaborate with other engineers, customers to brainstorm and develop impactful data products tailored to our clients. Leverage AI and machine learning techniques to integrate intelligent features into our offerings. Develop, and optimize end-to-end data pipelines on AWS Follow best practices in software architecture and development. Implement effective cost...

Collaborate with other engineers, customers to brainstorm and develop impactful data products tailored to our clients. Leverage AI and machine learning techniques to integrate intelligent features into our offerings. Develop, and optimize end-to-end data pipelines on AWS Follow best practices in software architecture and development. Implement effective cost...

Key deliverables: Enhance and maintain the MDM platform Monitor and optimize system performance Troubleshoot and resolve technical issues Support production incident resolution Role responsibilities: Develop and refactor Python and SQL code Integrate REST APIs within MDM workflows Utilize Azure Databricks and ADF for ETL tasks Work on Markit EDM or...

Roles and Responsibilities Design, develop, and maintain large-scale data pipelines using Azure Data Factory (ADF) to extract, transform, and load data from various sources into Azure Data bricks. Develop complex ETL processes using Python scripts and SQL queries to process large datasets stored in Azure Data Lake Storage. Collaborate with cross-functional...

Candidate should have strong technical capabilities, particularly in the following areas: SQL : Expertise in writing stored procedures, complex queries, and optimizing performance. Power BI development :  Experience of developing complex power bi reports Dax :  Complex Dax queries to meet business needs Paginated Reports (Power BI)  : Experience in...

Job DescriptionWant to join KANINI We are looking for aData Engineer who can build a robust database and its architecture. In thisrole, you will assess a wide range of requirements and apply relevant databasetechniques to create a sustainable data architecture before you begin theimplementation process and develop the database from scratch. You areall set...

Must have 5+ years of experience in Python programming. Extensive experience in handling complex projects. Good leadership skills and ability to lead projects independently. Good communication and teamwork skills. Good analytical skills and proficiency in Web based development technologies. Expertise in Agile development methodology. Strong problem-solving...

Data Engineer to design, develop, and maintain data pipelines and ETL workflows for processing large-scale structured and unstructured data. The ideal candidate will have expertise in Azure Data Services (Azure Data Factory, Synapse, Databricks, SQL, SSIS, and Data Lake) along with big data processing, real-time analytics, and cloud data integration. Key...

Source, extract, and manipulate large data sets to serve Machine Learning and Artificial Intelligence needs of Paychex Insurance Agency. Responsibilities Utilize existing infrastructure to assemble large, complex data sets that meet business requirements through extraction, transformation, and loading of data from a wide variety of data sources Work...