big data engineer data analysis

#Hiring: Data Engineer – Microsoft Fabric 📍 Location: Bengaluru/Bangalore 💼 Permanent role 💰 Salary – Up to INR 36 LPA 🏢 Work Mode: Hybrid (2 days per week in the office) ⏱️ Availability: Immediate or short-notice candidates preferred 💼 Experience: 9+years of relevant experience preferred We are looking for an experienced Data...

Data Engineers design and build data systems and pipelines. Responsibilities include developing data processing workflows, optimizing data storage, and ensuring data accuracy. You will collaborate with data scientists and analysts to meet data requirements and resolve data issues. Strong experience in data engineering and problem-solving skills are...

Role & Responsibilities: Design, develop, and maintain ELT/ETL pipelines on GCP using Dataflow/Beam, Dataproc/Spark, and Airflow/Composer. Model and optimize datasets in BigQuery using partitioning, clustering, materialized views, and UDFs. Build streaming and near-real-time data ingestion using Pub/Sub, Dataflow, and CDC where applicable. Implement data...

Responsibilities: Ingest data from various internal and external sources into AWS Redshift and S3 buckets using methods such as DMS, Zero-ETL, Kinesis, Glue, Lambda, Lake Formation, Cross

Responsibilities: Ingest data from various internal and external sources into AWS Redshift and S3 buckets using methods such as DMS, Zero-ETL, Kinesis, Glue, Lambda, Lake Formation, Cross

Key Responsibilities Develop and optimize ETL processes to streamline data flow, Manage and enhance BI tools like Metabase for secure and effective reporting, Build and maintain dashboards and data models to provide business teams with real-time insights, Work with Mixpanel or similar tools to analyze user behavior and generate actionable insights, Ensure...

Key Responsibilities: Design, develop, and maintain scalable data pipelines and ETL processes . Collaborate with data scientists, analysts, and stakeholders to understand data requirements and deliver solutions. Ensure data quality and integrity through rigorous testing and validation. Optimize and tune data processing systems for performance and...

Job Responsibilities - Architect and implement scalable offline data pipelines for manufacturing systems including AMHS, MES, SCADA, PLCs, vision systems, and sensor data. Design and optimize ETL/ELT workflows using Python, Spark, SQL, and orchestration tools (e.g., Airflow) to transform raw data into actionable insights. Lead database design and...

Job Responsibilities - Architect and implement scalable offline data pipelines for manufacturing systems including AMHS, MES, SCADA, PLCs, vision systems, and sensor data. Design and optimize ETL/ELT workflows using Python, Spark, SQL, and orchestration tools (e.g., Airflow) to transform raw data into actionable insights. Lead database design and...

We are seeking a highly skilled Data Engineer to contribute to the development and maintenance of our data infrastructure. You will leverage your proficiency in AWS Big Data Services, strong programming skills, and expertise in data modeling and warehousing to build robust and scalable data solutions. This role requires a solid understanding of DevOps...

Role & responsibilities What You'll Do Build the underneath data platform and maintain data processing pipelines using best in class technologies. Special focus on R&D to challenge status-quo and build the next generation data mesh that is efficient and cost effective. Translate complex technical and functional requirements into detailed designs. Who...

Key Responsibilities Design, develop, and optimize data pipelines and ETL processes using modern data engineering tools and technologies Apply domain expertise in operations, supply chain, and manufacturing to deliver tailored data solutions Process and analyze large-scale operational datasets using frameworks like Apache Spark Implement data...

Key Responsibilities Design, develop, and maintain scalable ETL pipelines and DataOps workflows Build robust processes to integrate internal and external data sources with quality checks Automate manual tasks and optimize data ingestion and delivery processes Collaborate with cross-functional teams including product, marketing, and business development...

Nisum is looking for a skilled Data Engineer to join our team. In this role, you'll be responsible for designing and building scalable data pipelines, developing robust data models, and ensuring data quality across our systems. If you're passionate about transforming raw data into actionable insights and enjoy collaborating with diverse teams, we encourage...

Key deliverables: Enhance and maintain the MDM platform Monitor and optimize system performance Troubleshoot and resolve technical issues Support production incident resolution Role responsibilities: Develop and refactor Python and SQL code Integrate REST APIs within MDM workflows Utilize Azure Databricks and ADF for ETL tasks Work on Markit EDM or...

Key deliverables: Enhance and maintain the MDM platform Monitor and optimize system performance Troubleshoot and resolve technical issues Support production incident resolution Role responsibilities: Develop and refactor Python and SQL code Integrate REST APIs within MDM workflows Utilize Azure Databricks and ADF for ETL tasks Work on Markit EDM or...

Roles and Responsibilities Design, develop, and maintain large-scale data pipelines using Azure Data Factory (ADF) to extract, transform, and load data from various sources into Azure Data bricks. Develop complex ETL processes using Python scripts and SQL queries to process large datasets stored in Azure Data Lake Storage. Collaborate with cross-functional...

 Should have strong min 5 years of handson experience as Data Engineer  Should have strong handson experience on Python Development and SQL  Strong experience on Spark is mandatory  Experience with AWS is preferred but a cloud experience will be a plus

How you will contribute You will: Execute the business analytics agenda in conjunction with analytics team leaders Work with best-in-class external partners who leverage analytics tools and processes Use models/algorithms to uncover signals/patterns and trends to drive long-term business performance Execute the business analytics agenda using a methodical...

Job DescriptionWant to join KANINI We are looking for aData Engineer who can build a robust database and its architecture. In thisrole, you will assess a wide range of requirements and apply relevant databasetechniques to create a sustainable data architecture before you begin theimplementation process and develop the database from scratch. You areall set...